JP4828535B2 - Apparatus and method for transmitting / receiving 3D stereoscopic digital broadcast using 3D stereoscopic video additional data - Google Patents

Description

  The present invention relates to a transmission / reception apparatus and method for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data, and more specifically, supports only a 3D stereoscopic digital broadcasting system using video from another viewpoint. Unlike conventional methods, 3D stereoscopic video additional data such as video from another viewpoint, disparity information (Disparity Information), and depth information (Depth Information) are synchronized with the 2D video stream (Transport Stream). 3D stereoscopic digital broadcast transmission / reception device using 3D stereoscopic video additional data, which can be compatible with a 2D digital broadcasting system by defining and processing as an additional stream, and the same Regarding the method.

  Digital broadcasts using MPEG (Motion Picture Experts Group) (hereinafter referred to as “MPEG”) technology can transmit high-quality programs over the same bandwidth as conventional analog broadcasts. It can also be transmitted on one channel. In addition, digital broadcasting can provide various application services such as data broadcasting and interactive broadcasting. As described above, in order to provide a plurality of programs and various application services on one transmission channel, the MPEG-2 transport stream (TS: Transport Stream) generated from each service provider is multiplexed on one channel. Must be able to

  In conventional analog broadcasting, when transmitting and receiving stereoscopic video, there is no problem because the order of transmitting videos takes an alternating and orderly form, but in digital broadcasting, video information in the transport format (Transport Format), Additional information for audio information, program guide, and the like is multiplexed in a complicated manner, and videos are arranged in a disorderly manner, so there is a problem in re-separating and outputting them.

  In order to solve such a problem, a packet identifier (PID: Packet Identifier) that can identify each packet of a video signal, an audio signal, and additional information, and a packet that distinguishes left and right video information for stereoscopic video A method of providing an identifier (PID) has been proposed.

  However, the technique proposed for servicing such conventional 3D stereoscopic video content is such that two video streams exist by defining packet identifier (PID) values for left and right video respectively. Therefore, in the conventional two-dimensional system, since this cannot be classified, a problem of lack of compatibility occurs.

  On the other hand, information that can generate a three-dimensional stereoscopic video includes two-viewpoint video, one-viewpoint video and disparity information, or one-viewpoint video and depth information. It refers only to perspective videos.

  The present invention has been made to solve the above-described problem, and its purpose is different from a conventional method that supports only a three-dimensional stereoscopic digital broadcasting system using a video of another viewpoint, and has a different viewpoint. 2D digital broadcasting by defining and processing 3D stereoscopic video additional data such as video, disparity information, and / or depth information as an additional stream synchronized with a 2D video transport stream (TS) An object of the present invention is to provide a transmission / reception apparatus and method for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data, which can be compatible with a system.

  In order to achieve the above object, a transmission apparatus of the present invention is a video acquisition means for acquiring original video and 3D stereoscopic video additional data in a 3D stereoscopic digital broadcast transmission apparatus using 3D stereoscopic video additional data. Audio data acquisition means for acquiring audio data, encoding means for encoding the original video and 3D stereoscopic video additional data transmitted from the video acquisition means, and audio data transmitted from the audio data acquisition means , Program specification information generating means for generating program specification information (PSI: Program Specific Information) for classifying each information, and each elementary stream (ES: Elementary) encoded by the encoding means. A packetizing unit that generates an elementary stream packet (PES: Packetizer Elementary Stream), and receives each elementary stream packet (PES) from the packetizing unit. Transport stream generating means for receiving program specification information (PSI) from the information generating means and generating each transport stream (TS), and each transport stream (TS) transmitted from the transport stream generating means And a modulation means for modulating the multiplexed transport stream (TS).

  Further, the receiving device of the present invention is a receiving device for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data, a demodulating means for receiving a modulated transport stream (TS) and demodulating a modulated signal; The transport stream demodulated by the demodulation means is received, the program specification information (PSI) is received from the program specification information analysis means, and the transport stream (TS) is demultiplexed to generate each transport stream (TS). Demultiplexing means, a transport stream (TS_PSI) for program specification information from the demultiplexing means, and analyzing the program specification information (PSI), and analyzing the analyzed program specification information (PSI) The program specification information analyzing means for transmitting to the demultiplexing means, and the demultiplexing Means for receiving each transport stream demultiplexed by the means, analyzing each transport stream and generating elementary stream packets (PES), and each element from the transport stream analyzing means. Depacketizing means for receiving and streaming elementary stream packets (PES) and generating respective elementary streams (ES); and decoding means for receiving and decoding each elementary stream (ES) from the depacketizing means A video synthesizing unit that synthesizes the original video decoded by the decoding unit and the 3D stereoscopic video additional data to generate a 3D stereoscopic video, and a 2D video or a 3D stereoscopic video received from the video synthesizing unit, The above And an outputting means for outputting the audio data received from the code means.

  On the other hand, the transmission method of the present invention is a transmission method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data, in which a) an acquisition step of acquiring original video, 3D stereoscopic video additional data, and audio data; b) an encoding step of encoding each of the original video, the 3D stereoscopic video additional data, and the audio data in a form suitable for digital transmission to generate each elementary stream (ES); c) each of the elementary streams A step of packetizing (ES) to generate an elementary stream packet (PES); and d) program specification information (PSI) for segmenting each information such as original video, 3D stereoscopic video additional data, audio data, etc. ) Program specifications that generate An information generation step; e) a step of generating a transport stream using the program specification information (PSI) and the generated elementary stream packets (PES) as respective transport streams (TS); A transport step (TS) that is multiplexed into one transport stream (TS), and g) a modulation step that modulates and transmits the transport stream (TS). .

  The receiving method of the present invention is a receiving method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data. A) Demodulating step of receiving a modulated transport stream (TS) and demodulating a modulated signal And b) a demultiplexing step for demultiplexing the transport stream (TS_PSI) for the program specification information (PSI) according to the packet identifier, and c) a program using the transport stream (TS_PSI) for the program specification information A program specification information analyzing step for analyzing the specification information; and d) a demultiplexing step for dividing the transport stream (TS) using the analyzed program specification information and demultiplexing the transport stream (TS). And e) each of the demultiplexed transpo An elementary stream packet generation step for analyzing the stream and generating an elementary stream packet (PES); and f) de-packetizing each of the generated elementary stream packets (PES) to generate each elementary stream (ES). An elementary stream generating step to be generated; g) a decoding step for decoding each of the depacketized elementary streams (ES); and h) combining the decoded original video with the 3D stereoscopic video additional data to generate 3 A 3D stereoscopic video generating step for generating a 3D stereoscopic video; and i) an output step for outputting 2D video or 3D stereoscopic video and audio data according to a user's selection.

  The above objects, features and advantages will become more apparent through the following detailed description in conjunction with the accompanying drawings. Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing an embodiment of a transmission device for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention.

  As shown in the figure, a transmission apparatus for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention includes a video acquisition unit 110, an audio acquisition unit 120, an encoding unit 130, and a program specification information generation unit 140. , A packetization unit 150, a transport stream (TS) generation unit 160, a multiplexing unit 170, and a modulation unit 180.

  The video acquisition unit 110 acquires an original video and 3D stereoscopic video additional data. The audio acquisition unit 120 acquires audio data. The encoding unit 130 receives the original video and the 3D stereoscopic video additional data acquired by the video acquisition unit 110, receives the audio data acquired by the audio acquisition unit 120, and encodes it in a form suitable for digital transmission. To do.

  The program specification information generation unit 140 generates program specification information (PSI) that classifies each piece of information. The packetizing unit 150 receives each elementary stream (ES) encoded by the encoding unit 130 and packetizes it to generate each elementary stream packet (PES). The transport stream (TS) generation unit 160 receives each elementary stream packet (PES) from the packetization unit 150, receives program specification information (PSI) from the program specification information generation unit 140, and The transport stream (TS) is generated. The multiplexing unit 170 receives each transport stream (TS) from the transport stream generation unit 160 and multiplexes it into one transport stream (TS). The modulation unit 180 modulates the transport stream (TS) multiplexed by the multiplexing unit 170.

  The video acquisition unit 110 acquires one or more of one viewpoint video for generating an original video and another viewpoint video for generating 3D stereoscopic video additional data, disparity information, and depth information.

  Here, the video of one viewpoint that generates the original video acquired through the video acquisition unit 110 is a reference video that can be compared with the video of another viewpoint, and the video through the video acquisition unit 110. The video of another viewpoint that generates the 3D stereoscopic video additional data acquired in this way is a video of one different viewpoint having a different viewpoint from the original video, or a multi-view video having a plurality of different viewpoints.

  The disparity information for generating the three-dimensional stereoscopic video additional data is obtained from different viewpoints when two videos obtained from different viewpoints from a multi-view video or a one-view video are projected into one, It is distance information between two points representing the same position, and depth information is perspective information that can be acquired and grasped from a video of a different viewpoint for the same object at a predetermined distance from a video of one viewpoint.

  The encoding unit 130 includes a first MPEG-2 encoder 131, an arbitrary encoder 132, and a second MPEG-2 encoder 133. The first MPEG-2 encoder 131 receives the original video of the reference viewpoint from the video acquisition unit 110 and encodes it into MPEG-2, which is the current broadcast standard. The arbitrary encoder 132 receives the 3D stereoscopic video additional data from the video acquisition unit 110 and encodes it efficiently. The second MPEG-2 encoder 133 receives audio data from the audio acquisition unit 120 and encodes it into MPEG-2, which is the current broadcast standard.

  The program specification information generation unit 140 generates program specification information (PSI) that separates each piece of information, such as original video, 3D stereoscopic video additional data, and audio data. At this time, the program specification information generation unit 140 is a program map table (PMT) packet that is divided into respective transport streams (TS) for compatibility with the two-dimensional digital broadcasting system and the three-dimensional stereoscopic digital broadcasting system. In the identifier (PID) information, the stream type (stream_type) defined for conventional digital broadcast video and audio is used as it is, and the stream type (stream_type) for the 3D stereoscopic video additional data is set to “reserved” or “ A function that is newly defined as a value defined in “user individual” is performed.

  The packetizing unit 150 includes a first packetizer 151, a second packetizer 152, and a third packetizer 153. The first packetizer 151 receives an elementary stream (ES_Ori) for the original video from the encoding unit 130 and packetizes it, and generates an elementary stream packet (PES_Ori) for the original video. The second packetizer 152 receives and packetizes the elementary stream (ES_3D) for the 3D stereoscopic video additional data from the encoding unit 130 and generates an elementary stream packet (PES_3D) for the 3D stereoscopic video additional data. The third packetizer 153 receives the elementary stream for the audio data from the encoding unit 130 and packetizes it, and generates an elementary stream packet (PES_Au) for the audio data.

  At this time, when there is an input field newly input in association with the 3D stereoscopic video additional data, the packetizing unit 150 includes the header portion of the elementary stream packet (PES_3D) for the 3D stereoscopic video additional data. In order to discriminate videos of different viewpoints, disparity information, depth information, and the like, a function of further defining an input field for the 3D stereoscopic video additional data type is performed.

  The transport stream generator 160 includes a first transport stream generator 161, a second transport stream generator 162, a third transport stream generator 163, and a fourth transport stream generator 164. The first transport stream generator 161 receives an elementary stream packet (PES_Ori) for the original video from the packetizer 150 and generates a transport stream (TS_Ori) for the original video.

  The second transport stream generator 162 receives an elementary stream packet (PES_3D) for 3D stereoscopic video additional data from the packetizer 150 and generates a TS packet (TS_3D) for 3D stereoscopic video additional data. . The third transport stream generator 163 receives an elementary stream packet (PES_Au) for audio data from the packetizing unit 150 and generates a TS packet (TS_Au) for audio data. The fourth transport stream generator 164 receives the program specification information (PSI) from the program specification information generation unit 140 and generates a TS packet (TS_PSI) for the program specification information.

  The multiplexing unit 170 performs a function of inserting a program clock reference (PCR) into the transport stream (TS_Ori) for the original video in order to detect the system time in the final process of multiplexing.

  FIG. 2 is a structural diagram illustrating an embodiment relating to a configuration diagram of elementary stream packets (PES).

  As shown in the figure, the elementary stream packet (PES) generated by the packetization unit 150 of FIG. 1 is a three-dimensional stereoscopic video according to the configuration of the MPEG-2 system standard (ISO / IEC 13818-1). When there is a newly input field related to the additional data, the definition is made in the header part of the elementary stream packet (PES).

  For example, an input field for a 3D stereoscopic video additional data type (3D_Video_Type) may be further defined in order to segment 3D stereoscopic video additional data such as video of different viewpoints, disparity information, and depth information.

  FIG. 3 is a structural diagram showing an embodiment in which a configuration for dividing information of 3D stereoscopic video is added to the header portion of an elementary stream packet (PES) according to the present invention.

  In the figure, when each elementary stream packet (PES) is generated by the packetization unit 150 of FIG. 1, the elementary stream packet (PES) in the conventional elementary stream packet (PES) header shown in FIG. An embodiment in which an information type capable of classifying the type of 3D stereoscopic video additional data by using the space of the extended field data is added is shown. As shown in FIG. 3, a 2-bit 3D stereoscopic video additional data type (3D_Video_type) can be further defined using elementary stream packet (PES) extension field data.

[Table 1] below shows the types of 3D stereoscopic video additional data.

  When the 3D stereoscopic video additional data type (3D_Video_type) of FIG. 3 is further defined, the 3D stereoscopic video additional data type (3D_Video_type) is added to the elementary stream packet (PES) extension field data as shown in [Table 1]. The value to represent must be predefined. A value of “00” means disparity information, a value of “01” means depth information, a value of “10” means a video of another viewpoint, and a value of “11” means “reserved”.

  On the other hand, the program specification information generation unit 140 is composed of four tables: a program association table (PAT), a program map table (PMT), a network information table (NIT: Network Information Table), and a limited access table (CAT: Conditional Access Table). Generate program specification information (PSI). Here, the program specification information (PSI) is inserted into the payload portion of the TS packet, but is repeatedly transmitted at regular time intervals for initialization in the receiver. The tables are divided by different packet identifier (PID) values, and only one type of table is transmitted in one TS packet.

[Table 2] below shows the definition for the packet identifier (PID) value of the program specification information (PSI).

  In order to identify the transport stream (TS) including program specification information (PSI), as defined in [Table 2] above, the packet identifier (PID) value in the section “0x00010 to 0x1FFE” is arbitrarily set and utilized. The set packet identifier (PID) value and meaning must be predefined in the program map table (PMT). Therefore, not only the setting and description of the packet identifier (PID) of the transport stream TS used in the conventional digital broadcasting in the program map table (PMT) but also the transport stream (TS) for the 3D stereoscopic video additional data. It further defines the setting and description of the packet identifier (PID).

  Here, “0x0000” of the packet identifier PID is a program association table (PAT), “0x0001” is a limited access table (CAT), “0x0002” is a transport stream description table, and “0x0003 to 0x000F” sections are “reserved”. , “0x00010-0x1FFE” section is an arbitrary packet identifier (PID) that can be arbitrarily set, and “0x1FFF” means a null packet.

  FIG. 4 is a structural diagram showing an embodiment relating to a configuration diagram of a transport stream (TS) having program association table (PAT) information according to the present invention.

  As shown in the figure, a transport stream (TS) having program association table (PAT) information is stored in the program association table (PAT) according to the configuration of the MPEG-2 system standard (ISO / IEC 13818-1). Information relating to a program such as a program number and a packet identifier (PID) indicating what program the transport stream (TS) is configured is defined. That is, it includes a network identifier (network_PID) for each program number (Program_number0, 1, 2,..., I), a packet identifier (program_map_PID) for the program map table, and the like.

  For example, the 3D stereoscopic video additional data has one program number and always has a packet identifier (program_map_PID) for one program map table.

  FIG. 5 is a structural diagram showing an embodiment relating to a configuration diagram of a transport stream (TS) having program map table (PMT) information according to the present invention.

  As shown in the figure, a transport stream (TS) having program map table (PMT) information follows the configuration of the MPEG-2 system standard (ISO / IEC 13818-1), and the program structure table (PMT) It includes the contents for the elementary stream (ES) included in one program and the packet identifier (PID). That is, it includes information such as the stream type (stream_type) of each information for the program, the packet identifier (elementary_PID) of the transport stream for the constituent element, the elementary stream information length (ES_info_length), and the descriptor (discriptor).

  For example, when three-dimensional content exists, original video, three-dimensional stereoscopic video additional data, and audio data are required. Therefore, in order to distinguish each information, a packet identifier (elementary_PID) for each component and a stream for each information Information such as type (stream_type) is included.

  The packet identifier (elementary_PID) for the component represents the packet identifier (PID) value of the TS packet including the program component, and the stream type (stream_type) represents the packet identifier (PID) value of the packet identifier (elementary_PID) for the component. Represents the type of program component contained in the packet it has.

[Table 3] below is an allocation table for the currently standardized stream type (stream_type).

  In order to distinguish the stream type (stream_type), as defined in [Table 3] above, MPEG-2 video is defined as “0x02” and MPEG-2 audio is defined as “0x04”. However, since the stream type (stream_type) for the 3D stereoscopic video additional data is not defined, when the 3D stereoscopic video additional data is defined as “0x02” like the 2D video, two video streams are included in one program. As a result, an error occurs in the conventional two-dimensional digital receiver.

  Therefore, a 3D stereoscopic video additional data stream is newly defined as one of the values reserved in the current standard or defined for individual users.

  FIG. 6 is a structural diagram showing an embodiment relating to the structure of a TS packet according to the present invention.

  As shown in the figure, each elementary stream packet (PES) is generated as a TS packet having a fixed length of 188 bytes according to the configuration of the MPEG-2 system standard (ISO / IEC 13818-1). It is divided into two parts, a TS packet header and a TS packet payload. The TS packet header includes a synchronization byte and a packet identifier (PID) of the TS packet that enables the TS packet to be distinguished, and the TS packet payload includes elementary stream packets (PES_Ori, PES_3D) for each video, It includes data such as elementary stream packets (PES_Au) for audio data and program specification information (PSI).

  Each elementary stream packet (PES_Ori, PES_3D, PES_Au) is generated as a TS packet according to the structure of the transport stream (TS) of the MPEG-2 system standard (ISO / IEC 13818-1) shown in FIG. . Accordingly, the transport stream generation unit 160 of FIG. 1 adds the elementary stream packet (PES_Ori) and the 3D stereoscopic video to the original video with reference to the packet identifier (PID) value defined in the program map table (PMT). An elementary stream packet (PES_3D) for data and an elementary stream packet (PES_Au) for audio data are received, and respective TS packets are generated.

  Each TS packet is multiplexed into one transport stream (TS) by the multiplexing unit 170 of FIG. 1 and modulated by the modulation unit 180 so as to be transmitted.

  At this time, in the last process of the multiplexing unit 170, a program clock reference (PCR) is inserted into the transport stream (TS_Ori) of the original digital video and used for synchronization. The program clock reference (PCR) insertion period follows the MPEG-2 system standard.

  FIG. 7 is a block diagram showing an embodiment of a 3D stereoscopic digital broadcast receiving apparatus using 3D stereoscopic video additional data according to the present invention.

  As shown in the figure, a 3D stereoscopic digital broadcast receiving apparatus using 3D stereoscopic video additional data according to the present invention includes a demodulator 710, a demultiplexer 720, a program specification information analyzer 730, a transport stream. An analysis unit 740, a depacketization unit 750, a decoding unit 760, a video synthesis unit 770, and an output unit 780 are provided.

  The demodulator 710 receives the modulated transport stream (TS) and demodulates the modulated signal. The demultiplexer 720 receives the demodulated transport stream from the demodulator 710, receives program specification information (PSI) from the program specification information analyzer 730, and receives one multiplexed transport stream TS. Are demultiplexed and divided into respective transport streams (TS). The program specification information analysis unit 730 receives a transport stream (TS_PSI) corresponding to the program specification information from the demultiplexing unit 720, analyzes the program specification information, and transmits it to the demultiplexing unit 720.

  The transport stream analysis unit 740 receives each transport stream demultiplexed by the demultiplexing unit 720, analyzes each transport stream, and generates an elementary stream packet (PES). The depacketization unit 750 receives each elementary stream packet (PES) from the transport stream analysis unit 740 and depackets it to generate each elementary stream (ES). The decoding unit 760 receives and decodes each elementary stream (ES) from the depacketization unit 750. The video synthesis unit 770 receives and synthesizes the original video decoded by the decoding unit 760 and the 3D stereoscopic video additional data, and generates a 3D stereoscopic video. The output unit 780 receives the 2D video or the 3D stereoscopic video from the video synthesis unit 770, outputs the video according to the display type selected by the user, and receives and outputs the audio data from the decoding unit 760.

  The demultiplexer 720 receives the demodulated transport stream from the demodulator 710, first separates the transport stream (TS_PSI) corresponding to the program specification information, and transmits it to the program specification information analyzer 730. The program specification information (packet identifier information) that can classify each information is received from the specification information analysis unit 730, and the transport stream (TS_Ori) for the original video and the transport stream (TS_3D) for the 3D stereoscopic video additional data The audio data is demultiplexed into a transport stream (TS_Au).

  That is, the demultiplexing unit 720 receives the multiplexed transport stream (TS), and the program association table (PAT) having a packet identifier (PID) value “0x0000” in the transport stream (TS) header. The TS packet having information is searched for and transmitted to the program specification information (PSI) analysis unit 730. Thereafter, the program specification information analysis unit 730 receives the program number and the packet specification (Program_map_PID) for the program map table from the program specification information analysis unit 730, and receives the program map table (PMT) information from the transport stream (TS). The TS packet that is included is searched and transmitted to the program specification information analysis unit 730. Thereafter, each elementary stream type (stream_type) and an elementary packet identifier (elementary_PID) from the program specification information analysis unit 730 are received from the program specification information analysis unit 730, and transport streams (TS_Ori, TS_3D, TS_Au) is demultiplexed.

  At this time, since the stream type (stream_type) for the 3D stereoscopic video additional data is newly defined as a value defined as “reserved” or “personal user”, the receiving apparatus is a 2D digital broadcasting system. 3D stereoscopic video additional data is recognized as “reserved” or “user personal”, and only the stream for video and audio is processed. Therefore, compatibility with the conventional two-dimensional digital broadcasting system is ensured, and in the case of the three-dimensional stereoscopic digital broadcasting system, the newly defined stream type (stream_type) is recognized, and video, audio, and three-dimensional stereoscopic video are recognized. Process additional data.

  In addition, the demultiplexing unit 720 is configured to generate a system clock based on a program clock reference (PCR) of a transport stream (TS_Ori) for the original video in order to synchronize the clocks of the transmission apparatus of FIG. To restore.

  The program specification information analysis unit 730 receives a transport stream (TS_PSI) corresponding to the program specification information from the demultiplexing unit 730 and receives information on the program association table (PAT) and a packet identifier (PID) of the program map table (PMT). ) Analyzing the information, and outputting the program specification information (PSI) that can distinguish each transport stream (TS) from the demultiplexer 720 to the demultiplexer 720.

  That is, the program specification information analysis unit (PSI) receives a TS packet having program association table (PAT) information from the demultiplexing unit 720, analyzes the payload information of the TS packet, and sends it to the demultiplexing unit 720. The TS packet having the program map table (PMT) information is received again from the demultiplexing unit 720, and the payload information of the TS packet is analyzed and transmitted to the demultiplexing unit 720.

  The transport stream analyzer 740 includes a first transport stream analyzer 741, a second transport stream analyzer 742, and a third transport stream analyzer 743. The first transport stream analyzer 741 receives and analyzes the transport stream (TS_Ori) for the original video from the demultiplexing unit 720 and generates an elementary stream packet (PES_Ori) for the original video. The second transport stream analyzer 742 receives and analyzes the transport stream (TS_3D) for the 3D stereoscopic video additional data from the demultiplexer 720, analyzes the transport stream (TS_3D) for the 3D stereoscopic video additional data ( PES_3D) is generated. The third transport stream analyzer 743 receives and analyzes the transport stream (TS_Au) for the audio data from the demultiplexing unit 720, and generates an elementary stream packet (PES_Au) for the audio data.

  The depacketizer 750 includes a first depacketizer 751, a second depacketizer 752, and a third depacketizer 753. The first depacketizer 751 receives the elementary stream packet (PES_Ori) for the original video from the transport stream analysis unit 740 and depackets it to generate an elementary stream (ES_Ori) for the original video. The second depacketizer 752 receives the elementary stream packet (PES_3D) for the 3D stereoscopic video additional data from the transport stream analysis unit 740, depackets it, and converts the elementary stream (ES_Ori) for the 3D stereoscopic video additional data. Generate. The third depacketizer 753 receives an elementary stream packet (PES_Au) for audio data from the transport stream analysis unit 740 and depackets it to generate an elementary stream (ES_Au) for audio data.

  At this time, as shown in [Table 1] above, when there is a newly input field related to the 3D stereoscopic video additional data, the second depacketizer 752 of the depacketizer 750 uses the 3D stereoscopic video additional data. In the header part of the elementary stream packet (PES_3D), a function of analyzing information on a 3D stereoscopic video additional data type such as a video of another viewpoint, disparity information, and depth information and classifying each information is further performed.

  The decoding unit 760 includes a first MPEG-2 decoder 761, an arbitrary decoder 762, and a second MPEG-2 decoder 763. The first MPEG-2 decoder 761 receives an elementary stream (ES_Ori) for the original video from the depacketizer 750 and decodes it to MPEG-2, which is the current broadcast standard. The arbitrary decoder 762 receives the elementary stream (ES_3D) for the 3D stereoscopic video additional data from the depacketizer 750 and efficiently decodes it. The second MPEG-2 decoder 763 receives an elementary stream (ES_Au) for audio data from the depacketizer 750 and decodes it to MPEG-2, which is the current broadcast standard.

  At this time, the decoding unit 760 includes an elementary stream (ES_Ori) for the original video input from the depacketization unit 750, an elementary stream (ES_3D) for 3D stereoscopic video additional data, and an elementary stream for audio data (ES_3D). ES_Au) is synchronized using a program clock reference (PCR).

  The video synthesis unit 770 receives and synchronizes the original video decoded by the decoding unit 760 and the 3D stereoscopic video additional data, generates a 3D stereoscopic video, and then generates 2D of the original video for 2D display. The three-dimensional video (2D) and the three-dimensional stereoscopic video (3D) for three-dimensional display are output to the video display unit 781.

  At this time, the original video for generating the 3D stereoscopic video and the 3D stereoscopic video additional data are the playback time information (PTS: Presentation Time) present in the system clock program clock reference (PCR) and the elementary stream packet (PES). (Stamp) to synchronize.

  Here, the original video of the 2D video is a reference video of 1 viewpoint that can be compared with a video of another viewpoint, and the 3D stereoscopic video additional data of the 3D stereoscopic video is different from the viewpoint of the original video. One different viewpoint video and / or multi-view video having different viewpoints, disparity information, or depth information.

  In addition, the video synthesis unit 770 applies an appropriate 3D stereoscopic video generation algorithm according to the type of 3D stereoscopic video additional data such as video of different viewpoints, disparity information, and / or depth information. Generate a 3D stereoscopic video.

  The output unit 780 includes a video display unit 781 that displays 2D video or 3D stereoscopic video input from the video synthesis unit 770, and an audio data output unit 782 that outputs audio data input from the decoding unit 760. Is provided.

  At this time, the output unit 780 has different output information according to the display type selected by the user. When the user selects the 2D display type, 2D video is output via the video display unit 781. When the user selects the 3D display type, 3D stereoscopic video is output via the video display unit 781.

  FIG. 8 is a flowchart illustrating an embodiment of a transmission method for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention.

  First, in step S810, the video acquisition unit 110 acquires the original video and the 3D stereoscopic video additional data, and in step S820, the audio acquisition unit 120 acquires the audio data.

  Thereafter, in step S840, the encoding unit 130 encodes the original video and the 3D stereoscopic video additional data acquired by the video acquisition unit 110 and the audio data acquired by the audio acquisition unit 120 into a form suitable for digital transmission. Then, each elementary stream ES is generated.

  In step S830, the acquired original video and 3D stereoscopic video additional data are classified. In step S841, the original video is encoded into an MPEG-2 encoder which is the current broadcasting standard, and in step S842, the 3D stereoscopic video additional data is encoded into an arbitrary encoder in order to efficiently encode the respective elementary data. A stream (TS) is generated. In step S843, the audio data acquired by the audio acquisition unit 120 is encoded into an MPEG-2 encoder which is the current broadcast standard, and an elementary stream for the audio data is generated.

  Thereafter, in step S850, the program specification information generation unit 140 generates program specification information (PSI) that divides each piece of information, such as original video, 3D stereoscopic video additional data, and audio data.

  In step S860, the packetizing unit 150 packetizes each elementary stream (ES) generated by encoding and generates an elementary stream packet (PES).

  Thereafter, in step S870, the transport stream generation unit 160 generates the generated program specification information (PSI) and the generated elementary stream packets (PES) as the transport streams (TS).

  Thereafter, in step S880, the multiplexing unit 170 multiplexes each of the generated transport streams (TS) into one transport stream.

  Thereafter, the modulation unit 180 modulates and transmits the multiplexed transport stream (TS).

  FIG. 9 is a flowchart showing an embodiment of a receiving method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention.

  First, in step S910, the demodulator 710 receives the modulated transport stream (TS) and demodulates the modulated signal.

  Thereafter, in step S920, the demultiplexer 720 first separates the transport stream (TS_PSI) for the program specification information (PSI) according to the packet identifier.

  In step S930, the program specification information analysis unit 730 analyzes the program specification information using the transport stream (TS_PSI) for the program specification information.

  Thereafter, in step S940, the demultiplexing unit 720 classifies the transport stream (TS) using the analyzed program specification information and demultiplexes the transport stream (TS) into each transport stream (TS).

  Thereafter, in step S950, the transport stream analyzing unit 740 analyzes each demultiplexed transport stream to generate an elementary stream packet (PES).

  Thereafter, in step S960, the depacketization unit 750 depackets each generated elementary stream packet (PES) to generate each elementary stream (ES).

  After that, in step S970, the decoding unit 760 decodes each of the depacketized elementary streams (ES).

  In step S971, the first MPEG-2 decoder 761 decodes the elementary stream (ES_Ori) for the original video into MPEG-2, which is the current broadcast standard, and in step S972, an arbitrary decoder 762 performs the process for the 3D stereoscopic video additional data. The elementary stream (ES_3D) is efficiently decoded. In step S973, the second MPEG-2 decoder 763 decodes the elementary stream (ES_Au) for the audio data into MPEG-2, which is the current broadcast standard.

  Thereafter, in step S980, when the video display mode is input from the user and 3D is selected, the video combining unit 770 combines the decoded original video and the 3D stereoscopic video additional data to generate the 3D stereoscopic video. Is generated. Conversely, when 2D is selected, the original video is passed.

  Thereafter, in step S990, the output unit 780 outputs both the two-dimensional video or the three-dimensional stereoscopic video and audio data according to the user's selection.

  Since the detailed operation process of the present invention is the same as the description in FIG. 1 and FIG. 7, the detailed description is omitted here.

  The method of the present invention described above is realized by a program, and can be stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a form that can be read by a computer. Such a process can be easily carried out by a person having ordinary knowledge in the technical field to which the present invention belongs, and thus detailed description thereof is omitted.

  The present invention described above is not limited by the above-described embodiments and the accompanying drawings, and various replacements, modifications, and changes can be made without departing from the technical idea of the present invention. It is obvious to those having ordinary knowledge in the technical field to which the present invention belongs.

  The present invention differs from a conventional method that supports only a 3D digital broadcasting system using a video of another viewpoint, and 2D of additional 3D stereoscopic video additional data such as video of another viewpoint, disparity information, or depth information. By defining and processing as an additional stream synchronized with a three-dimensional video stream (Transport Stream), there is an effect that complete compatibility with a two-dimensional digital broadcasting system can be ensured.

  Therefore, the present invention enables a user having a conventional digital broadcast receiving apparatus to enjoy a 2D video broadcast even when receiving a 3D stereoscopic video-based broadcast content, and receiving a 3D stereoscopic digital broadcast. There is an effect that a user having a device can enjoy broadcasting of a two-dimensional video or a three-dimensional stereoscopic video.

  Furthermore, the present invention has an effect that a three-dimensional stereoscopic video broadcasting apparatus can be easily realized.

It is a block diagram which shows one Embodiment of the transmission apparatus of the three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data based on this invention. It is a structural diagram which shows one Embodiment regarding the block diagram of an elementary stream packet (PES). It is a figure for demonstrating the three-dimensional stereoscopic video type (3D_Video_type) added in order to classify the three-dimensional stereoscopic video additional data based on this invention. It is a structural diagram which shows one Embodiment regarding the block diagram of the transport stream (TS) which has the program association table (PAT: Program Association Table) information which concerns on this invention. It is a structural diagram which shows one Embodiment regarding the block diagram of the transport stream (TS) which has the program map table (PMT: Program Map Table) information which concerns on this invention. It is a block diagram which shows one Embodiment regarding the block diagram of TS packet (Transport Stream Packet) which concerns on this invention. It is a block diagram which shows one Embodiment of the receiver of the three-dimensional stereoscopic digital broadcasting using the three-dimensional stereoscopic video additional data based on this invention. 3 is a flowchart illustrating an embodiment of a transmission method of 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention. 3 is a flowchart illustrating an embodiment of a receiving method for 3D stereoscopic digital broadcasting using 3D stereoscopic video additional data according to the present invention.

Claims (23)

In a three-dimensional stereoscopic digital (digital) broadcast transmission apparatus using three-dimensional stereoscopic video (video) additional data (data) ,
The original video, the 3D stereoscopic video additional data, and the audio data are received, and the original video, the 3D stereoscopic video additional data, and the audio data are received as respective elementary streams (ES: Element). Encoding means for encoding to ( Stream) ;
Packetizing means for converting each elementary stream (ES) encoded by the encoding means into a packet and generating each elementary stream packet (PES : Packetized Element Stream );
Transport stream generating means for generating each elementary stream packet generated by the packetizing means into a respective transport stream (TS) ; and
Multiplexing means for multiplexing into one transport stream a respective transport stream generated by the transport stream generating means,
Modulation means for modulating one transport stream multiplexed by the multiplexing means ,
The three-dimensional stereoscopic video additional data is
3D stereoscopic video additional data including one or more of a viewpoint video different from a viewpoint of the original video, or disparity information (Disparity Information) or depth information (Depth Information) with respect to the original video. 3D stereoscopic digital broadcast Okuoku communication apparatus used. The multiplexing means comprises:
In each of the elementary streams, synchronization between an elementary stream (ES_Ori) for the original video, an elementary stream (ES_3D) for the 3D stereoscopic video additional data, and an elementary stream (ES_AU) for the audio data is performed. For,
The 3D using the 3D stereoscopic video additional data according to claim 1 , wherein a program clock reference (PCR) is inserted into the transport stream for the original video in the one transport stream. Stereo digital broadcast transmitter. The original video, the 3D stereoscopic video additional data, and program specification information for distinguishing the audio data with each other: claim 1, characterized in that it comprises a program specification information generating means for generating (PSI Program Specific Information) 3D stereoscopic digital broadcast Okuoku communication apparatus using 3D stereoscopic video additional data according to. The program specification information generating means is
For compatibility between 2D digital broadcasting system and 3D 3D digital broadcasting system ,
Program Map Table for distinguishing the respective transport stream (PMT: Program Map Table) packet identifier (PID: Packet Identifier) in the information stream that is defined for the video and audio of the 2-dimensional digital broadcasting system use the type (stream_type),
Claims, characterized in that the used-defined values in the "reserved" (reserved) or "individual user" (user private) in the stream type to be newly defined stream type for the 3D stereoscopic video additional data 3D stereoscopic digital broadcast Okuoku communication apparatus using 3D stereoscopic video additional data according to 3. The packetizing means comprises:
If there is a new input fields required in connection with the 3D stereoscopic video additional data, the different viewpoints of the video, the disparity information (Disparity Information), and to divide the depth information (Depth Information),
3 according to claim 1, characterized in that the header of the elementary stream packets for the 3D stereoscopic video additional data (PES_3D), performs a function to add defining an input field for the three-dimensional video additional data type 3D stereoscopic digital broadcast Okuoku communication apparatus using the dimensions stereoscopic video additional data. In the 3D stereoscopic digital broadcast receiver using the 3D stereoscopic video additional data,
Modulated transport stream: a demodulating means for receiving the (TS Transport Stream) to demodulate the transport stream the modulation,
A demultiplexing means for demultiplexing a transport stream, to generate a respective transport stream demodulated by the demodulating means,
Analyzing the respective transport stream generated by the demultiplexing means, each of the elementary stream packet: and the transport stream analyzing means for generating (PES Packetized Element Stream),
Wherein each elementary stream packet generated by the transport stream analyzing means and depacketizing, each elementary stream (ES: Element Stream) opposite packetization means for generating,
A decoding means for decoding (decoding) at the respective elementary streams generated by the inverse packetizer means original (original) video, 3D stereoscopic video additional data, and audio (audio) data,
Video synthesizing means for generating a synthesized and 3D stereoscopic video original video and 3D stereoscopic video additional data decoded by said decoding means,
And outputs the audio data decoded by said decoding means and an output means for outputting the three-dimensional video or a two-dimensional video,
The three-dimensional stereoscopic video additional data is
The original video viewpoint to another viewpoint video or among the disparity information (Disparity Information) or the depth information (Depth Information) for the original video, 3D stereoscopic video additional data, characterized in that it comprises one or more 3D stereoscopic digital broadcasting transmission and reception apparatus using. The demultiplexing means comprises:
The transport stream the demodulated, program specification information (PSI: Program Specific Information) transport stream for (TS_PSI), a transport stream (TS_Ori) for the original video, a transport stream (TS_3D for said three-dimensional video additional data ), and three-dimensional digital broadcasting transmission and reception apparatus using 3D stereoscopic video additional data according to claim 6, characterized in that the demultiplexing each transport stream (TS_AU) for said audio data. Receiving a transport stream for said program specification information from said demultiplexing means to analyze the program specification information in the transport stream for the program specification information, it transmits the program specification information to the demultiplexing means 3D stereoscopic digital broadcasting transmission and reception apparatus using 3D stereoscopic video additional data according to claim 7, characterized in that it comprises a program specification information analyzing means. The demultiplexing means comprises:
The demodulated transport packet identifiers in the stream header (PID: Packet Identifier) Check the value program association table (PAT: Program Association Table) the program locates the transport stream packet having information related table information transmitting the transport stream packet having a broadcast on the program specification information analyzing means, said program specification information analyzing section program number from (program number the) and program map table (PMT: program map table) packet to identifiers (program_map_PID) Receive ,
Transmitting the transport stream packet having the program map table information locate a transport stream packet having a program map table information from the transport stream the demodulated in the program specification information analyzing means, said program specification information analyzing means received stream-type (stream_type) and the element packet identifier (elementary_PID) from,
The demultiplexing is performed on a transport stream ( TS_Ori) for the original video, a transport stream ( TS_3D) for the 3D stereoscopic video additional data, and a transport stream ( TS_AU ) for the audio data. 3D stereoscopic digital broadcasting transmission and reception apparatus using 3D stereoscopic video additional data according to. The demultiplexing means comprises:
For clock synchronization between transmitter / receiver apparatus, program clock reference picture for a transport stream (TS_Ori) for the original video: based on (PCR Program Clock Reference) in claim 8, characterized in that to restore the system clock 3D stereoscopic digital broadcasting transmission and reception apparatus using 3D stereoscopic video additional data according. The program specification information analyzing means is
Receiving said transport stream (TS_PSI) from demultiplexing means for said program specification information, program association table in the transport stream for said program specification information (PAT: Program Association Table) information or a program map table (PMT: Program Map Table ) packet identifier (PID) information ,
3D stereoscopic digital broadcasting transmission and reception using 3D stereoscopic video additional data according to claim 8, characterized in that communicating the program specification information you divide the respective transport streams from each other in the demultiplexing means Communication device. The program specification information analyzing means is
Receiving a transport stream packet having the program association table information from said demultiplexing means, the analyzing the payload (payload) information of the transport stream packet having the program association table information the payload information Communicate to the demultiplexing means;
Receiving a transport stream packet having the program map table information from said demultiplexing means, said payload information by analyzing the payload (payload) information of the transport stream packet having the program map table information 3D stereoscopic digital broadcasting transmission and reception apparatus using 3D stereoscopic video additional data according to claim 9, characterized in that transmitted to the demultiplexing means. The depacketizing means comprises:
When there is an input field newly input in association with the 3D stereoscopic video additional data,
Previously defined in the header portion of the elementary stream packet for 3D stereoscopic video additional data (PES_3D), said another viewpoint video, the disparity information (Disparity Information), and three-dimensional of the depth information (Depth Information) Analyzing information for video ancillary data types ,
The 3D stereoscopic video additional data according to claim 6, further comprising a function of dividing the video of the different viewpoint, the disparity information (Disparity Information), and the depth information (Depth Information) . 3D stereoscopic digital broadcast sending and receiving devices. The decoding means comprises:
Wherein each elementary stream, the elementary stream for the original video (ES_Ori), an elementary stream for the 3D stereoscopic video additional data (ES_3D), and the elementary stream (ES_AU) for said audio data, program clock referencing lance (PCR: Program Clock reference) 3-dimensional digital broadcasting transmission and reception apparatus using 3D stereoscopic video additional data according to claim 6, characterized in that to synchronize with. The video synthesizing means is
Said another viewpoint video, the disparity information (Disparity Information), or the depth information in accordance with the three-dimensional type of stereoscopic video additional data including (Depth Information), by applying each of the three-dimensional video generation algorithm 3D stereoscopic digital broadcasting transmission and reception apparatus using 3D stereoscopic video additional data according to claim 6, characterized in that to generate the three-dimensional video. The video synthesizing means is
The original video and the 3D stereoscopic video additional data, program clock referencing lance (PCR: Program Clock Reference) and the reproduction time information of each elementary stream packets (PES): synchronize with (PTS Presentation Time Stamp) 3D stereoscopic digital broadcasting transmission and reception apparatus using 3D stereoscopic video additional data according to claim 6, characterized in that to. The output means is
If the display type of user selection signal is a two-dimensional, the two-dimensional video via the video display unit outputs,
The 3D stereoscopic data additional data according to claim 6, wherein when the display type of the user selection signal is 3D, the 3D stereoscopic video is output via the video display unit. dimension stereoscopic digital broadcast sending and receiving devices. In 3D stereoscopic digital broadcast Okuoku signal method using 3D stereoscopic video additional data,
Receiving your original (original) video, 3D stereoscopic video additional data, and audio and (audio) data,
A step of encoding (encoding) to: (Element Stream ES), the original video, the 3D stereoscopic video additional data, and the audio data each elementary stream
Generating a: (Packetized Element Stream PES), wherein each elementary stream (ES) respectively Packet (packet) turned into and each elementary stream packet
And generating a: (Transport Stream TS), each elementary stream packets the respective transport stream
And Luz step to multiplex respective transport stream wherein the one transport stream,
Look including the absence steps be transmitted by modulating the single transport stream,
The three-dimensional stereoscopic video additional data is
Among the different viewing Tenbi Deo the viewpoint of the original video or the disparity information (Disparity Information) or the depth information for the original video, (Depth Information), 3-dimensional video added which comprises one or more 3D stereoscopic digital broadcast Okuoku signal method using data. According to claim 18, characterized in that it comprises: (Program Specific Information PSI) away step to generate the original video, the 3D stereoscopic video additional data, and program specification information for distinguishing the audio data with each other 3D stereoscopic digital broadcast Okuoku signal method using 3D stereoscopic video additional data. Generating the program specification information comprises :
For compatibility between 2D digital broadcasting system and 3D 3D digital broadcasting system,
Program Map Table for distinguishing the respective transport stream (PMT: Program Map Table) packet identifier (PID: Packet Identifier) in the information, the two-dimensional digital broadcasting system video and stream defined for the audio type (stream_type) use,
The value defined in the "reserved" in the stream type of the used (reserved) or "individual user" (user private), characterized in that it newly defines a stream type for the 3D stereoscopic video additional data 3D stereoscopic digital broadcast Okuoku signal method using 3D stereoscopic video additional data according to claim 18. In 3D stereoscopic digital broadcasting transmission and reception method using 3D stereoscopic video additional data,
Modulated transport stream: a step that will receive (TS Transport Stream),
Demodulating the modulated transport stream ;
Generating a respective transport stream by demultiplexing the transport stream the demodulated,
Each elementary stream packets by analyzing the respective transport stream: and Luz step to generate (PES Packetized Element Stream),
And Luz step to generate: (Element Stream ES), each elementary stream by depacketizing the respective elementary stream packet
Wherein each elementary stream of the original (original) video, 3D stereoscopic video additional data, and audio (audio) decoded data (decoding) to Luz step,
And Luz step to generate a three-dimensional video by combining the three-dimensional video additional data and the original video,
Includes answering step to output the three-dimensional video or a two-dimensional video depending on the user selection to output the audio data,
The three-dimensional stereoscopic video additional data is
Three-dimensional stereoscopic video additional data including one or more of video of a viewpoint different from the viewpoint of the original video, or disparity information (Disparity Information) or depth information (Depth Information) with respect to the original video 3D stereoscopic digital broadcasting transmission and reception method using. Generating the respective transport stream comprises:
The demodulated transport stream is converted into a transport stream (TS_PSI) for program specification information (PSI: Program Specific Information), a transport stream (TS_Ori) for the original video, and a transport stream (TS_3D) for the 3D stereoscopic video additional data. ), and three-dimensional digital broadcasting transmission and reception method using 3D stereoscopic video additional data according to claim 21, wherein the demultiplexing each transport stream (TS_AU) for said audio data. Said program specification information: includes answering step to analyze the program specification information in the transport stream (TS_PSI) for (PSI Program Specific Information),
Analyzing the program specification information,
Said program specification program association table in the transport stream to the information (PAT: Program Association Table) information or a program map table: analyzing a packet identifier (PID) information (PMT Program Map Table), the respective transport stream 3D stereoscopic digital broadcasting transmission and reception method using 3D stereoscopic video additional data according to claim 22, characterized in that to generate the program specification information you partitioned from each other.

Images