JP4121135B2 - Digital content reception and playback system - Google Patents

Description

The present invention relates to a digital content reception / playback system, and more particularly to a digital content reception / playback system for efficiently performing recording and playback when data loss occurs when a digital broadcast signal is received.

  In the distribution of digital contents such as broadcasting and communication, data received and stored on the receiving side may be lost due to data discard due to deterioration of radio wave conditions if wireless, and line congestion if wired. When this missing data is played, sound skipping or video disturbance occurs in the missing data part, but when sound skipping or video disturbance occurs, it is not due to equipment failure, etc. It is desirable to be able to inform the user that there is a lack of stored data. FIG. 10 is a diagram showing a system configuration of a conventional system capable of notifying the user that accumulated data is missing (see, for example, Patent Document 1).

  In FIG. 10, 61 is a tuner, 62 is a TS decoder, 63 is a CPU, 64 is a digital interface (hereinafter, digital I / F), 65 is a recording unit, 66 is a recording control unit, 70 and 71 are memories, and 80 is an image. Decoder unit 81 is a video output unit 82 is a video output device 90 is an audio decoder unit 91 is an audio output unit 92 is an audio output device 10 is a synthesis unit

  Next, the operation will be described. The tuner 61 receives and demodulates radio waves from a broadcasting satellite, for example, and extracts a data stream. The TS decoder 62 analyzes the data stream and separates media information corresponding to video, audio, etc. of necessary programs and contents. The separated video and audio information is stored in the recording unit 65. The format when stored is shown in FIG. Missing information, which is stuffing data for simply causing the system to detect that there is a data loss, is inserted in the location where the data is missing, and is stored in the recording unit 65. When reproducing the stored content, the corresponding data is read from the recording unit 65, and the video, audio, and missing information are separated by the TS decoder 62. The video information is decoded by the video decoder unit 80, converted into an output signal format by the video output unit 81, and output as video from the video output device 82. Similarly, the audio is decoded by the audio decoder 90, converted into an output signal format by the audio output unit 91, and output as audio from the audio output device 92. When missing information is detected during playback, a message indicating to the user that there was a loss in the synthesizing unit 10 (for example, “12:00 to 12:05 could not be recorded due to radio interference. Now that 1 minute has passed, it takes 4 minutes to return to normal playback. ”) Is created and displayed.

JP 2003-319280 A

  However, since the conventional system is configured as described above and the missing data is stored in the stored data, the recording capacity is consumed. In addition, there is a problem in that it is impossible to grasp at a glance how much of a part is missing from the whole digital content.

The present invention has been made to solve such a problem, and when there is a lack of data to be stored, digital content that can be efficiently stored and reproduced without consuming recording capacity. The purpose is to obtain a reception reproduction system.

The present invention provides a TS packet receiving means for receiving one or more TS packets constituting a digital content, a time stamp adding means for adding a time stamp indicating the received time to the TS packet, and the time stamp is added. a de I digital content reception playback system including a TS packet accumulating means, the stored digital contents of the first TS packet and the last TS packet in the appended with that timestamp respectively for storing the TS packets A total content playback time calculation means for calculating the total playback time of the stored digital content from the difference between the read and time stamps, and sequentially reading the TS packets of the stored digital content, and the preceding TS packet and the subsequent TS packet Based on timestamp And determining whether or not they are continuous, and if not continuous, a missing time calculating means for calculating a missing time when missing data has occurred, and a current playback progress time from the time stamp of the subsequent TS packet A playback progress time calculating means for calculating the total playback time, the progress progress displaying time and the missing time, and a content playback means for decoding and outputting the subsequent TS packet. A digital content reception / playback system characterized by the above.

The present invention provides a TS packet receiving means for receiving one or more TS packets constituting a digital content, a time stamp adding means for adding a time stamp indicating the received time to the TS packet, and the time stamp is added. a de I digital content reception playback system including a TS packet accumulating means, the stored digital contents of the first TS packet and the last TS packet in the appended with that timestamp respectively for storing the TS packets A total content playback time calculation means for calculating the total playback time of the stored digital content from the difference between the read and time stamps, and sequentially reading the TS packets of the stored digital content, and the preceding TS packet and the subsequent TS packet Based on timestamp And determining whether or not they are continuous, and if not continuous, a missing time calculating means for calculating a missing time when missing data has occurred, and a current playback progress time from the time stamp of the subsequent TS packet A playback progress time calculating means for calculating the total playback time, the progress progress displaying time and the missing time, and a content playback means for decoding and outputting the subsequent TS packet. Since the digital content reception / playback system is characterized by the above, even if there is a lack of stored data, it is possible to efficiently store and play back without consuming storage capacity.

Embodiment 1 FIG.
The present invention sequentially receives TS packets of a transport stream (hereinafter referred to as TS) that constitutes digital contents transmitted wirelessly or by wire, and consumes storage capacity in storing these data. This is a digital content reception / playback system that can easily notify the user that data has been lost. Embodiments of the present invention will be described below.

Since the hardware configuration of the digital content reception / playback system according to the present invention is the same as that shown in FIG. 10 except for the synthesizing unit 10, reference is made to FIG. 10 and only the functional configuration diagram is shown. I will do it. FIG. 1 shows a functional block diagram of a digital content reception / playback system of the present invention. As shown in FIG. 1, the digital content reception / playback system of the present invention includes TS packet receiving means 1 for receiving one or more TS packets constituting digital content, and a time stamp indicating the time at which the TS packet is received. A time stamp adding means 2 for adding to the TS packet and a TS packet storage means 3 having a storage device and storing the TS packet with the time stamp added thereto are provided. As a result, the digital content reception / playback system of the present invention can normally receive the TS packet storage means when missing data occurs because all TS packets constituting the content cannot be continuously received normally. Only connect TS packets.

The digital content reception / playback system of the present invention also reads the time stamps added to the first TS packet and the last TS packet of the stored digital content, and stores the digital content stored from the difference between the time stamps. Content total playback time calculation means 4 for calculating the total playback time of the digital content, and sequentially reading the TS packets of the stored digital content, and based on the time stamp of the preceding TS packet and the current succeeding TS packet read most recently , It is determined whether or not they are continuous, and if they are not continuous, the missing time calculation means 5 for calculating the missing time indicating the temporal range in which the missing data has occurred, and the current subsequent TS read most recently The current playback progress time is calculated from the packet time stamp. Progress time calculation means 6, progress status display means 7 for displaying the total playback time of the content, the current playback progress time, and the missing time when the TS packet is missing, and the subsequent TS packet read out the latest And content reproduction means 8 for outputting.

The hardware configuration will be described.
The TS packet receiving means 1 selects the target content from the digital broadcast signal received by the antenna (not shown) in the tuner 61 of FIG. The TS is output as a transport stream (hereinafter abbreviated as TS) that has been subjected to error correction processing, etc., and the TS decoder 62 separates and extracts signals in units of TS packets from the TS in accordance with instructions from the CPU 63, so In order to output the packet separately, it includes a tuner 61, a TS decoder 62, a CPU 63, and a memory 70.
Further, the time stamp adding means 2 receives received time data based on the time of an internal clock (not shown) connected to the CPU 63 in accordance with a command of the CPU 63 operating in accordance with the program in the memory 70 in the TS decoder 62. Is added as a time stamp, and is composed of a TS decoder 62, a CPU 63, and a memory 70.
The TS packet accumulating means 3 has a storage device such as a magnetic disk, accumulates TS packets output from the TS decoder 62 in the recording unit 65 via the digital I / F 64, and also records the recording unit 65. Since the input / output of data is controlled by a recording control unit 66 that operates using the memory 71 as a work area, the recording control unit 66 includes a recording unit 65, a recording control unit 66, and a memory 71.
In addition, the total content playback time calculation unit 4, the missing time calculation unit 5, and the playback progress time calculation unit 6 use the time stamp of the TS packet read from the recording unit 65 via the digital I / F 64 to store in the memory 70. The TS decoder 62 is composed of a TS decoder 62, a digital I / F 64, a CPU 63, and a memory 70 in order to calculate the total content playback time, missing time, and playback progress time in accordance with the instructions of the CPU 63 that operates according to the above program. Has been.
In addition, the progress status display means 7 in the TS decoder 62 and the video decoder unit 80 in accordance with an instruction from the CPU 63 that operates according to the program in the memory 70 based on the calculated total content playback time, missing time, and playback progress time. In order to generate a progress bar 102, which will be described later, and display it on the screen by the video output unit 81 and the video output device 82, the TS decoder 2, the video decoder unit 80, the video output unit 81, and the video output device 82 are displayed. It consists of and.
Further, the content reproduction means 8 generates video data to be displayed on the screen in the TS decoder 62 and the video decoder unit 80 according to an instruction of the CPU 63 that operates according to the program in the memory 70, and the video output unit 81 and the video output device 82, and the voice data is generated in the TS decoder 62 and the voice decoder unit 90 according to the instruction of the CPU 63 that operates according to the program in the memory 70, and the voice output unit 91 and the voice output device 92 Therefore, the TS decoder 62, the video decoder unit 80, the video output unit 81, the video output unit 82, the audio decoder unit 90, the audio output unit 91, and the audio output unit 92 are output. It is composed of

FIG. 2 shows a configuration showing the principle of the present invention. FIG. 2 (a) shows the configuration of a broadcast stream that has lost data due to deterioration of radio wave conditions, etc., and FIG. 2 (b) shows the configuration of stored content in the digital content reception / playback system of the present invention. . As shown in FIG. 2A, the broadcast stream is composed of a plurality of continuous TS packets. The portion of the TS packet marked with a cross is a TS packet in which data is missing. In the digital content reception / playback system of the present invention, as shown in FIG. 2B, at the time of accumulation, a time stamp indicating the reception time is added and accumulated for each TS packet. In addition, when data loss occurs as shown in FIG. 2A, the streams before and after the data loss are connected as shown in FIG. 2B without inserting the missing information as in the conventional system. Accumulate.

  FIG. 3 shows the structure of the TS packet. Each TS packet has a fixed length of 188 bytes. As shown in FIG. 3, each TS packet is composed of a 4-byte header and a 184-byte payload. As shown in FIG. 3, the header includes a sync byte (8 bits), an error indication (Transport Error indicator) (1 bit), a unit start indication (Payload unit Start indicator) (1 bit), etc. Synchronization information, PID (Packet IDentifier) (13 bits) indicating attributes such as whether the individual stream of each TS packet is video or audio, presence / absence of payload scramble (Transport scramble control) (2 bits), Control information indicating the presence / absence of an adaptation field (Adaptation Field) (2 bits) and the like, and a continuity counter (Continuity counter) (hereinafter referred to as continuity counter) (4 bits) indicating continuity for each PID are embedded. . The payload includes information data such as video and audio. Note that the continuity counter is incremented (incremented by 1) for each PID and is initialized to the original value at a constant cycle. In this example, since the continuity counter is composed of 4 bits, 16 values become one cycle and are initialized to the original value when incremented for the 16th time. Thus, the continuity counter is a continuous numerical value for each PID.

  In the present invention, when the stored content is played back, a progress bar 102 for showing the progress of playback is displayed on the screen 100 together with the video display portion 101 for displaying the video, as shown in FIG. 4B. . The progress bar 102 calculates the location and period of data loss based on the time stamp added to the TS packet at the time of accumulation and the continuity counter, and as shown in FIG. This indicates whether there is a missing part. By displaying such a progress bar 102, it is possible to easily display to the user that data has been lost in the accumulated digital data. The progress bar 102 includes a first band 102a indicating the length of the total playback time of the content, a second band 102b indicating the length of the current playback progress time, and the second band 102b. The third band 102c that highlights the missing time in which data has been lost is displayed as a band graph. The third band 102c is preferably a conspicuous color such as a red band because it is easy for the user to find and to alert the user. As described above, the progress bar 102 is a progress status display means for expressing the missing time as a ratio with respect to the total reproduction time. When the ratio is displayed, the ratio is displayed as the length of the band in the band graph. It is expressed by this.

  The progress bar 102 will be described more specifically. The length of the first band 102a in the progress bar 102 is always constant regardless of the total playback time of the content because of the limitation of the screen size. Accordingly, for example, if the length of the first band 102a of the progress bar 102 is 6 cm, for example, if the total content playback time is 60 minutes, 1 cm of that corresponds to 10 minutes, and the total content playback time is 120 minutes. In the case of minutes, 1 cm corresponds to 20 minutes. In addition, the current playback progress time is displayed after being converted into a length determined by a ratio with respect to the total playback time of the content, for example, when the total playback time of the content is 60 minutes. At the time when 30 minutes of playback is performed, if the length of the first band 102a of the progress bar 102 is 6 cm, for example, the length of the second band 102b indicating the length of the current playback progress time The length is 3 cm, and the length of the second band 102b is 4 cm when 40 minutes of reproduction is performed. Also, if there is data loss in the second band 102b, only that portion is displayed as a third band 102c with a different color. For example, when the total playback time of the content is 60 minutes and 30 minutes of playback is performed, the content is converted into a length determined by the ratio with respect to the time. If there is data loss for 10 minutes and 5 minutes, the length of the first band 102a is 6 cm, the length of the second band 102b is 3 cm, and the length (width) of the third band 102c. ) Is 1 cm and 0.5 cm, respectively.

  Note that the length of the first band 102a in the progress bar 102 is always constant regardless of the total playback time of the content because the size of the screen is limited. For example, the total playback time of the content 360 In the case of minutes, when 30 minutes of the playback is performed and there is data loss for 5 minutes, the length of the first band 102a is 6 cm and the length of the second band 102b The length is 0.5 cm, and the length (width) of the third band 102c is about 0.08 cm. Therefore, in the present invention, for the third band 102c, a threshold value for the length (width) is set in advance, and if it is equal to or less than the threshold value, it is changed to a predetermined width. The third band 102c is displayed. That is, in the above example, it is difficult for the user to see at 0.08 cm. Therefore, for example, when the threshold value is set to 0.2 cm and the length (width) of the third band 102c is 0.2 cm or less, All are changed to 0.2 cm for display, and when larger than 0.2 cm, display is performed with the length (width) as it is.

FIG. 5 is a flowchart showing the operation during storage in the digital content reception / playback system of the present invention, and FIGS. 6, 7 and 8 are flowcharts showing the operation during playback.

  As shown in FIG. 5, at the time of accumulation, the TS packet receiving means 1 selects the target content from the digital broadcast signal received by the tuner 61 according to the instruction of the CPU 63, and sequentially receives the TS packets constituting the TS. The time stamp adding means 2 adds a time stamp indicating the received time to the TS packet (step S1), and the TS packet storage means 3 stores the TS packet (step S2). It is confirmed whether or not there is an instruction to end accumulation from the user or the like (step S3), and the above processing is sequentially repeated on the received data until the instruction is given. Exit.

  As shown in FIG. 6, at the time of reproduction, the total content reproduction time calculation means 4 reads the time stamp added to the first TS packet of the accumulated data and the time stamp added to the last TS packet, The total reproduction time when reproduction is performed by taking the time difference is calculated (step S10). Since this time is the length of the entire time of the content, the first band 102a indicating the length of the entire time of the content when displaying the progress bar 102 corresponds to this time, and the length of the progress It is used as comparison data when determining the size. Next, the missing time calculation means 5 reads the continuity counter included in the header of the TS packet and the time stamp added to the TS packet for the TS packet having the PID indicating the medium to be reproduced, for example, the audio medium, They are held as previous values (initial values) for comparison with the next packet (steps S11 and S12). Next, the content reproduction means 8 decodes and outputs the TS packet. At that time, the progress display means 7 starts displaying the progress bar 102 (step S13). However, the second band 102b indicating the length of the current reproduction progress time is displayed as 0 (that is, the length of the second band 102b is 0 cm at this time).

  Next, as shown in FIG. 7, the missing time calculation means 5 identifies the PID, reads the next TS packet of the medium to be played (in this example, the audio medium), and includes it in the TS packet header. The continuity counter and the time stamp added to the TS packet are read (step S14, step S15). Next, the missing time calculation means 5 compares the previous continuity counter with the read current continuity counter, compares the previous time stamp with the read current time stamp, and determines the comparison result. Based on this, it is determined whether or not there is data loss (step S16). That is, if the previous continuity counter and the current continuity counter are not continuous values, it means that there is data loss. Since the continuity counter is composed of 4 bits, it takes 16 values, and the 17th value is initialized to the 1st value. Therefore, even if the previous continuity counter and the current continuity counter are continuous values, there is a possibility that data for one cycle may have been lost. Determine the presence or absence of sex. As a result, if it is determined that data is missing, the missing time calculation means 5 calculates the period of data loss from the time stamp difference, and the reproduction progress time calculation means 6 adds the read current time stamp to the current time stamp. Based on these values, the progress status display means 7 displays the first band 102a indicating the total playback time on the progress bar 102 and the current playback progress time. Display of the second band 102b indicating the length of the minute and display by the third band 102c for highlighting that data has been lost are performed (step S17). On the other hand, if it is determined that there is no data loss, the progress display means 7 displays the normal progress bar 102 that does not include the third band 102c (that is, only the first band 102a and the second band 102b). The content reproduction means 8 decodes and outputs the TS packet (step S18).

  Next, as shown in FIG. 8, the missing time calculation means 5 determines whether or not there is a reproduction end instruction from the user or the like (step S19). End. On the other hand, if there is no such instruction, the missing time calculation means 5 determines whether or not the accumulated data has ended (step S20), and if it has ended, the reproduction is ended. On the other hand, if not completed, the process returns to step S14, and the processing of steps S14 to S20 is repeated until the reproduction end instruction from the user or the stored data is completed.

  As described above, in the present embodiment, except for missing data, only normally received TS packets are connected and stored, so that efficient contents can be obtained without unnecessarily consuming memory. Can be accumulated. Also, during playback, the total length of the content and the length of the current playback progress time are displayed as a progress bar 102, and further, the portion where data is missing is highlighted and notified to the user. Therefore, the user can know at a glance that the data is missing, not a malfunction of the device, etc., even if a video disturbance, abnormal sound or sound skip occurs, by referring to the progress bar 102. The anxiety can be resolved. In addition, even if there is data loss, it is possible to connect and play back only the parts that can be received normally without displaying a black screen without playing the video, so it does not waste time. Efficient.

Embodiment 2. FIG.
In the first embodiment, as a band graph using the progress bar 102, a first band 102a indicating the length of the total playback time of the content and a second band 102b indicating the length of the current playback progress time In the second band 102b, the example of displaying the third band 102c that highlights the missing time corresponding to the missing data has been described. In the present embodiment, as shown in FIGS. 9A and 9B, as a pie chart using the clock 202, a first arc 202a indicating the length of the total playback time of the content and the current A second arc 102b indicating the length of the playback progress time and a third arc 102c that highlights the missing time in the second belt 102 arc where data is missing are displayed. In this case, the arcs 202a, 202b and 202c may be indicated by arrows as shown in FIG. 9 (a), or only the arcs 202a, 202b and 202c as shown in FIG. 9 (b). Instead, the corresponding fan shape may be painted and displayed together. Thus, in the present embodiment, when the ratio of the missing time to the total reproduction time is displayed as the progress status display means, the ratio is expressed by an angle in the pie chart. If necessary, a threshold value is set in advance for the angle, and when the angle is equal to or less than the threshold value, the angle is changed to a predetermined angle and the ratio is displayed. When the angle is larger than the threshold value, the ratio may be displayed as it is. Since other configurations and operations are the same as those in the first embodiment, the description thereof is omitted here.

  As described above, also in the present embodiment, it is possible to obtain the same effect as in the first embodiment.

Embodiment 3 FIG.
In the first and second embodiments described above, an example has been described in which the progress time display means uses the progress bar 102 or the clock 202 to convert the missing time into a ratio with respect to the total reproduction time and express it in terms of length or angle. . However, the present invention is not limited to this, and the missing time may be expressed by a length or an angle in terms of a ratio to the current reproduction progress time.

  In the first and second embodiments described above, the example in which the total playback time, the playback progress time, and the missing time are displayed by the progress bar 102 or the clock 202 has been described. Only the total playback time and missing time, or only the playback progress time and missing time may be displayed by the progress bar 102 or the clock 202.

  As described above, also in the present embodiment, it is possible to obtain the same effect as in the first embodiment.

1 is a functional configuration diagram showing a functional configuration of a digital content reception / playback system according to Embodiment 1 of the present invention. FIG. It is explanatory drawing which shows the operation principle in the digital content receiving / reproducing system which concerns on Embodiment 1 of this invention. It is explanatory drawing which showed the structure of the transport stream (TS) and TS packet in the digital content receiving / reproducing system based on Embodiment 1 of this invention. It is explanatory drawing which showed an example of the progress condition display means in the digital content reception reproduction | regeneration system concerning Embodiment 1 of this invention. 3 is a flowchart showing the operation of the digital content reception / playback system according to the first embodiment of the present invention. 3 is a flowchart showing the operation of the digital content reception / playback system according to the first embodiment of the present invention. 3 is a flowchart showing the operation of the digital content reception / playback system according to the first embodiment of the present invention. 3 is a flowchart showing the operation of the digital content reception / playback system according to the first embodiment of the present invention. It is explanatory drawing which showed an example of the progress condition display means in the digital content reception reproduction | regeneration system concerning Embodiment 2 of this invention. It is the block diagram which showed the structure of the conventional system. It is explanatory drawing which shows the operation principle in a conventional system.

Explanation of symbols

  1 TS packet receiving means, 2 time stamp adding means, 3 TS packet storing means, 4 content total playback time calculating means, 5 missing time calculating means, 6 playback progress time calculating means, 7 progress status displaying means, and 8 content playback means.

Claims (7)

TS packet receiving means for receiving one or more TS packets constituting digital content;
Time stamp adding means for adding a time stamp indicating the received time to the TS packet;
A de I digital content reception playback system including a TS packet storing means for storing the TS packets in which the time stamp is added,
Content total playback time calculating means for reading the time stamps added to the first TS packet and the last TS packet of the stored digital content, and calculating the total playback time of the stored digital content from the difference between the time stamps; ,
The TS packets of the stored digital content are sequentially read out, and it is determined whether or not they are continuous based on the time stamps of the preceding TS packet and the subsequent TS packet. A missing time calculating means for calculating the generated missing time;
Playback progress time calculating means for calculating the current playback progress time from the time stamp of the subsequent TS packet;
Progress display means for displaying the total playback time, the playback progress time, and the missing time;
Content reproduction means for decoding and outputting the subsequent TS packet;
A digital content receiving and reproducing system comprising: 2. The digital content receiving and reproducing system according to claim 1 , wherein the progress status display means expresses the missing time as a ratio with respect to one of the total reproduction time and the reproduction progress time. The progress status display means represents the ratio by length when displaying the ratio,
A threshold is set in advance for the length,
If the length is less than or equal to the threshold, the length is changed to a predetermined length and the ratio is displayed.
The digital content receiving / reproducing system according to claim 2 , wherein, when the length is larger than the threshold value, the ratio is displayed by the length. The progress status display means represents the ratio by an angle when displaying the ratio,
A threshold is set in advance for the angle,
If the angle is equal to or less than the threshold value, the angle is changed to a predetermined angle set in advance, and the ratio is displayed.
The digital content reception / playback system according to claim 2 , wherein when the angle is larger than the threshold, the ratio is displayed at the angle. The TS packet is provided with a header, and the header includes a continuity counter that is incremented at a constant period to indicate the continuity of the TS packet.
The missing time calculation means determines whether or not a preceding TS packet and a succeeding TS packet are continuous based on the time stamp and the continuity counter. 5. The digital content reception / playback system according to any one of 4 above. 4. The digital content receiving / reproducing system according to claim 2 , wherein the progress status display means displays the ratio in a band graph. 5. The digital content receiving / reproducing system according to claim 2 , wherein the progress status display means displays the ratio in a pie chart.

Images