JP6720111B2 - Display device - Google Patents

Description

The present invention relates to a display device.

2. Description of the Related Art A barcode displayed on the screen of a television receiver is photographed by a mobile phone, decoded, and used. Patent Document 1 (Japanese Patent Laid-Open No. 2011-095824) discloses displaying a bar code on a TV screen in a television broadcasting shopping program, capturing and decoding the barcode on a user terminal, and making it available for shopping. .. It is complicated to take an image with a user terminal such as a mobile phone.

The above-mentioned prior art and its problems are described only for explaining a part of the background of the present invention. It should be noted that the present invention is not limited to the above-mentioned conventional techniques and problems.

JP, 2011-0985824, A

The present invention has been made in view of the above circumstances, and an object thereof is to make it possible to easily use a bar code displayed on a display device such as a television receiver.

According to this invention, in order to achieve the above-mentioned object, the structure as described in the claims is adopted. Here, before describing the invention in detail, the description of the claims will be supplementarily described.

That is, according to one aspect of the present invention, a display device includes: a display unit; a touch panel corresponding to the display unit; a decoding unit for decoding a barcode; and an image at a position corresponding to a touch operation on the touch panel. Then, a means for decoding by the above-mentioned decoding means is included.

In such a configuration, the bar code displayed on the display device such as a television receiver can be easily used.

According to another aspect of the present invention, the display device includes: a display unit; a touch panel corresponding to the display unit; a unit for extracting an image at a position corresponding to a touch operation on the touch panel and causing the barcode decoding unit to decode the image. It is configured to include and.

Even in such a configuration, the bar code displayed on the display device such as a television receiver can be easily used.

In such a configuration, the barcode may be a two-dimensional barcode.

Further, the processing may be executed based on the decoding result when the decoding by the decoding means is successful.

The decryption result is a URL, and the URL request may be transmitted.

Further, the display device may be composed of a mobile communication terminal.

Further, the display device may display a document described in BML.

According to another aspect of the present invention, a terminal that has a display unit and a touch panel corresponding to the display unit extracts an image at a position corresponding to a touch operation on the touch panel and causes the barcode decoding unit to decode the image. A computer program used to realize the above is provided.

Even in such a configuration, the bar code displayed on the display device such as a television receiver can be easily used.

The present invention can be realized not only as an apparatus or system, but also as a method. Further, it goes without saying that a part of such an invention can be configured as software. Further, it goes without saying that a software product used for causing a computer to execute such software is also included in the technical scope of the present invention.

The aspects defined above and further aspects of the invention are described in the claims and are explained in more detail below using examples.

According to the present invention, it is possible to reduce the processing load of the broadcast service retransmission device. In addition, the load on the viewing terminal of the retransmission service can be reduced.

It is a figure explaining the environment where the IP retransmission system of the Example of this invention is performed. It is a functional block diagram explaining the outline|summary of the IP retransmission system of FIG. It is a figure explaining the message management file of FIG. It is a figure explaining subtitle data. It is a block diagram which shows the structural example of the portable terminal of FIG. It is a functional block diagram of the portable terminal of FIG. It is a figure explaining the example of a display of the portable terminal of FIG. It is a figure which shows the example of the channel information which can be acquired from an authentication server. It is a figure explaining the detail of the channel information of FIG. 9 is a block diagram showing a configuration example of a synchronous data reproducing unit in FIG. 8. FIG. FIG. 9 is a schematic diagram illustrating an operation of the synchronous data reproducing unit in FIG. 8. FIG. 12 is a schematic diagram illustrating an example of a correction PCR acquisition operation of the synchronous data reproducing unit in FIG. 11. 7 is a flowchart illustrating a button selecting operation of the user interface unit of FIG. 6. FIG. 7 is a diagram showing a screen display example for explaining a button selecting operation of the user interface unit of FIG. 6. FIG. 7 is a diagram showing a BML description example for explaining a button selection operation of the user interface unit of FIG. 6. 7 is a flowchart illustrating an operation of a two-dimensional bar code processing unit of the user interface unit of FIG. 6. FIG. 7 is a diagram showing a screen display example for explaining the operation of the two-dimensional barcode processing unit of the user interface unit of FIG. 6. It is a functional block diagram explaining the modification of the said Example. It is a schematic diagram explaining the processing flow of subtitle data. It is a figure explaining the message in a message management file. It is a figure explaining the substance classification of the message in a message management file.

Examples of the present invention will be described below.

FIG. 1 shows the IP retransmission (IP is an abbreviation of Internet Protocol, hereinafter also referred to as “Internet retransmission”) of digital television broadcasting (terrestrial digital television broadcasting, BS, CS digital television broadcasting) of the present invention. The environment for implementing the embodiment applied to the digital television retransmission system is shown as a whole. In this figure, the broadcaster system 100 may be a system operated by a backbone broadcaster, and before uplinking. Of the broadcasting service of the above, or demodulates the received broadcast wave to obtain the TS stream, and further demultiplexes it into the video/audio stream and the data stream to use a predetermined line for the distribution company system 200. To transmit. The distribution company system 200 processes the transmitted video/audio stream and data stream for re-distribution, and as described later, the video/audio stream (MPEG-2 TS) for IP re-distribution. In a predetermined format (HLS, MPEG-DASH, etc.) and distributed to the mobile terminal 300, and synchronized data synchronized with a video/audio stream such as subtitle data, character super data, and event message in the data stream. And other asynchronous data (data broadcasting described in BML or the like, electronic program guide, that is, EPG or the like) are individually managed, the former is distributed by using HTTP long polling, and the latter is on-demand. It is supposed to be delivered. As will be described later, both synchronous data synchronized with the video/audio stream and other asynchronous data may be distributed using HTTP polling. The distributor system 200 is connected to a communication network 500, typically the Internet. At least a part of the communication network 500 may be configured with a CDN (content delivery network) service. The mobile terminal 300 is connected to the communication network 500 via a gateway 400 of a mobile communication carrier. Alternatively, the authentication server 600 may be connected to the communication network 500 to authenticate the request from the mobile terminal 300 regarding the IP retransmission service. The broadcasting company system 100 and the distribution company system 200 may be integrated and configured.

FIG. 2 illustrates a configuration example of the broadcaster system 100, the delivery provider system 200, and the mobile terminal 300, and other configuration examples may be adopted. In FIG. 2, the broadcaster system 100 has a broadcast video/audio extraction unit 110 and a broadcast data extraction unit 120. The broadcast video/audio extraction unit 110 extracts video/audio TS packets from a broadcast TS stream. Extract. The broadcast data extraction unit 120 extracts data-related TS packets other than video/audio from the broadcast TS stream. The distribution business system 200 includes a video/audio transcoding unit 210, a data receiving unit 220, a data management DB unit 230, a video/audio distribution unit 240, a synchronous data distribution unit 250, an asynchronous data distribution unit 260, and a message management file storage. It has a section 270 and the like. The video/audio transcoding unit 210 converts a video/audio MPEG-2 TS packet into a streaming file of an HTTP streaming system (typically an HLS system). The video/audio distribution unit 240 distributes the video/audio stream to the mobile terminal 300 by the HTTP streaming method. The data receiving unit 220 typically receives TS packets related to data other than video/audio, and provides synchronization data that is synchronized with video/audio streams such as caption data, character super data, and event messages as synchronization data. The synchronization data distribution unit 250 sends the synchronization data to the distribution unit 250, and distributes the synchronization data to the mobile terminal 300 by HTTP long polling. Further, the data receiving unit 220 reconstructs the BML document, the EPG, etc. from the asynchronous data packet and stores them in the data management DB 230, and the asynchronous data distribution unit 260 turns on the BML document, the EPG, etc. from the mobile terminal 300. It is delivered to the mobile terminal 300 based on a demand HTTP request, for example, an HTTP request made by operating a default button display displayed on the display unit of the mobile terminal 300.

Note that the broadcasting company system 100 or the distribution company system 200 uses an index file (also called index data, index list, message management data, message management file, message list) for managing TS packets of a broadcast TS stream as a message. It is held in the message management file holding unit 270 as a management file. The broadcasting company system 100 or the distribution company system 200 creates and manages the index (message entry, message) shown in FIG. 3 every time a TS packet is received. Regarding the subtitle data, the subtitle packet as schematically shown in FIG. 4 is retained as it is in the data storage management unit, for example, the data management DB 230, the data body storage management unit 280 of FIG. 18 described later, and other storage units. It can be accessed with the path specified by the entity file name attribute of the message.

The mobile terminal 300 displays the video delivered by HTTP streaming on the display unit 300A (FIG. 2), and the subtitle data (300B) delivered by using the message management file transmitted by HTTP long polling. ) Is displayed on the display unit 300A in a superimposed manner, and the BML document or EPG delivered on demand is displayed on the display unit 300C. The display unit 300A and the display unit 300C are divided according to the layout, and may be a part of the display area of the mobile terminal 300 or the entire display area. The display unit 300A may be displayed over the entire display area based on the selectable display mode. In addition, the subtitle data and/or the character super data may be displayed in different areas (windows) that do not overlap or only partially overlap the display unit 300A based on the selectable display mode.

An example of HTTP long polling will be described later.

FIG. 5 shows a configuration example of the mobile terminal 300, in which the mobile terminal 300 includes a processing system 310, a memory 320, an input/output subsystem 330, a high frequency circuit section 340, and an audio circuit section 350. Each of the constituent elements can be appropriately implemented by hardware including a signal processing integrated circuit, an application specific integrated circuit, software, or a combination thereof. The high frequency circuitry 340 is used to send and receive information to other devices over the wireless link or network, and to perform this function, the antenna system, RF transceiver, amplifier, tuner, oscillator, Including but not limited to digital signal processors, CODEC chipsets, memories, and other well known circuit configurations. The high frequency circuit unit 340 includes mobile communication such as time division multiple access (TDMA) and code division multiple access (CDMA), wireless LAN (IEEE 802.11b, IEEE 802.11a, IEEE 802.11g and/or IEEE 802.11N), Bluetooth. (IEEE802.15.1, "Bluetooth" is a trademark), Wi-MAX (IEEE802.16), and other communication protocols can be used, but are not limited thereto. The audio circuit unit 350 is connected to the audio speaker 351 and the microphone 352. The processing system 310 includes a processor 311, a memory controller 312, and a peripheral device interface 313. The memory 320 stores code and data executed by the processor 311. The memory 320 may include any storage device such as RAM, ROM, FLASH, disk drive, magnetic tape, or the like. Processor 311 executes various software components stored in memory 320. For example, the software components include operating system 321, communication module 322, contact/motion module 323, graphics module 324, application 325, timer module 326, and web browser module 327. Applications 325 include a browser, address book, email, encryption, location-determining functions such as Global Positioning System (GPS), and a two-dimensional barcode decoder. The internet retransmit television broadcast viewing application 325A (FIG. 6) of this embodiment is typically implemented as one of the applications 325. The input/output subsystem 330 controls the touch panel 331 and the like. In this mobile terminal 300, the function of viewing the television broadcasting service distributed by Internet retransmission is implemented as an application. By installing the corresponding application in the memory 320, the mobile terminal 300 is realized as an Internet retransmission television broadcast viewing terminal.

FIG. 6 schematically shows the functions realized by the Internet retransmission television broadcast viewing application 325A. In the figure, the mobile terminal 300 includes a video/audio stream reproducing unit 360, a synchronous data reproducing unit 370, and an asynchronous data browsing unit. A function 380 and a user interface unit 390 are included. The user interface unit 390 includes a button selection unit 391 and a barcode processing unit 392.

The video/audio stream reproducing unit 360 decodes the file of the video/audio packet distributed from the video/audio distribution unit 240 of the distributor system 200 by HTTP streaming, and, for example, as shown in FIG. The moving image is displayed in the video viewing area A of the display area. To start watching the television broadcast, the corresponding application may be selected and activated, and the channel may be selected from an on-screen display or the like similar to a normal television receiver. The channel may be switched based on swipe. In some cases, an authentication dialog is executed with the authentication server 600 (FIG. 1). Note that the application 325A can acquire channel information for each of the broadcast channels that can be viewed from the authentication server 600, for example, and FIG. 8 shows a specific example of this channel information. The channel information includes information as shown in FIG. Further, in FIG. 7, the "d" button has a switch for data broadcasting, the "character" button has a switch for subtitles, the "main" button has a switch for audio, and other buttons for switching the display vertically and horizontally. In addition, in relation to subtitle display, a button for displaying subtitles in another area and a button for advancing or delaying the timing of subtitles etc. are provided to enable fine adjustment of the subtitle display mode and timing. Good.

Further, in FIG. 6, the synchronous data reproducing unit 370 reproduces synchronous data such as subtitles. The synchronous data reproducing unit 370 uses HTTP long polling to acquire the synchronous data from the synchronous data distributing unit 250 of the distributor system 200, and displays the subtitles, the character super, etc. at the timing synchronized with the video/audio streaming. It is supposed to do. Further, the synchronous data reproducing section 370 processes the event message which is also synchronous data at a timing synchronized with the video/audio streaming. The content of the BML document can be switched by the event message.

FIG. 10 illustrates the correction PCR generation unit 372 that controls the synchronization timing in the synchronization data reproduction unit 370. 10, the synchronous data reproducing unit 370 includes a caption display unit 371, a correction PCR generating unit 372, a message management file holding unit 373, a caption data holding unit 374, and a polling control unit 375. The correction PCR generation unit 372 generates a PCR (program clock reference) according to the reproduction status of the video/audio stream reproduction unit 360. The polling control unit 375 polls the synchronous delivery unit 250 of the delivery provider system 200 to take out a new entry (message) from the message management file holding unit 270, and the message management file holding unit of the synchronous data reproducing unit 370. 373, and new caption data is added to the caption data holding unit 374. The message management file holding unit 373 and the subtitle data holding unit 374 are configured to delete unnecessary entries. The message management file holding unit 270 of the distribution business system 200 also deletes unnecessary entries. The subtitle display unit 371 refers to the display timing (PST) of the subtitle packet in the subtitle data holding unit 374 based on the corrected PCR calculated by the corrected PCR generation unit 372, and starts displaying the subtitles (similar to the character super). Then, the subtitle display ends with reference to the erasing timing.

The correction PCR generation unit 372 detects the program switch (change in the stream configuration of the broadcast program in one channel), the date and time PRSTS (the date and time based on the time of the server that creates the message management file), and the reproduction. Elapsed time from the program switching time to the date and time on the playback time axis (the date and time on the playback time axis. The date and time based on the server time for TS transcoding) The elapsed time of PCR is obtained, and the resolution of the program reference clock (for example, 90000/sec) is multiplied to this to obtain the elapsed clock. Further, the correction PCR generation unit 372 holds the PCR (PCRP) at the time of detecting the program change, and adds the elapsed clock based on this to calculate the correction PCR. Such a calculation method is shown in FIG. A specific calculation example is shown in FIG. The upper limit of PCR is "85899935102". Here, the exact time of the moving image is set to EXT-PROGRAM-DATE-TIME, and preferably, the time of the server that creates the HLS and TS transcodes and the server that creates the message management file is one frame unit. It is assumed that there is no gap. For program switching (change in stream structure of broadcast program in one channel), for example, the mobile terminal 300 detects that the version number value of the PMT (program map table) packet has changed and Detect. In a typical example, “pmt_changed” (see FIGS. 21 and 20 described later) is a message notifying that the PMT data has changed, and the server detection time is transferred to the message execution time in this message. To be done. Further, the server receives the PMT data extracted from the tuner, acquires the PCR from the description location of the PCR described in the PMT, and transfers it to the fourth column of the “pmt_changed” message as additional information. When the PMT indicates that the program has been switched (the stream configuration of the broadcast program in one channel has changed), the previous message management data may be cleared. FIG. 12 schematically shows an example of the correction PCR calculation operation.

It should be noted that the difference between the PTS (Presentation Time Stamp) and the real-time conversion location of the PCR is calculated, and the difference is added to the time when the PCR is received to be converted into the real-time, which is output to the message management file, and the PCR is The display/erasure of subtitles may be controlled in real time instead of based on the clock. When a button for advancing or delaying the timing of subtitles or the like is provided so that the subtitle display mode and timing can be finely adjusted, for example, each time the “+” button is operated, the correction PCR current A constant clock increment (ΔPCR, for example, 90,000 clocks per second) corresponding to a constant time increment is added to the value, and a constant time is added to the current value of the correction PCR each time the “−” button is operated. A fixed clock decrement (-ΔPCR) corresponding to the decrement may be added (subtracted), and when the "reset" button is operated, the original corrected PCR may be restored. Not limited to the correction PCR, the reference PCR set by a predetermined reference may be similarly increased or decreased.

Next, the button selection unit 391 of the user interface unit 390 of FIG. 6 will be described. FIG. 14 shows a display example of a television broadcast, and the document other than the video portion is a document described in BML. “A”, “B”, and “C” are operation buttons, and in relation to a normal television receiver, the cursor movement key of the remote controller is used to change the focus position from the button to the button, and finally the remote controller. Press the OK button to select the item. A key corresponding to the cursor movement key of the remote controller may be provided in the user interface unit 390 of the mobile terminal 300. In this embodiment, the item is selected when the target button is touched. The details will be described below.

FIG. 15 shows the BML document description of the display example of FIG. As can be seen, the description of the button element includes the style attribute “nav-index”. That is, in the example of FIG. 14, the description for displaying the buttons shown in (1), (2), and (3) includes the style attribute “nav-index” enclosed in (1) of FIG. In this example, if the description of the touched area includes the style attribute “nav-index”, it is determined that the style attribute is selectable, and the content is selected.

FIG. 13 shows an operation example of the button selection unit 391. As shown in FIG. 13, when a touch is detected, it is determined whether or not an element is detected in the area (step S01), and when it is not detected, the process is ended (on-screen display may be displayed. ), if detected, it is determined whether or not the focus movement description (description of the style attribute of “nav-index”) is included (step S02). If not detected, the process ends as it is, and if detected. Executes the instruction in the button description (step S03). After that, the button selection process ends.

Next, the barcode processing unit 392 of the user interface unit 390 of FIG. 6 will be described. FIG. 17 shows a state where a two-dimensional barcode image is displayed on the display unit of the mobile terminal 300. In a normal usage mode of a television receiver, a two-dimensional barcode image displayed on the screen of the television receiver is captured by a camera function of a mobile terminal or the like, and this is decoded by a barcode decoding function to obtain a URL. The browser is started based on the acquired URL to browse the content of the URL. In this embodiment, by touching the image display portion (portion (1) in FIG. 17) of the two-dimensional barcode on the display portion of the mobile terminal 300, the content of the URL can be browsed as it is. There is.

As shown in FIG. 16, when a touch is detected, it is determined whether or not an element is detected in the area (step S11), and when it is not detected, the process ends as it is (the on-screen display may be displayed. ), if detected, the element image is extracted and decoded by the two-dimensional decoding function, and it is determined whether the decoding is successful (step S12). If the decoding is unsuccessful, the process ends as it is, and if the decoding is successful, the decoded content (URL) is used to make the content viewable by the browser. After that, the barcode processing ends.

Of course, when the display unit is touched, the button selection process of FIG. 13 and the bar code process of FIG. 16 can be performed before and after.

This is the end of the description of the embodiment.

Next, a modified example of the above-described embodiment will be described.

FIG. 18 corresponds to FIG. 2, and corresponding parts are designated by corresponding reference numerals. In FIG. 18, not only synchronous data but also asynchronous data (BML document) is distributed to the mobile terminal 300 by long polling. That is, the data receiving unit 220 receives TS packets related to data other than video/audio, generates a processing management message for each TS packet, and holds the message in the message management file holding unit 270. , Which can be designated by a message is held in the data body storage management unit 280 by an address. The data distribution unit 250A uses the message management file (also referred to as message management data) to synchronize data such as subtitle data, character super data, and video/audio streams such as event messages, BML documents, EPG, and the like. Asynchronous data is delivered to the mobile terminal 300 by HTTP long polling.

FIG. 19 illustrates a processing flow example using caption data as an example. In the modification of FIG. 18, other data-related TS packets are processed in the same manner. In FIG. 19, the tuner of the broadcast wave receiving apparatus 100A of the broadcasting company system 100 receives the TS packet and supplies it to the TS separation program 100B of the broadcasting company system 100 (X01), and this TS separation program 100B converts the subtitle data. The data distribution server 200A of the distribution business system 200 transmits the TS packet (X02). The data distribution server 200A saves the subtitle data in the data body storage management unit 280, and correspondingly adds a new message to the message management data (message management file) in the message management file holding unit 270 and stores it. Update (X03). In the long polling process portion X04, the application 325A of the mobile terminal 300 first obtains the message management data (X05), and accordingly, the data distribution server 200A returns the latest message management data to the application 325A. (X06). The data distribution server 200A repeats returning the updated portion of the message management data to the application 325A each time it is updated (X07). The application 325A interprets the message management data acquired in steps X06 and X07 line by line, and if the message is a caption message, goes to the caption data acquired in step X03 (X08), and the data distribution server 200A responds accordingly. And sends the subtitle data to the application 325A (X09). The application 325A performs display processing at an appropriate timing based on the contents of the message management data and the caption data, and the caption is displayed to the user (X10, X11).

FIG. 20 shows an example of the message. As shown with reference to FIG. 3, the message has a message execution time in the first column (also called an ignition time) and a message type in the second column (entity). (Also referred to as type), the actual file name in the third column and the additional information in the fourth column are included (FIG. 20A). In the specific example of FIG. 20B, the message execution time is “2016-04-20T13:02:15.588+0900”, the message type is “cap_packet”, and the actual file name is “/tvmock/20160420/7fe4”. .7fe4.0420/cap/00055002” and does not include any additional information. The message type "cap_packet" indicates that the message is related to subtitles, and indicates that subtitle data is stored in the entity file name "/tvmock/20160420/7fe4.7fe4.0420/cap/00055002". .. The main message types are as shown in FIG. Although the message is formed for each TS packet of the data stream, the TS packet of the video/audio stream may be generated and used for management.

As described above, “pmt_changed” in FIG. 21 is used to control the display timing of subtitle data.

The present invention is determined based on the description of the claims, and is not limited to the specific configurations, problems, and effects of the embodiments. The present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the invention.

For example, although the above embodiments have been described with reference to the mobile terminal, the present invention may be widely applied to fixed terminals and television receivers. For example, button selection operation and bar code processing are performed with a touch panel. It can also be applied to a fixed terminal or a television receiver with a touch panel connected to the Internet.

The technical features described here will be listed below.
[Broadcast retransmission method]
[Technical features 1]
A video/audio stream transmitting means for transmitting the video/audio stream extracted from the broadcast stream to the terminal via the network in a streaming system,
A data stream transmitting means for transmitting the data stream extracted from the broadcast stream to the terminal via the network,
The data stream transmitting means is
Data stream storage means for storing the data stream in packet units,
Index file storage means for storing an index file for making the data stream stored in packet units accessible in packet units,
Means for transmitting the index file to the terminal via the network in response to polling from the terminal;
Means for transmitting the data stream stored in the data stream storage means to the terminal in packet units in response to a transfer request in packet units from the terminal using the index file transmitted to the terminal. A broadcasting service retransmitting device having.
[Technical features 2]
The broadcasting service re-transmission apparatus according to Technical Feature 1, further comprising: a unit that further includes a unit that extracts a video/audio stream and a data stream from the broadcast stream.
[Technical features 3]
3. The broadcast service retransmission device according to technical feature 1 or 2, wherein the data stream transmitted by the data stream transmitting means is a data stream synchronized with the video/audio stream.
[Technical Feature 4]
The broadcasting service retransmitting device according to the technical feature 1, 2, or 3, wherein the data stream transmitted by the data stream transmitting means is data content asynchronous with the video/audio stream.
[Technical features 5]
5. The broadcast service retransmission device according to any one of technical features 1 to 4, wherein the streaming method is a streaming method based on the HTTP protocol.
[Technical features 6]
The broadcast service retransmission device according to any one of technical features 1 to 5, wherein the polling is HTTP long polling.
[Technical features 7]
A terminal that can be connected to a network,
A video/audio stream receiving means for receiving, from a transmitting device, a video/audio stream extracted from a broadcast stream and transmitted via the network in a streaming system,
A data stream extracted from the broadcast stream and transmitted via the network, the data stream receiving means for receiving from the transmission device,
The data stream receiving means is
Index file receiving means for receiving, from the transmitting device by polling, an index file that makes the data stream stored in the transmitting device accessible in packet units,
A terminal for receiving the data stream stored in the transmitting device, in packet units, using the index file received by the index file receiving means.
[Technical feature 8]
The terminal according to Technical Feature 8, which performs communication based on mobile communication.
[Technical features 9]
A terminal that can be connected to the network
A video/audio stream receiving means for receiving, from a transmission device, a video/audio stream extracted from a broadcast stream and transmitted via the network in a streaming system, and
A computer program used to execute a data stream extracted from the broadcast stream and transmitted via the network, as data stream receiving means for receiving from the transmission device,
The data stream receiving means is
Index file receiving means for receiving, from the transmitting device by polling, an index file that makes the data stream stored in the transmitting device accessible in packet units,
The computer program, comprising means for receiving the data stream stored in the transmission device in packet units using the index file received by the index file receiving means.
[Element selection method]
[Technical features 1]
A display unit that displays a document written in a markup language,
A touch panel corresponding to the display unit,
A document browsing device having means for executing a command relating to the display element when the description of the document relating to the display element at a position corresponding to a touch operation on the touch panel includes an instruction regarding focus movement.
[Technical features 2]
The document browsing device according to technical feature 1, wherein the instruction regarding focus movement corresponds to a cursor movement key of a remote controller.
[Technical features 3]
The document browsing device according to any one of technical features 1 and 2, wherein the markup language is BML.
[Technical Feature 4]
Regarding a mobile terminal having a display unit for displaying a document described in a markup language and a touch panel corresponding to the display unit, focus movement is performed on the description of the document regarding a display element at a position corresponding to a touch operation on the touch panel. A computer program used to realize a means for executing an instruction regarding the display element when instructed.
[Bar code processing method]
[Technical features 1]
Display part,
A touch panel corresponding to the display unit,
Decoding means for decoding the barcode,
A display device having a unit for extracting an image at a position corresponding to a touch operation on the touch panel and decoding the image by the decoding unit.
[Technical features 2]
Display part,
A touch panel corresponding to the display unit,
A display device having means for extracting an image at a position corresponding to a touch operation on the touch panel and causing the barcode decoding means to decode the image.
[Technical features 3]
The display device according to technical feature 1 or 2, wherein the barcode is a two-dimensional barcode.
[Technical Feature 4]
4. The display device according to any one of technical features 1, 2 and 3 which executes processing based on the decoding result when the decoding by the decoding means is successful.
[Technical features 5]
The display device according to any one of technical features 1 to 4, wherein the decryption result is a URL, and the URL request is transmitted.
[Technical features 6]
The display device according to any one of technical features 1 to 5, which is configured by a mobile communication terminal.
[Technical features 7]
7. The display device according to any one of technical features 1 to 6 for displaying a document described in BML.
[Technical feature 8]
A mobile terminal having a display unit and a touch panel corresponding to the display unit,
A computer program used for realizing as a means for extracting an image at a position corresponding to a touch operation on the touch panel and causing the barcode decoding means to decode the image.
[Synchronization method]
[Technical features 1]
A terminal that can be connected to a broadcasting service retransmission device via a network,
Means for receiving a video/audio stream extracted from a broadcast stream and transmitted from the broadcast service retransmitting device via the network in a first method;
Means for playing back the video/audio stream,
A means for obtaining a date and time (reproduction time axis date and time) conforming to the broadcasting service retransmission device at the current reproduction time of the video/audio stream being reproduced,
When the program map table (PMT) indicates that the stream structure of the broadcast program in the channel has changed, the program reference clock (PCRP) obtained from the description of the PMT and the broadcast service transmission device that processes the PMT. Means for acquiring the date and time (PRSTS) in accordance with
Means for receiving a data stream synchronized with the video/audio stream extracted from the broadcast stream and transmitted via the network in a second method;
Means for calculating the number of clocks elapsed during the period based on the elapsed time from the PRSTS to the reproduction time axis date and time, and adding the calculated clock number to the PCRP to predict the program clock reference of the reproduction time axis date and time. ,
And a processing execution unit that executes processing of the data stream synchronized with the video/audio stream based on the predicted program clock reference.
[Technical features 2]
The terminal according to technical feature 1, wherein the data stream synchronized with the video/audio stream includes caption data, and the processing execution means reproduces the caption data.
[Technical features 3]
3. The terminal according to technical feature 1 or 2, wherein the data stream synchronized with the video/audio stream includes an event message, and the processing execution means processes the event message.
[Technical Feature 4]
The terminal according to any one of technical features 1 to 3, wherein the video/audio stream is an HTTP live streaming system stream.
[Technical features 5]
The terminal according to technical feature 4, wherein the reproduction time axis date and time is calculated by HPDT+MCT from EXT-PROGRAM-DATE-TIME (HPDT) and reproduction elapsed time (MCT) of the HLS file forming the video/audio stream.
[Technical features 6]
When the resolution of the program clock reference is FHz, the program clock reference of the above reproduction time axis date and time is
PCRP+(HPDT+MCT-PRSTS)×F
A terminal described in Technical Feature 5 calculated by.
[Technical features 7]
The terminal according to technical feature 6, wherein F is 90,000.
[Technical feature 8]
A terminal that can be connected to the broadcasting service retransmission device via a network,
Means for receiving a video/audio stream extracted from a broadcast stream and transmitted from the broadcast service retransmitting device via the network in a first method;
Means for playing back the video/audio stream,
A means for obtaining a date and time (reproduction time axis date and time) conforming to the broadcasting service retransmission device at the current reproduction time of the video/audio stream being reproduced,
When the program map table (PMT) indicates that the stream structure of the broadcast program in the channel has changed, the program reference clock (PCRP) obtained from the description of the PMT and the broadcast service transmission device that processes the PMT. Means for acquiring the date and time (PRSTS) in accordance with
Means for receiving a data stream synchronized with the video/audio stream extracted from the broadcast stream and transmitted via the network in a second method;
Means for calculating the number of clocks elapsed during the period based on the elapsed time from the PRSTS to the reproduction time axis date and time, and adding the calculated clock number to the PCRP to predict the program clock reference of the reproduction time axis date and time. ,
A computer program used for realizing as a process executing means for executing a process of a data stream synchronized with the video/audio stream based on the predicted program clock reference.
[Technical features 9]
A terminal that can be connected to a broadcasting service retransmission device via a network,
Means for receiving a video/audio stream extracted from a broadcast stream and transmitted from the broadcast service retransmission device in the first system via the network;
Means for playing the video/audio stream,
A means for obtaining a date and time (reproduction time axis date and time) conforming to the broadcast service retransmission device at the current reproduction time of the video/audio stream being reproduced,
A means for acquiring a program reference clock (PCRP) related to the predetermined event and a date and time (PRSTS) based on the broadcast service transmitting device on which the predetermined event is processed when the predetermined event occurs;
Means for receiving a data stream synchronized with the video/audio stream extracted from the broadcast stream and transmitted via the network in a second method;
A means for calculating the number of clocks elapsed during the period based on the elapsed time from the PRSTS to the reproduction time axis date and time and adding the calculated clock number to the PCRP to predict the program clock reference of the reproduction time axis date and time; ,
A terminal for performing processing of a data stream synchronized with the video/audio stream based on the predicted program clock reference.

100 Broadcaster System 110 Broadcast Video/Audio Extractor 120 Broadcast Data Extractor 200 Broadcaster System 210 Video/Audio Transcode Unit 220 Data Receiver 230 Data Management DB 240 240 Video/Audio Distributor 250 Synchronous Data Distributor 260 Asynchronous data delivery unit 270 Message management file holding unit 280 Data body storage management unit 300 Mobile terminal 310 Processing system 320 Memory 325 Application 360 Video/audio stream playback unit 370 Synchronous data playback unit 371 Subtitle display unit 372 Correction PCR generation unit 373 Message management File holding unit 374 Subtitle data holding unit 375 Polling control unit 380 Asynchronous data browsing unit 390 User interface unit 391 Button selection unit 392 Bar code processing unit

Claims (7)

A display unit for displaying images of TV broadcasts,
A touch panel corresponding to the display unit,
Decoding means for decoding the barcode,
Of the images of the television broadcast displayed on the display unit, when the image at the position corresponding to the touch operation on the touch panel is an element of the BML document, the image is extracted and is decoded by the decoding unit. And a display device for viewing television broadcast having. A display unit for displaying an image of a television broadcasting service distributed by IP retransmission,
A touch panel corresponding to the display unit,
When the image of the position corresponding to the touch operation on the touch panel is an element of the BML document among the images of the television broadcast displayed on the display unit, the image is extracted and is decoded by the barcode decoding means. A display device for viewing and listening to a television broadcast, comprising: The television broadcast viewing display device according to claim 1, wherein the barcode is a two-dimensional barcode. 4. The television broadcast viewing display device according to claim 1, wherein processing is executed based on the decoding result when the decoding by the decoding means is successful. The television broadcast viewing display device according to claim 1, wherein the decryption result is a URL, and the URL request is transmitted. The television broadcast viewing display device according to claim 1, comprising a mobile communication terminal. In a computer program used to realize a function for viewing a television broadcasting service distributed by IP retransmission, on a terminal having a display unit and a touch panel corresponding to the display unit,
The above terminal,
Further, decoding means for decoding the bar code, and
When the image of the position corresponding to the touch operation on the touch panel is an element of the BML document among the images of the television broadcasting service displayed on the display unit, the image is extracted and decoded by the decoding means. A computer program used to realize the means.

Images