JP4264043B2 - Subtitle information processing system and program - Google Patents

Description

  The present invention relates to a caption information processing system and program for processing caption information.

As a conventional technique, there is the following caption program data conversion device. In the caption program data conversion apparatus, the program clock reference (PCR) is extracted from the transport stream (TS) through the PCR filter 31, and the system time clock (STC) is reproduced by the STC reproduction 32. Based on this STC, a PTS generation 33 generates a caption display time stamp (PTS). This time stamp (PTS) is input to the buffer 34. Separately, NAB data is input. This is separated into subtitle data and time data by separation / transmission 35, the subtitle data is input to the buffer 34, and the time data is input to the clock 36. The clock 36 starts time counting by the start signal. This device compares the time with the time data, and outputs a trigger to the buffer 34 if they match.
Such a caption program data conversion device can broadcast a caption signal separately synchronized with a video / audio signal of digital broadcasting.
JP 2003-259212 A (first page, FIG. 1 etc.)

  However, in the conventional caption program data conversion device, it is not considered that a plurality of input workers share the caption input work in real time. Therefore, for example, it is not suitable for producing a program with real-time captions such as a news program.

  Further, in the conventional caption program data conversion device, when a plurality of input workers share the caption input work in real time, the ease of input by the worker is not considered. Therefore, for example, it is not suitable for producing a program with real-time captions such as a news program.

  In addition, in a caption information processing system including a plurality of caption information input devices and a caption information sending device in the past, consideration is given to maintainability when a plurality of caption information input devices are dynamically connected to the caption information processing system. Not. For this reason, it is not possible to easily cope with various systems and systems when subtitle information is given to various programs.

A closed caption information processing system according to a first aspect of the present invention is a closed caption information processing system having two or more input devices and a transmission device, wherein the input device transmits an input of closed caption information and the closed caption information. A subtitle information transmitting unit that receives the subtitle information transmitted by the two or more input devices; and the information input by the two or more input devices is different information. The subtitle information processing system includes a subtitle information transmission unit that sequentially transmits two or more subtitle information received by the subtitle information reception unit.
With this configuration, a plurality of input workers can share the subtitle input work in real time.

The subtitle information processing system according to the second aspect of the present invention is the subtitle information processing system according to the first aspect, wherein the input device includes an auxiliary subtitle information receiving unit that receives subtitle information received by another input device; The subtitle information processing system further includes an auxiliary subtitle information display unit that displays subtitle information received by the information receiving unit.
With such a configuration, a plurality of input workers can easily perform subtitle input work in real time.

The subtitle information processing system of the third invention is the subtitle information processing system of the second invention, further comprising an auxiliary device, wherein the subtitle information transmission unit receives the subtitle received by the receiving unit in the auxiliary device. The auxiliary subtitle information display unit displays the subtitle information received from another input device, and the auxiliary device displays the subtitle information from the input device. A display subtitle information receiving unit for receiving, and a subtitle information transfer unit for transmitting the subtitle information received by the display subtitle information receiving unit to an input device different from the input device that transmitted the subtitle information. 2. The closed caption information processing system according to 2.
The auxiliary device in the caption information processing system according to the third aspect of the present invention may further include a transmission caption information transmission unit that transmits the caption information received by the display caption information reception unit to the transmission device.
With such a configuration, maintainability when a plurality of caption information input devices are dynamically connected to the caption information processing system is greatly improved.

The subtitle information processing system according to the fourth aspect of the present invention is a subtitle information processing system having two or more sets of input systems each having a set of two or more input devices and auxiliary devices, and a sending device, A receiving unit that receives input of subtitle information, a subtitle information transmitting unit that transmits the subtitle information to the auxiliary device, an auxiliary subtitle information receiving unit that receives subtitle information received by another input device from the auxiliary device, The auxiliary subtitle information receiving unit includes an auxiliary subtitle information display unit that displays the subtitle information received, and the auxiliary device includes a display subtitle information receiving unit that receives subtitle information from the input device, and the display subtitle information. A subtitle information transfer unit that transmits the subtitle information received by the reception unit to an input device different from the input device that transmitted the subtitle information, and the transmission device transmits the subtitle information And subtitle information receiving unit that receives the subtitle information from the auxiliary device, two or more subtitle information the caption information receiving unit receives, successively, a subtitle information processing system comprising a subtitle information generating portion for sending.
With this configuration, subtitle information can be input in a shared manner in an input system in a plurality of districts.

The subtitle information processing system according to the fifth aspect of the present invention is the subtitle information processing system according to the fourth aspect of the present invention, further comprising an instruction device, wherein the instruction device includes two or more sets of input devices for inputting subtitle information. An instruction receiving unit that receives an input of an instruction as to whether or not to receive an instruction, and an instruction transmitting unit that transmits the instruction to one or more input devices of the two or more input devices. Is a subtitle information processing system including an instruction receiving unit that receives the instruction and an instruction output unit that outputs an instruction received by the instruction receiving unit.
With this configuration, each input system can function properly.

  INDUSTRIAL APPLICABILITY The present invention can provide a caption information processing system and the like in which a plurality of caption information input operators can share and perform caption work in real time.

Hereinafter, embodiments of a caption information processing system and the like will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.
(Embodiment 1)

  FIG. 1 is a block diagram of a caption information processing system in the present embodiment. The caption information processing system includes two or more input devices 11 (a plurality of input devices are appropriately represented as an input device 11 (1), an input device 11 (2)... Input device 11 (n)), and an auxiliary device. 12, a sending device 13, a sign language information input device 14, a synthesizing device 15, and a broadcasting device 16.

The input device 11 includes a reception unit 1101, subtitle information transmission unit 1102, auxiliary subtitle information reception unit 1103, auxiliary subtitle information display unit 1104, and subtitle information display unit 1105. The input device 11 is realized by, for example, a so-called personal computer.
The auxiliary device 12 includes a display subtitle information receiving unit 1201, a subtitle information transfer unit 1202, and a transmission subtitle information transmission unit 1203. The auxiliary device 12 is realized by, for example, a so-called personal computer.
The sending device 13 includes a caption information receiving unit 1301 and a caption information sending unit 1302. The sending device 13 is realized by, for example, a so-called workstation.
The sign language information input device 14 includes a sign language information input reception unit 1401 and a sign language information transmission unit 1402. The sign language information input device 14 is realized by a video camera, for example.
The synthesizing device 15 includes a sign language information receiving unit 1501, a caption information receiving unit 1502, a synthesizing unit 1503, and a synthetic information sending unit 1504. The synthesizing device 15 is realized by a down converter, for example.
The broadcasting device 16 includes a transmission information reception unit 1601 and a transmission information transmission unit 1602.

  The accepting unit 1101 accepts input of caption information. The language of subtitle information, the data structure, etc. are not ask | required. The input means is usually a keyboard or a numeric keypad, but may be anything such as a mouse or a menu screen. The accepting unit 1101 can be realized by a device driver for input means such as a keyboard, control software for a menu screen, or the like.

  The caption information transmission unit 1102 transmits the caption information received by the reception unit 1101. Here, only the auxiliary device 12 is suitable as the transmission destination, but the auxiliary device 12 and the other input device 11 or only the other input device 11 may be used. The caption information transmission unit 1102 holds in advance the IP address and the like (information for specifying the transmission destination) of the auxiliary device 12 that is the transmission destination. The caption information transmission unit 1102 is normally realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  The auxiliary caption information receiving unit 1103 receives the caption information received by the other input device 11. That is, it is for measuring the timing when the user of the input device 11 inputs the subtitle information based on the subtitle information received by the other input device 11. It is preferable that the auxiliary caption information receiving unit 1103 normally receives the caption information from the auxiliary device 12. However, the auxiliary caption information receiving unit 1103 may receive caption information directly from another input device 11. The auxiliary caption information receiving unit 1103 is normally realized by a wireless or wired communication unit, but may be realized by a broadcast receiving unit.

The auxiliary subtitle information display unit 1104 displays the subtitle information received by the auxiliary subtitle information reception unit 1103. The auxiliary caption information display unit 1104 may be considered as including or not including an output device such as a display. The auxiliary caption information display unit 1104 can be realized by output device driver software or output device driver software and an output device.
The caption information display unit 1105 displays the caption information received by the receiving unit 1101. Normally, the caption information display unit 1105 is realized by the same means as the auxiliary caption information display unit 1104.
The display caption information receiving unit 1201 receives caption information from two or more input devices 11. Display subtitle information receiving section 1201 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The caption information transfer unit 1202 transmits the caption information received by the display caption information receiving unit 1201 to an input device 11 different from the input device 11 that transmitted the caption information. The caption information transfer unit 1202 holds the IP addresses and the like (information specifying the transmission destination of caption information) of all the input devices 11 that can be the input device 11. For example, when the caption information processing system includes three input devices 11 (input device 11 (1), input device 11 (2), input device 11 (3)), the caption information transfer unit 1202 includes the input device 11 ( The caption information received from 1) is transmitted to the input device 11 (2) and the input device 11 (3). The caption information transfer unit 1202 is normally realized by a wireless or wired communication unit, but may be realized by a unit that receives a broadcast.

  The transmission subtitle information transmission unit 1203 transmits the subtitle information received by the display subtitle information reception unit 1201 to the transmission device 13. The sending caption information transmitting unit 1203 is normally realized by a wireless or wired communication means, but may be realized by a broadcasting means.

  The caption information receiving unit 1301 receives caption information received by two or more input devices 11. The subtitle information receiving unit 1301 preferably receives subtitle information from the auxiliary device 12, but may receive subtitle information directly from two or more input devices 11. The caption information receiving unit 1301 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

The caption information transmission unit 1302 sequentially transmits two or more pieces of caption information received by the caption information reception unit 1301. The subtitle information transmission unit 1302 normally transmits the subtitle information as soon as the subtitle information reception unit 1301 receives the subtitle information. The subtitle information transmission unit 1302 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.
The sign language information input reception unit 1401 receives input of sign language information that is video information of sign language. The sign language information input receiving unit 1401 can be realized by a CCD camera, for example.

  The sign language information transmission unit 1402 transmits the sign language information received by the sign language information input reception unit 1401 to the synthesis device 15. The sign language information transmission unit 1402 is normally realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  A sign language information receiving unit 1501 receives sign language information which is video information of sign language. Here, the reception may be reception, input reception, or reading from a storage medium. The sign language information receiving unit 1501 is realized by, for example, a wireless or wired communication unit.

  The caption information receiving unit 1502 receives caption information input from two or more input devices 11. The reception here also has the above-mentioned significance. The subtitle information receiving unit 1502 normally receives subtitle information from the transmission device 13. The caption information receiving unit 1502 is realized by, for example, a wireless or wired communication unit.

The combining unit 1503 combines the sign language information received by the sign language information receiving unit 1501 and the caption information received by the caption information receiving unit 1502 to constitute combined information. Note that the synthesis unit 1503 usually also synthesizes a program (video information and audio information constituting the program). Since such composition processing is an existing technology, detailed description thereof is omitted. The combining unit 1503 can be usually realized by an MPU, a memory, or the like. The processing procedure of the synthesizing unit 1503 is usually realized by software, and the software is recorded in a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit).
The synthesis information sending unit 1504 sends the synthesis information synthesized by the synthesis unit 1503. The composite information sending unit 1504 is normally realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

  The sending information receiving unit 1601 receives the combining information sent from the combining device 15. Further, the transmission information receiving unit 1601 may receive the caption information transmitted from the caption information transmitting unit 1302. In this case, the information transmitted by the transmission information transmission unit 1602 does not have sign language information. The sending information receiving unit 1601 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

The sending information sending unit 1602 sends the composite information received by the sending information receiving unit 1601. Further, the transmission information transmission unit 1602 may transmit only the caption information received by the transmission information reception unit 1601. The transmission referred to here is usually broadcasting, but may be transmission using communication means. The broadcast is terrestrial analog broadcast, terrestrial digital broadcast, satellite broadcast, Internet broadcast, CATV broadcast, or the like. The sending information sending unit 1602 is usually realized by broadcasting means, but may be realized by wireless or wired communication means.
The operation of the caption information processing system will be described below. First, the operation of the input device 11 will be described using the flowchart of FIG.
(Step S201) The reception unit 1101 determines whether or not input of caption information has been received. If the input of subtitle information is accepted, the process goes to step S202. If the input of subtitle information is not accepted, the process jumps to step S204.
(Step S202) The caption information display unit 1105 displays the caption information received in Step S201.
(Step S203) The caption information transmission unit 1102 transmits the caption information received in Step S201 to the auxiliary device 12. The process returns to step S201.

(Step S204) The auxiliary caption information receiving unit 1103 determines whether or not the caption information received by the other input device 11 has been received. If closed caption information is received, the process proceeds to step S205, and if closed caption information is not received, the process returns to step S201.
(Step S205) The auxiliary caption information display unit 1104 displays the caption information received in step S204. The process returns to step S201.

In the flowchart of FIG. 2, the process is terminated by powering off or a process termination interrupt. In the flowchart of FIG. 2, the caption information transmission unit 1102 may transmit caption information when the input caption information exceeds a predetermined size, or when input is not accepted for a predetermined time. In addition, it may be determined that it is a delimiter for inputting the subtitle information, and the subtitle information input so far may be transmitted. That is, the transmission timing of the caption information of the caption information transmission unit 1102 does not matter.
Next, operation | movement of the auxiliary | assistant apparatus 12 is demonstrated using the flowchart of FIG.
(Step 301) The display subtitle information receiving unit 1201 determines whether or not subtitle information has been received from the input device 11. If closed caption information is received, the process goes to step 302, and if closed caption information is not received, the process returns to step 301.
(Step 302) The subtitle information transmission unit 1203 for transmission transmits the subtitle information received in step 301 to the transmission device 13.

(Step 303) The caption information transfer unit 1202 determines the input device 11 that transfers the caption information received in Step 301. Such a determination is made as follows. For example, the caption information transfer unit 1202 holds all the IP addresses of the input devices 11 constituting the caption information processing system. Also, the subtitle information packet received by the display subtitle information receiving unit 1201 includes, for example, the IP address of the input device 11 that has transmitted the subtitle information in the source address area of the packet. Then, the caption information transfer unit 1202 acquires one or more IP addresses excluding the IP address included in the received packet from the IP addresses of all the input devices 11 held in advance, and the one or more IPs One or more input devices specified by the address are determined as the input device 11 that transfers the caption information.
(Step 304) The caption information transfer unit 1202 assigns 1 to the counter i.

(Step 305) The caption information transfer unit 1202 determines whether or not the i-th input device 11 to which caption information is to be transmitted exists. If the i-th input device 11 exists, the process goes to step 306. If the i-th input device 11 does not exist, the process returns to step 301.
(Step 306) The caption information transfer unit 1202 transmits the caption information received in Step 301 to the i-th input device 11.
(Step 307) The caption information transfer unit 1202 increments the counter i by 1. Return to step 305.
In the flowchart of FIG. 3, the process ends when the power is turned off or the process is terminated.
Next, the operation of the sending device 13 will be described. The caption information receiving unit 1301 of the sending device 13 receives the caption information from the auxiliary device 12, and the caption information sending unit 1302 sends the caption information to the synthesizing device 15.

  Next, the operation of the sign language information input device 14 will be described. The sign language information input reception unit 1401 of the sign language information input device 14 receives input of sign language information, and the sign language information transmission unit 1402 transmits the sign language information to the synthesis device 15. The sign language information is a moving image showing a person performing a sign language operation.

  Next, the operation of the synthesizing device 15 will be described. The sign language information receiving unit 1501 of the synthesis device 15 receives sign language information from the sign language information input device 14. The subtitle information receiving unit 1502 receives subtitle information from the transmission device 13. The combining unit 1503 combines the sign language information received by the sign language information receiving unit 1501 and the caption information received by the caption information receiving unit 1502 to constitute combined information. Further, the synthesis information sending unit 1504 sends the synthesis information synthesized by the synthesis unit 1503. The synthesizer 15 repeats the above processing. Note that the synthesis unit 1503 synthesizes the sign language information and the caption information in synchronization.

  Next, the operation of the broadcasting device 16 will be described. The sending information receiving unit 1601 receives the combining information sent from the combining device 15. Then, the sending information sending unit 1602 sends the composite information received by the sending information receiving unit 1601. The broadcast device 16 repeats such processing. Note that the broadcasting device 16 usually transmits information on the program body and caption information or / and sign language information.

  Hereinafter, a specific operation of the caption information processing system in the present embodiment will be described. A specific configuration of the caption information processing system is as shown in FIG. Here, the caption information processing system includes two input devices 11 (input device 11 (1) and input device 11 (2)), auxiliary device 12, router 41, router 42, sending device 13, sign language information input device 14, The relay apparatus 43, the synthesis apparatus 15, and the broadcasting apparatus 16 are provided. The relay device 43 plays a role of relaying caption information.

  FIG. 5 is an input device information management table held by the caption information transfer unit 1202 of the auxiliary device 12. The input device information management table holds a plurality of records having the name of the input device 11 and the IP address of the input device 11 for communicating with the input device 11. The input device information management table normally holds information on the input device 11 that may constitute a caption information processing system. Note that the IP address here is a local IP address, but any information that can communicate with the input device 11 such as a global IP address may be used.

  Further, it is assumed that the IP address of the auxiliary device 12 is “192.168.0.1”. Then, the input device 11 (1) of the input device 1 and the input device 11 (2) of the input device 2 store in advance the IP address “192.168.0.1” of the auxiliary device 12 that transmits the caption information. Yes.

  In such a situation, it is assumed that the user of the input device 1 has input subtitle information “Today's weather in Kansai. Then, the subtitle information transmission unit 1102 of the input device 1 transmits subtitle information “Today's weather in Kansai ...” to the auxiliary device 12. An example of data (packets) transmitted from the input device 1 to the auxiliary device 12 is shown in FIG. In FIG. 6, “SA” is the IP address of the input device 1, and “DA” is the IP address of the auxiliary device 12. That is, “SA” is a source address and “DA” is a destination address. The payload contains subtitle information. The subtitle information display unit 1105 displays the subtitle information received by the receiving unit 1101 "Today's weather in Kansai ...." (see FIG. 7). In FIG. 7, subtitle information input by the user of the input device is displayed in the upper window, and subtitle information received from other input devices is displayed in the lower window. At that time, it is preferable to devise such as changing the luminance in the upper and lower windows, changing the background color and the title bar color so that the upper window and the lower window can be clearly distinguished. This distinction of display modes is particularly effective when subtitle information is shared and input in real time.

  Next, the display caption information receiving unit 1201 of the auxiliary device 12 receives the data of FIG. Next, the subtitle information transmission unit 1203 for transmission of the auxiliary device 12 transmits subtitle information having data “Today's weather in Kansai....” To the transmission device 13.

  Next, the caption information transfer unit 1202 of the auxiliary device 12 extracts SA “192.168.0.2”. Next, the caption information transfer unit 1202 extracts IP addresses excluding SA “192.168.0.2” from the input device information management table of FIG. That is, the caption information transfer unit 1202 takes out the IP address “192.168.0.3”.

  Next, the caption information transfer unit 1202 of the auxiliary device 12 configures information to be transmitted to the input device 2 specified by the IP address “192.168.0.3”. The caption information transfer unit 1202 configures data shown in FIG. 8, for example. Then, the caption information transfer unit 1202 transmits the data illustrated in FIG. 8 to the input device 2. In this case, “DA” in the data of FIG. 8 is the IP address of the input device 2.

  Next, the auxiliary caption information receiving unit 1103 of the input device 2 receives the data of FIG. Next, the auxiliary caption information display unit 1104 of the input device 2 displays the data of FIG. 8 received by the auxiliary caption information reception unit 1103 (see FIG. 9). According to FIG. 9, it is understood for the user of the input device 2 what subtitle information is input by which user of the input device 11.

  Next, the user of the input device 2 looks at the display of the window below the screen of the input device 2, recognizes that the next is the order in which he / she inputs the subtitle information, and as shown in FIG. Enter the subtitle information “Sunny in Kyoto.

  In such a case, in the input device 11, when the user's input is started, when transmission of the caption information input by the user is started, during transmission of the caption information, or when transmission is completed, It is preferable to delete the received subtitle information (subtitle information displayed in the lower window). This is because the received subtitle information is displayed.

Then, the input device 2 transmits subtitle information “Kyoto Sunny. Osaka Cloudy Sunny....” To the auxiliary device 12. Next, the auxiliary device 12 receives the caption information “Kyoto Sunny. Osaka Cloudy Sunny....” And transmits it to the sending device 13. In addition, the input device 2 transmits subtitle information “Kyoto Sunny. Osaka Cloudy Sunny ....” to the input device 1.
Further, the input device 1 receives the subtitle information “Kyoto Sunny. Osaka Cloudy Sunny....” Input by the user of the input device 2 and displays it in the lower window (reception window).

In this way, in the input device 1 and the input device 2, the caption information input from another input device is received via the auxiliary device 12 and displayed. As a result, the user of the input device can input the subtitle information to be input by the user in a timely manner.
Next, the sending device 13 sequentially receives the caption information from the auxiliary device 12 and transmits it to the synthesizing device 15.
In addition, the sign language information input device 14 receives sign language information and transmits it to the synthesis device 15.

The synthesizing device 15 synthesizes the subtitle information and the sign language information to form the synthesis information. Note that the composite information may also include program information (here, video and sound of a weather forecast program). The program information is sent to the synthesizing device 15 by means not shown, and the synthesizing device 15 synthesizes the caption information, sign language information, and program information.
Next, the synthesis device 15 transmits the synthesis information to the broadcast device 16. Then, the broadcasting device 16 broadcasts the composite information. An example of composite information to be broadcast is shown in FIG.
As described above, according to the caption information processing system in the present embodiment, a plurality of input workers can share the caption input work. Therefore, it is particularly effective when subtitle information is transmitted in real time such as live broadcasting.

Also, according to the caption information processing system in the present embodiment, it is possible to input caption information while viewing caption information input by other users, so that a plurality of input workers share the caption input work in real time. It is easy for the operator to input when performing the operation.
Also, the caption information is not transmitted individually from all input devices to the transmission device, but the caption information is transmitted to the transmission device via the auxiliary device, so that the communication cost can be reduced.

In addition, the input device obtains subtitle information input from another input device via the auxiliary device, so that the input device does not need to know communication destination information such as the IP address of the other input device, and the entire system is maintained. Improves. If the input device transmits subtitle information directly to another input device, all the input devices need to register communication destination information for communicating with other input devices, which is inappropriate. . This is because the input device is often a device familiar to a specific user, and in such a case, the input devices constituting the system are often replaced. According to the caption information processing system of the present embodiment, only the auxiliary device or a server device (not shown) that can acquire communication destination information by communication registers the communication destination information of all input devices. As a result, the maintainability of the entire system is improved.
In the specific example of the present embodiment, there are two input devices, but it goes without saying that three or more input devices may be used. The same applies to other embodiments.

  Furthermore, the processing in the present embodiment may be realized by software. Then, this software may be distributed by software download or the like. Further, this software may be recorded and distributed on a recording medium such as a CD-ROM. This also applies to other embodiments in this specification. Note that the software that implements the input device according to the present embodiment is the following program. That is, the program includes a reception step of receiving subtitle information input to a computer, a subtitle information transmission step of transmitting the subtitle information, an auxiliary subtitle information reception step of receiving subtitle information received by another input device, A program for executing an auxiliary subtitle information display step for displaying the subtitle information received in the auxiliary subtitle information reception step. In the subtitle information transmission step, the program transmits the subtitle information received in the reception step to the auxiliary device, the subtitle information transmitted from the auxiliary device in the auxiliary subtitle information display step, The subtitle information received by the input device may be displayed.

Moreover, the software which implement | achieves the auxiliary | assistant apparatus in this Embodiment is the following programs. That is, this program is a display subtitle information receiving step for receiving subtitle information from the input device, and the subtitle information received in the display subtitle information receiving step to the computer. It is a program for executing a subtitle information transfer step to be transmitted to another input device. Further, the program may be a program for causing a computer to further execute a transmission subtitle information transmission step of transmitting the subtitle information received in the display subtitle information reception step to a transmission device.
(Embodiment 2)

  In the present embodiment, there will be described an aspect of a caption information processing system having an input system having two or more input devices and auxiliary devices at a plurality of points and having the plurality of input systems. In such a caption information processing system, an instruction device instructs which pair of two or more input devices accept input of caption information. With such a caption information processing system, collaboration of caption information input work at a plurality of points can be facilitated.

  FIG. 12 is a block diagram of the caption information processing system in the present embodiment. The caption information processing system includes two or more input devices 121 (a plurality of input devices are appropriately represented as input device 121 (1), input device 121 (2)... Input device 121 (n)) and an auxiliary device. Two or more sets 122 are provided, the sending device 13, the sign language information input device 14, the synthesizing device 15, the broadcasting device 16, and the instruction device 123.

  The input device 121 includes a reception unit 1101, subtitle information transmission unit 1102, auxiliary subtitle information reception unit 1103, auxiliary subtitle information display unit 1104, subtitle information display unit 1105, instruction reception unit 12101, and instruction output unit 12102. The input device 11 is realized by, for example, a so-called personal computer.

The auxiliary device 122 includes a display subtitle information receiving unit 1201, a subtitle information transfer unit 1202, a transmission subtitle information transmission unit 1203, and an instruction transfer unit 12201. The auxiliary device 122 is realized by, for example, a so-called personal computer.
The instruction device 123 includes an instruction reception unit 12301 and an instruction transmission unit 12302.

  The instruction receiving unit 12101 receives from the auxiliary device 122 an instruction as to which pair (input system) of two or more input devices accepts input of caption information. The data structure of the instruction does not matter. The instruction includes, for example, information indicating a district or a spot such as “Osaka district” or “Tokyo district” or a district ID. The instruction receiving unit 12101 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast.

  The instruction output unit 12102 outputs the instruction received by the instruction receiving unit 12101. Output is a concept that includes display on a display, sound output, transmission to an external device, and the like. The instruction output unit 12102 may or may not include an output device such as a display or a speaker. The instruction output unit 12102 can be implemented by output device driver software, or output device driver software and an output device.

  The instruction transfer unit 12201 receives an instruction from the instruction device 123 as to which set of two or more input devices accepts the input of subtitle information, and the instruction is subordinate (for example, connected to a LAN). Transfer to all input devices 121. The subordinate all input devices 121 are all input devices 121 that are managed, and are all input devices 121 constituting one input system. Note that the instruction transfer unit 12201 may not receive an instruction directly from the instruction device 123. That is, the instruction transfer unit 12201 may receive an instruction via a relay device (the relay device is, for example, the sending device 13). Further, for example, an instruction may be transmitted from the instruction device 123 to the transmission device 13 and accumulated, and the instruction transfer unit 12201 may acquire the instruction from the transmission device 13 periodically, for example. The instruction transfer unit 12201 is normally realized by a wireless or wired communication unit, but may be realized by a unit that transmits and receives a broadcast.

  The instruction receiving unit 12301 receives an input of an instruction as to which set of two or more input devices receives input of caption information. The instruction includes information for identifying the above set. The instruction input means may be anything such as a numeric keypad, a keyboard, a mouse, a menu screen, or an automatic input from a timer. The instruction receiving unit 12301 can be realized by a device driver of an input unit such as a numeric keypad or a keyboard, menu screen control software, or the like.

  The instruction transmission unit 12302 transmits the instruction received by the instruction reception unit 12301. The destination to which the instruction transmission unit 12302 transmits the instruction is, for example, all the auxiliary devices 122. However, the destination to which the instruction transmission unit 12302 transmits the instruction may be one or more auxiliary devices 122 of the auxiliary devices 122. The destination to which the instruction transmission unit 12302 transmits an instruction may be the sending device 13. In such a case, for example, the instruction is transmitted to the auxiliary device 122 via the sending device 13. Further, the instruction transmission unit 12302 may transmit the instruction to all the input devices 121 (an aspect in which the instruction transmission unit 12302 directly transmits to the input device 121). The instruction transmission unit 12302 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit.

The operation of the caption information processing system will be described below. First, the operation of the input device 121 will be described using the flowchart of FIG. In the flowchart of FIG. 13, only steps different from the flowchart of FIG. 2 will be described.
(Step S1301) It is determined whether or not the instruction receiving unit 12101 has received an instruction. If an instruction is received, the process goes to step S1302, and if no instruction is received, the process returns to step S201.
(Step S1302) The instruction output unit 12102 outputs the instruction received in step S1301. The process returns to step S201.
In the flowchart of FIG. 13, the process is terminated by powering off or a process termination interrupt.
Next, the operation of the auxiliary device 122 will be described using the flowchart of FIG. In the flowchart of FIG. 14, only steps different from the flowchart of FIG. 3 will be described.
(Step S1401) The instruction transfer unit 12201 determines whether an instruction is received from the instruction device 123. If an instruction is received, the process goes to step 1402, and if no instruction is received, the process returns to step 301.
(Step S1402) The instruction transfer unit 12201 substitutes 1 for a counter i.

(Step S1403) The instruction transfer unit 12201 determines whether or not the i-th input device 121 is present among the managed input devices. If the i-th input device 121 exists, the process goes to step 1404. If the i-th input device 121 does not exist, the process returns to step 301.
(Step S1404) The instruction transfer unit 12201 transmits the instruction received in step 1401 to the i-th input device 121.
(Step S1405) The instruction transfer unit 12201 increments the counter i by 1. Return to step 305.
In the flowchart of FIG. 14, the process is terminated by powering off or a process termination interrupt.

  Next, the operation of the instruction device 123 will be described. The instruction receiving unit 12301 of the instruction device 123 receives an input of an instruction including information indicating a point from the user, for example. Then, the instruction transmission unit 12302 transmits the instruction to all the auxiliary devices 122.

  Hereinafter, a specific operation of the caption information processing system in the present embodiment will be described. The specific configuration of the caption information processing system is as shown in FIG. Here, the subtitle information processing system includes three sets of input systems including two input devices 121, an auxiliary device 122, and a router 41, a router 42, a transmission device 13, a sign language information input device 14, a relay device 43, and a synthesis device 15. A broadcasting device 16 and an instruction device 123. The relay device 43 plays a role of relaying caption information between the sending device 13 and the synthesizing device 15. The relay device 43 may also play a role of relaying instructions.

  Here, the input system is a system divided into three areas of “Tokyo”, “Osaka 1”, and “Osaka 2”. Each input system has two input devices 121, but may have three or more input devices 121. The input system of “Tokyo” includes an input device 121 (11), an input device 121 (12), an auxiliary device 122 (1), and a router 41 (1). “Osaka 1” and “Osaka 2” are as shown in FIG.

  As described in the specific example of the first embodiment, each auxiliary device 122 manages an IP address and the like for communicating with the input device 121 connected via the LAN (see FIG. 15). . In addition, each auxiliary device 122 holds the IP address of the transmission device 13 and the like, and is in a situation in which caption information can be transmitted to the transmission device 13.

  In such a situation, it is assumed that broadcasting of a 30-minute program has started. In such a case, it is assumed that the commercial is inserted after about 10 minutes and after about 20 minutes. Subtitle information is input from the input device 121 in the “Tokyo” area for the first approximately 10 minutes, and subtitle information is input from the input device 121 in the “Osaka 1” area for the next approximately 10 minutes, and the last approximately 10 minutes. Suppose that subtitle information is input from the input device 121 in the “Osaka 2” area.

  First, it is assumed that the user inputs an instruction including “Tokyo” from the instruction device 123. In such a case, for example, an instruction including “Tokyo” is transmitted from the instruction device 123 to the three auxiliary devices 122 (1), 122 (2), and 122 (3) via the relay device 43. Next, an instruction including “Tokyo” is transmitted from the three auxiliary devices 122 (1), 122 (2), and 122 (3) to all the input devices 121 in each region. Here, for example, it is assumed that the auxiliary device 122 (1) in the “Tokyo” district holds the input device information management table of FIG. The instruction transfer unit 12201 of the auxiliary device 12 receives an instruction including “Tokyo”. Next, the instruction transfer unit 12201 of the auxiliary device 12 instructs the input device 1 (input device 121 (11)) and the input device 2 (input device 121 (12)) managed in FIG. 5 to include “Tokyo”. Send. Then, the input device 1 and the input device 2 receive the instruction including “Tokyo” (see FIG. 16) and display it. With this display, the users of the input device 121 in the “Tokyo” area know that they must input subtitle information, and the users of the input devices 121 in the “Osaka 1” and “Osaka 2” areas Know that you don't need to enter subtitle information.

  Next, it is assumed that the user of the input device 121 (11) in the “Tokyo” area inputs, for example, subtitle information “Today, a fireworks display was held in Edogawa. Then, the input device 121 (11) transmits the subtitle information “Today a fireworks display was held in Edogawa....” To the auxiliary device 122 (1). Then, the auxiliary device 122 (1) receives the subtitle information “Today a fireworks display was held in Edogawa....” And transfers it to the auxiliary device 122 (2). Since this process is the same as the caption information process described in the first embodiment, a detailed description thereof will be omitted. Note that FIG. 17 shows a screen display example of the input device 121 (11) and the input device 121 (12). A screen display example of the input device 121 (11) is FIG. 17A, and a screen display example of the input device 121 (12) is FIG. 17B. Each of the input devices 121 includes an instruction display window for displaying instructions, an input window for displaying subtitle information input by the input device 121, and a stranger information display window for displaying subtitle information received from other input devices. In the input of subtitle information using the input device 121, the user normally inputs subtitle information while listening to the audio of the program. The same applies to the first embodiment.

  Next, after about 10 minutes, the user inputs an instruction having “Osaka 1” to the instruction device 123. Then, the instruction device 123 receives an instruction having “Osaka 1” and transmits the instruction to all the auxiliary devices 122. Then, each auxiliary device 122 transfers an instruction to the managed input device 121 connected thereto.

  Each input device 121 displays an instruction having “Osaka 1” in the instruction display window by the same processing as described above. Then, the user of the input device 121 of “Osaka 1” knows that it is the order of inputting the subtitle information and prepares. In addition, the users of the input device 121 in the “Tokyo” area know that their input work is finished and that they can take a break.

  Then, processing in which subtitle information input from all input devices 121 is transmitted to the sending device 13 via the auxiliary device 122, or processing in which the sign language information input device 14 receives sign language information and transmits it to the synthesizing device 15. Since the synthesizing device 15 synthesizes subtitle information and sign language information and composes the synthesizing information, the broadcasting processing of the broadcasting device 16 and the like are the same as the processing described in the first embodiment, description here Is omitted.

As described above, according to the caption information processing system in the present embodiment, caption information input workers (users) in a plurality of districts can appropriately share and input caption information. Although such an input system exists for each of a plurality of districts, the caption information processing system has the following advantages. That is, considerable skill is required to input subtitle information. Such skilled subtitle information input operators are distributed throughout Japan, for example. Since it is difficult to collect such skilled workers in one place, it is preferable that a caption information processing system exists for each of a plurality of districts.
In each district, a plurality of input workers can share the subtitle input work. Therefore, it is particularly effective when subtitle information is transmitted in real time such as live broadcasting.

Also, according to the caption information processing system in the present embodiment, it is possible to input caption information while viewing caption information input by other users, so that a plurality of input workers share the caption input work in real time. It is easy for the operator to input when performing the operation.
Also, the caption information is not transmitted individually from all input devices to the sending device, but the caption information is sent to the sending device via the auxiliary device, so that the communication cost can be reduced.

  In addition, the input device obtains subtitle information input from another input device via the auxiliary device, so that the input device does not need to know communication destination information such as the IP address of the other input device, and the entire system is maintained. Improves. If the input device transmits subtitle information directly to another input device, all the input devices need to register communication destination information for communicating with other input devices, which is inappropriate. . According to the caption information processing system of the present embodiment, only the auxiliary device or a server device (not shown) that can acquire communication destination information by communication registers the communication destination information of all input devices. As a result, the maintainability of the entire system is improved.

  In this embodiment, the user inputs an instruction to the pointing device, but the pointing device may automatically accept the instruction. For example, the instruction device stores schedule information indicating the broadcast schedule of the program shown in FIG. In FIG. 18, the schedule information includes “time”, “program information”, and “instruction”. The instruction device holds a clock and transmits an instruction to each auxiliary device based on the clock and schedule information. That is, the instruction device transmits the instruction “Tokyo” to each auxiliary device at 18:00. Also, an instruction “break” is transmitted to each auxiliary device at 18:10. Further, an instruction “Osaka 1” is transmitted to each auxiliary device at 18:11. When the instruction “break” is displayed, the user of the input device 121 knows that no one needs to input subtitle information at present.

  Further, in the present embodiment, the instruction may be transmitted from the instruction device 123 to the transmission device 13, and the transmission device 13 may accumulate and hold the instruction. Each auxiliary device 122 may periodically obtain instructions stored in the sending device 13. By performing such processing, even when the number of input systems (districts) is dynamically changed, it is not necessary to change the management information of each auxiliary device 122 in the sending device 13, and the maintainability is excellent. The management information of the auxiliary device 122 is, for example, the IP address of the auxiliary device 122. In such a case, each auxiliary device 122 only needs to store the IP address or the like of the sending device 13 that is fixedly installed.

  As described above, the caption information processing system according to the present invention has an effect that a plurality of input workers can share and perform caption input work, and is particularly useful as a broadcasting system or the like that performs input work in real time. It is.

Block diagram of caption information processing system in Embodiment 1 Flow chart for explaining the operation of the input device Flow chart for explaining the operation of the auxiliary device The figure which shows the specific structure of the subtitle information processing system The figure which shows the same input device information management table The figure which shows the example of data transmitted to the auxiliary device from the input device The figure which shows the example of a display of the input device A diagram showing an example of data transferred by the auxiliary device The figure which shows the example of a display of the input device The figure which shows the example of a display of the input device The figure which shows the example of the synthetic information which broadcasts Block diagram of a caption information processing system in Embodiment 2 Flow chart for explaining the operation of the input device Flow chart for explaining the operation of the auxiliary device The figure which shows the specific structure of the subtitle information processing system The figure which shows the example of a display of the input device The figure which shows the example of a display of the input device The figure which shows the schedule information storage table which shows the broadcast schedule of the program

Explanation of symbols

11, 121 Input device 12, 122 Auxiliary device 13 Sending device 14 Sign language information input device 15 Synthesizer device 16 Broadcast device 123 Instruction device 1101 Accepting unit 1102 Subtitle information transmitting unit 1103 Auxiliary subtitle information receiving unit 1104 Auxiliary subtitle information display unit 1105 Subtitle information Display unit 1201 Display subtitle information reception unit 1202 Subtitle information transfer unit 1203 Transmission subtitle information transmission unit 1301 Subtitle information reception unit 1302 Subtitle information transmission unit 1401 Sign language information input reception unit 1402 Sign language information transmission unit 1501 Sign language information reception unit 1502 Subtitle information Accepting unit 1503 Combining unit 1504 Combining information sending unit 1601 Sending information receiving unit 1602 Sending information sending unit 12101 Instruction receiving unit 12102 Instruction output unit 12201 Instruction transferring unit 12301 Instruction receiving unit 12302 Instruction sending unit

Claims (9)

A subtitle information processing system having two or more sets of input systems having a pair of two or more input devices and auxiliary devices, and a sending device and a pointing device ,
The pointing device is
An instruction receiving unit that receives an input of an instruction as to whether or not a pair of two or more input devices receives an input of subtitle information;
An instruction transmission unit that transmits the instruction to one or more input devices of the two or more input devices;
The input device is:
A reception unit that accepts input of subtitle information;
A subtitle information transmission unit for transmitting the subtitle information to the auxiliary device;
An auxiliary subtitle information receiving unit for receiving subtitle information received by another input device from the auxiliary device;
An auxiliary subtitle information display unit for displaying the subtitle information received by the auxiliary subtitle information reception unit ;
An instruction receiving unit for receiving the instruction;
An instruction output unit for outputting the instruction received by the instruction receiving unit ;
The auxiliary device is
Display subtitle information receiving unit for receiving subtitle information from the input device;
A subtitle information transfer unit that transmits the subtitle information received by the display subtitle information receiving unit to an input device different from the input device that transmitted the subtitle information;
The sending device is
Subtitle information receiving unit for receiving subtitle information transmitted from the two or more input devices from the auxiliary device;
A caption information processing system comprising: a caption information transmission unit that sequentially transmits two or more pieces of caption information received by the caption information reception unit. The pointing device is
Means for storing schedule information indicating a broadcast schedule of the program;
The caption information processing system according to claim 1, wherein the instruction is transmitted based on the schedule information. The caption information processing system further includes a synthesis device,
The synthesizer is
A sign language information receiving unit for receiving sign language information which is video information of sign language;
Subtitle information receiving unit that receives subtitle information input from the two or more input devices;
A combining unit that combines the sign language information received by the sign language information receiving unit and the subtitle information received by the subtitle information receiving unit;
Claim 1 or claim 2 subtitles information processing system according comprises combining information sending unit further sends the combined information. The caption information processing system further includes a broadcasting device,
The broadcasting device is:
Subtitle information sent by the subtitle information sending unit, or a sending information receiving unit that receives synthesized information sent by the synthesizing device;
4. The caption information processing system according to claim 1, further comprising: a transmission information transmission unit configured to transmit the caption information received by the transmission information reception unit or the synthesis information. 5. The input device which comprises the closed caption information processing system in any one of Claims 1-4 . 5. A transmission apparatus constituting the caption information processing system according to claim 1 . The auxiliary | assistant apparatus which comprises the closed caption information processing system in any one of Claims 1-4 . The instruction | indication apparatus which comprises the closed caption information processing system in any one of Claims 1-4 . On the computer,
A reception step for receiving input of subtitle information;
Subtitle information transmission step for transmitting the subtitle information;
Auxiliary subtitle information receiving step for receiving subtitle information received by another input device;
An auxiliary subtitle information display step for displaying the subtitle information received in the auxiliary subtitle information reception step ;
An instruction receiving step for receiving an instruction as to which set of two or more input devices accepts input of subtitle information;
A program for executing an instruction output step for outputting the instruction received in the instruction receiving step .

Images