JP4832465B2 - Media multiplexing transmission system and multiplexing apparatus - Google Patents

Description

  The present invention relates to a media multiplex transmission system and a multiplexing apparatus for transmitting media multiplexed data such as encoded video and audio by redundant switching.

  In a transmission system having a redundant switching function of transmission data, it is common to detect the occurrence of abnormality by encoding or the like and perform redundant switching within one device (see, for example, Patent Document 1). For example, in a surveillance system that installs multiple cameras and microphones at remote locations and transmits each video and audio to a remote center, each media for multiplexing video and audio near the camera and microphone A delivery device is provided.

JP 2000-78241 A

  In a plurality of media sending devices in the above monitoring system, detection of anomalies due to encoding is performed by each media sending device. Therefore, when redundant switching of media multiplexed data output from each media sending device is performed at one place, redundancy switching is performed. Therefore, it is necessary to transmit the abnormality detection data for the redundant switching devices at different distances from each media sending device. For this purpose, it has been necessary to send the signal using a signal line different from the media multiplexed data. However, in such a case, there are problems that a number of dedicated signal lines are required and there is a laying work for that purpose. Further, the distance between the media sending device and the redundant switching device by the signal line has to be a distance that does not cause a delay in redundant switching, and there is a problem that the installation location of the redundant switching device is restricted. In addition, it is necessary to make settings on the side of the media sending device that generates the redundancy switching signal for detailed designation of the redundancy switching condition considering the line status, equipment quality, user usage status, and user desired settings. Minute setting was required.

  The present invention has been made to solve the above-described problems. A device having a redundant switching function can be freely set regardless of the distance from a plurality of media sending devices without using a dedicated signal line for redundant switching. An object of the present invention is to obtain a media multiplex transmission system and a multiplexing device used in the system.

  The transmission system of the present invention encodes at least video and audio to generate video data and audio data, and at that time, detects abnormalities due to video and audio encoding and generates respective abnormality detection data. Video data, audio data, anomaly detection data, a plurality of media sending devices that generate a transmission stream, and a plurality of media sending devices received via each line, video data, audio data, Separate the anomaly detection data, compare the anomaly detection data between multiple separated media sending devices, select video data and audio data from the media sending device with good transmission conditions, and select the selected video data and audio data Multiplexing is performed again to generate a transmission stream, and the transmission stream is transmitted to the media via a line different from the above line. Those having a multiplexer to be transmitted to the communication apparatus.

  According to the present invention, each media sending device multiplexes data in which an abnormality due to encoding of video, audio, etc. is detected with data such as video, audio, etc., to be transmitted, and sends it to a multiplexing device having a redundancy switching function. Since it is used for redundancy switching after being separated by a multiplexing device, a redundant switching dedicated signal line is not required and redundancy switching delay does not occur, so multiplexing without considering the distance from the media sending device Redundancy switching can be performed by installing a device.

Embodiment 1 FIG.
1 is a block diagram showing an overall configuration of a media multiplex transmission system according to Embodiment 1 of the present invention.
In the figure, the media multiplex transmission system has a main configuration including media sending devices 7 and 8, a multiplexing device 11, and a media receiving device 13. The media sending devices 7 and 8 have equivalent functions. For the media sending device 7, a video output device 1 that outputs a video signal from a camera or the like, and an audio output device that outputs an audio signal from a microphone or the like. 2. An event information output device 3 for outputting various instruction data is connected. Similarly, a video output device 4, an audio output device 5, and an event information output device 6 are also connected to the media transmission device 8. The multiplexing device 11 is installed at a location distant from the media sending devices 7 and 8 and transmits multiplexed media information (hereinafter referred to as a transmission stream) to be sent to and from the media sending devices 7 and 8, respectively. Wired lines A and B are provided. In addition, a line C for transmitting a transmission stream sent from the multiplexer 11 is provided between the multiplexer 11 and the media receiver 13. Connected to the media receiver 13 are a video display device 14 that displays a video signal separated from the received transmission stream, an audio output device 15 that converts an audio signal into audible sound, and an event information receiver 16 that receives event information. ing.
In the configuration example of this media multiplex transmission system, two media sending devices 7 and 8 and one media receiving device 13 are shown, but the number is not limited.

Next, the general operation of the media multiplex transmission system will be described.
The media transmission device 7 receives video data from the video output device 1, audio data from the audio output device 2, and event information from the event information output device 3. The inputted media information is multiplexed by the media sending device 7 to be formed into a predetermined transport stream (for example, H.222 Transport Stream of TTC standard) and sent to the multiplexing device 11 via the line A. Similarly, video data from the video output device 4, audio data from the audio output device 5, and event information from the event information output device 6 are also input to the media sending device 8. The inputted media information is multiplexed by the media sending device 8 and formed into a transmission stream, and then sent to the multiplexing device 11 via the line B. Multiplexer 11 selects one of the media information transmission streams input via lines A and B, respectively, and transmits the selected stream to media receiver 13 via line C. The media receiver 13 separates the received media multiplexed data into video data, audio data, and event information. The separated video data is given to the video display device 14 and displayed as a visible video. The audio data information is given to the audio reproduction device 15 and recognized as audible audio. The event information is given to the event information receiving device 16 and used for a predetermined instruction operation.

The media sending apparatus in FIG. 1 has a functional configuration as shown in FIG. Since the media sending devices 7 and 8 have the same configuration of FIG. 2 and perform the same operation, an example of the media sending device 7 will be described here.
The media sending device 7 includes a video encoding unit 21, an audio encoding unit 22, an event information encoding unit 23, a video abnormality detection unit 24, an audio abnormality detection unit 25, an event information abnormality detection unit 26, and a media multiplexing unit 27. ing.

Next, the operation of the media sending device will be described.
When receiving the video signal from the video output device 1, the video encoding unit 21 performs transmission format conversion (encoding) and sends the converted video data to the media multiplexing unit 27. Also, the validity of the data is checked at the time of transmission format conversion, and if there is an abnormality, the video abnormality detection unit 24 converts the determination result into video abnormality detection data and sends it to the media multiplexing unit 27. When receiving the audio signal from the audio output device 2, the audio encoding unit 22 performs transmission format conversion, and sends the converted audio data to the media multiplexing unit 27. At the time of transmission format conversion, the validity of the data is checked, and if there is an abnormality, the audio abnormality detection unit 25 converts the determination result into audio abnormality detection data and sends it to the media multiplexing unit 27. When receiving event information from the event information output device 3, the event information encoding unit 23 performs transmission format conversion and sends the converted event information data to the media multiplexing unit 27. At the time of transmission format conversion, the validity of the data is checked. If there is an abnormality, the event information abnormality detection unit 26 converts the determination result into event information abnormality detection data and sends it to the media multiplexing unit 27.

  In the media multiplexing unit 27, video data, audio data, event information data input from the encoding units 21, 22, 23, and video abnormality detection data and audio abnormality detection input from the detection units 24, 25, 26 are detected. A transmission stream is generated by multiplexing data and event information abnormality detection data. The media information transmission stream generated by the media sending device 7 is transmitted to the multiplexing device 11 via the line A.

The multiplexing apparatus in FIG. 1 has a functional configuration as shown in FIG.
The multiplexing device 11 includes separation units 31 and 32, media abnormality detection units 33 and 34, a switching determination unit 35, a switching unit 36, data buffers 37 and 38, a switching condition input unit 39, and a media multiplexing unit 40.
Next, the operation of the multiplexing device will be described.
In the separation unit 31, an abnormality information portion (packet) including video abnormality detection data, audio abnormality detection data, and event information abnormality detection data from the media information transmission stream received from the media transmission device 7 via the line A, and video It is divided into media information parts (packets) including data, audio data, and event information data. The separated abnormality information portion is provided to the media abnormality detection unit 33, and the media information portion is provided to the data buffer 37. The media abnormality detection unit 33 decodes the separated abnormality information part to detect video abnormality detection data, audio abnormality detection data, and event information abnormality detection data from the media transmission device 7, and outputs them to the switching determination unit 35. In the data buffer 37, the media information part is stored for delay so as not to be transmitted to the switching unit 36 before performing redundancy switching.
On the other hand, the separation unit 32, the media abnormality detection unit 34, and the data buffer 38 similarly perform the same processing on the transmission stream of media information received from the media transmission device 8 via the line B.

  In the switching determination unit 35, the video abnormality detection data, audio abnormality detection data, event information abnormality detection data, and media abnormality detected by the media abnormality detection unit 33 based on the switching conditions input and set in advance by the switching condition input unit 39. The switching unit 36 receives a control signal for selecting the media information portion from the media sending apparatus that compares the video abnormality detection data, audio abnormality detection data, and event information abnormality detection data detected by the detection unit 34 and has little influence on media reproduction. Output. The switching unit 36 selects the media information portion stored in the data buffer 37 or 38 based on the control signal from the switching determination unit 35. The media multiplexing unit 40 generates a transmission stream using the media information part selected by the switching unit 36, that is, video data, audio data, and event information data, and transmits the transmission stream to the media reception device 13 via the line C. That is, the transmission data having the least influence on media reproduction is selected from the transmission streams of the media information portion of the media sending devices 7 and 8 and transmitted to the media receiving device 13 via the line C. Here, the switching condition set by the switching condition input unit 39 may be set so that optimum redundancy switching can be performed according to the line state, the equipment quality, the user usage status, and the user's request.

As described above, according to the first embodiment, in each media sending device, data in which an abnormality is detected due to encoding of video, audio, and event information is transmitted as data of video, audio, and event information to be transmitted. The data is multiplexed and sent to a multiplexing device having a redundancy switching function, and separated by the multiplexing device and used for redundancy switching. Therefore, a signal line dedicated for redundancy switching is not required, and delay of redundancy switching does not occur. Therefore, it is possible to perform redundancy switching by installing a multiplexing device without considering the distance from the media sending device. In addition, the redundancy switching conditions are changed in detail in one multiplexing device according to the line status, equipment quality, user usage status, and user preferences, so the delivery quality to the receiving user is improved and the user needs are met. Therefore, it is possible to easily customize the redundancy switching condition.
Note that IP (Internet Protocol) transmission paths may be applied as the lines A, B, and C in the configuration of FIG. 1, and in that case, without considering the installation locations of the media sending device and the multiplexing device. It is possible to configure a media multiplex transmission system in which the redundancy switching condition can be controlled only by the multiplexing device.
The present invention is also applicable to a broadcasting system that performs redundant switching from a remote location using a plurality of lines.

It is a block diagram which shows the whole structure of the media multiplex transmission system by Embodiment 1 of this invention. It is a block diagram which shows the function structure of the media transmission apparatus which concerns on Embodiment 1 of this invention. It is a block diagram which shows the function structure of the multiplexing apparatus which concerns on Embodiment 1 of this invention.

Explanation of symbols

  1, 4 Video output device, 2, 5 Audio output device, 3, 6 Event information output device, 7, 8 Media sending device, 11 Multiplexing device, 13 Media receiving device, 14 Video display device, 15 Audio playback device, 16 Event information receiving device, 21 Video encoding unit, 22 Audio encoding unit, 23 Event information encoding unit, 24 Video abnormality detection unit, 25 Audio abnormality detection unit, 26 Event information abnormality detection unit, 27, 40 Media multiplexing unit, 31, 32 Separation unit, 33, 34 Media abnormality detection unit, 35 Switching determination unit, 36 Switching unit, 37, 38 Data buffer, 39 Switching condition input unit, A, B, C line.

Claims (8)

At least video and audio are encoded to generate video data and audio data. At that time, abnormalities due to video and audio encoding are detected to generate respective abnormality detection data, and these video data, audio data, A plurality of media sending devices that multiplex anomaly detection data and generate a transmission stream;
Separate the video data, audio data, and abnormality detection data from the transmission streams of the plurality of media transmission devices received via the respective lines, and compare the abnormality detection data between the separated media transmission devices. Select video data and audio data from a media sending device with good transmission conditions, re-multiplex the selected video data and audio data to generate a transmission stream, and transmit the transmission stream to a medium via a line different from the line. A media multiplex transmission system comprising a multiplexing device for transmission to a receiving device. Video, audio, and event information is encoded to generate video data, audio data, and event information data. At that time, anomalies due to encoding of video, audio, and event information are detected, and each abnormality detection data is detected. A plurality of media sending devices that multiplex these video data, audio data, event information data, and abnormality detection data to generate a transmission stream;
  Video data, audio data, event information data, and abnormality detection data are separated from the transmission streams of the plurality of media transmission devices received via the respective lines, and abnormality detection between the plurality of separated media transmission devices is performed. Compare the data and select video data, audio data, and event information data from a media sending device with good transmission conditions, and re-multiplex the selected video data, audio data, and event information data to generate a transmission stream A media multiplex transmission system comprising a multiplexing device for transmitting the transmission stream to a media receiving device via a line different from the line.   Judgment by comparison of abnormality detection data between multiple media sending devices in the multiplexing device is made based on the switching conditions set according to the line status, equipment quality, user usage status, and user preferences. The media multiplex transmission system according to claim 1 or 2, characterized in that   The media multiplex transmission system according to any one of claims 1 to 3, wherein an IP transmission path is used instead of each line. Encoded video data, audio data, and transmission streams obtained by multiplexing anomaly detection data by encoding these video and audio data are received from a plurality of media transmission devices via respective lines,
Separate video data, audio data and anomaly detection data from each received transmission stream,
Compare the abnormality detection data between the plurality of separated media sending devices, and select video data and audio data from the media sending device with good transmission conditions,
The selected video data and audio data are multiplexed again to generate a transmission stream,
A multiplexing apparatus, wherein the generated transmission stream is transmitted to a media receiving apparatus via a line different from the input line. Receives encoded video data, audio data, and event information data, as well as a transmission stream that multiplexes anomaly detection data by encoding these video, audio, and event information, from multiple media transmission devices via each line. And
  Separate video data, audio data, event information data, and anomaly detection data from each received transmission stream,
  Compare the abnormality detection data between the plurality of separated media sending devices, and select video data, audio data, and event information data from the media sending device with good transmission conditions,
  The selected video data, audio data, and event information data are multiplexed again to generate a transmission stream,
  A multiplexing apparatus, wherein the generated transmission stream is transmitted to a media receiving apparatus via a line different from the input line.   The determination based on comparison of abnormality detection data among a plurality of media transmission devices is performed based on a switching condition set according to a line state, equipment quality, user usage status, and user desire. Item 7. The multiplexing device according to item 5 or item 6.   8. The multiplexing apparatus according to claim 5, wherein an IP transmission path is used instead of each line.

Images