JP6576974B2 - Image composition system for monitor and image composition method for monitor - Google Patents

Description

  The present invention relates to a monitor image composition system and a monitor image composition method, and more particularly to a monitor image composition system and a monitor for use in a monitor system used for image composition and monitoring of broadcasting station materials and operation data. The present invention relates to an image composition method.

  In recent years, a monitor system for monitoring material and operation data in a broadcasting station is also described in Japanese Patent Application Laid-Open No. 2015-096920 “Image Processing Apparatus and Image Processing System Control Method”. In addition, a mechanism is used in which video and audio level bar images relating to a plurality of materials for monitoring are collectively displayed on a single monitor screen. That is, a large number of materials for monitoring are divided into an appropriate number of materials and assigned to each of a plurality of image synthesizers. The image is converted into a reduced image, combined in a form that is laid out in a plurality of arrangement areas, and the combined image is output to a plurality of monitor devices corresponding to the respective image combining devices, and a plurality of materials are parallelized. A monitor image composition system having a mechanism for monitoring is used.

  Here, the monitor system is required to be able to display on a monitor device in a layout (arrangement of images such as a plurality of images, audio level bars, and characters) that can be easily monitored by a monitor, and the layout. It is a necessary requirement to be able to change freely without changing the connection. That is, in a broadcasting station or the like, the above-described monitor image composition system is employed in order to enable a plurality of materials to be monitored in parallel for the monitor system. In an image composition system, generally, as shown in FIG. 9, in order to realize that an arbitrary material is selected from a plurality of materials and an appropriate number of materials are selected and an image is synthesized in an arbitrary layout and displayed on a monitor. As described above, the monitor switcher, the plurality of image composition apparatuses, and the plurality of monitor apparatuses are installed.

  FIG. 9 is an image diagram showing a monitor display system image in the current technology when, for example, 16 pieces of 64 materials are combined and displayed on four monitor screens in a broadcasting station. 1 shows an example of a system configuration of a commercial image composition system. The monitor image composition system shown in FIG. 9 includes four first image composition apparatuses 11A, second image composition apparatuses 12A,..., Fourth image composition apparatus 14A, four first monitor apparatuses 21, The second monitor device 22,..., The fourth monitor device 24, the control terminal 30 </ b> A, and the monitor switcher 40.

  The monitor switcher 40 receives the switching control instruction from the control terminal 30A by the switching control unit 41, so that the 64 materials S1, materials S2,..., IN64 input to the input terminals IN1, IN2,. ..., the material S64 can be independently allocated to each of the output terminals OUT1, OUT2, ..., OUT64. Here, the material S1, the material S2,..., The material S64 are 64 materials used in the broadcasting station, and each material is composed of a video signal on which audio is superimposed.

  In the connection configuration shown in FIG. 9, the output terminals OUT1, OUT2,..., OUT64 of the monitor switcher 40 are in units of 16 units, that is, four image composition units, that is, the first image composition unit 11A and the first. Are connected to the second image composition device 12A,..., And the fourth image composition device 14A, respectively. That is, the output terminal OUT1, the output terminal OUT2,..., And the output terminal OUT16 are connected to the input terminals VIN1, VIN2,. The output terminal OUT17, the output terminal OUT18,..., And the output terminal OUT32 of the monitor switcher 40 are connected to the input terminals VIN1, VIN2,. The output terminal OUT33, the output terminal OUT34,..., And the output terminal OUT48 of the monitor switcher 40 are connected to the input terminals VIN1, VIN2,..., VIN16 of the third image composition device 13A, respectively. The output terminal OUT49, the output terminal OUT50,..., And the output terminal OUT64 of the monitor switcher 40 are connected to the input terminals VIN1, VIN2,..., VIN16 of the fourth image composition device 14A, respectively.

  The four image synthesizing apparatuses, that is, the first image synthesizing apparatus 11A, the second image synthesizing apparatus 12A,..., And the fourth image synthesizing apparatus 14A all have the same device configuration, and each has a control terminal 30A. Based on the layout control from the image, the video, sound level bar image, and text (character) image relating to the 16 materials input to each of the 16 input terminals VIN1, VIN2,. The image is synthesized with an arbitrary size and output from the output terminal VOUT. The four first image synthesizing devices 11A, the second image synthesizing device 12A,..., The fourth image synthesizing device 14A have output terminals VOUT respectively corresponding to the four first monitor devices 21 and the second. Are connected to the second monitor device 24...

  The four first monitor devices 21, the second monitor device 22,..., The fourth monitor device 24 all have the same device configuration, and each of the four first image composition devices 11A. , Second image synthesizer 12A,..., And fourth image synthesizer 14A, which are images synthesized (images related to video frames, audio level bars, text, etc.) output from output terminals VOUT of the respective images are used for monitoring. Display on the screen.

Japanese Patent Laying-Open No. 2015-096920

  In recent years, materials handled by broadcasting stations have been increasing year by year, and in the image synthesis system for monitors in the current technology, the addition of image composition devices and the expansion of switchers for monitors are performed according to the number of materials handled. ing.

  However, when such an expansion / expansion is performed in the monitor image composition system, when the monitor switcher 40 shown in FIG. 9 is to be replaced with a larger monitor switcher, the monitor switcher 40 itself is replaced. Since the number of input / output terminals is large and the outer shape is large, there is a problem that a large-scale repair work is required.

(Object of the present invention)
The present invention has been made in view of the problems as described above, and by easily connecting a plurality of image composition apparatuses, it is possible to easily perform expansion as the number of materials increases without using a monitor switcher. It is an object of the present invention to provide a monitor image composition system and a monitor image composition method capable of performing the above.

  In order to solve the above-described problems, the monitor image composition system and the monitor image composition method according to the present invention mainly adopt the following characteristic configuration.

(1) An image composition system for a monitor according to the present invention comprises:
In order to simultaneously monitor a plurality of materials consisting of video frame and audio level bar images for monitoring, the video frames and audio level bars of the respective materials are divided into a predetermined number of materials. And a plurality of monitor devices for displaying the synthesized image generated by the image synthesizing device on a monitor screen, and operations of the image synthesizing devices. In the monitor image composition system comprising a control terminal for generating control parameters for controlling
The control terminal
Layout data relating to the video frame and sound level bar image of each material when the images are synthesized in each of the image synthesizers is generated and output to the corresponding image synthesizer as the control parameter. Means
On the other hand, each of the image composition devices
Based on the control parameters input from the control terminal, a composite image related to each material is generated, and the generated composite image has an effective image area for output to another image composition device. Means for outputting an existing composite image to the other image composition device;
An image effective for monitor display among the synthesized image generated in the image synthesizing device and the synthesized image inputted from another image synthesizing device based on the control parameter inputted from the control terminal Means for outputting a composite image existing in the region as a monitor display composite image to the corresponding monitor device.

(2) A monitor image composition method according to the present invention comprises:
In order to simultaneously monitor a plurality of materials composed of video frames and audio level bar images for monitoring, the video frames and audio of each of the materials corresponding to the divided number of materials are divided. Each of the image synthesizers includes an image synthesizer that synthesizes the images of the level bar and generates a synthesized image, and a monitor device that displays the synthesized image generated by the image synthesizer on a monitor screen. A monitor image composition method for generating a monitor composite image in a monitor image composition system having a control terminal for generating a control parameter for controlling the operation of:
The control terminal
Layout data relating to the video frame and sound level bar image of each material when the images are synthesized in each of the image synthesizers is generated and output to the corresponding image synthesizer as the control parameter. Steps
On the other hand, each of the image composition devices
Based on the control parameters input from the control terminal, a composite image related to each material is generated, and the generated composite image has an effective image area for output to another image composition device. Outputting an existing composite image to the other image composition device;
An image effective for monitor display among the synthesized image generated in the image synthesizing device and the synthesized image inputted from another image synthesizing device based on the control parameter inputted from the control terminal And a step of outputting the composite image existing in the region as a monitor display composite image to the corresponding monitor device.

  According to the monitor image composition system and the monitor image composition method of the present invention, the following effects can be obtained.

  That is, by adopting the present invention, a plurality of image composition apparatuses installed as a monitor image composition system can be connected to each other, and all target materials can be shared among the image composition apparatuses. The monitoring switcher used in the current technology related to the invention is not necessary. Thus, according to the present invention, with the increase in the number of target materials, it is no longer necessary to perform large-scale renovation work that was essential in the current technology, and against the variation in the number of materials. A flexible system can be constructed.

FIG. 2 is a left half partial view of a block configuration diagram showing an example of a block configuration of an image composition apparatus that constitutes a monitor image composition system according to the present invention; FIG. 3 is a right half partial view of a block configuration diagram illustrating an example of a block configuration of an image composition apparatus that constitutes a monitor image composition system according to the present invention; 1 is a system configuration diagram illustrating an example of a system configuration of a monitor image composition system according to the present invention. It is a schematic diagram which shows an example of the layout screen displayed on the 1st monitor apparatus among the four monitor apparatuses which comprise the monitor image composition system shown in FIG. It is a schematic diagram which shows an example of the synthesized image produced | generated in the 2nd image composition apparatus of the image composition system for monitors shown in FIG. It is a schematic diagram which shows an example of the synthesized image produced | generated in the 3rd image composition apparatus of the image composition system for monitors shown in FIG. It is a schematic diagram which shows an example of the synthesized image produced | generated in the 4th image composition apparatus of the image composition system for monitors shown in FIG. In the first image composition device of the monitor image composition system shown in FIG. 2, an example of a composite image obtained by combining the composite image generated in the device and the composite image input from each of the other three image composition devices. It is a schematic diagram which shows. FIG. 2 is a schematic diagram illustrating an example of a composite image in which a character image is superimposed on a composite image of a video frame and an audio level bar image illustrated in FIG. 7 in the first image composition apparatus of the monitor image composition system illustrated in FIG. 2. It is. It is an image figure which shows the monitor display system | strain image in the present technique at the time of carrying out monitor composition display on four monitor screens, for example by combining 16 images of 64 materials at a broadcasting station.

  Preferred embodiments of a monitor image composition system and a monitor image composition method according to the present invention will be described below with reference to the accompanying drawings. It should be noted that the reference numerals attached to the following drawings are added for convenience to each element as an example for facilitating understanding, and it is needless to say that the present invention is not intended to be limited to the illustrated embodiment. Yes.

(Features of the present invention)
Prior to the description of the embodiments of the present invention, an outline of the features of the present invention will be described first. The present invention is provided with a mechanism that allows a plurality of image composition apparatuses installed as a monitor image composition system to be connected to each other to share all target materials among the image composition apparatuses. This is the main feature. Thus, while the current technology related to the present invention described with reference to FIG. 9 requires a monitor switcher, the present invention does not require a monitor switcher. In addition, with the increase in the number of target materials, the current technology related to the present invention described with reference to FIG. 9 required a large-scale renovation work. It is possible to cope with the increase in the number of materials without performing construction, and it is possible to construct a system that is rich in expandability for the increase in the number of materials.

(Embodiment of the present invention)
Next, an embodiment of a monitor image composition system according to the present invention will be described. Here, the monitor image composition system according to the present embodiment is the same as the system configuration of the monitor image composition system in the current technology as shown in FIG. There are, for example, 64 materials S1, S2,..., S64 as the number of materials (images, audio level bar images), and 4 images are synthesized by combining up to 16 images of each of the 64 materials. As an example, a case where a monitor is displayed on each of the monitor screens will be described. However, as will be apparent from the content described in detail below as an embodiment, the present invention is not limited to such numerical values, the number of all materials to be monitored is an arbitrary number, and Select and divide any number of materials to be monitored from all the materials to be monitored, synthesize video and audio level bar images for each divided material, and monitor them on any number of monitor screens. Needless to say, it can be displayed.

  The monitor image composition system according to the present embodiment is obtained by deleting the monitor switcher 40 shown in FIG. 9 by connecting the image composition apparatuses to each other. As will be described later with reference to FIG. Four first image synthesizing apparatuses 11, second image synthesizing apparatuses 12,..., Fourth image synthesizing apparatus 14, four first monitor apparatuses 21, second monitor apparatuses 22,. 4 monitoring devices 24 and a control terminal 30.

  Here, the four first monitor devices 21, the second monitor devices 22,..., The fourth monitor device 24 may be exactly the same as those described in FIG. The description which overlaps here is omitted. Further, in the present embodiment, as described above, since the monitor switcher 40 shown in FIG. 9 is deleted, the control terminal 30 is different from the control terminal 30A in FIG. It is not necessary to generate and output the switching control data to be controlled, and control the operation of the four first image synthesizers 11, the second image synthesizer 12, ..., the fourth image synthesizer 14. A function to generate and output layout data is provided. Further, the four first image synthesizing apparatuses 11, the second image synthesizing apparatus 12,..., The fourth image synthesizing apparatus 14 have the same block configuration, and FIG. An example is shown. FIG. 1 is divided into FIG. 1A and FIG. 1B because of the limitation of the paper size. A, B, C, D, E, and F indicated by circles on the right side of FIG. 1A are respectively connected to A, B, C, D, E, and F indicated by circles on the left side of FIG. 1B. Yes. That is, FIG. 1 is a diagram in which FIG. 1A and FIG. 1B are connected at points A, B, C, D, E, and F. Therefore, the figure described as FIG. 1 below means that one figure in which FIGS. 1A and 1B are connected to each other at points A, B, C, D, E, and F. FIG.

(Block configuration example of the image composition apparatus according to the present invention)
FIG. 1 is a block configuration diagram showing an example of a block configuration of an image composition apparatus constituting a monitor image composition system according to the present invention. As described above, 64 material S1, material S2,. Of these, a first image composition device 11 that composes an image of a maximum of 16 materials S1, S2,..., S16 is shown as an example. As is apparent from the above, the first image synthesizing device 11 is a device represented by connecting FIG. 1A and FIG. 1B to each other in terms of A, B, C, D, E, and F.

  Here, the first image composition device 11 shown in FIG. 1 is composed from other image composition devices (that is, the second image composition device 12, the third image composition device 13, and the fourth image composition device 14). In contrast to the function of capturing an image and synthesizing it with the synthesized image generated by the first image synthesizing apparatus 11, the synthesized image generated by the first image synthesizing apparatus 11 is output to another image synthesizing apparatus. And a connection operation with other image composition devices (a connection operation between four image composition devices). Thus, all the materials are shared among the four image synthesizing apparatuses of the first image synthesizing apparatus 11, the second image synthesizing apparatus 12, the third image synthesizing apparatus 13, and the fourth image synthesizing apparatus 14. It is possible to eliminate the need for the monitor switcher 40 as shown in FIG.

  1 includes a parameter receiving unit 110, a first IN image generation processing unit 1101, a second IN image generation processing unit 1102,..., A sixteenth IN image. It includes at least a generation processing unit 1116, a first CAS image composition processing unit 111, a second CAS image composition processing unit 112, a third CAS image composition processing unit 113, and an OUT image composition processing unit 115. Composed. The second image synthesizing device 12 to the fourth image synthesizing device 14 have the same configuration.

  The parameter receiving unit 110 is a circuit unit that receives layout data from a control terminal 30 (shown in FIG. 2 described later) that generates layout data from a layout image as a control parameter. Then, the parameter receiving unit 110 outputs the received control parameter to the related circuit unit. Here, as layout data (that is, control parameters) received from the control terminal 30, processing relating to the materials S1 to S16 input from the input terminals VIN1 to VIN16 (processing relating to images of video frames and audio level bars). Video frame control V1 to video frame control V16 and audio level bar control A1 to audio level bar control A16. In other words, the video frame control (video frame control V1 to video frame control V16) is used for video frame control for designating the image size and arrangement position regarding the video frame of each material when the images are synthesized in each of the image synthesis devices. The audio level bar control (audio level bar control A1 to audio level bar control A16) is information, and the number of level bars and the image size related to the image of the audio level bar of each material at the time of image synthesis in each image synthesis apparatus. This is information for audio level bar control that designates an arrangement position.

  Furthermore, as layout data received from the control terminal 30, the first monitor device 21 and another image composition device (in the case of the first image composition device, the second image composition device 12 to the fourth image composition device 14). ) ON control M1 to ON control M4 for controlling the presence / absence of the composite image of the video frame and the sound level bar image relating to each of the material S1 to material S16 to be output to each are also included. In other words, each of the ON control M1 to the ON control M3 converts a composite image that exists in an image area that is effective for output to another image composition device from among the composite images generated in the respective image composition devices to other images. The control information is designated as a composite image to be output to each of the composition devices (in the case of the first image composition device 11, the second image composition device 12 to the fourth image composition device 14). In addition, the ON control M4 includes a composite image generated in each image composition device and another image composition device (in the case of the first image composition device, the second image composition device 12 to the fourth image composition device 14). The composite image existing in the effective image area for monitor display is displayed on the monitor screen of the corresponding monitor device (in the case of the first image composition device 11, the first monitor device 21). This is control information designated as a monitor display composite image for display.

  Further, as layout data (that is, control parameters) received from the control terminal 30, text control for controlling a character image to be superimposed on the composite image output to the first monitor device 21 or an area where no composite image exists. Parameters such as background control for controlling the background color to be set are also included.

  Next, the first IN image generation processing unit 1101, the second IN image generation processing unit 1102,..., And the sixteenth IN image generation processing unit 1116 respectively include a video frame generation unit 11011 and a video frame limiter 11012. , An audio level bar generator 11013 and an audio level bar limiter 11014. The first IN image generation processing unit 1101, the second IN image generation processing unit 1102,..., And the sixteenth IN image generation processing unit 1116 respectively receive the video frame controls V 1 to V 1 from the parameter receiving unit 110. Based on the video frame control V16 and the audio level bar control A1 to the audio level bar control A16, the video frame VF1 to the video frame VF16 related to the material S1 to the material S16 input to the input terminal VIN1 to the input terminal VIN16, respectively, and the audio The images of the level bar AL1 to the sound level bar AL16 are generated.

  That is, the materials S1 to S16 input as video signals to the input terminal VIN1 to the input terminal VIN16 are the video frame control V1 to video specified by the video frame generation unit 11011 as control parameters from the parameter reception unit 110, respectively. Based on the image size and arrangement position of the frame control V16, the image reduction ratio and arrangement position for each of the input video, that is, the material S1 to the material S16 are determined, and each reduced image is reduced according to the determined image reduction ratio. It is converted and generated as a video frame arranged in each determined arrangement position. Further, the video frame limiter 11012 limits the upper limit value of each reduced image (video frame) generated by the video frame generation unit 11011 to a data range of 0x3FB and the lower limit value to 0x005, and the reduced image is not arranged. The video frame VF1 to the video frame VF16 in which the area is set to 0x004 data are output.

  In addition, the materials S1 to S16 input as audio signals to the input terminals VIN1 to VIN16 are designated as control parameters from the parameter receiver 110 after the audio level is detected by the audio level bar generator 11013. Based on the number of level bars, the image size, and the arrangement position of the audio level bar control A1 to audio level bar control A16, the coordinates are converted into coordinates corresponding to the detected audio level. Thereafter, the image is converted into a size corresponding to the image size, and is generated as an audio level bar image arranged at the position indicated by the arrangement position. Further, the audio level bar limiter 11014 performs limit processing similar to that for the video frame, and outputs the images as audio level bars AL1 to AL16.

  Each of the first CAS image composition processing unit 111, the second CAS image composition processing unit 112, and the third CAS image composition processing unit 113 includes each of the other three image composition devices (that is, the second image). A synthesized image to be output to each of the synthesizing device 12, the third image synthesizing device 13, and the fourth image synthesizing device is generated. Then, each of the first CAS image composition processing unit 111, the second CAS image composition processing unit 112, and the third CAS image composition processing unit 113 includes an ON control M1 to an ON control M3 from the parameter receiving unit 110. On the basis of the image frames VF1 to VF16 and the images of the audio level bar AL1 to audio level bar AL16 from the first IN image generation processing unit 1101 to the 16th IN image generation processing unit 1116, respectively. Of these, images to be output to each of the other three image synthesizers are selected and synthesized. The first CAS image composition processing unit 111, the second CAS image composition processing unit 112, and the third CAS image composition processing unit 113 are respectively an IN1 to IN16 key generation unit 1111 and an image composition unit 1112. Is included.

  That is, the first CAS image composition processing unit 111, the second CAS image composition processing unit 112, and the third CAS image composition processing unit 113 each of the IN 1 to 16 key generation units 1111 includes the first CAS image composition processing unit 111. This is to detect the synthesis region of the video frames VF1 to VF16 and the images of the audio level bar AL1 to the audio level bar AL16 from the IN image generation processing unit 1101 to the 16th IN image generation processing unit 1116, respectively. Thus, an area where data other than 0x004 exists is the synthesis area.

  Then, the first CAS image composition processing unit 111, the second CAS image composition processing unit 112, and the third CAS image composition processing unit 113 are input as control parameters to the IN 1 to 16 key generation units 1111. The ON control M1 to ON control M3 from the parameter receiving unit 110 are the video frames VF1 to VF16 and audio from the first IN image generation processing unit 1101 to the 16th IN image generation processing unit 1116, respectively. The synthesis area with the images of the level bar AL1 to the audio level bar AL16 is made effective. That is, the ON control M1 to the ON control M3 in the synthesis region of the video frames VF1 to VF16 detected by the IN1 to 16 key generation unit 1111 and the images of the audio level bar AL1 to the audio level bar AL16 are effective. A synthetic region of the video frame and the sound level bar image is extracted, generated as a synthesis key, and output.

  Further, in the image composition unit 1112, each of the first IN image generation processing unit 1101 to the 16th IN image generation processing unit 1116 is based on the composite key output from the IN 1 to 16 key generation unit 1111. Of the video frame VF1 to the video frame VF16 and the image of the audio level bar AL1 to the audio level bar AL16 from the video frames VF1 to AL16 are synthesized. Generate a composite image. Note that the video signal after image synthesis is data of 0x004 for areas other than the synthesis area that is valid as a synthesis key.

  In each of the first CAS image composition processing unit 111, the second CAS image composition processing unit 112, and the third CAS image composition processing unit 113, the generated video signals after image composition are the other three units. It is output as a composite image to each of the image composition devices (that is, in the case of the first image composition device 11, the second image composition device 12, the third image composition device 13, and the fourth image composition device 14). The

  The OUT image composition processing unit 115 is based on the ON control M4 from the parameter receiving unit 110, and the video frames VF1 from the first IN image generation processing unit 1101 to the sixteenth IN image generation processing unit 1116, respectively. A composite image to be displayed for monitoring is extracted from a composite image obtained by combining the video frame VF16 and the images of the audio level bar AL1 to the audio level bar AL16. The extracted synthesized image and the other three image synthesizing apparatuses (that is, in the case of the first image synthesizing apparatus 11, the second image synthesizing apparatus 12, the third image synthesizing apparatus 13, and the fourth image synthesizing apparatus). The image synthesis device 14) further synthesizes the synthesized images input from the respective image synthesis devices 14). Thereafter, the character image to be superimposed on the synthesized image is synthesized based on the text control from the parameter receiving unit 110, and the background synthesis is performed based on the background control from the parameter receiving unit 110. Therefore, the OUT image composition processing unit 115 includes a first CAS key generation unit 1151, a second CAS key generation unit 1152, a third CAS key generation unit 1153, and an IN1-16 key generation unit 1154. , An OR unit 1155, an image composition unit 1156, a text composition unit 1157, and a background composition unit 1158.

  That is, in each of the first CAS key generation unit 1151, the second CAS key generation unit 1152, and the third CAS key generation unit 1153, the other three image composition devices (that is, the first image) In the case of the synthesizing apparatus 11, the second image synthesizing apparatus 12, the third image synthesizing apparatus 13, and the fourth image synthesizing apparatus 14) detect the image area related to the synthesized image input from each, and the synthesis key. Are generated and output. The video signals input from each of the other three image synthesizers are the first CAS image synthesizer 111, the second CAS image synthesizer 112, the third image synthesizer of the first image synthesizer. Since processing similar to that in each of the CAS image composition processing units 113 is performed in each of the other three image composition devices, an area where data other than 0x004 exists is a composite image area. Therefore, an area where data other than 0x004 exists is detected, and a composite key is generated.

  Further, in the IN1-16 key generation unit 1154, the video frames VF1 to VF1 from the first IN image generation processing unit 1101 to the 16th IN image generation processing unit 1116 in the first image composition apparatus, respectively. A synthesized image area in which a synthesized image of the frame VF16 and the images of the audio level bar AL1 to the audio level bar AL16 exists is detected, and an area in which data other than 0x004 exists is a synthesized image area. Further, the ON control M4 input as a control parameter from the parameter receiving unit 110 to the IN1 to 16 key generation unit 1154 is the first IN image generation processing unit 1101 to the 16th IN image generation processing unit 1116, respectively. The composite image area of the composite image of the video frames VF1 to VF16 and the images of the audio level bar AL1 to the audio level bar AL16 is validated. Therefore, in the key generation unit 1154 for IN1 to 16, the ON control M4 further validates the detected image frame and the synthesized image area of the audio level bar image (that is, the area where data other than 0x004 exists). The synthesized image area is extracted and generated as a synthesized key.

  Next, in the OR unit 1155, the first CAS key generation unit 1151, the second CAS key generation unit 1152, the third CAS key generation unit 1153, and the IN1-16 key generation unit 1154, respectively. By performing OR operation on the synthesized key, an OUT synthesized key indicating a synthesized image area in all four image synthesizing apparatuses (first image synthesizing apparatus 11 to fourth image synthesizing apparatus 14) is generated.

  In the image composition unit 1156, based on the OUT composition key generated in the OR unit 1155, the video frames VF1 to VF1 from the first IN image generation processing unit 1101 to the sixteenth IN image generation processing unit 1116, respectively. Among the images of the video frame VF16 and the audio level bar AL1 to the audio level bar AL16, the video frame and the audio level bar image that are enabled by the OUT synthesis key, and the other three image synthesis devices (that is, the first image synthesis device). In the case of the image synthesizing device 11, the second image synthesizing device 12, the third image synthesizing device 13, and the fourth image synthesizing device 14) are effective by the OUT synthesizing key among the synthesized images inputted from the respective images. The image is synthesized with the synthesized image of the region indicated by. Note that in the video signal after image synthesis, the area other than the synthesized image area is data of 0x004.

  Further, the text synthesis unit 1157 generates a character image based on the character string specified by the text control input as a control parameter from the parameter receiving unit 110, the character size of the character string, and the arrangement position, The image is synthesized in such a manner that it is superimposed on the video signal from the image synthesis unit 1156. The character image data is limited to data with an upper limit of 0x3FB and a lower limit of 0x005. Then, the area other than the composite image area and the character image area is 0x004 data.

  Further, the background synthesis unit 1158 generates a background image based on the background control coloring information input from the parameter reception unit 110 as a control parameter, and synthesizes the video signal from the text synthesis unit 1157. The generated background image is synthesized in an area where data of 0x004 other than the image area and the character image area is set.

  The video signal generated in the OUT image composition processing unit 115 of the first image composition device 11 is output to the first monitor device 21 from the output terminal VOUT as a monitor display composite image MV1-OUT for monitor display. The first monitor device 21 that has received the output and received the monitor display composite image MV1-OUT displays it on the monitor screen as a monitor display composite image.

  As described above, the first image synthesizing apparatus 11 constituting the monitor image synthesizing system according to the present embodiment is the other three image synthesizing apparatuses (that is, the second image synthesizing apparatus 12 and the third image synthesizing apparatus). The apparatus 13 and the fourth image synthesizing apparatus 14) are provided with means for outputting a synthesized image video and means for inputting the synthesized image video from the other three image synthesizing apparatuses. Since the apparatus can be connected and operated, all of the materials S1 to S64 that are the targets for monitoring are converted into four image composition apparatuses (that is, the first image composition apparatus 11 to the fourth image composition apparatus). 14) can be shared between. Therefore, each of the four image synthesizing apparatuses (that is, the first image synthesizing apparatus 11 to the fourth image synthesizing apparatus 14) synthesizes all the materials S1 to 64 to be monitored in any combination. An image can be generated and displayed on a screen in parallel with each of the monitor devices connected thereto (that is, a first monitor device 21 to a fourth monitor device 24 described later in FIG. 2).

  In addition, each image composition device includes other three image composition devices (for example, in the case of the first image composition device 11, the second image composition device 12, the third image composition device 13, and the fourth image composition device). Regarding the input / output of the image with the apparatus 14), the video frame and the audio level bar image existing in the effective synthesized image area are synthesized, not the video frames and audio level bar images of the materials S1 to S64. (That is, an image that is input / output to / from the other three image synthesizers and an image composition area in which input / output to / from the other three image synthesizers is valid) Therefore, the number of wires connecting the devices can be greatly reduced. In the above description, the case where the monitor image composition system is configured by four image composition apparatuses has been described. However, the image composition system is not limited to four image composition apparatuses, and may be an arbitrary number. Needless to say.

(System configuration example of monitor image composition system according to the present invention)
Next, an example of the system configuration of the monitor image composition system according to the present invention will be described in detail with reference to FIG. FIG. 2 is a system configuration diagram showing an example of the system configuration of the monitor image composition system according to the present invention. In the case of including four image composition devices, four monitor devices, and a control terminal. Show.

  Here, all of the four image synthesizing apparatuses shown in FIG. 2, that is, the first image synthesizing apparatus 11, the second image synthesizing apparatus 12, the third image synthesizing apparatus 13, and the fourth image synthesizing apparatus 14, It has the same block configuration as that of the first image composition device 11 shown in FIG. 1, and is connected to each other in order to connect and operate four image composition devices. 2 differs from the control terminal 30A shown in FIG. 9 as the current technology, in addition to the data relating to the layout of the composite image, the switching of the monitor switcher 40 shown in FIG. Instead of generating data to be controlled, data for connecting the four image synthesizers is generated and output as control parameters to the four image synthesizers. Also, the four monitor devices, that is, the first monitor device 21, the second monitor device 22, the third monitor device 23, and the fourth monitor device 24 are the same as those shown in FIG. I do not care. Note that the number of the image composition device and the monitor device is not limited to four, and may be configured from an arbitrary plurality of devices.

  Each of the four image synthesizing apparatuses, that is, the first image synthesizing apparatus 11, the second image synthesizing apparatus 12, the third image synthesizing apparatus 13, and the fourth image synthesizing apparatus 14, is made of materials S1 to S16 as input units. , Material S17 to material S32, material S33 to material S48, material S49 to material S64, input terminal VIN1 to input terminal VIN16 for inputting each, and other three image composition devices (for example, first image composition device) 11, a CAS input terminal CAS for inputting a composite image from each of the second image composition device 12, the third image composition device 13, and the fourth image composition device 14. -IN1, CAS input terminal CAS-IN2, CAS input terminal CAS-IN3, and CONT input terminal CON for inputting control parameters from the control terminal 30 And -IN, are provided.

  In addition, each of the four image synthesizing apparatuses, that is, the first image synthesizing apparatus 11, the second image synthesizing apparatus 12, the third image synthesizing apparatus 13, and the fourth image synthesizing apparatus 14, corresponds as output units 4 Output terminal for outputting a monitor display composite image by connecting to each of the two monitor devices, that is, the first monitor device 21, the second monitor device 22, the third monitor device 23, and the fourth monitor device 24. VOUT and the other three image synthesizers (for example, in the case of the first image synthesizer 11, three of the second image synthesizer 12, the third image synthesizer 13, and the fourth image synthesizer 14) CAS output terminals CAS-OUT1 to CAS-OUT3 for outputting a combined composite image to each of them.

  In other words, the first image composition device 11 connects the CAS output terminal CAS-OUT1 to the CAS input terminal CAS-IN1 of the second image composition device 12 to perform composition for the second image composition device 12. Transfer the image MV1-CAS2. Further, the CAS output terminal CAS-OUT2 is connected to the CAS input terminal CAS-IN1 of the third image composition device 13 to transfer the composite image MV1-CAS3 for the third image composition device 13. Further, the CAS output terminal CAS-OUT3 is connected to the CAS input terminal CAS-IN1 of the fourth image synthesizing apparatus 14, and the synthesized image MV1-CAS4 for the fourth image synthesizing apparatus 14 is transferred.

  Similarly, the second image synthesizing apparatus 12 connects the CAS output terminal CAS-OUT1 to the CAS input terminal CAS-IN1 of the first image synthesizing apparatus 11, and is used for the first image synthesizing apparatus 11. The composite image MV2-CAS1 is transferred. Further, the CAS output terminal CAS-OUT2 is connected to the CAS input terminal CAS-IN2 of the third image composition device 13 to transfer the composite image MV2-CAS3 for the third image composition device 13. Further, the CAS output terminal CAS-OUT3 is connected to the CAS input terminal CAS-IN2 of the fourth image composition device 14, and the composite image MV2-CAS4 for the fourth image composition device 14 is transferred.

  Similarly, the third image synthesizing device 13 connects the CAS output terminal CAS-OUT1 to the CAS input terminal CAS-IN2 of the first image synthesizing device 11 so that the first image synthesizing device 11 can be used. The composite image MV3-CAS1 is transferred. Further, the CAS output terminal CAS-OUT2 is connected to the CAS input terminal CAS-IN2 of the second image composition device 12, and the composite image MV3-CAS2 for the second image composition device 12 is transferred. Further, the CAS output terminal CAS-OUT3 is connected to the CAS input terminal CAS-IN3 of the fourth image composition device 14, and the composite image MV3-CAS4 for the fourth image composition device 14 is transferred.

  Similarly, the fourth image synthesizer 14 connects the CAS output terminal CAS-OUT1 to the CAS input terminal CAS-IN3 of the first image synthesizer 11 so as to be directed to the first image synthesizer 11. The composite image MV4-CAS1 is transferred. Further, the CAS output terminal CAS-OUT2 is connected to the CAS input terminal CAS-IN3 of the second image composition device 12, and the composite image MV4-CAS2 for the second image composition device 12 is transferred. Further, the CAS output terminal CAS-OUT3 is connected to the CAS input terminal CAS-IN3 of the third image composition device 13, and the composite image MV4-CAS3 for the third image composition device 13 is transferred.

  Next, as described in FIG. 1, the control terminal 30 corresponds to each of the four image composition devices (that is, the four image composition devices of the first image composition device 11 to the fourth image composition device 14). Layout data is generated and output as control parameters CONT1 to CONT4 from the CONT output terminal CONT-OUT to the CONT input terminals CONT-IN of each of the four image composition devices. is there.

  The layout data generated in the control terminal 30 is four types of control parameters CONT1 to control parameters CONT4 for four image composition apparatuses, that is, the first image composition apparatus 11 to the fourth image composition apparatus 14, respectively. Each of the four types of layout data includes video frame control V1 to video frame control V16, audio level bar control A1 to audio level bar control A16, ON control M1 to ON control M4, text control, It includes clock control and background control.

  Here, the video frame control V <b> 1 to the video frame control V <b> 16 are controls for generating the respective reduced images, that is, the video frame VF <b> 1 to the video frame VF <b> 16 from the material S <b> 1 to the material S <b> 16 in the case of the first image composition device 11. In the case of the second image synthesizing apparatus 12, the control data for generating the respective reduced images, that is, the video frames VF1 to VF16, from the materials S17 to S32, and the third In the case of the image synthesizer 13, the control data for generating the respective reduced images, that is, the video frames VF1 to VF16 from the materials S33 to S48, and the case of the fourth image synthesizer 14 are provided. Are reduced images from the materials S49 to S64, that is, video frames VF1 to VF1. A control data for generating an image frame VF16.

  In addition, when the audio level bar control A1 to the audio level bar control A16 is for the first image synthesis apparatus 11, the audio level bar AL1 to the audio level bar is obtained from the audio signal superimposed on each of the materials S1 to S16. Control data for generating an AL16 image. In the case of the second image composition device 12, the audio level bar AL1 to the audio level bar is obtained from the audio signal superimposed on each of the materials S17 to S32. Control data for generating an image of AL16. In the case of the third image composition device 13, the audio level bar AL1 to the audio level bar is obtained from the audio signal superimposed on each of the materials S33 to S48. Control data for generating an AL16 image, and in the case of the fourth image composition device 14, 49 to material S64 is control data for generating the respective images of the speech level bar AL1~ audio level bar AL16 from the voice signal superimposed on each.

  Further, the ON control M1 to the ON control M3 are respectively the other three image composition devices (for example, in the case of the first image composition device 11, the second image composition device 12 and the third image composition device 13). As a composite image to be output to the fourth image composition device 14 (three image composition devices), it is designated by a designated effective image area (that is, designated by a composition key generated based on the ON control M1 to ON control M3). This is control data for instructing synthesis of a video frame existing in the image area) and an image of the audio level bar. The ON control M4 is a valid image area designated as a monitor display composite image to be output to a connected monitor device (for example, the first monitor device 21 in the case of the first image composition device 11). This is control data for instructing synthesis of a video frame and an image of an audio level bar existing in (that is, an image area designated by a synthesis key generated based on the ON control M4).

  Further, the text control generates a character image to be superimposed on the monitor display composite image output to the connected monitor device (for example, the first monitor device 21 in the case of the first image composition device 11). Control data. The background control includes a composite image and a character image among video signals output to a connected monitor device (for example, the first monitor device 21 in the case of the first image composition device 11). This is control data for generating a background image for coloring a non-existing region.

  Note that the control terminal 30 corresponds to the control parameters CONT1 to CONT4 for each of the image composition devices (the first image composition device 11 to the fourth image composition device 14), for example, from the layout screen illustrated in FIG. It has a function to generate layout data. FIG. 3 is a schematic diagram showing an example of a layout screen displayed on the first monitor device 21 among the four monitor devices constituting the monitor image composition system shown in FIG. In the layout screen shown in FIG. 3, reduced images corresponding to 16 materials, that is, video frames are arranged in 4 columns × 4 rows, and audio level bar images corresponding to the video frames are arranged on the left and right sides of each video frame. Further, an example is shown in which text images (character images) corresponding to the respective video frames are arranged above the respective video frames. In addition, the background color is colored in the area where the video frame, the audio level bar image, and the text image are not arranged.

  In the layout screen of FIG. 3, among the reduced images corresponding to 16 materials, that is, the video frames, the first frame includes the video frames MV1-1 to MV1-4 corresponding to the four materials in the first row. Video frames related to the materials S1 to S4 input to the input terminals VIN1 to VIN4 of the image composition device 11 are arranged, and the video frames MV2-1 to MV2 for the four materials in the second row. In the region 4, video frames related to the materials S17 to S20 inputted to the input terminals VIN1 to VIN4 of the second image composition device 12 are arranged, and the video for the four materials in the third row is arranged. The areas of the frame MV3-1 to the video frame MV3-4 are input to the input terminal VIN1 to the input terminal VIN4 of the third image composition device 13, respectively. The video frames related to the material S33 to the material S36 are arranged, and the input terminal of the fourth image composition device 14 is provided in the region of the video frames MV4-1 to MV4-4 for the four materials in the fourth row. A case is shown in which video frames related to the materials S49 to S52 input to the VIN1 to the input terminal VIN4 are arranged.

  Based on the layout screen as shown in FIG. 3, the control terminal 30 controls the video frame control V1 to V16 for the first image synthesizing apparatus 11 (the arrangement for calculating the reduction ratio and position regarding the materials S1 to S16). Coordinate), audio level bar control A1 to A16 (arrangement coordinates for calculating audio level coordinates relating to material S1 to material S16), ON control (existence of arrangement of video frames and audio level bar images relating to material S1 to material S16) Information and presence / absence information of composite image placement from other image composition devices), text control (character information and placement coordinates for composing character images related to materials S1 to S16), background control (background coloring information) ) As a control parameter CONT1 for the first image synthesizing device 11 and output to the first image synthesizing device 11.

  Similarly, the video frame controls V1 to V16 for the second image synthesizing apparatus 12 to the fourth image synthesizing apparatus 14 (reduction ratios and positions regarding the materials S17 to S32, the materials S33 to 48, and the materials 49 to 64, respectively. Audio level bar controls A1 to A16 (material S17 to material S32, material S33 to material 48, material 49 to material 64 are arranged coordinates for calculating the audio level bar coordinates), ON control (information regarding the presence of video frames, audio level bar images, and presence / absence of composite images from other image compositing devices regarding the materials S17 to S32, materials S33 to 48, and materials 49 to 64) Information), text control (material S17 to material S32, material S33 to material 48, material 49 to material 64, respectively. Character information and arrangement coordinates) and background control (background coloring information) are generated as control parameters CONT2 to CONT4 for the second image synthesis device 12 to the fourth image synthesis device 14, respectively. Then, the image is output to each of the second image synthesizing apparatus 12 to the fourth image synthesizing apparatus 14.

(Explanation of composite image generation operation in monitor image composition system)
Next, an operation example until the composite image as shown in the layout screen of FIG. 3 is generated in the monitor image composition system shown in FIG. 2 will be described in order with reference to the schematic diagrams of FIGS. explain.

  First, an example of an operation in which the second image composition device 12 of the monitor image composition system shown in FIG. 2 generates a composite image for the first image composition device 11 will be described with reference to FIG. FIG. 4 is a schematic diagram showing an example of a composite image generated by the second image composition device 12 of the monitor image composition system shown in FIG.

  As the control parameter CONT2 for the second image composition device 12, the control terminal 30 sets the video frame and the sound level bar image for the four materials S17 to S20 among the materials S17 to S32. An ON control M1 that enables the composition is generated. Furthermore, the control terminal 30 sets the video frames side by side on the second line of the monitor screen shown in FIG. 4 for the four materials S17 to S20 as the control parameter CONT2 for the second image composition device 12. Video frame controls V1 to V4 and audio level bar controls A1 to A4 indicating arrangement coordinates for calculating a reduction ratio and an arrangement position are generated so that a composite image of the image and the audio level bar image is arranged. Thereafter, the control terminal 30 outputs the generated control parameter CONT2 to the second image composition device 12.

  As a result, in the second image composition device 12, based on the control parameter CONT2 input from the control terminal 30, at least the first IN image generation processing unit 1101 to the fourth IN image generation processing. In each of the units 1104, the video frames VF1 to VF4 related to the materials S17 to S20 from the input terminals VIN1 to VIN4 are the video frames for four materials located in the second row of the monitor screen shown in FIG. The images of the audio level bar AL1 to the audio level bar AL4 related to the material S17 to the material S20 are arranged in the area of the video frame MV2-1 to the video frame MV2-4. It is generated in a form that is arranged on both sides.

  Thereafter, the second image composition device 12 uses the first CAS image composition processing unit 111 to perform the first IN image generation processing unit 1101 to the first one based on the control parameter CONT2 from the control terminal 30. Among the images of the video frames VF1 to VF16 and audio level bars AL1 to AL16 output from each of the 16 IN image generation processing units 1116, the effective image area is positioned on the second line of the monitor screen shown in FIG. A composite image relating to each of the video frames VF1 to VF4 and the images of the audio level bars AL1 to AL4 existing in the area of the video frames MV2-1 to MV2-4 for four materials is generated. Note that background data of 0x004 is inserted in an area where the composite image does not exist. As a result, a composite image having the layout as shown in FIG. 4 is obtained as the composite image MV2-CAS1 for the first image composition device 11 from the CAS output terminal CAS-OUT1 of the second image composition device 12. 1 is input to the CAS input terminal CAS-IN1 of the image synthesizer 11.

  Next, an example of an operation in which the third image composition device 13 of the monitor image composition system shown in FIG. 2 generates a composite image for the first image composition device 11 will be described with reference to FIG. FIG. 5 is a schematic diagram illustrating an example of a composite image generated by the third image composition device 13 of the monitor image composition system illustrated in FIG. 2.

  As in the case of the control parameter CONT2 for the second image composition device 12, the control terminal 30 uses the material S33 to the material S33 to S48 as the control parameter CONT3 for the third image composition device 13. For the four materials of the material 36, the ON control M1 that enables the composition of the video frame and the sound level bar image is generated. Further, the control terminal 30 sets the video frames side by side in the third row of the monitor screen shown in FIG. 5 for the four materials S33 to 36 as the control parameter CONT3 for the third image composition device 13. Video frame controls V1 to V4 and audio level bar controls A1 to A4 indicating arrangement coordinates for calculating a reduction ratio and an arrangement position are generated so that a composite image of the image and the audio level bar image is arranged. Thereafter, the control terminal 30 outputs the generated control parameter CONT3 to the third image composition device 13.

  As a result, in the third image synthesizing apparatus 13, as in the case of the second image synthesizing apparatus 12, at least the first IN image is based on the control parameter CONT3 input from the control terminal 30. In each of the generation processing unit 1101 to the fourth IN image generation processing unit 1104, the video frames VF1 to VF4 related to the materials S33 to S36 from the input terminals VIN1 to VIN4 are displayed on the monitor screen shown in FIG. The images of the audio level bar AL1 to the audio level bar AL4 related to the material S33 to the material S36 are arranged in the area of the video frame MV3-1 to the image frame MV3-4 for four materials located in the third row. -1 to video frames MV3-4 are generated in such a manner that they are arranged on both the left and right sides of each area.

  Thereafter, on the basis of the control parameter CONT3 from the control terminal 30, the third image composition device 13 performs the first IN image generation processing unit 1101 to the first IN image composition processing unit 111 in the first CAS image composition processing unit 111. Among the images of the video frames VF1 to VF16 and audio level bars AL1 to AL16 output from each of the 16 IN image generation processing units 1116, the effective image area is located in the third line of the monitor screen shown in FIG. A composite image is generated for each of the video frames VF1 to VF4 and the images of the audio level bars AL1 to AL4 existing in the area of the video frames MV3-1 to MV3-4 for four materials. Note that background data of 0x004 is inserted in an area where the composite image does not exist. As a result, the composite image having the layout as shown in FIG. 5 is obtained as the composite image MV3-CAS1 for the first image composition device 11 from the CAS output terminal CAS-OUT1 of the third image composition device 13. 1 is input to the CAS input terminal CAS-IN2.

  Next, an example of the operation in which the fourth image composition device 14 of the monitor image composition system shown in FIG. 2 generates a composite image for the first image composition device 11 will be described with reference to FIG. FIG. 6 is a schematic diagram showing an example of a composite image generated by the fourth image composition device 14 of the monitor image composition system shown in FIG.

  As in the case of the control parameter CONT2 for the second image composition device 12, the control terminal 30 uses the material S49 to the control parameter CONT4 for the fourth image composition device 14 among the materials S49 to S64. For the four materials 52, the ON control M1 that enables the composition of the video frame and the sound level bar image is generated. Further, the control terminal 30 sets the video frames side by side on the fourth line of the monitor screen shown in FIG. 6 for the four materials S49 to 52 as the control parameter CONT4 for the fourth image composition device 14. Video frame controls V1 to V4 and audio level bar controls A1 to A4 indicating arrangement coordinates for calculating a reduction ratio and an arrangement position are generated so that a composite image of the image and the audio level bar image is arranged. Thereafter, the control terminal 30 outputs the generated control parameter CONT4 to the fourth image synthesizer 14.

  As a result, in the fourth image synthesizing device 14, as in the case of the second image synthesizing device 12, at least the first IN image is based on the control parameter CONT 4 input from the control terminal 30. In each of the generation processing unit 1101 to the fourth IN image generation processing unit 1104, the video frames VF1 to VF4 related to the materials S49 to S52 from the input terminals VIN1 to VIN4 are displayed on the monitor screen shown in FIG. The images of the audio level bar AL1 to the audio level bar AL4 related to the materials S49 to S52 are arranged in the area of the video frames MV4-1 to MV4-4 for four materials located in the fourth row, and the video frames MV4. -1 to video frame MV4-4 are generated in such a manner as to be arranged on both the left and right sides of each area.

  Thereafter, on the basis of the control parameter CONT4 from the control terminal 30, the fourth image composition device 14 uses the first IN image generation processing unit 1101 to the first IN image generation processing unit 111 in the first CAS image composition processing unit 111. Among the images of the video frames VF1 to VF16 and audio level bars AL1 to AL16 output from each of the 16 IN image generation processing units 1116, the effective image area is positioned on the fourth line of the monitor screen shown in FIG. A composite image is generated for each of the video frames VF1 to VF4 and the images of the audio level bars AL1 to AL4 existing in the area of the video frames MV4-1 to MV4-4 for four materials. Note that background data of 0x004 is inserted in an area where the composite image does not exist. As a result, a composite image having the layout as shown in FIG. 6 is obtained as the composite image MV4-CAS1 for the first image composition device 11 from the CAS output terminal CAS-OUT1 of the fourth image composition device 14. 1 is input to the CAS input terminal CAS-IN3 of one image composition device 11.

  Next, the first image synthesizing apparatus 11 of the monitor image synthesizing system shown in FIG. 2 combines the synthesized image generated in the apparatus and the other three image synthesizing apparatuses (that is, the second image synthesizing apparatuses 12 to 12). An example of an operation for generating a synthesized image obtained by synthesizing a synthesized image input from each of the fourth image synthesizing apparatuses 14) will be described with reference to FIG. FIG. 7 shows the first image composition device 11 of the monitor image composition system shown in FIG. 2, which composes the composite image generated in the device and the composite image input from each of the other three image composition devices. It is a schematic diagram which shows an example of the synthesized image. That is, FIG. 7 shows, from the control terminal 30, the synthesized image generated by the first image synthesizing apparatus 11 and the synthesized image input from each of the other three image synthesizing apparatuses shown in FIGS. The example of the synthesized image synthesized based on the layout data instructed as the control parameter CONT1 is shown.

  In the control terminal 30, as in the case of the control parameter CONT2 for the second image composition device 12, as the control parameter CONT1 for the first image composition device 11, among the materials S1 to S16, the materials S1 to S1. For the four materials 4, the composition of the video frame and the sound level bar image is made effective, the composite image generated by the first image composition device 11 and the other three image composition devices ( In other words, the ON control M4 that enables the synthesis with the synthesized image input from each of the second image synthesizing device 12 to the fourth image synthesizing device 14) is generated. Furthermore, the control terminal 30 sets the video frames side by side in the first line of the monitor screen shown in FIG. 7 for the four materials S1 to S4 as the control parameter CONT1 for the first image composition device 11. Video frame controls V1 to V4 and audio level bar controls A1 to A4 indicating arrangement coordinates for calculating a reduction ratio and a position are generated so that a composite image of the image and the audio level bar image is arranged. Furthermore, the control terminal 30 includes text control for designating a character image to be superimposed on each image area of the composite image and a composite image as the control parameter CONT1 for the first image composition device 11. Generate a background control that indicates the background color to be set for the missing region. Thereafter, the control terminal 30 outputs the generated control parameter CONT1 to the first image composition device 11.

  As a result, in the first image synthesizing apparatus 11, as in the case of the second image synthesizing apparatus 12, based on the control parameter CONT1 input from the control terminal 30, at least the first IN image. In each of the generation processing unit 1101 to the fourth IN image generation processing unit 1104, the video frames VF1 to VF4 related to the materials S1 to S4 from the input terminals VIN1 to VIN4 are displayed on the monitor screen shown in FIG. The images of the audio level bar AL1 to the audio level bar AL4 related to the material S1 to the material S4 are arranged in the area of the video frame MV1-1 to the video frame MV1-4 for four materials located in the first row. -1 to video frames MV1-4 are generated in such a manner that they are arranged on the left and right sides of each region.

  Thereafter, based on the control parameter CONT1 from the control terminal 30, the first image composition device 11 performs the first IN image generation processing unit 1101 to the 16th IN in the OUT image composition processing unit 115. Among the images of the video frames VF1 to VF16 and the audio level bars AL1 to AL16 output from the image generation processing unit 1116, four material positions located in the first line of the monitor screen shown in FIG. Composite images relating to the video frames VF1 to VF4 and the images of the audio level bars AL1 to AL4 existing in the regions of the video frames MV1-1 to MV1-4 are generated. Further, in the OUT image composition processing unit 115, the second to fourth lines of the monitor screen shown in FIG. 7 are displayed as effective image areas for the composite image generated by the first image composition device 11. A composite image existing in each region, that is, input from each of the other three image composition devices (that is, the second image composition device 12, the third image composition device 13, and the fourth image composition device 14) is shown in FIG. To the composite image shown in FIG. 6 (composite image MV2-CAS1, composite image MV3-CAS1, composite image MV4-CAS1). As a result, a composite image having the layout as shown in FIG. 7 is displayed in each of the areas of the first to fourth rows of the monitor screen. 4 image synthesizing devices 14) are generated as synthesized images obtained by further synthesizing the synthesized images generated in the respective images. Note that, as shown in FIG. 7, background data of 0x004 is inserted in an area where no composite image exists.

  That is, the composite image shown in FIG. 7 is made of the materials S1 to S4 and the materials S17 to S20 by the connecting operation of four image composition devices (that is, the first image composition device 11 to the fourth image composition device 14). Each of the synthesized images of the video frames and the sound level bar images generated in the first image synthesizing apparatus 11 to the fourth image synthesizing apparatus 14 based on the materials S33 to S36 and the materials S49 to S52 is finalized. Specifically, the image is synthesized on the first image synthesizing apparatus 11, and the area where the synthesized image does not exist is 0x004 background data. In addition, regarding the composite image to be generated, the control parameters CONT1 to CONT4 generated by the control terminal 30 are combined images of any of the 64 materials S1 to S64 to be monitored. It is possible to generate by arbitrarily selecting and setting in.

  Next, FIG. 8 shows a character image superimposed on the composite image of the video frame and the sound level bar image shown in FIG. 7 in the first image composition device 11 of the monitor image composition system shown in FIG. It is a schematic diagram which shows an example of a synthesized image. As described above, the control terminal 30 further generates a text control that arranges a character image above the image area of each synthesized image as the control parameter CONT1 for the first image synthesizing device 11, so that the first control is performed. Are output to the image synthesizing apparatus 11.

  As a result, in the first image synthesizing apparatus 11, the OUT image synthesizing processing unit 115, based on the text control included in the control parameter CONT1 from the control terminal 30, as shown in FIG. On the upper side of each of the video frame and the synthesized image of the audio level bar for the total of 16 materials located on the first to fourth rows of the monitor screen shown in FIG. Character images TBT-1 to TBT-16 instructed by the control are superimposed and inserted. Note that background data of 0x004 is inserted in an area where no video frame image, audio level bar image, or character image is arranged.

  Further, as described above, the control terminal 30 further controls the control parameter CONT1 for the first image synthesizing apparatus 11 in an area where no synthesized image is arranged, that is, an area where 0x004 background data is inserted. Background control for setting the designated background color is also generated and output to the first image composition device 11. Therefore, in the composite image layout shown in FIG. 8, the background color generated based on the background control of the control parameter CONT1 is combined with the area where the composite image is not placed in which the background data 0x004 is inserted. . As a result, a composite image having the same layout as the layout screen shown in FIG. 3 is generated. The generated composite image is output as a monitor display composite image MV1-OUT for the first image composition device 11 from the output terminal VOUT to the first monitor device 21 and displayed on the monitor screen.

  As described above, in this embodiment, the control parameter CONT1 related to the layout data input from the control terminal 30 to each of the four image composition apparatuses (the first image composition apparatus 11 to the fourth image composition apparatus 14). Based on the control parameter CONT4, the first image synthesizing device 11 includes the other three image synthesizing devices (that is, the second image synthesizing device 12, the third image synthesizing device 13, and the fourth image synthesizing device). By performing the connecting operation with 14), it is possible to freely capture any of the target materials, generate a composite image relating to any combination of materials, and display the composite image on the first monitor device 21. That is, the monitor image composition system according to the present embodiment has a mechanism for performing a connecting operation between the four image composition apparatuses. Therefore, as the current technology related to the present invention, the image composition system shown in FIG. Unlike the case, it is not necessary to provide a large monitor switcher 40, and it is possible to more flexibly cope with a change in the number of target materials without performing a large-scale repair work.

  The composite image generation operation shown in FIGS. 4 to 8 is performed by the first image composition apparatus 11 based on the control parameters CONT1 to CONT4 from the control terminal 30. Not only the synthesized image generated by the device 11 itself, but also each of the other three image synthesizing devices (that is, the second image synthesizing device 12, the third image synthesizing device 13, and the fourth image synthesizing device 14). An example of generating a composite image including a composite image has been shown. However, the operation as described above is not limited to the first image synthesizing apparatus 11, but the other three image synthesizing apparatuses (that is, the second image synthesizing apparatus 12, the third image synthesizing apparatus 13, and the fourth image synthesizing apparatus). It goes without saying that exactly the same composite image generation operation can be carried out in each of the image composition devices 14). In addition, the total number of target materials is 64, and each of the four image composition devices of the first image composition device 11 to the fourth image composition device 14 inputs 16 materials. However, the number of materials (the total number of target materials, the number of materials input by each image composition device) is an example, and any number may be used. Needless to say.

(Description of the effect of this embodiment)
As described in detail above, the following effects can be obtained in the monitor image composition system according to the present embodiment.

  Based on the control parameters CONT1 to CONT4 from the control terminal 30 capable of generating and outputting arbitrary layout data based on the layout image, the first image synthesizing device 11 to the fourth image. Four image synthesizers of the synthesizer 14 can be connected and operated. Thus, for example, among the 64 materials S1 to S64, a plurality of materials S1 to S4, materials S17 to S20, materials S33 to S36, and materials S49 to S52 are arbitrarily selected. Based on these materials, a composite image relating to each image frame and sound level bar image can be generated and displayed on the first monitor device 21. Similarly, in other monitor devices (that is, the second monitor device 22, the third monitor device 23, and the fourth monitor device 24), the control parameter CONT1 to the control parameter CONT4 from the control terminal 30 are similarly used. Based on the above, the four image composition devices of the first image composition device 11 to the fourth image composition device 14 are connected and operated, so that each video frame, based on any combination of materials, A composite image relating to the sound level bar image can be generated and displayed on the monitor screen.

  Further, in each of the first image synthesizing apparatus 11 to the fourth image synthesizing apparatus 14, based on the control parameters CONT 1 to CONT 4 from the control terminal 30, based on the material of each arbitrary combination. It is also possible to superimpose an arbitrary character image on the synthesized image related to the generated video frame and audio level bar image and display it on the screen. It is also possible to set the background color.

  As described above, in the monitor image composition system according to the present invention, the first image composition apparatuses 11 to 4 as shown as an example of the present embodiment are used as the number of image composition apparatuses that are connected to each other. However, the present invention is not limited to the case where the four image synthesizers of the image synthesizer 14 are connected and operated. That is, a connection circuit unit (that is, i-th CAS image composition processing unit 11i and i-th CAS key generation unit 115i: i is a natural number) for connecting the image composition apparatuses, and a connection terminal (Coupling output terminal CAS-OUTi and coupling input terminal CAS-INi), and the control terminal 30 has a function of editing control parameters according to the configuration of the coupling circuit unit. Yes. Therefore, an arbitrary number of image compositing devices can be installed in a state where they can be connected to each other according to the number of target materials.

  For example, when the number of materials increases beyond 64, more than four image composition devices are installed in accordance with the increased number of materials, the number of connection circuit units is increased, and the control terminal 30 By changing the control parameters from the number of materials and the number of image synthesizers, it is possible to easily connect the image synthesizers to each other. A mechanism having expandability with respect to increase can be realized.

  The same applies to the number of materials input to each of the four image synthesizing apparatuses of the first image synthesizing apparatus 11 to the fourth image synthesizing apparatus 14, and the number of materials is not limited to 16, but each image synthesizing apparatus. However, needless to say, it can be configured to input an arbitrary number of materials.

  As described above, in the monitor image composition system according to the present embodiment, all the target materials can be shared between the image composition apparatuses by connecting a plurality of image composition apparatuses to each other. Therefore, the monitoring switcher 30 as shown in FIG. 9 is not necessary as the current technology related to the present invention. As a result, it is no longer necessary to carry out large-scale renovation work due to fluctuations in the number of target materials, and to build a flexible system that can easily cope with fluctuations in the number of materials. Can do.

  Furthermore, in the monitor image composition system according to the present embodiment, the video frame and audio level bar relating to each material, not the video frame and audio level bar image relating to each material handled in each of the plurality of image composition apparatuses. 9 is adopted as a current technology related to the present invention, because a composite image obtained by combining the image of the image is transferred between a plurality of image composition apparatuses and a target material is shared. Compared with the monitor image composition system shown in FIG. 1, it is possible to significantly reduce the number of wirings straddling between the devices.

  The configuration of the preferred embodiment of the present invention has been described above. However, it should be noted that such embodiments are merely examples of the present invention and do not limit the present invention in any way. Those skilled in the art will readily understand that various modifications and changes can be made according to a specific application without departing from the gist of the present invention.

11 First image composition device 11A First image composition device 12 Second image composition device 12A Second image composition device 13 Third image composition device 13A Third image composition device 14 Fourth image composition device 14A 4th image composition device 21 1st monitor device 22 2nd monitor device 23 3rd monitor device 24 4th monitor device 30 Control terminal 30A Control terminal 40 Switcher 41 for monitoring Switching control part 110 Parameter receiving part 111 1st 1 CAS image composition processing unit 112 Second CAS image composition processing unit 113 Third CAS image composition processing unit 115 OUT image composition processing unit 1101 First IN image generation processing unit 1102 Second IN Image generation processing unit 1104 Fourth IN image generation processing unit 1111 IN1 to 16 key generation unit 1112 Image composition unit 1116 Sixteenth I Image generation processing unit 1151 first CAS key generation unit 1152 second CAS key generation unit 1153 third CAS key generation unit 1154 IN1-16 key generation unit 1155 OR unit 1156 image synthesis unit 1157 text synthesis Unit 1158 background synthesis unit 11011 video frame generation unit 11012 video frame limiter 11013 audio level bar generation unit 11014 audio level bar limiter A1 audio level bar control A16 audio level bar control AL1 audio level bar AL16 audio level bar CAS-IN1 CAS input terminal CAS-IN2 CAS input terminal CAS-IN3 CAS input terminal CAS-OUT1 CAS output terminal CAS-OUT2 CAS output terminal CAS-OUT3 CAS output terminal CONT1 control parameter CONT2 control Parameter CONT3 control parameter CONT4 control parameter CONT-IN CONT input terminal CONT-OUT CONT output terminal IN1 input terminal IN2 input terminal IN16 input terminal IN64 input terminal M1 ON control M4 ON control MV1-1 video frame MV1-2 Video frame MV1-3 Video frame MV1-4 Video frame MV1-CAS2 Composite image MV1-CAS3 Composite image MV1-CAS4 Composite image MV1-OUT Composite image (for monitor display)
MV2-1 Video frame MV2-2 Video frame MV2-3 Video frame MV2-4 Video frame MV2-CAS1 Composite image MV2-CAS3 Composite image MV2-CAS4 Composite image MV2-OUT Composite image (for monitor display)
MV3-1 video frame MV3-2 video frame MV3-3 video frame MV3-4 video frame MV3-CAS1 composite image MV3-CAS2 composite image MV3-CAS4 composite image MV3-OUT composite image (for monitor display)
MV4-1 video frame MV4-2 video frame MV4-3 video frame MV4-4 video frame MV4-CAS1 composite image MV4-CAS2 composite image MV4-CAS3 composite image MV4-OUT composite image (for monitor display)
OUT1 output terminal OUT2 output terminal OUT64 output terminal S1 material S2 material S16 material S64 material TBT-1 character image TBT-16 character image V1 image frame control V16 image frame control VF1 image frame VF16 image frame VIN1 input terminal VIN2 input terminal VIN4 input terminal VIN16 input terminal VOUT output terminal

Claims (8)

In order to simultaneously monitor a plurality of materials consisting of video frame and audio level bar images for monitoring, the video frames and audio level bars of the respective materials are divided into a predetermined number of materials. And a plurality of monitor devices for displaying the synthesized image generated by the image synthesizing device on a monitor screen, and operations of the image synthesizing devices. In the monitor image composition system comprising a control terminal for generating control parameters for controlling
The control terminal
Layout data relating to the video frame and sound level bar image of each material when the images are synthesized in each of the image synthesizers is generated and output to the corresponding image synthesizer as the control parameter. Means
On the other hand, each of the image composition devices
Based on the control parameters input from the control terminal, a composite image related to each material is generated, and the generated composite image has an effective image area for output to another image composition device. Means for outputting an existing composite image to the other image composition device;
An image effective for monitor display among the synthesized image generated in the image synthesizing device and the synthesized image inputted from another image synthesizing device based on the control parameter inputted from the control terminal And a means for outputting a composite image existing in the region to the corresponding monitor device as a monitor display composite image. The control terminal
As the layout data to be output as the control parameter,
Video frame control information for designating an image size and an arrangement position for a video frame of each of the materials at the time of image synthesis in each of the image synthesis devices;
Audio level bar control information for designating the number of level bars, the image size, and the position of the audio level bar image of each material at the time of image synthesis in each of the image synthesis devices;
A composite image that is output to each of the other image synthesizers a composite image that exists in an image area effective for output to the other image synthesizer among the composite images generated in each of the image synthesizers. Control information specified as
Of the synthesized image generated in each of the image synthesizing apparatuses and the synthesized image input from another image synthesizing apparatus, a synthesized image existing in an image area effective for monitor display is displayed on the monitor of the corresponding monitor apparatus. The monitor image composition system according to claim 1, further comprising: control information that is designated as the monitor display composite image to be displayed on a screen. The control terminal
Each of the image synthesizers further generates text control information for designating a character image to be superimposed on the area of each synthesized image constituting the monitor display synthesized image, and includes each of the corresponding parameters included in the control parameter. Means for outputting to the image synthesizer;
On the other hand, each of the image composition devices
Based on the text control information included in the control parameter input from the control terminal, a composite image obtained by superimposing the character image on each composite image area constituting the monitor display composite image The monitor image composition system according to claim 1 or 2, further comprising means for generating a new composite image for display on a monitor and outputting it to the corresponding monitor device. The control terminal
Each of the image synthesizers further generates background control information for designating a background color to be inserted into an area where each of the synthesized images constituting the monitor display synthesized image is not arranged, and includes it in the control parameters And a means for outputting to each of the corresponding image synthesizers,
On the other hand, each of the image composition devices
Based on the background control information included in the control parameter input from the control terminal, the background color is inserted into an area where each composite image constituting the monitor display composite image is not arranged. 4. The monitor image composition system according to claim 1, further comprising means for generating a composite image as a new monitor display composite image and outputting the composite image to the corresponding monitor device. . In order to simultaneously monitor a plurality of materials composed of video frames and audio level bar images for monitoring, the video frames and audio of each of the materials corresponding to the divided number of materials are divided. Each of the image synthesizers includes an image synthesizer that synthesizes the images of the level bar and generates a synthesized image, and a monitor device that displays the synthesized image generated by the image synthesizer on a monitor screen. A monitor image composition method for generating a monitor composite image in a monitor image composition system having a control terminal for generating a control parameter for controlling the operation of:
The control terminal
Layout data relating to the video frame and sound level bar image of each material when the images are synthesized in each of the image synthesizers is generated and output to the corresponding image synthesizer as the control parameter. Steps
On the other hand, each of the image composition devices
Based on the control parameters input from the control terminal, a composite image related to each material is generated, and the generated composite image has an effective image area for output to another image composition device. Outputting an existing composite image to the other image composition device;
An image effective for monitor display among the synthesized image generated in the image synthesizing device and the synthesized image inputted from another image synthesizing device based on the control parameter inputted from the control terminal And outputting the composite image existing in the area as a monitor display composite image to the corresponding monitor device. The control terminal
As the layout data to be output as the control parameter,
Video frame control information for designating an image size and an arrangement position for a video frame of each of the materials at the time of image synthesis in each of the image synthesis devices;
Audio level bar control information for designating the number of level bars, the image size, and the position of the audio level bar image of each material at the time of image synthesis in each of the image synthesis devices;
A composite image that is output to each of the other image synthesizers a composite image that exists in an image area effective for output to the other image synthesizer among the composite images generated in each of the image synthesizers. Control information specified as
Of the synthesized image generated in each of the image synthesizing apparatuses and the synthesized image input from another image synthesizing apparatus, a synthesized image existing in an image area effective for monitor display is displayed on the monitor of the corresponding monitor apparatus. The monitor image composition method according to claim 5, further comprising: generating control information designated as the monitor display composite image to be displayed on the screen. The control terminal
Each of the image synthesizers further generates text control information for designating a character image to be superimposed on the area of each synthesized image constituting the monitor display synthesized image, and includes each of the corresponding parameters included in the control parameter. And further outputting to the image synthesizer,
On the other hand, each of the image composition devices
Based on the text control information included in the control parameter input from the control terminal, a composite image obtained by superimposing the character image on each composite image area constituting the monitor display composite image The monitor image synthesizing method according to claim 5, further comprising a step of generating as a new monitor display synthesized image and outputting to the corresponding monitor device. The control terminal
Each of the image synthesizers further generates background control information for designating a background color to be inserted into an area where each of the synthesized images constituting the monitor display synthesized image is not arranged, and includes it in the control parameters And further outputting to each corresponding image synthesizer,
On the other hand, each of the image composition devices
Based on the background control information included in the control parameter input from the control terminal, the background color is inserted into an area where each composite image constituting the monitor display composite image is not arranged. A monitor image according to any one of claims 5 to 7, further comprising: generating a composite image as a new monitor display composite image and outputting the composite image to the corresponding monitor device. Image composition method.

Images