JP4628464B2 - Video editing device - Google Patents

Description

The present invention relates to a video editing apparatus, in particular, many without any complicated settings for each still image, a video editing apparatus capable of appropriately performing an abstraction such as a mosaic or blur constituting the video data It is about.

  As disclosed in Japanese Patent Laid-Open No. 2001-86407, an editing apparatus that automatically performs mosaic processing on video data is known. This is because video data to be subjected to mosaic processing is stored in advance as template video data, and a mosaic block size to be applied to the template video data is set, and video data and template video data to be subjected to mosaic processing are set. If the matching degree is equal to or higher than a predetermined threshold value, mosaic processing is performed with a block size set for an area including an image corresponding to the template image data (Patent Document 1). reference).

JP 2001-86407 A (FIG. 1 etc.)

  However, the above-described editing apparatus cannot set the mosaic block size corresponding to the size of the target image in the video data to be mosaicked. Therefore, since the mosaic block size is relatively large when the target image is small, it is impossible to determine what the target image is subjected to the mosaic process, or conversely, when the target image is large, the mosaic block size is large. Therefore, there is a problem in that it is possible to determine what the target image is despite the mosaic processing. On the other hand, it is conceivable to change the block size of the mosaic in response to the change in the size of the target image. In such a case, however, the target for each of many still images (frames) constituting the video data. A mosaic block size corresponding to the size of the image has to be set, and there is a problem that extremely complicated settings are required.

The present invention has been made in order to solve the above-described problems , and appropriate abstraction such as mosaic and blurring can be performed without making complicated settings for each of a large number of still images constituting video data. It aims at providing the video editing apparatus which can be applied to.

In order to achieve this object, the video editing apparatus according to claim 1 performs abstraction on video data, setting means for setting information used for abstraction applied to the video data, and the setting means Execution means for performing abstraction on the video data using the information set by the method, wherein the setting means performs abstraction on one frame included in a plurality of frames constituting the video data. Parameter setting that sets the abstraction parameter that is the ratio of the amount of abstraction to the size of the reference area specified by the reference abstraction area specification means that specifies the reference area to be applied means and from the frame included in a plurality of frames constituting the video data, it the end point performing abstraction starting frame is a start point and becomes a frame subjected to abstraction Frame specifying means for specifying an end frame that is a frame, and frame abstraction area specifying means for specifying an area to be abstracted for each of the start frame and the end frame specified by the frame specification means The execution means uses a region for abstraction with respect to the start frame specified by the frame abstraction region specification means and a region for abstraction with respect to the end frame, and the start point specified by the frame specification means. for any frame that exists between the frame and the end frame, and abstraction area setting means for automatically setting the respective interpolation regions subjected to abstraction, abstract set by the abstraction area setting means in addition to the area for receiving a, against the start frame specified by the frame abstracting region specifying means Against a region subjected to abstraction for the ending frame a region subjected to abstraction, and abstraction amount calculating means for calculating an abstraction amount corresponding to the abstraction parameter set by said parameter setting means, the abstraction An area to be abstracted set by the abstraction area setting means based on the abstraction amount calculated by the quantity calculation means , and an area to be abstracted for the start frame specified by the frame abstraction area specifying means and and a abstraction means for applying an abstraction in the area for receiving a abstraction for the end point frame.

According to the video editing apparatus of the first aspect, the reference abstraction area designating unit designates a reference area for abstracting one frame included in a plurality of frames constituting the video data. Then, the parameter setting means sets an abstraction parameter that is a ratio of the abstraction amount to the size of a region serving as a reference for performing the abstraction. When an area to be abstracted is specified by the frame abstraction area specifying means for each of the start point frame and the end point frame specified by the frame specifying means, the abstraction area setting means Using the abstraction area and the abstraction area for the end frame, the abstraction area is automatically set by interpolation for any frame existing between the start and end frames. To do. Then, the abstraction amount calculating means performs the abstraction specified by the frame abstraction area specifying means in accordance with the abstraction parameter set by the parameter setting means, the start frame set by the abstraction area setting means The amount of abstraction is calculated for the area where the abstraction is applied to and the area where the abstraction is applied to the end frame. Then, the abstraction means, based on the calculated abstraction amount, the area to be abstracted designated by the frame abstraction area designation means, the area to be abstracted for the start frame set by the abstraction area setting means Abstraction is applied to the area where the abstraction is performed on the end frame.

Video editing apparatus according to claim 2, wherein, in the video editing apparatus according to claim 1, wherein the abstracting means, the area for receiving a abstracted set by the abstraction area setting unit, by the frame abstracting region specifying means are those for the specified the start frame subjected to mosaic the area for receiving a abstractions for regions and the ending frame subjected to abstraction, the parameter setting means, a designated reference by the reference abstracting region specifying means The ratio of the mosaic block size to the area size is set as the abstraction parameter .

Video editing apparatus according to claim 3, wherein, in the video editing apparatus according to claim 1, wherein the abstracting means, the area for receiving a abstracted set by the abstraction area setting unit, by the frame abstracting region specifying means It is intended to apply a blur in a region subjected to abstraction for regions and the ending frame subjected to abstraction for a given the start frame, the parameter setting means, a designated reference by the reference abstracting region specifying means The ratio of the blur amount to the size of the area is set as the abstraction parameter .

According to the video editing apparatus of claim 1 , when an abstraction parameter that is a ratio of an abstraction amount to a size of a region to be abstracted is set, thereafter, the set abstraction parameter is set. Based on the above, the amount of abstraction for the region to be abstracted is calculated, and the region to be abstracted is abstracted based on the calculated amount of abstraction. As a result, even if the abstraction area is automatically set by interpolation by the abstraction area setting means for each of a large number of still images constituting the video data, if the abstraction parameter is set, An abstraction amount for an automatically applied abstraction area is calculated based on the abstraction parameter, and based on the calculated abstraction amount, an abstraction can be performed for each still image. Here, the abstraction performed for each still image is performed based on the abstraction amount calculated for each still image, and this abstraction amount is an abstraction parameter, that is, a criterion for performing abstraction. It is calculated based on the ratio of the abstraction amount to the size of the region to be. Therefore, even if the size of the area to be abstracted automatically set by interpolation differs for each still image, the amount of abstraction calculated for each area to be abstracted is The ratio is based on the ratio of the abstraction amount to the size of the reference area to be applied (the ratio of the block size and the ratio of the blurring amount). In this way, even when the size of the automatically applied abstraction area differs for each still image, the amount of abstraction calculated corresponding to each abstraction area is Since the calculation is based on the ratio of the amount of abstraction to the size of the standard area to be applied (the ratio of the block size and the ratio of the blurring amount), the accuracy of the abstraction applied to each area to be abstracted is calculated. Therefore, it is possible to maintain a certain accuracy based on the ratio. Thus, for each of a number of still images constituting the video data, there is an effect that no, it is possible to properly apply an abstraction to a complicated configuration.

According to the video editing apparatus according to claim 2, in addition to the effects of the video editing apparatus according to claim 1, as an abstract parameter, since setting the ratio of the block size of a mosaic, a number which constitutes the video data of without setting the block size of a mosaic respectively static image, there is an effect that it is possible to apply the mosaic block size suitable to the region of their respective.

According to the video editing apparatus of the third aspect, in addition to the effect produced by the video editing apparatus of the first aspect , the blur amount ratio is set as the abstraction parameter , so that a large number of still images constituting the video data can be obtained. without setting the amount of blurring, respectively to the image, there is an effect that may be subjected to blurring by the blurring amount suitable in the area of their respective.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 is a block diagram schematically showing an electrical configuration of a video editing apparatus 1 according to an embodiment of the present invention.

  The video editing apparatus 1 includes a CPU 11 as a central processing unit that controls the overall operation of the video editing apparatus 1, a ROM 13 that is a read-only memory that stores a control program executed by the CPU 11, various data tables, and the like. A RAM 12 that is a randomly accessible memory having a working area in which various register groups necessary for a control program executed by the CPU 11 are set and a temporary area for temporarily storing data being processed, and a mosaic for the user Alternatively, an operator 14 composed of various operation groups that are operated when blurring is added to video data, a video storage device 15 configured by a hard disk (HD) or the like for storing video data, and an external device (not shown). Input / output video signal interface (I / F) 1 A display 17 of a large display such as a liquid crystal monitor on which video data display and video data editing screens are displayed, a display circuit 18 operated to cause the display 17 to perform various displays, A bus 10 is mainly provided as a path for connecting the components to exchange data.

  The I / F 16 inputs an input interface for inputting a video signal as encoded video data output from an external device (not shown), and outputs video data edited and encoded by the video editing apparatus 1 as a video signal. Output interface. A part of the output interface is provided with a video signal output terminal, and a video monitor or the like is connected to the video signal output terminal so that editing can be performed while checking the editing state of the video data as needed. It is configured.

  Next, processing executed by the video editing apparatus 1 configured as described above will be described with reference to the flowchart of FIG. FIG. 2 is a flowchart showing main processing executed by the CPU 11, and is repeatedly executed by the CPU 11 while the video editing apparatus 1 is powered on.

  When the video editing apparatus 1 is turned on, main processing is executed and initial setting processing such as clearing various registers is executed. When the initial setting processing is completed, mode setting processing is executed. (S101). The mode setting process is a process for confirming whether the preview (video playback) mode for playing back video data or the edit mode for automatically adding mosaic or blur to the video data is selected. If it is confirmed that the mosaic process is selected, it is also confirmed whether the mosaic process is selected or the blur process is selected. Note that these modes are selected by operating the operation element 14 in advance.

  When the mode setting is confirmed, it is confirmed whether or not the mode setting is an edit mode (S102), and when it is confirmed that the edit mode is selected (S102: Yes), mosaic processing or The blurring process is executed (S103). On the other hand, if it is confirmed that the editing mode is not selected (S102: No), other processes are executed (S104).

  Other processes executed in S104 include a process of playing video data performed in the video playback mode on the display unit 17 and a process artificially set by the user. It is determined by the operation state of the child 14. In the processing executed in the video playback mode, arbitrary video data stored in the video storage device 15 is read according to an instruction from the CPU 11, and the video data is played back on the display 17 via the display circuit 18. The processing set by the user includes the ratio of the block size of the mosaic to the reference area N and the setting of the blur amount ratio, which is the degree of blurring, the setting of the key frame to which the mosaic and blur are added, and the processing for that key frame. This is a process for setting the coordinates of the target effect addition area. The set block size ratio and blur amount ratio are stored in the RAM 12, and key frames are stored in the key frame storage area of the video storage device 15. . The setting of the mosaic block size ratio and the blur amount ratio, the setting of the key frame, and the effect addition area will be described later.

  When the execution of the editing process (S103) or other processes (S104) is instructed, the process returns to S101 and the main process is repeatedly executed.

  Here, a case where mosaic processing is selected as the editing processing mode will be described below.

  The mosaic block size ratio setting, key frame setting, and effect addition area setting set by the user executed in S104 will be described with reference to FIG. FIG. 3 is an explanatory diagram showing an operation procedure for adding a mosaic to video data by operating the operation element 14, and FIGS. 3 (a) to 3 (c) are operations for setting a mosaic block size ratio. FIG. 3D to FIG. 3F show an operation procedure for setting a region to which a key frame mosaic is added. The operation procedure shown in FIG. 3 is set by the user while viewing the video data on the liquid crystal monitor of the display unit 17.

  The state of FIG. 3A is a state in which one of the reference frames is selected from a series of video data, and in this embodiment, the frame of the frame in which the target image X to be added with a mosaic is shown. The frame in which the target image X is shown as large as possible is selected, and this is used as the reference frame F.

  In the state of FIG. 3B, a region to which a mosaic is added is set in the region on the selected reference frame F. In this embodiment, the entire reference frame F is set as a reference area N to which a mosaic is added, and the size of the area is represented by the width SW and the height SH of the reference area N. Note that the setting of the area to which the mosaic is added on the reference frame F is set by changing the size of the area according to the type and size of the target image X.

  In the state of FIG. 3C, the block size of the mosaic to be added is set, and this block size setting is, for example, the block size that is the smallest block size that cannot determine what the image X is. Set. This is because if the block size is too large, it is impossible to determine what the image X is. Conversely, if the block size is too small, it is possible to determine what the image X is, so the block size cannot be determined. The minimum block size is set. The size of the block size is represented by the width B and the height B of the block size. In this embodiment, the block size is a square having a side length B.

  As described above, the operation procedure from FIG. 3A to FIG. 3C is an operation procedure for setting the ratio of the block size to the size of the reference region N to which the mosaic is added, and this ratio is the block size. Is calculated by dividing the width B by the width SW of the reference region N, and the calculated value is stored in the RAM 12 as the reference abstraction amount BBs. Further, since the block size is set on the reference frame F in which the target image X to be processed is large, it is possible to set a subtle block size while viewing the target image X.

  The state shown in FIG. 3D is a state in which a frame to which a mosaic is actually added is selected from a series of video data, and the selected frame is set as a key frame. A key frame is a frame that is divided by an arbitrary frame in a continuous series of video data, and becomes the delimiter. A series of video data is numbered from the top frame, and the selected key frame is used as a mark for editing processing.

  In the state shown in FIG. 3E, an effect addition area for adding a mosaic effect is set in an area on the selected key frame. In the present embodiment, the effect addition region is set so as to be approximately the same size as the reference region N to which the mosaic of the target image X set in FIG. 3B is added, and the size of the effect addition region is It is represented by the width EW and the height EH of the effect addition region.

  The state of FIG. 3 (f) is a state in which the mosaic block size is automatically set corresponding to the size of the effect addition region set in FIG. 3 (e). This is based on the reference abstraction amount BBs set in FIG. 3A to FIG. 3C, and the mosaic block corresponding to the size of the area composed of the width EW and the height EH of the effect addition area. The size is set. The setting of the mosaic block size is performed by reading a table stored in the ROM 13 by associating the reference abstraction amount BBs with the block size corresponding to the size of the effect addition area, and reading the block size from the reference abstraction amount BBs on the table. Set. The size of the block size is represented by the block size width BW and height BH of the effect addition region.

  The operation procedure from FIG. 3D to FIG. 3F is an operation procedure for setting an effect addition region to which a mosaic effect is added in a key frame, and the mosaic block size of the set effect addition region. Is set automatically. In addition, when adding the effect of the conventional mosaic, operation which sets an effect addition area | region similarly to operation in FIG.3 (d)-FIG.3 (e), and after that in FIG.3 (c) Similar to the operation, an operation of setting the block size to a minimum with a block size that cannot be determined what the target image X in the effect addition region is is performed. In practice, video data consists of a series of frames before and after the key frame, so it is necessary to repeatedly set the effect addition area and block size for a huge number of frames. The amount of work was enormous. In this embodiment, when the ratio of the block size serving as a reference in the operation procedure of FIGS. 3A to 3C is preset, the block size of the effect addition area in the key frame is automatically determined and a mosaic is added. The Therefore, it is possible to apply a mosaic with a block size suitable for each effect addition region without making complicated settings compared to the conventional operation procedure for adding a mosaic.

  The key frame can be set by arbitrarily selecting a frame including the target image X to which a mosaic is to be added in a series of video data. The frame that is the starting point of the frame to which the mosaic is added is the first key. The frame is the frame, and the frame that is the end point is stored in the key frame storage area as the second key frame.

  Furthermore, there may be a case where a plurality of first key frames and a plurality of second key frames are set. In this case, the reference abstraction amount BBs is set every time from the first key frame to the second key frame.

  Here, a method for setting the brightness of the mosaic when the mosaic is added as described above with reference to FIG. 4 will be described. FIG. 4 is an explanatory diagram showing a method for setting the brightness of the mosaic.

  As shown in FIG. 4A, the effect addition region for adding a mosaic is divided by a set block size, and the state in which the block size is divided for each pixel is shown in FIG. Is the state illustrated in FIG. In this embodiment, one block size of the mosaic is a block size composed of 9 pixels. In setting the brightness of the mosaic, the value of the pixel A at the upper left position shown in the figure is reflected in all other pixels, and the brightness of the mosaic is set with all the pixels within the block size as the value of the pixel A. For example, if the value of the pixel A is “64”, the brightness of the mosaic is set with all the pixels in the block having a value of 64. This value “64” represents the brightness of the pixel, and is configured to be set between “minimum value 0 and maximum value 127”. In addition, when the image is monochrome, the luminance is obtained, and when the image is colored, the luminance of each color of RGB is obtained. In this embodiment, the brightness of the mosaic is set with reference to the upper left pixel A. However, it is possible to use the center pixel as a reference, or to set a reference at random for each block. good.

  Next, the editing process executed in S103 described above will be described with reference to FIGS. FIG. 5 is a flowchart showing the editing process executed by the CPU 11. FIG. 6 is an explanatory diagram showing an interpolation process executed in the editing process. FIG. 6 (a) shows a state before the interpolation process, and FIG. 6 (b) shows a state after the interpolation process. Yes.

  The necessary data including the reference abstraction amount BBs used in the editing process, the first key frame, and the second key frame is data stored by setting in advance by the operation described with reference to FIG. Read and process.

  When the execution of the editing process is instructed in S103 of the main process, the first key frame and the second key frame stored in the key frame storage area are read, the frame number of the first key frame is set as the start point frame Fs, The frame number of the 2-key frame is set as the end point frame Fe (S111). In FIG. 6, (i) in FIG. 6 (a) is the start point frame Fs, and (iv) in FIG. 6 (a) is the end point frame Fe. There are a plurality of frames between the start point frame Fs and the end point frame Fe, and any frame among them corresponds to (ii) and (iii) in FIG.

  When the start point frame Fs and the end point frame Fe are read from the key frame storage area, the start point frame Fs is subtracted from the end point frame Fe to calculate the number of frames Sf between the start point frame Fs and the end point frame Fe (S112).

  Next, the movement amount from the start point effect addition region Ns, which is the region to which the mosaic of the start point frame Fs is added, to the end point effect addition region Ne, which is the region to which the mosaic of the end point frame Fe is added, is calculated (S113). The start point effect addition region Ns and the end point effect addition region Ne are represented by two coordinates of the upper left coordinate and the lower right coordinate of each region, and the movement amount is calculated by 2 of the upper left coordinate and the lower right coordinate. It is obtained from the amount of change in points. The coordinates of the effect addition region Ns of the start point frame Fs are the upper left x coordinate Fsl, the upper left y coordinate Fst, the lower right x coordinate Fsr, and the lower right y coordinate Fsb, and the coordinates of the effect addition region Ne of the end point frame Fe are the upper left. An x coordinate Fel, an upper left y coordinate Fet, a lower right x coordinate Fer, and a lower right y coordinate Feb are obtained by subtracting the movement amount for each coordinate. The movement amounts corresponding to the calculated coordinates are the upper left x coordinate movement amount STL, the upper left y coordinate movement amount STT, the lower right x coordinate movement amount STR, and the lower right y coordinate movement amount STB.

  When the movement amount of each coordinate is calculated in S113, the ratio TCo of the total number of frames Sf to the frame Fi when an arbitrary frame to be processed is set as the frame Fi is calculated (S114). The arbitrary frame Fi is a frame that is sequentially selected from the start point frame Fs from the start point frame Fs to the end point frame Fe, and is shifted to the next frame every time the process of S114 is completed. The ratio TCo is calculated by dividing a value obtained by subtracting the start point frame Fs from an arbitrary frame Fi by the number of frames Sf. That is, the number of frames of an arbitrary frame Fi from the start point frame Fs is calculated as a ratio.

  An effect addition area Ni, which is an area to which a mosaic effect of an arbitrary frame Fi is added, is calculated from the movement amount (STL, STT, STR, STB) of each coordinate calculated in S113 to S114 and the ratio TCo (S115). . The effect addition area Ni is represented by two coordinates, an upper left coordinate composed of an upper left x coordinate Fil and an upper left y coordinate Fit, and a lower right coordinate composed of a lower right x coordinate Fir and a lower right y coordinate Fib. Is calculated by adding the coordinates (Fsl, Fst, Fsr, Fsb) of the effect addition region Ns of the start point frame Fs to the value obtained by multiplying the movement amount (STL, STT, STR, STB) by the ratio TCo. As shown in (ii) and (iii) of FIG. 6B, the calculated effect addition area Ni is interpolated so as to increase as the state shifts from the start point key frame Fs to the end point key frame Fe. ing.

  The processing of S111 to S115 is processing for setting the effect addition area Ni of an arbitrary frame Fi between the start point frame Fs and the end point frame Fe, but the processing after S115 is processing for setting the mosaic block size. It is. The process will be described below.

  When the effect addition area Ni of an arbitrary frame Fi is calculated, the ratio between the effect addition area Ni and the reference area N is calculated (S116). The ratio is calculated with the x-axis ratio ABX as the x-axis ratio and the y-axis ratio ABY as the y-axis ratio. The x-axis ratio ABX is calculated from the lower right x coordinate Fir indicating the coordinates of the effect addition area Ni. The value obtained by subtracting the x coordinate Fil is obtained by dividing by an integer 720, and the y-axis ratio ABY is obtained by dividing the value obtained by subtracting the upper left y coordinate Fit from the lower right y coordinate Fib by the integer 480. In this embodiment, since the reference area N is an area having 720 pixels in the horizontal direction and 480 pixels in the vertical direction, it is divided by the integer 720 and the integer 480, but FIG. The numerical value is changed and calculated in accordance with the size of the area set by the operation of). Since the coordinates of the pixel at the upper left corner of the screen are (0.0), the lower left coordinates are subtracted from the lower right coordinates for the xy coordinates.

  When the x-axis ratio ABX and the y-axis ratio ABY are calculated in S116, the x-axis ratio ABX and the y-axis ratio ABY are multiplied by a reference abstraction amount BBs that is an abstraction amount with respect to the reference region N, and an effect is added. Conversion abstraction amounts BSX and BSY corresponding to the size of the area Ni are calculated (S117). In this embodiment, since the mosaic block is a square, when the value of the x-axis conversion abstraction amount BSX is greater than or equal to the value of the y-axis conversion abstraction amount BSY, Then, the subsequent processing is executed by adopting the x-axis conversion abstraction amount BSX, and otherwise, the subsequent processing is executed by adopting the y-axis conversion abstraction amount BSY.

  The mosaic block size is set using the conversion abstraction amount set in the processing of S116 to S117 for the effect addition region Ni set in the processing of S111 to S115, and the mosaic is added to the effect addition region Ni ( S118). The state is shown in FIG. 6B, and the mosaic is added so that the block size of the mosaic becomes larger as it becomes (i) to (iv). The frame to which the mosaic is added is combined with the original image corresponding to the frame stored in the video storage device 15, and the combined frame is stored in the post-processing frame storage area of the video storage device 15.

  When the addition of the mosaic is finished, it is confirmed whether or not an arbitrary frame Fi has reached the end point frame Fe (S119). If the end point frame Fe has not been reached (S119: No), the start frame Fs to the end point frame Fe are checked. Since interpolation processing has not been performed for all the frames in between, the process returns to S114 and the subsequent processing is repeatedly executed.

  On the other hand, as a result of checking in S119, if it is the end point frame Fe (S119: Yes), there is no more frame to be interpolated, so this processing routine is terminated and the processing returns to the main processing routine.

  As described above, in the editing process for applying the mosaic as described above, by setting the reference abstraction BBs in advance, the block size of the mosaic for a large number of arbitrary frames Fi between the start point frame Fs and the end point frame Fe. And the effect added area Ni are automatically complemented, so that the mosaic processing can be performed with a block size suitable for each effect added area Ni.

  Next, the case where the blurring process is selected as the editing process mode will be described below.

  When the blurring process is selected in the editing process mode, in the process of S105, the ratio of the blurring degree to the reference area N set by the user, the setting of the key frame to which the blurring process is added, and the processing target for the key frame And the coordinates of the effect addition region are set. In this setting, as in the operation described with reference to FIGS. 3A to 3C, the reference frame F in which the target image X to be blurred is shown as large as possible is selected, and the entire reference frame F is selected. Is set as a reference area N so that the blur amount is such that it cannot be determined what the target image X is. The ratio of the blur amount with respect to the reference region N is stored in the RAM 12 as the reference abstraction amount BBs. In addition, since the blur amount is set on the reference frame F where the target image X to be processed is large, it is possible to set a subtle blur amount while viewing the target image X.

  When the reference abstraction amount BBs is set, a key frame that actually adds blur is selected from a series of video data in the same manner as the operations described with reference to FIGS. 3D to 3F. When the effect addition region on the key frame is set, the blur amount is set based on the reference abstraction amount BBs and the blur is added. The blur amount is set by reading a table stored in the ROM 13 in correspondence with the reference abstraction amount BBs and the blur amount for the size of the effect addition area, and setting the blur amount from the reference abstraction amount BBs on the table. To do. As in the case of mosaic processing, the first key frame and the second key frame are stored in the key frame storage area.

  Here, a method for setting the brightness of the blur when the blur is added as described above with reference to FIG. 7 will be described. FIG. 7 is an explanatory diagram showing a method for setting the brightness of the blur.

  As shown in FIG. 7A, the effect addition region for adding blur is divided in units of pixels, and each pixel has a coordinate of pixel A (1.0) and a coordinate of pixel B (0). .1), the coordinates of pixel C are (1.1), the coordinates of pixel D are (2.1), and the coordinates of pixel E are (1.2). In this embodiment, the blur setting method is an average of five pixels (pixel A, pixel B, pixel D, and pixel E) that are the upper, lower, left, and right pixels centering on the pixel C that is the central pixel of 3 × 3 pixels. The value is set as the value of the pixel C, and the pixel C in which blur is added to an area different from the original image stored in the video storage device 15 is stored. This blurring process is executed for all the pixels in the effect addition region, and the state is shown in FIG.

  FIG. 7B shows a case where the blurring process is performed on the pixel D, the pixel F having the coordinate (2.0) on the upper side of the pixel D, the pixel G having the coordinate (3.1) on the right side, and the lower side. A pixel H having coordinates (2.2) is represented in FIG. 5B, and the blurring setting of the pixel D is obtained by calculating an average value of five pixels (pixel C, pixel D, pixel F, pixel G, pixel H) as the pixel D. Set as the value of. In this way, the blurring process is sequentially executed for all the pixels. It should be noted that the pixel that is the boundary of the effect addition region is calculated from the average value of four pixels, and the pixel that is a corner is calculated from the average value of three pixels. Further, the brightness of the blur is configured so that it can be set between “minimum value 0 and maximum value 127” in the same way as the brightness of the mosaic. When the image is monochrome, the brightness is obtained. It becomes lightness.

  FIG. 7C shows the case where the blurring process is performed in the range of 5 × 5 pixels. In this case, an average value is set from two pixels vertically and horizontally with respect to the center pixel. is doing. In addition, it is possible to further flatten the blur by widening and averaging the range of pixels for which the blur processing is set in this way, or by averaging not only the upper, lower, left and right pixels but also the diagonal pixels. .

  Next, the editing process executed in S103 described above will be described. In the editing process of the blurring process, the process from S111 to S117 described above sets the effect addition area Ni in the same manner as the mosaic process, and thus description thereof is omitted.

  In S118, blurring is added to the effect addition region Ni set in the processing of S111 to S115 using the conversion abstraction amount set in the processing of S116 to S117 (S118). The blurring process reads the table stored in the ROM 13 by associating the conversion abstraction amount with the pixel region for setting the degree of blurring and the number of repetitions, and associates the conversion abstraction amount set in S117 with the table. Then, the pixel region and the number of repetitions are determined, and blurring is added to the effect addition region Ni. The blurred frame is combined with the original image corresponding to the frame stored in the video storage device 15, and the combined frame is stored in the post-processing frame storage area of the video storage device 15. It should be noted that the table of the blur pixel area is set such that the larger the effect addition area Ni is, for example, 3 × 3 pixels, 5 × 5 pixels, and 7 × 7 pixels. The number of repetitions is a process of performing the blurring process again on the pixels once subjected to the blurring process on all the pixels. In this case as well, a table is set so that the number of repetitions increases as the effect addition area Ni increases. In addition, the blurring process is performed when adding blur by changing the pixel area, when adding blur by changing the number of repetitions, or when adding blur by combining the pixel area and the number of repetitions. Can be changed according to the target image X to be added and its size.

  Since the process after S119 is the same as the mosaic process described above, the description thereof is omitted.

  As described above, in the editing process for performing the blurring, by setting the reference abstraction BBs in advance, the blurring amount and the effect for many arbitrary frames Fi between the start point frame Fs and the end point frame Fe are set. Since the additional area Ni is automatically complemented, the blurring process can be performed with the blurring amount suitable for each effect added area Ni.

  In each flowchart, the process of S115 corresponds to the area specifying step according to claim 1, S117 corresponds to the abstraction amount calculation step, and S118 corresponds to the abstraction process step. The parameter setting step according to claim 1 corresponds to the operation of FIG. Further, the amount of abstraction described in claim 1 is a block size when a mosaic is added to the frame Fi, such as an area of a pixel to be subjected to blurring processing when adding blur and the number of repetitions.

  The present invention has been described above based on the embodiments. However, the present invention is not limited to the above embodiments, and various improvements and modifications can be made without departing from the spirit of the present invention. It can be easily guessed.

  For example, in the above-described embodiment, the video storage device 15 is configured by HD, but may be configured by a recording device such as a PC card, MO, CD-ROM, or DVD.

  In the above-described embodiment, after the mosaic block size and the blur amount ratio are set in advance on the reference frame F, the key frame effect addition area is set, but first the key frame effect addition is performed. After the area is set, the mosaic block size or the blur amount ratio may be set on the reference frame F.

  In the above embodiment, the mosaic process and the blurring process are separate editing processes, but may be executed simultaneously. This is because a table in which the block size of the mosaic and the blur amount are associated with each other so as to determine whether or not the target image X can be determined through experiments or the like is stored in the ROM 13 in advance, and the mosaic and blur are determined using this table. It is good also as what gives.

  In the above embodiment, the mosaic and the blur are added inside the effect addition region. However, the mosaic and the blur may be added outside the effect addition region.

1 is a block diagram schematically showing an electrical configuration of a video editing apparatus. It is the flowchart which showed the main process performed by CPU. It is explanatory drawing which showed the operation procedure which adds a mosaic to video data by operation of an operator. It is explanatory drawing which showed the setting method of the brightness of a mosaic. It is the flowchart which showed the edit process performed by CPU. It is explanatory drawing which showed the interpolation process performed by an edit process. It is explanatory drawing which showed the setting method of the brightness of a blur.

Explanation of symbols

1 Video Editing Device 10 Bus 11 CPU
12 RAM
13 ROM
14 Control 15 Video storage device 16 Video signal interface (I / F)
17 Display 18 Display circuit X Target image
S103 Editing process (execution means)
S104 Other processing (setting means, standard abstraction area designation means, parameter setting means, frame designation means, frame abstraction area designation means)
S111 to S115 Editing processing (abstracted area setting means)
S116 to S117 Editing processing (abstraction amount calculation means)
S118 Editing processing (abstracting means)

Claims (3)

In video editing equipment that abstracts video data,
Setting means for setting information used for abstraction applied to the video data;
Execution means for performing abstraction on the video data using the information set by the setting means,
The setting means includes
A standard abstraction area designating unit for designating a standard area for performing abstraction on one frame included in a plurality of frames constituting the video data;
Parameter setting means for setting an abstraction parameter that is a ratio of the abstraction amount to the size of the reference area specified by the reference abstraction area specifying means ;
Frame designation means for designating a start point frame that is a start point frame to be abstracted and an end point frame that is an end point to be abstracted from frames included in a plurality of frames constituting the video data;
Frame abstraction area designation means for designating an area to be abstracted for each of the start frame and the end frame specified by the frame specification means,
The execution means includes
Using the region for abstracting the start point frame specified by the frame abstraction region specifying unit and the region for abstracting the end point frame, the start point frame and end point frame specified by the frame specifying unit Abstraction area setting means for automatically setting an area to be abstracted by interpolation for any frame existing between ,
In addition to the area to be abstracted set by the abstraction area setting means, the area to be abstracted with respect to the start frame specified by the frame abstraction area specifying means and the area to be abstracted with respect to the end frame On the other hand, an abstraction amount calculation unit that calculates an abstraction amount according to the abstraction parameter set by the parameter setting unit ;
Based on the abstract value calculated by the abstraction amount calculating means, the abstraction for the area subjected to abstraction set by abstraction area setting means, said start frame specified by the frame abstracting region specifying means video editing apparatus characterized by and an abstraction means for applying an abstraction in the area for receiving a abstractions for regions and the ending frame subjected to. The abstraction means, the area for receiving a said abstraction area setting abstracted set by means of abstraction for regions and the ending frame subjected to abstraction for the start frame specified by the frame abstracting region specifying means is intended to apply the mosaic in the area to perform,
2. The parameter setting means sets a ratio of a block size of a mosaic to a size of a reference area designated by the reference abstraction area designation means as the abstraction parameter. The video editing device described in 1. The abstraction means, the area for receiving a said abstraction area setting abstracted set by means of abstraction for regions and the ending frame subjected to abstraction for the start frame specified by the frame abstracting region specifying means is intended to apply a blur to the area to perform,
2. The parameter setting unit is configured to set, as the abstraction parameter, a ratio of a blur amount to a size of a reference region designated by the reference abstraction region designating unit. Video editing equipment .

Images