JP3845641B2 - Image editing apparatus and image editing method - Google Patents

Description

The present invention relates to an image editing apparatus and editing method for editing video image information.

  In recent years, personal computers using a microprocessor and computer systems such as workstations tend to be multi-windowed for higher performance and better user interface. In such a video window system, improvement of the operability of the workstation and the development of new application methods are major problems, and in particular, how to handle general video signals such as NTSC signals in a multi-window system is a big problem. One of the problems.

  Conventionally, multi-window systems have mainly dealt only with text information, but in recent years we have also proposed a window system in which a window that displays video based on general video signals as a moving picture is displayed on the workstation display. (For example, see Non-Patent Document 1).

In the device described in Non-Patent Document 1, the video signal is A / D converted and then stored in the primary memory, and then subjected to predetermined image processing and then stored in the secondary memory. The contents of the secondary memory are read out in synchronization with the synchronization signal of the display, D / A converted, and then synthesized with the video signal from the personal computer and output to the display.
Araki et al., “VP-150 High-Definition Natural Image Processor”, NEC Technical Report VOL. 40, no. 7/1987, pp. 28-33

  However, in the apparatus described in Non-Patent Document 1, only a part or all of a display image by a personal computer is replaced with a video signal from another video signal source such as a VTR or a video camera and displayed. However, it was not possible to perform processing such as recording and editing on the video signal itself while viewing the displayed image.

  The present invention has been devised in order to solve the above-mentioned problem, and once a video signal is recorded in a memory for a plurality of screens and a predetermined operation is added to the contents of the memory, An object of the present invention is to provide a video processing apparatus having a wider operability and a better operability.

An image editing apparatus according to the present invention includes a display unit that displays image data, an image data acquisition unit that acquires moving image data, a recording unit that records moving image data acquired by the image data acquisition unit, and a mouse button While holding down, by moving the mouse cursor on the scroll bar displayed on the display means, image data corresponding to the position of the mouse cursor on the scroll bar is selected from the moving image data recorded on the recording means. an image selection means for successively selecting and displayed on the display means, the image from the moving image data by specifying a partial area of the specific image data selected displayed by said image selecting means to the display means And a cutout means for cutting out data. In the image editing method of the present invention, the moving image data is acquired by the image data acquiring unit, the moving image data acquired by the image data acquiring unit is recorded in the recording unit, and the mouse cursor is held down while the mouse button is pressed. Is shifted on the scroll bar displayed on the display means, and image data corresponding to the position of the mouse cursor on the scroll bar is continuously selected from the moving image data recorded on the recording means by the image selection means. is displayed on the display means, that the cutting by means cuts out the image data from the moving image data by specifying a partial area of the specific image data selected displayed by said image selecting means to the display means Features.

According to the present invention, a part of an arbitrary scene in a video image can be cut out .

  Hereinafter, the features of the present invention will be specifically described based on examples with reference to the drawings.

  FIG. 1 is a block diagram showing the basic configuration of the first embodiment of the video window system of the present invention.

  As shown in FIG. 1, the video window system of the first embodiment can display at least an image (hereinafter referred to as a video video) based on a video signal output from a video playback device 1 such as a VTR or a video camera. Video window 2, video data recording means 3 for recording a video signal corresponding to the video picture displayed in video window 2 in a memory in real time, and interface means for interpreting signals inputted from keyboard 4 and mouse 5 6 and a signal interpreted by the interface means 6 to select any video data intended by the user from a set of a plurality of video data recorded in the video data recording means 3, and the video window 2 or other video window 7 is composed of video data reproduction display means 8 for display on the screen 7.

  In this video window system, two types of display modes, a monitor mode and a playback mode, can be taken. Normally, the monitor mode is set, and the video window 2 displays the video image from the video reproduction device 1. In the reproduction mode, the video image from the video data reproduction display means 8 is displayed. .

  Signals input from the keyboard 4 and mouse 5 are output as control signals for the video data reproduction / display unit 8 by the interface unit 6, and one screen of video from a plurality of video data recorded in the video data recording unit 3. Select data. The selected video data is displayed on the video window 2 or another video window 7 by the video data reproduction / display unit 8.

  Next, the specific configuration of the first embodiment will be described with reference to the block diagram of FIG. An example of the display screen of this embodiment is shown in FIG.

  In the example of FIG. 2, in the video image display means 9, the video signal input from the video input terminal 10 is converted into a digital signal by the A / D converter 11, and the write controller 12 according to the field rate of the video signal. Write to the video memory 13. The contents of the video memory 13 are read out as a digital video signal by the read controller 14 controlled according to the scanning rate of the display to be displayed. This digital video signal passes through a switch 15 for switching between a monitor mode for monitoring video input and a playback mode for displaying recorded image data, and further, according to the size of the displayed video window, In order to prevent aliasing noise, it is stored in the buffer 17 through the spatial filter 16.

  On the other hand, display input from a computer, workstation, or the like for displaying text information is also input to the image synthesizer 19 via the display input terminal 18 and synchronized for display, and stored in the buffer 17. It is combined with the digital video signal and output from the video output terminal 20 to the display device as a video output.

  FIG. 3 shows an example of a display screen. The display unit 51 of the display device echoes and displays a command input from the keyboard 4 (see FIG. 1) or a response from the system. A text window 52 for displaying the image data, a video display window 53 for displaying image data for one screen read from the video data memory bank 22 of the video data recording means 21 described later, and a part of the image data is cut out and displayed. A text window 54 to be displayed together with the text data is displayed. In the text window 54, for example, a partial area of the image displayed in the video display window 53 is designated with the mouse 5 or the like, and the character string input from the keyboard 4 is copied into the text window 54 displayed. By doing so, it is possible to create a multimedia document in which a part of an arbitrary scene in a video image is cut out and incorporated in a document.

The video data recording means 21 inputs video video data D0, D1, D2,... Converted into digital signals from the video memory 13 in order to record the video signal input from the video input terminal 10. The write controller 12 assigns field numbers 0, 1, 2,... Starting from 0 and increments for each field, and stores them in the video data memory bank 22. An example of the storage state in the video data memory bank 22 is shown in Table 1.

  In the interface means 23, the position information supplied from the mouse 5 (see FIG. 1) via the mouse input terminal 24 is counted by the coordinate counter 25 and held as the coordinates of the mouse cursor 55 (see FIG. 3). Is done. The mouse button detector 26 detects mouse button on / off information and outputs it to the video data reproduction display means 28. In this embodiment, as shown in FIG. 4, a mouse 5 having three types of buttons, a right button 5R, a middle button 5C, and a left button 5L is considered. Further, as shown in FIG. 3, it is assumed that the mouse cursor 55 indicates a part of the scroll bar 56 on the display unit 51. The scroll bar 56 is disposed adjacent to the right side of the video display window 53 and has a length substantially equal to the height of the video display window 53. The coordinate counter 25 detects that the mouse buttons 5L, 5C, and 5R have been pressed, and outputs the coordinates at that time to the normalizer 27. The normalizer 27 calculates the ratio of the distance 1 from the starting point of the designated point on the scroll bar 56 to the total length L of the scroll bar 56 from the coordinate value, and takes the video as a value α from 0 to 1 The data is output to the data reproduction display means 28.

  In the video data reproduction display means 28, the number M of image data recorded in the video data memory bank 22 is held in a recorded image number holder 29. Further, when the recorded video data is reproduced and displayed on the video display window 53, an image indicating which field is displayed on the video display window 53 among the image data recorded on the video data memory bank 22 is displayed. A counter 30 and a multiplier 31 for obtaining a field number F corresponding to an image to be displayed from the output α of the normalizer 27 of the interface means 23 and the output M of the recorded image number holder 29 are provided.

  When the mouse button detector 26 detects that the right button 5R of the mouse 5 has been pressed, a signal CU is generated. By this signal CU, the image counter 30 is counted up. The image data of the field being displayed is displayed in the video display window 53.

  Further, the image counter 30 is counted down by the signal CD for detecting that the left button 5L is pressed, and as a result, the image data of the field recorded immediately before is displayed on the video display window 53.

  Further, the multiplier 5 multiplies the value α from 0 to 1 output from the normalizer 27 of the interface means 23 and the content M of the recorded image number holder 29 by the mouse 5, thereby instructing. The field number F of the obtained image data is obtained, and the field number F is loaded into the image counter 30 by the signal LD for detecting that the middle button 5C has been pressed. As a result of loading, the image data of the field number recorded in the video data memory bank 22 is displayed in the video display window 53.

  Thereby, for example, the recorded video data can be viewed as if the video tape recorder is performing frame advance by the right or left button 5R, 5L of the mouse 5. In addition, a specific one scene of the recorded video data can be directly selected and displayed by the middle button 5C of the mouse 5. Further, by holding the middle button 5C of the mouse 5 and shifting the mouse cursor 55 on the scroll bar 56, the image counter 30 continuously changes while the field number F of the image data designated by the mouse 5 changes. In the video display window 53, video data corresponding to the position designated by the mouse 5 on the scroll bar 56 is continuously displayed, as if the video tape recorder was fast-forwarding or rewinding. Processing becomes easy.

  As a result, an arbitrary scene can be extracted from a series of moving images by a simple operation as needed. For example, a new image is created by combining a computer graphic image and a video image from a video tape recorder. It is possible to provide a better user interface in such a multimedia document editing operation.

  Next, a second embodiment of the present invention will be described with reference to the principle block diagram of FIG. 5 and the specific block diagram of FIG. Note that members and the like corresponding to those of the first embodiment shown in FIGS. 1 to 3 are denoted by the same reference numerals, and redundant description is omitted.

  The principle block diagram of the second embodiment shown in FIG. 5 is compared with the principle block diagram of the first embodiment shown in FIG. The difference is that a preview data display means 32 is provided. The preview data display means 32 is for displaying a series of video data continuously from a set of video data recorded in the video data recording means 3. A memory is provided for recording video data of interest and a plurality of video data before and after the video data based on the instruction.

  In the second embodiment shown in FIG. 5, as in the first embodiment, the video window 2 normally displays a video image from the image reproducing apparatus 1, and also displays the reproduction display. In some cases, the video image from the video data reproduction display means 8 can be displayed. Further, by reading out the image data recorded in the preview data display means 32, a plurality of video data recorded before and after the video data of interest is displayed in the video window 2 in the order of the recorded time. In this embodiment, this video window is particularly distinguished by being called a preview window. On the other hand, the signals inputted from the mouse 5 and the keyboard 4 are outputted as control signals of the video data reproduction / display means 8 by the interface means 6, and one screen of video from a plurality of video data recorded in the video data recording means 3. Select data. The selected video data is displayed on the video window 2 or the like by the video data reproduction / display means 8 and at the same time, displayed on the preview window together with a plurality of video data recorded before and after the selected video data. The In the example of FIG. 5, the preview window is included in the video window 2.

  FIG. 6 shows a specific block diagram of the second embodiment, which differs from the specific block diagram of the first embodiment shown in FIG. The output is supplied to the preview data memory 35 via the spatial filter 34, and the output of the preview data memory 35 is supplied to the image synthesizer 19 via the buffer 36. The preview data memory 35 is supplied with control signals from the write controller 12 and the read controller 14. FIG. 7 shows an example of a display screen according to the second embodiment.

  In this embodiment, as shown in FIG. 7, a preview window 57 is displayed separately from the video display window 53, and the preview window 57 includes the video data of interest and five fields before and after that, that is, a total of 11 pieces. The video data Dn-5, Dn-4,..., Dn,..., Dn + 4, Dn + 5 can be displayed.

  A preview data display means 33 having a spatial filter 34 and a preview data memory 35 inputs the field number F output from the video data reproduction display means 28 and corresponds to the field number F from the video data memory bank 22. The video data to be processed and the image data of a total of 11 fields, that is, 5 fields before and after are stored in the preview data memory 35 via the spatial filter 34. The stored image data for 11 fields is output to the video image display means 9 and displayed as a preview window 57.

  As a result, as shown in FIG. 7, by simultaneously viewing a plurality of video data displayed in the preview window 57, the relationship and flow before and after the video data can be grasped. Further, if the mouse 5 is operated on the preview window 57 and the right button 5R or the left button 5L is pressed, the field number indicated by the image counter 30 is increased or decreased by 1, so that it corresponds to the field number. The image data to be read is read from the video data memory bank 22 and displayed on the video display window 53, and image data for 11 fields centering on the field number after the change is displayed on the preview window 57. As a result, the recorded video data can be viewed as if the video tape recorder is moving forward by operating the mouse 5. Further, by operating the middle button 5C of the mouse 5 and loading the field number F obtained by the multiplier 31 directly into the image counter 30, a specific scene in the recorded video data is directly selected. You can select and display.

  Further, by moving the mouse cursor 58 on the scroll bar 59 while the middle button 5C of the mouse 5 is being pressed, the video display window 53 and the preview window 57 are displayed in the corresponding video indicated by the mouse 5 on the scroll bar 59. Data is continuously displayed, and processing such as fast-forward playback and rewind playback of a video tape recorder can be easily performed.

  In the second embodiment, it is assumed that the interface unit 23 has been changed to one corresponding to the preview window 57.

  Next, a third embodiment of the present invention will be described with reference to the principle block diagram of FIG. 8 and the specific block diagram of FIG. Note that members and the like corresponding to those of the second embodiment shown in FIGS. 5 to 7 are denoted by the same reference numerals, and redundant description is omitted. FIG. 10 shows an example of a display screen according to the third embodiment.

  The principle block diagram of the third embodiment shown in FIG. 8 is compared with the principle block diagram of the second embodiment shown in FIG. 5 between the video data reproduction display means 8 and the preview data display means 32. The difference is that an image cue unit 37 is provided. The image queue unit 37 is a memory having a queue structure for storing a number uniquely corresponding to video data.

  Also in the third embodiment, as in the first and second embodiments described above, the video window 2 normally displays a video image from the video reproduction device 1, and also displays the reproduction display. In some cases, the video image from the video data reproduction display means 8 can be displayed. Similarly to the second embodiment, the preview data display means 32 displays a plurality of video data recorded before and after the video data of interest in the preview window in the order of the recorded times.

  On the other hand, the signals inputted from the mouse 5 and the keyboard 4 are outputted as control signals of the video data reproduction / display means 8 by the interface means 6, and one screen of video from a plurality of video data recorded in the video data recording means 3. Select data. The selected video data is displayed on the video window 2 by the video data reproduction / display unit 8 and at the same time, the selected video data is displayed together with a plurality of video data recorded before and after the selected video data.

  Here, in the third embodiment, when an operation for selecting a desired video data range on the preview window is performed using the mouse 5, a series of numbers uniquely corresponding to the series of video data is displayed in the image queue. Stored in section 37. By repeating this operation, it is possible to obtain moving image data obtained by connecting arbitrary video data stored in the video data recording means 3 in an arbitrary order intended by the user. The moving images are displayed in the preview window and the video window 2 based on the number stored in the image queue unit 37.

  FIG. 9 shows a specific block diagram of the third embodiment. The difference from the second embodiment shown in FIG. 6 is that the interface means 23 determines the mouse position. And a range indicator 41 for converting a range on the scroll bar 59 designated by the mouse cursor 58 into a range of field numbers of a plurality of image data. The image queue unit 39 is provided with a queue memory 38 to which the output of the device 41 is supplied and stored, and the output is supplied to the preview data memory 35.

  The field numbers from the range indicator 41 and the image counter 30 are supplied to the image queue unit 39, and the field numbers are output from the image queue unit 39 to the video data memory bank 22 and the preview memory 35. Further, a signal for changing the contents of the image counter 30 to the field number corresponding to the image designated by the mouse on the preview window 57 is output from the image queue unit 39.

  Also in the third embodiment, as in the first and second embodiments, the image data selected by the mouse 5 from the plurality of image data stored in the video data memory bank 22 is converted into video. The image data is displayed on the image window 53, and the image data for the previous and next 11 fields including the target image data is displayed on the preview window 57 by the preview data display means 33.

  Now, in a state where the mouse cursor 58 is present on the preview window 57, the left button 5L of the mouse 5 is used to start the area in the range desired by the user in the series of video data displayed in the preview window 57. When the instruction is given and the end is instructed by the right button 5R, the coordinate value of the mouse cursor 58 when each of the buttons 5L and 5R is pressed is supplied to the coordinate comparator 40, respectively. The coordinate comparator 40 detects that a specific series of video data on the preview window 57 has been selected, and outputs the coordinate value of the mouse cursor 58 to the range indicator 41. The range indicator 41 knows the field numbers corresponding to the individual video data of the series of video data selected from the output of the preview data memory 35, and writes them in the queue memory 38 as a series of field numbers in time order. Here, it should be noted that the field number corresponding to each video data is uniquely determined in this system.

  By repeating the above-described operation of selecting a series of video data displayed in the preview window 57 and writing a corresponding series of field numbers to the image queue section 39, the moving picture data are joined together to create a new one. Create moving image data.

  On the other hand, by outputting a series of field numbers written in the queue memory 38 to the preview data memory 35, image data corresponding to the field numbers written in the queue memory 38 is displayed in the preview window 57. Similarly, by outputting a specific field number among the series of field numbers to the video data memory bank 22, image data corresponding to the field number is displayed on the video display window 53.

  As a result, as in the first and second embodiments, while simultaneously viewing a plurality of video data displayed in the preview window 57, the relationship and flow before and after the video data can be grasped. By operating the mouse 5, the recorded video data can be viewed as if the video tape recorder was performing frame advance, fast forward playback, and rewind playback.

  In particular, in the third embodiment, by providing the image queue unit 39, the moving image data is referred to, and after examination, a series of moving images desired by the user are cut out and connected by the mouse 5, and a new moving image is obtained. Image data can be easily obtained.

  In addition, the ratio of the amount of data indicating the field number actually written with respect to the maximum capacity of the queue memory 38 is displayed as a marker 60 on the display screen 51 so as to cut out and join the images. The user can know how much further editing can be performed. In order to display the marker 60, for example, a marker generator in which the generation timing of the marker signal is changed in the signal path between the queue memory 38 and the image synthesizer 19 according to the amount of data in the queue memory 38 ( (Not shown) may be provided.

  As described above, an identification number such as a field number assigned to image data to be displayed among a plurality of image data stored in the memory is stored in the queue memory, and the memory is based on this identification number at the time of reproduction. By reading out the image data, the above-mentioned frame advance and other operations are performed to examine the flow of the video, and a series of moving images desired by the user are cut out and connected to create new moving image data Can do. In addition, unlike editing by film or video tape, the editing location can be changed very easily, and since the processing is performed digitally, there is no deterioration in image quality due to editing work.

Principle block diagram of the first embodiment of the video window system of the present invention Specific block diagram of the first embodiment Explanatory drawing which shows the example of the display screen by 1st Example Schematic top view of the mouse Principle block diagram of the second embodiment of the video window system of the present invention Specific block diagram of the second embodiment Explanatory drawing which shows the example of the display screen by 2nd Example Principle block diagram of the third embodiment of the video window system of the present invention Specific block diagram of the third embodiment Explanatory drawing which shows the example of the display screen by 3rd Example

Explanation of symbols

1: Video playback device 2, 7: Video window 3: Video data recording means 4: Keyboard 5: Mouse 6, 23: Interface means 8, 28: Video data raw display means 9: Video image display means 10: Video input terminal 11 : A / D converter 12: Write controller 13: Video memory 14: Read controller 15: Switcher 16, 34 Spatial filter 17: Buffer 18: Display input terminal 19: Image synthesizer 20: Video output terminal
21: Video data recording means 22: Video data memory bank 24: Mouse input terminal 25: Coordinate counter 26: Mouse button detector 27: Normalizer 29: Recorded image count holder 30: Image counter 31: Multiplier 32 33: Preview data display means 35: Preview data memory 36: Buffer 37, 39: Image queue section 38: Queue memory 40: Coordinate comparator 41: Range indicator 51: Display section 52, 54: Text window 53: Video display Window 55, 58: Mass cursor 56, 59: Scroll bar 57: Preview window 60: Marker

Claims (2)

Display means for displaying image data;
Image data acquisition means for acquiring moving image data;
Recording means for recording moving image data acquired by the image data acquisition means;
While holding down the mouse button, the mouse cursor is shifted on the scroll bar displayed on the display means, thereby corresponding to the position of the mouse cursor on the scroll bar from the moving image data recorded on the recording means . an image selection means for displaying on said display means continuously select the image data,
Clipping means for cutting out image data from moving image data by designating a partial area of the specific image data selected and displayed by the image selection means on the display means;
An image editing apparatus comprising: Moving image data is acquired by image data acquisition means,
Recording the moving image data acquired by the image data acquisition unit in a recording unit;
An image corresponding to the position of the mouse cursor on the scroll bar from the moving image data recorded on the recording unit by moving the mouse cursor on the scroll bar displayed on the display unit while holding down the mouse button. data continuously selected is displayed on the display unit by the image selecting means,
An image editing method, wherein image data is cut out from moving image data by specifying a partial area of the specific image data selected and displayed by the image selection means on the display means.

Images