JP3626080B2 - Moving image processing device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a moving image processing apparatus that processes moving image data, and in particular, by adding an input code by a user to an index image for referring to moving image data, moving image data desired by the user can be easily obtained. The present invention relates to a moving image processing apparatus that can be created and reproduced.
[0002]
[Prior art]
In recent years, with the widespread use of portable video cameras, 8 mm cameras, etc., anyone can easily shoot images. However, in order to complete as a video work, it is necessary to perform editing processing such as rearranging the captured video data (material data) in an easy-to-view order, inserting titles and explanations, and adding music. .
[0003]
In general, as shown in FIG. 11, moving image data is composed of a set of continuous still image data (frame data), and each frame is reproduced in order along the time axis direction.
[0004]
As an editing apparatus for moving image data of such a format, for example, in Japanese Patent Laid-Open No. 4-117686, a user takes out a frame (index image) representing each material data from a plurality of material data and indexes them. Displaying a list of images, registering index images corresponding to each material data in the playback order table according to the order in which the material data is played back, and moving image data indicated by each index image in chronological order according to the order of the registered index images It has been proposed to obtain moving image data desired by a user by reproducing the image automatically.
[0005]
[Problems to be solved by the invention]
However, in the above-described conventional moving image editing apparatus, it is necessary to display a list of index images as many as the number of material data, and a sufficiently large display device for displaying the index images is necessary. There is a problem that it is difficult to apply to a portable device in which it is difficult to mount a display device having a large area.
[0006]
In the conventional moving image editing apparatus, it is possible to display many index images on a display device having a small display area by reducing the index image. However, if the index image is reduced, it is difficult to see. In addition, the contents of the image data indicated by the index image are difficult to understand, and there is a problem that the usability is poor.
[0007]
The present invention has been made in view of the above problems, and displays a single index image, and a display device with a small display area is used by the user registering an input code for the index image. Even in such a case, a moving image processing apparatus capable of easily editing a moving image or the like is provided.
[0008]
[Means for Solving the Problems]
The first invention of the present application is for referring to at least one moving image data.A single display corresponding to each moving image dataMeans for registering an input code input by a user with respect to an index image; means for reading out an input code registered with respect to the index image; andAnd beforeA code registration table registered in association with an editing method of moving image data referred to by the index image, and an editing method corresponding to the read input codeBeforeMeans for searching from the code registration table;The moving image data referred to by the index image is converted according to the searched editing method.And means for editing.
[0009]
The second invention of the present application is for referring to at least one moving image data.A single display corresponding to each moving image dataMeans for registering an input code input by a user with respect to an index image; means for reading out an input code registered with respect to the index image; andAnd beforeA code registration table registered in association with a reproduction method of moving image data referred to by the index image, and a reproduction method corresponding to the read input codeBeforeMeans for searching from the code registration table;According to the retrieved reproduction method, the moving image data referred to by the index imageAnd a reproducing means.
[0010]
A third invention of the present application is for referring to at least one moving image data.A single display corresponding to each moving image dataMeans for registering an input code input by a user with respect to an index image; means for reading out an input code registered with respect to the index image; andAnd beforeA code registration table registered in association with additional data of moving image data referred to by the index image, and additional data corresponding to the read input codeBeforeMeans for retrieving from the code registration table, and the additional data retrievedBeforeAnd means for reproducing in synchronization with moving image data referred to by the index image.
[0011]
In each of the above video processing devices,Furthermore, the input code newly created by the user, the editing method associated with the input code, and the playback methodLaw or lawIs provided with means for registering additional data in the code registration table. Also,In each of the above moving image processing devices, at least the image data of the index image, the moving image data, and a handwritten input code input by the handwritten code input device, and the image data stored in the storage device And an image display device capable of switching and displaying each reproduction image of the moving image data or the handwritten input code. Furthermore, in this moving image processing apparatus, the reproduced image of the handwritten input code is superimposed on the reproduced image of the image data of the index image displayed by the image display device.
[0012]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, a first embodiment of a moving image processing apparatus of the present invention will be described in detail with reference to FIGS.
[0013]
FIG. 1 is a block diagram showing a schematic configuration of a moving image processing apparatus according to the present embodiment. In FIG. 1, an instruction input device 10 is a controller for inputting instructions for starting and ending editing and reproduction, and the input instructions are output to the editing control device 18.
[0014]
The handwriting code input device 11 is an input device such as a touch panel on which a user inputs a handwriting input code. The input handwriting input code is stored in the storage device 17 via the editing control device 18. It has become.
[0015]
Here, the code is input by handwriting by the user. However, the present invention is not limited to this, and it goes without saying that a desired code may be input using, for example, a keyboard or a mouse. .
[0016]
The handwriting code reproduction device 12 reproduces the handwriting input code stored in the storage device 17 in a form that can be displayed on the image display device 14 and outputs the code to the image display device 14.
[0017]
Further, the index image reproduction device 13 reproduces the index image data stored in the storage device 17 in a form that can be displayed on the image display device 14 and outputs it to the image display device 14. Here, the index image refers to a representative image for referring to at least one moving image data stored in the storage device 17.
[0018]
In the present embodiment, one index image data is arbitrarily selected from a plurality of index image data stored in the storage device 17 and displayed on the image display device 14.
[0019]
The moving image reproduction device 16 reproduces the moving image data stored in the storage device 17 in a form that can be displayed on the image display device 14, and outputs it to the image display device 14.
[0020]
Here, a CRT, a liquid crystal display, or the like is used as the image display device 14, and the handwriting input code image output from the handwriting code playback device 12 is superposed on the index image output from the index image playback device 13. Imposed.
[0021]
As data to be displayed on the image display device 14, moving image data or index image data can be switched.
[0022]
The handwriting code registration table 15 stores handwriting input codes and editing methods in association with each other so that by specifying the handwriting input code, the corresponding editing method can be searched. It has become.
[0023]
The handwriting code determination device 19 searches the handwriting code registration table 15 for an editing method corresponding to the handwriting input code input from the editing control device 18 by using the handwritten character recognition function. The editing method is output to the editing control device 18.
[0024]
The editing control device 18 reads the moving image data and the index image data stored in the storage device 17 and outputs them to the moving image reproduction device 16 and the index image reproduction device 13, respectively. It comes to play.
[0025]
The edit control device 18 stores the handwriting input code input from the handwriting code input device 11 in the storage device 17. Further, the input handwritten code is not only recorded in the recording device 17 but also output to the handwritten code reproducing device 12 and the handwritten input code is displayed on the image display device 14. It is possible to confirm the handwritten input code.
[0026]
In addition, by reading the handwriting input code stored in the storage device 17 and outputting it to the handwriting code determination device 19, an editing method corresponding to the handwriting input code can be obtained. The moving image data stored in the storage device 17 is edited according to the obtained editing method.
[0027]
Here, an optical disk device, a magnetic disk device, a magnetic tape device, a memory card, or the like can be used as the storage device 17, and moving image data, index image data, audio data, It is assumed that various data such as handwritten codes, character data, and information associated therewith are stored.
[0028]
Further, the storage device 17 manages the storage position and size in the storage device 17 for the moving image data, index image data, handwritten code, voice data, character data, and information associated therewith. By specifying a data identification code such as a file name from the editing control device 18, arbitrary data can be appropriately acquired.
[0029]
FIG. 2 is an explanatory diagram showing the handwritten code registration table 15 in the present embodiment. The handwritten code registration table 15 is composed of a handwritten code column 2a and an editing method column 2b. Each handwritten input code stored in the handwritten code column 2a and each editing stored in the editing method column 2b. Each method has a relationship in which reference can be made to each other. By specifying a certain handwriting input code, it is possible to specify an editing method corresponding to the handwriting input code.
[0030]
For example, in FIG. 2, as an editing method corresponding to the “·” mark of the handwriting input code 2a1, the editing method2b1See “Playing the Referenced Video Data First”Dobe able to.
[0031]
If no editing method corresponding to the handwriting input code is found in the handwriting code registration table 15, “do nothing” of the editing method 2b3 is selected.
[0032]
Here, any text can be stored in the editing method column 2b of the handwriting code registration table 15 as long as it is a description that can be edited, such as a text document that describes the editing processing procedure or a computer language that performs editing processing. A description can be used.
[0033]
In addition, a handwriting input code newly created by the user may be registered in the handwriting code registration table 15 by adding a reference relationship with the editing method stored in the handwriting code registration table 15. It is possible. As a result, editing can be performed using a code that allows the user to easily recall the editing method, thereby improving editing efficiency.
[0034]
Next, FIG. 3 is an explanatory diagram showing the structure of moving image data stored in the storage device 17 in the present embodiment. The moving image data is composed of at least one frame. In FIG. 3, the moving image data 30 is composed of a series of frames F31, F32, F33,..., F3n (n is an integer).
[0035]
Each moving image data is given a unique data identification code in the storage device 17, and arbitrary moving image data can be read from the storage device 17 by designating the data identification code.
[0036]
FIG. 4 is an explanatory diagram showing a structure (index entry) for managing the relationship between moving image data stored in the storage device 17 and index image data referring to the moving image data.
[0037]
In FIG. 4, the index entry 40 is composed of an index image data storage area 41, a handwritten code storage area 42, and a moving image identification information storage area 43, and the index entry 40 refers to the index image data storage area 41. An index image of moving image data is stored.
[0038]
The handwritten code storage area 42 is an area for storing a handwritten input code input by the user. The moving image identification information storage area 43 stores a data identification code of moving image data referred to by the index entry 40.
[0039]
Here, as shown in FIG. 5, all index entries are collectively stored in a table (index entry table) to which a unique data identification code is given in the storage device 17 and registered in the index entry table. Each index entry is assigned a unique registration number starting from 0 and continuously increasing.
[0040]
Therefore, any index entry can be acquired by specifying a registration number in the index entry table. An arbitrary frame in the moving image data can be used as the index image in the index image data storage area.
[0041]
In particular, by using a frame that can easily and in detail know the contents of moving image data as an index image, it becomes unnecessary to reproduce the moving image data and confirm the contents at the time of editing, thereby improving the efficiency of editing work. be able to.
[0042]
Further, FIG. 6 is an explanatory diagram showing a case where the moving image data V1 and the moving image data V2 are edited using the present embodiment. Here, the moving image data V1 is composed of a series of frames V1F1, V1F2, and V1F3, and the moving image data V2 is composed of a series of frames V2F1, V2F2, and V2F3.
[0043]
The moving image data V1 and V2 are referred to from index entries I1 and I2, respectively. The index entry I1 includes an index image data storage area I1P, a handwriting code storage area I1C, and a moving image identification information storage area I1L. Has been.
[0044]
Similarly, the index entry I2 includes an index image data storage area I2P, a handwriting code storage area I2C, and a moving image identification information storage area I2L.
[0045]
Next, in the moving image data V1 and V2 in FIG. 6, a procedure for editing the moving image data V2 first and then reproducing the moving image data V1 will be described with reference to the flowchart in FIG. .
[0046]
First, when an instruction to edit the index entry I2 referring to the moving image data V2 to be reproduced first is input from the instruction input device 10 to the editing control device 18, the index entry I2 is read from the storage device 17 ( Step 701).
[0047]
Then, the index image data stored in the index image data storage area I2P of the index entry I2 is displayed on the image display device 14 (step 702).
[0048]
Next, a handwriting input code “(1)” indicating “reproduce the reference destination moving image data first” is input from the handwriting code input device 11 (step 703). The input handwriting input code is stored in the handwriting code storage area I2C of the index entry I2 in the storage device 17 via the editing control device 18 (step 704).
[0049]
At this time, since the inputted handwriting input code is superimposed on the index image being displayed via the handwriting code reproducing device 12, the user correctly inputs the handwriting input code “▲ 1 ▼”. Can be confirmed.
[0050]
Similarly, when an instruction to edit the index entry I1 that refers to the moving image data V1 to be reproduced second is input from the instruction input device 10 to the editing control device 18, the index entry I1 is received from the storage device 17. Read.
[0051]
Then, the index image data stored in the index image data storage area I1P of the index entry I1 is displayed on the image display device 14. Next, from the handwriting code input device 11, a handwriting input code “{circle around (2)}” indicating “reproduce the second reference image data” is input.
[0052]
The input handwriting input code is stored in the handwriting code storage area I1C of the index entry I1 in the storage device 17 via the editing control device 18.
[0053]
As described above, since editing to the index entries I1 and I2 referring to the moving image data V1 and V2 to be edited is completed, the editing operation is finished (step 705).
[0054]
Next, a procedure for reproducing moving image data edited by the above-described editing operation will be described with reference to the flowchart of FIG.
[0055]
When the instruction input device 10 instructs the editing control device 18 to reproduce, the editing control device 18 registers the handwriting input code 2a1 indicating “reproduce the reference destination moving image data first” in the handwriting code storage area. Search for index entries that have been added.
[0056]
As a search procedure, first, index entries are read one by one from the index entry table of the storage medium 17 in order from the registration number 0 (step 802).
[0057]
Here, when the search of all index entries registered in the index entry table is completed, the reproduction process is terminated (step 801).
[0058]
If no handwriting input code is stored in the handwriting code storage area of the read index entry, the process repeats from step 801 for the index entry of the next registration number (step 803).
[0059]
Next, the handwriting input code stored in the handwriting code storage area of the read index entry is input to the handwriting code determination device 19 (step 804).
[0060]
If the handwriting input code stored in the index entry is not registered in the handwriting code registration table, the process repeats from step 801 for the index entry of the next registration number (step 805).
[0061]
By the above search procedure, the handwriting input code “▲ 1 ▼” in the handwriting code storage area I2C of the index entry I2 matches the handwriting input code 2a1 of the handwriting code registration table 15, so the handwriting input code 2a1 The editing method 2b1 corresponding to is acquired from the handwriting code registration table 15 (step 806).
[0062]
The editing method 2b1 acquired from the handwritten code registration table 15 is input to the editing control device 18 (step 807). In the editing control device 18, the moving image data V2 referred to by the index entry I2 is referred to according to the editing method 2b1. Is reproduced (step 808).
[0063]
Here, the moving image data referred to by the index entry can be acquired by designating the recording medium 17 with the data identification code in the moving image identification information storage area of the index entry.
[0064]
As described above, while the moving image data V2 is being reproduced, the editing control apparatus 18 registers the handwriting input code 2a2 indicating “reproduce the moving image data of the reference destination second” in the handwriting code storage area. Search for index entries that have been made.
[0065]
By executing Step 801 to Step 805, the handwriting input code “▲ 2 ▼” in the handwriting code storage area I1C of the index entry I1 matches the handwriting input code 2a2 of the handwriting code registration table 15. The editing method 2b2 corresponding to the handwriting input code 2a2 is acquired from the handwriting code registration table 15 (step 806).
[0066]
The acquired editing method 2b2 is input to the editing control device 18 (step 807). In accordance with the editing method 2b2, the editing control device 18 moves the moving image data referred to by the index entry I1 after the reproduction of the moving image data V2. V1 is reproduced (step 808).
[0067]
As described above, edited moving image data to be reproduced in the order of moving image data V2 and moving image data V1 is obtained from the moving image data V1 and V2 of the material.
[0068]
As the data structure of the index entry in the present embodiment, any structure can be used because index image data, handwriting input code, and moving image identification information may be prepared at the time of editing or reproduction.
[0069]
For example, the index image data, the handwriting input code, and the moving image identification information may be stored in the storage device 17 as separate files, and data necessary for editing or reproduction may be sequentially read from each file.
[0070]
In this case, it is sufficient to prepare a handwriting code storage area only for the index entry in which the handwriting input code is registered, so that the storage capacity of the storage device 17 can be saved.
[0071]
Further, in the present embodiment, description has been made using only frames as components of moving image data. However, it is obvious that audio data, character data, or the like may be added.
[0072]
Further, in the present embodiment, the moving image data V1 to be reproduced next is searched during the reproduction of the moving image data V2, but before the reproduction procedure is performed, the handwritten input code of the index entry is previously stored. Accordingly, the moving image data may be newly created.
[0073]
As a result, the editing method according to the present invention can be applied even when an apparatus that cannot implement the editing method registered in the handwritten code registration table in real time is used.
[0074]
As described above in detail, according to the moving image processing apparatus of the present embodiment, handwritten input codes are displayed on the index image data while displaying index images for referring to moving image data as a material one by one. By registering, moving image data can be edited.
[0075]
Therefore, it is not necessary to display a list of index images when editing, and the display screen can be used effectively. In addition, since a user can use a symbol or the like as a handwriting input code to be edited, an easy-to-use interface can be realized.
[0076]
Next, as a second embodiment of the moving image processing apparatus of the present invention, the reference relationship between the handwriting input code and the moving image data reproduction method is registered in the handwriting code registration table, and the handwriting code of the index entry is registered. If the handwritten code corresponding to the reproduction method desired by the user is registered in the storage area, the moving image data referred to by the index entry can be reproduced by the method desired by the user.
[0077]
For example, when two types of audio data, English and Japanese, are prepared as audio data to be reproduced in synchronization with moving image data referenced by the index entry, as shown in FIG. Such a handwritten code registration table is prepared, and a moving image referred to by the index entry is registered by registering a handwritten input code corresponding to a desired reproduction method in the handwritten code storage area of the index entry. When data is reproduced, it is possible to reproduce a voice desired by the user.
[0078]
Furthermore, as a third embodiment of the moving image processing apparatus of the present invention, a handwriting code registration table is prepared in which additional data such as voice data, still image data, and character data can be referred to from the handwriting code. By storing a handwriting input code that can be referred to by the additional data in the handwritten code storage area, the additional data is synchronized with the moving image data in accordance with the reproduction timing of the moving image data referred to by the index entry. Can be played.
[0079]
For example, in the case of moving image data, when a user wishes to insert a sound effect at a scene desired by the user, a handwritten code registration table as shown in FIG. 10 is prepared, and an index entry that refers to the moving image into which character data is to be inserted is prepared. By registering the handwriting input code “☆” in the handwriting code storage area, it becomes possible to display the character data in synchronization with the reproduction of the moving image data when the moving image data is reproduced.
[0080]
【The invention's effect】
According to the moving image processing apparatus according to claim 1 of the present application, while displaying index images for referring to moving image data as a material one by one, by registering an input code for the index image data, Since moving image data can be edited, it is not necessary to display a list of index images when editing, and the display screen can be used effectively.
[0081]
In addition, since a user can use a symbol or the like as an input code for editing, an easy-to-use interface can be realized.
[0082]
According to the moving image processing apparatus according to claim 2 of the present application, by registering an input code that can refer to the reproduction method in the index image data for referring to the moving image data as the material, the index image data is referred to. It is possible to reproduce the moving image data in a reproduction method desired by the user.
[0083]
According to the moving image processing apparatus according to claim 3 of the present application, the handwritten code that can refer to additional data such as voice data, still image data, and character data is registered in the index image data for referring to the moving image data as the material. By doing so, it becomes possible to reproduce the additional data in synchronization with the moving image data.
[0084]
According to the moving image processing apparatus according to claim 4 of the present application, since the user can register an input code that easily recalls the editing method, the moving image data can be edited using the input code, and the editing work by the user can be performed. Can be made easy.According to the moving image processing apparatus of the present invention, the index image image data, the moving image data, and the handwritten input code input by the handwritten code input device are stored, and the reproduced image is stored in the image display device. Since the display can be switched, each can be confirmed on the image display device. Furthermore, according to the moving image processing apparatus according to claim 6 of the present application, since the reproduction image of the handwritten input code is superimposed on the reproduction image of the image data of the index image, the user can use the image data of the index image. It can be confirmed that the handwritten input code has been correctly input on the reproduced image.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a schematic configuration of a first embodiment of the present invention.
FIG. 2 is an explanatory diagram showing a handwritten code registration table in the first embodiment of the present invention.
FIG. 3 is an explanatory diagram showing a structure of moving image data used in the first embodiment of the present invention.
FIG. 4 is an explanatory diagram illustrating a structure of an index entry according to the first embodiment of this invention.
FIG. 5 is an explanatory diagram showing the structure of an index entry table in the first embodiment of the invention.
FIG. 6 is an explanatory diagram showing a relationship and structure between moving image data edited by the first embodiment of the present invention and an index entry.
FIG. 7 is a flowchart showing a moving image data editing procedure according to the first embodiment of the present invention;
FIG. 8 is a flowchart showing a procedure for reproducing moving image data edited according to the first embodiment of the present invention.
FIG. 9 is an explanatory diagram showing a handwritten code registration table in the second embodiment of the present invention.
FIG. 10 is an explanatory diagram showing a handwritten code registration table in the third embodiment of the present invention.
FIG. 11 is an explanatory diagram showing a structural unit of moving image data.
[Explanation of symbols]
10 Instruction input device
11 Handwritten code input device
12 Handwritten code playback device
13 Index image playback device
14 Image display device
15 Handwritten code registration table
16 Moving image playback device
17 Storage device
18 Editing control device

Claims (6)

Means for registering an input code input by a user with respect to an index image displayed in a single manner corresponding to each moving image data for referring to at least one moving image data; and the index image means for reading the input code registered for the code registration table and editing of the moving image data to which the input code and the previous SL index image references are registered in association with, out the reading wherein means for retrieving from the previous SL code registration table editing method corresponding to the input code, that the moving image data to which the index image is referring and means for editing in accordance with the retrieved editing method A moving image processing apparatus. Means for registering an input code input by a user with respect to an index image displayed in a single manner corresponding to each moving image data for referring to at least one moving image data; and the index image means for reading the input code registered for the code registration table and a method of reproducing moving image data to which the input code and the previous SL index image references are registered in association with, out the reading means for retrieving from the previous SL code registration table reproduction method corresponding to the input code, characterized by comprising a means for reproducing the moving image data to which the index image is referred to in accordance with the retrieved playback method A moving image processing apparatus. Means for registering an input code input by a user with respect to an index image displayed in a single manner corresponding to each moving image data for referring to at least one moving image data; and the index image means for reading the input code registered for, said input code and the previous SL code and additional data of the moving image data index image references are registered in association with the registration table, leaving the reading and means for retrieving from the previous SL code registration table additional data corresponding to the input code, and means for reproducing in synchronization with the prior SL moving image data index image is referring to the retrieved additional data A moving image processing apparatus characterized by that. The moving image processing apparatus according to any one of claims 1 to 3, an input code newly created by the user, the editing method associated with the input code, reproducing how or the additional data, A moving image processing apparatus comprising means for registering in the code registration table. 4. The moving image processing apparatus according to claim 1, wherein at least image data of the index image, the moving image data, and a handwritten input code input by a handwritten code input device are stored; A moving image processing apparatus comprising: an image display device capable of switching and displaying each reproduced image of the image data, the moving image data, or the handwritten input code stored in a storage device. 6. The moving image processing apparatus according to claim 5, wherein the reproduction image of the handwritten input code is superimposed on the reproduction image of the image data of the index image displayed by the image display device. A moving image processing apparatus.

Images