JP5903754B2 - Video content production terminal, video content generation method, and program for video content production terminal - Google Patents

Description

The present invention student to that movies image content production terminal viewing video content generation method and a program for video content production terminal.

  In recent years, along with the development of the Internet, e-learning, which is an educational service using electronic teaching materials, has begun to be provided. One of the strengths of e-learning via the Internet is that it can provide moving images and rich interactive content that cannot be provided by books.

  For example, by combining moving images and commentary sounds with teaching materials, correct pronunciation can be provided to the learner, or detailed explanations that are too long can be easily provided. In addition, regarding the writing of explanations for educational materials, in the case of moving images, more sophisticated explanations are possible by combining the order of writing and commentary audio.

  For example, a “stored writing communication device” is disclosed that stores drawing and voice integrated with drawing in a completed state, transmits and receives them in a batch, and reproduces the process of drawing and voice input in the same manner as input. Yes.

Japanese Patent Application Laid-Open No. 07-046352

  Japanese Patent Application Laid-Open No. H10-228707 discloses a method of checking whether or not drawing and voice input are performed at regular intervals, storing a time during which drawing or voice is not input, and using this for data reproduction. Savings, eliminating time restrictions during communication, improving educational effects, improving the organization of materials.

  However, the method described in Patent Document 1 can simply represent a combination of drawing data and audio data with a small amount of data, and today, when the communication speed is sufficiently developed, it is greatly improved in the efficiency of content production itself. There is demand.

  Therefore, the inventor of the present invention does not grasp video content as a single moving image file, but regards materials such as sound and images as a collection of files recorded together with reproduction timing, so that specialized knowledge and software can be obtained. We focused on the ability to produce videos that can be easily edited partially without using.

In view of these problems, the present invention easily stores background image data, drawing data displayed overlaid on the background image, and audio data independently together with timing information for reproducing the data. with editing is possible, and to provide one renewable Film image content production terminal as the video content, the video content generation method, and a video content production terminal program.

  The present invention provides the following solutions.

An invention according to a first aspect is a video content production terminal that produces video content that is communicably connected to a video content generation device that generates video content.
Background image data input receiving means for receiving input of the background image data together with timing information from the playback start time when the background image data is displayed;
Drawing data input receiving means for receiving drawing data including position information on the background image displayed on the background image, together with timing information from the reproduction start time at which the drawing data is displayed;
Audio data input receiving means for receiving input of audio data together with timing information from the playback start point at which the audio data is reproduced;
Video content material storage means for independently storing the received background image data, the drawing data, and the audio data in association with the timing from the playback start time received together;
The video content generation device, together with timing information from the playback start point at which the background image data, the drawing data, and the audio data stored independently without being encoded into a single file are reproduced. Video content material transmission means for transmitting to,
For the background image data, the drawing data, or the audio data that has received an input, when there is the data already stored, video content material editing means that edits only the type of data that has received the input;
The video content material editing means changes a part of the drawing data only by changing the position information by drawing on the background image of a part of the drawing that is desired to be changed among the already drawn drawing data , Provided is a video content production terminal characterized by executing changes corresponding to audio data received at the same time .

According to the first aspect of the invention, a video content production terminal that produces video content that is communicably connected to a video content generation device that generates video content displays the background image data as the background image data. The timing from the reproduction start time at which the drawing data including the position information on the background image is received and input is received together with the timing information from the reproduction start time and displayed on the background image. The input is received together with the information, and the audio data is received together with the timing information from the reproduction start time when the audio data is reproduced, and the received background image data, the drawing data, and the audio data are received together. The timing from the playback start time The background image data, the drawing data, and the audio data that are independently stored without being encoded are transmitted to the video content generation device together with timing information from the playback start time at which the data is reproduced. When the background image data, the drawing data, or the audio data that has received the input is already stored, only the data of the type that has received the input is edited, and one of the drawing data that has already been drawn is edited. when changing the parts, as well as changing part of the drawing data only by changing the position information by the drawing on the background image of a portion of the drawing already desired changes of the rendered drawing data, simultaneously The change corresponding to the audio data received at the timing is also executed.
The invention according to the first feature is the category of the video content production terminal, but the video content generation method and the program for the video content production terminal have the same operations and effects according to the category.

The invention according to the second feature, when a plurality of drawing data at the same timing, is the invention according to the first aspect, characterized in that complements assigned a unique ID for each input Provide video content production terminals.

According to the invention of the second aspect, the video content production terminal that is the invention according to the first aspect, when a plurality of drawing data at the same timing, assigns a unique ID for each input And complement .

An invention according to a third aspect is a content generation method executed by a video content production terminal that produces video content that is communicably connected to a video content generation device that generates video content, the background image data being A step of accepting an input together with timing information from a playback start time at which background image data is displayed;
Receiving drawing data that is displayed superimposed on the background image and includes position information on the background image, together with timing information at which the drawing data is displayed;
Receiving audio data, together with timing information from the playback start point at which the audio data is reproduced;
Storing the received background image data, the drawing data, and the audio data independently in association with the timing from the reception start time received together;
The video content generation device, together with timing information from the playback start point at which the background image data, the drawing data, and the audio data stored independently without being encoded into a single file are reproduced. Sending to
For the background image data, the drawing data, or the audio data that has received an input, when there is the data already stored, editing only the type of data that has received the input;
With
The step of editing only the type of data for which the input has been accepted includes the step of editing the background image of a part of the drawing data that has already been drawn, when the part of the drawing data that has already been drawn is changed. A video content generation method characterized in that a part of the drawing data is changed only by changing position information by drawing above, and a change corresponding to the audio data received at the same time is also executed. provide.

According to the present invention, the background image data, the drawing data displayed overlaid on the background image, and the audio data can be easily edited by storing the data together with the timing information for reproducing the data. with certain, it is possible to provide reproducible Film image content production terminal, video content generation method, and a video content production terminal program as one of the video content.

FIG. 1 is a schematic diagram of a video content generation system 1 which is a preferred embodiment of the present invention. FIG. 2 is an overall configuration diagram of the video content generation system 1. FIG. 3 is a diagram illustrating the functional blocks of the video content generation apparatus 10 and the video content production terminal 50 and the relationship between the functions. FIG. 4 is a flowchart of video content production editing processing executed by the video content generation device 10. FIG. 5 is a flowchart of video content generation processing executed by the video content generation device 10 and the video content production terminal 50. FIG. 6 shows a locus when the drawing data is reproduced. FIG. 7 illustrates a locus when the edited drawing data is reproduced.

  Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. This is merely an example, and the technical scope of the present invention is not limited to this.

[Outline of video content generation system 1]
FIG. 1 is a diagram for explaining an outline of a video content generation system 1 which is a preferred embodiment of the present invention. The outline of the video content generation system 1 will be described with reference to FIG.

  First, the video content production terminal 50 receives input of background image data, drawing data, and audio data from a user who is a video content producer together with a reproduction timing (step S01). Hereinafter, these three types of data are collectively referred to as video content material data.

  Here, the drawing data represents the content to be drawn over the background image data as data. For example, the background image data shows a starry sky, a white line is drawn, and the constellation is surrounded. At that time, where the white line is written from where it passes and where it ends is the drawing data, and when it starts, when it passes, when it ends and when it ends, the playback timing. The same applies to audio data.

  Here, the user may not input the playback timing explicitly, but may use the timing measured by the video content production terminal 50 when inputting in real time as the playback timing.

  If it is normal recording software, when such drawing and sound are captured, the capacity is reduced by encoding into one reproducible file. However, in that case, it is difficult to separate the drawing and the background image when drawing the specific part or editing the sound.

  Therefore, the video content production terminal 50 stores the video content material data that has been accepted independently along with the reproduction timing (step S02). In this way, when it is desired to change only a part of the drawing data or audio data later, it is possible to perform editing by simply deleting the data at a specific reproduction timing and overwriting with new data.

  Thereafter, upon receiving a request from the video content generation device 10 used by the viewer of the video content, the video content production terminal 50 reads the stored video content material data (step S03) and transmits it to the video content generation device 10 (step S03). S04).

  The video content generation device 10 that has received the video content material data can generate a single video content as a whole for viewing by the user by playing back each video content material data according to the playback timing. Is possible.

  The outline of the video content generation system 1 has been described above.

[System configuration of video content generation system]
FIG. 2 is an overall configuration diagram of the video content generation system 1. In the video content generation system 1, the video content generation device 10 and the video content production terminal 50 are connected to be communicable via the public network 3. At this time, a video content providing server having a relay function may be inserted and the video content material data uploaded by the video content production terminal 50 may be transmitted in response to a request from the video content generation device 10.

  The video content generation device 10 and the video content production terminal 50 may each be a general terminal having the functions described later.

  Here, each function of the video content production terminal 50 may be provided from a server via the web, and the video content production terminal 50 may serve as a client terminal that performs input / output.

[Description of each function]
FIG. 3 is a diagram illustrating the functional blocks of the video content generation apparatus 10 and the video content production terminal 50 and the relationship between the functions.

  The video content generation apparatus 10 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like as the control unit 11, and a communication unit 12, for example, WiFi that conforms to IEEE 802.11. (Wireless Fidelity compatible device or wireless device compliant with IMT-2000 standard such as 3rd generation mobile communication system, etc., and GPS device. Further, the video content generation device 10 is controlled by the control unit as the input / output unit 13 Provided with an output unit that outputs and displays the data, images, and sounds, and an input unit such as a touch panel, a keyboard, a mouse, and a microphone that accepts input from the user.

  In the video content generation device 10, the background image data reception module 14, the drawing data reception module 15, and the audio data reception module 16 are realized in cooperation with the communication unit 12 by the control unit 11 reading a predetermined program. In the video content generation apparatus 10, the control unit 11 reads a predetermined program, thereby realizing the video content reproduction module 17 in cooperation with the input / output unit 13.

  Similarly, the video content production terminal 50 includes a CPU, a RAM, a ROM, and the like as the control unit 51, and a WiFi compatible device compliant with, for example, IEEE 802.11 as the communication unit 52 (may be wired). ). In addition, the video content production terminal 50 includes a data storage unit such as a hard disk or a semiconductor memory as the storage unit 53. In addition, the video content production terminal 50 includes an output unit that outputs and displays data, images, and sounds controlled by the control unit as the input / output unit 54, and includes a touch panel, a keyboard, a mouse, a microphone, and the like that accept input from the user. An input unit is provided.

  In the video content production terminal 50, the control unit 51 reads a predetermined program, thereby realizing the video content material transmission module 55 in cooperation with the communication unit 52. Also, in the video content production terminal 50, the control unit 11 reads a predetermined program, thereby realizing a video content material storage module 56 and a video content material editing module 57 in cooperation with the storage unit 53. Also, in the video content production terminal 50, the control unit 11 reads a predetermined program, so that in cooperation with the input / output unit 54, the background image data input reception module 58, the drawing data input reception module 59, the audio data input reception The module 60 is realized.

[Video content production editing]
FIG. 4 is a flowchart of video content production editing processing executed by the video content production terminal 50. The processing performed by the module of each device described above will be described together with this processing.

  First, the background image data input reception module 58, the drawing data input reception module 59, and the audio data input reception module 60 of the video content production terminal 50 wait for input of video content material data (step S11). Thereafter, when an input is received (step S12), the video content material storage module 56 determines whether a file of the received video content material data already exists (step S13).

  If the file does not exist (step S13: “NO”), a new file is created and the contents of the received input are stored (step S14). On the other hand, if the file already exists (step S13: “YES”), the video content material editing module 57 opens the file and edits the file (step S15).

  FIG. 6 shows a locus when the drawing data is reproduced. In FIG. 6 and FIG. 7 described later, t represents the number of seconds from the start of reproduction. The X axis 71 is positive in the right direction, and the Y axis 72 is positive in the downward direction. During reproduction, a line is drawn at a constant speed from the start position 73 at t = 1 to the end 75 in the direction of the arrow 74. The gray portion 76 is complemented during reproduction. It should be noted that the presence or absence of complementation may be provided with coordinates and thresholds for input intervals.

  FIG. 7 illustrates a locus when the edited drawing data is reproduced. Similar to FIG. 6, the point 91 at t = 3 and the point 92 at t = 4 have changed, so that the drawn figure is different. In this way, the drawing data can be changed only by changing the numerical value without performing image editing.

  When there are a plurality of drawing data at the same timing, a plurality of figures can be written at the same time by assigning a unique ID to each of them and complementing them. When editing, whether the drawing data is added or overwritten may be indicated by the user.

  In addition, since these editing operations are performed independently for each material data, the editing of the drawing data does not directly affect other data. Of course, it is possible to simultaneously overwrite the drawing data and the sound data input at the same time.

  After processing the input, it is determined whether or not the content production has been completed (step S16). Completion of content production is performed by closing the editing window or pressing a production completion button in response to user input or the like. When the content production is completed (step S16: “YES”), the video content production editing process is terminated. On the other hand, if it has not been completed yet (step S16: "NO"), the processing from step S12 to step S15 is repeated.

  The above is the procedure of the video content production editing process.

[Video content generation processing]
FIG. 5 is a flowchart of video content generation processing executed by the video content generation device 10 and the video content production terminal 50. The processing performed by the module of each device described above will be described together with this processing.

  First, the background image data reception module 14, the drawing data reception module 15, and the audio data reception module 16 of the video content generation device 10 transmit a request for video content material data to the video content production terminal 50 (step S21). Here, instead of the video content production terminal 50, the request may be sent to a server storing the video content material data after the video content production terminal 50 has produced the request. This request may be an http request for an archive file, for example, regardless of the protocol.

  The video content material transmission module 55 of the video content production terminal 50 receives the request (step S22), and transmits the video content material data, that is, background image data, drawing data, and audio data to the video content generation device 10 (step S22). S23). The background image data receiving module 14, the drawing data receiving module 15, and the audio data receiving module 16 of the video content generation apparatus 10 each receive this (step S24).

  Next, the video content reproduction module 17 of the video content generation device 10 reads the video content material data (step S25). Specifically, the video content material data may be read and expanded on the memory, or the file may be accessed and the reading position set at the beginning of the file.

  Next, the video content playback module 17 of the video content generation device 10 reads each file of each video content material data and plays back any data to be played back. In the example of FIG. 6, if the number of seconds from the start of the current reproduction is 4, a straight line is drawn with a 100th pen from coordinates (30, 10) to coordinates (40, 10). Also, if there is a sound to be played back or stopped, it is processed.

  Next, the video content reproduction module 17 of the video content generation device 10 advances the reading of the file as time elapses from the reproduction, and determines whether the reading of each file has reached the end (step S28). . If the file reaches the end and there is no more data to be reproduced (step S28: "YES"), the video content generation process is terminated. On the other hand, if the playback position is still in the middle of the file (step S28: "NO"), step S26 and step S27 are repeatedly executed until the end of the file is reached.

  If the contents of the file are not sorted at the timing from the start of re-correction, it is determined that there is no data to be played after the current timing, or a setting file with a playback time set is read, and the time The reproduction may be terminated when the time has elapsed. The above is the procedure of the video content generation process.

  The means and functions described above are realized by a computer (including a CPU, an information processing apparatus, and various terminals) reading and executing a predetermined program. The program is provided in a form recorded on a computer-readable recording medium such as a flexible disk, CD (CD-ROM, etc.), DVD (DVD-ROM, DVD-RAM, etc.), for example. In this case, the computer reads the program from the recording medium, transfers it to the internal storage device or the external storage device, stores it, and executes it. The program may be recorded in advance in a storage device (recording medium) such as a magnetic disk, an optical disk, or a magneto-optical disk, and provided from the storage device to a computer via a communication line.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to these embodiment mentioned above. The effects described in the embodiments of the present invention are only the most preferable effects resulting from the present invention, and the effects of the present invention are limited to those described in the embodiments of the present invention. is not.

  1 video content generation system, 3 public network, 10 video content generation device, 50 video content production terminal

Claims (3)

A video content production terminal that produces video content that is communicably connected to a video content generation device that generates video content,
Background image data input receiving means for receiving input of the background image data together with timing information from the playback start time when the background image data is displayed;
Drawing data input receiving means for receiving drawing data including position information on the background image displayed on the background image, together with timing information from the reproduction start time at which the drawing data is displayed;
Audio data input receiving means for receiving input of audio data together with timing information from the playback start point at which the audio data is reproduced;
Video content material storage means for independently storing the received background image data, the drawing data, and the audio data in association with the timing from the playback start time received together;
The video content generation device, together with timing information from the playback start point at which the background image data, the drawing data, and the audio data stored independently without being encoded into a single file are reproduced. Video content material transmission means for transmitting to,
For the background image data, the drawing data, or the audio data that has received an input, when there is the data already stored, video content material editing means that edits only the type of data that has received the input;
When the video content material editing unit changes a part of the already drawn drawing data, the video content material editing unit obtains positional information by drawing on the background image of a part of the drawing data already drawn. A video content production terminal, wherein a part of the drawing data is changed only by changing, and a change corresponding to the audio data received at the same time is also executed.   2. The video content production terminal according to claim 1, wherein when there are a plurality of drawing data at the same timing, the drawing data input receiving unit assigns a unique ID to each input and complements the input. . A content generation method executed by a video content production terminal that produces video content communicably connected to a video content generation device that generates video content,
A step of accepting an input of background image data together with timing information from a playback start time at which the background image data is displayed;
Receiving drawing data that is displayed overlaid on the background image and includes position information on the background image, together with timing information from the reproduction start point at which the drawing data is displayed;
Receiving audio data, together with timing information from the playback start point at which the audio data is reproduced;
Storing the received background image data, the drawing data, and the audio data independently in association with the timing from the reception start time received together;
The video content generation device, together with timing information from the playback start point at which the background image data, the drawing data, and the audio data stored independently without being encoded into a single file are reproduced. Sending to
For the background image data, the drawing data, or the audio data that has received an input, when there is the data already stored, editing only the type of data that has received the input;
With
The step of editing only the type of data for which the input has been accepted includes the step of editing the background image of a part of the drawing data that has already been drawn, when the part of the drawing data that has already been drawn is changed. A video content generation method, wherein a part of the drawing data is changed only by changing the position information by drawing above, and a change corresponding to the audio data received at the same timing is also executed.