JP5811076B2 - Movie recording apparatus, movie recording method, and program - Google Patents

Description

  The present invention relates to a moving image recording apparatus, a moving image recording method, and a program.

  2. Description of the Related Art Conventionally, a technique for compressing image data by recording the number of continuous image data when the same image data is continuous when recording moving image data or the like is known (see, for example, Patent Document 1). . When stream data is recorded on a recording medium while compressing moving image data, if there is data being written on the working memory, one dummy counter is added and the dummy data is written when the writing is completed. A technique for recording a dummy frame for a counter is known (see, for example, Patent Document 2).

JP-A-11-203457 JP 2005-203922 A

  However, the technique of Patent Document 1 is merely an alternative to moving image compression processing. Further, in the technique of Patent Document 2, only when there is a delay in recording speed when stream recording on a recording medium while compressing moving image data (only when there is data being written in the working memory). ) Since data is being reduced and the working memory is not used effectively, there are many cases where even necessary data is lost.

  The present invention has been made in view of such a situation, and even in a situation where there is a delay in the recording speed on the recording medium, the moving image is more effectively reduced while reducing the lack of necessary data. The purpose is to enable data recording.

In order to achieve the above object, a moving image recording apparatus according to one embodiment of the present invention includes a working memory having a predetermined storage capacity capable of storing image data of a plurality of frames constituting a moving image at a time, and a predetermined speed by moving image shooting. in a plurality of frames of image data is sequentially acquired, a temporary storage control means for storing at once the working memory the predetermined storage capacity as a limit, the working image data of the plurality of frames by the temporary storage control unit A first compression means for performing a first compression process at a processing speed per unit frame faster than the predetermined speed when storing in the work memory, and storing the work memory at a time ; serial subjected to stored the predetermined processing speed is slow second compression per unit frame than the rate for the image data of the plurality of frames at a time in the memory And second compression means for recording the use memory, characterized in that it comprises a.

  According to the present invention, even in a situation where the recording speed to the recording medium is delayed, moving image data can be recorded more effectively while reducing the loss of necessary data.

It is a block diagram which shows the structure of the hardware of the moving image recording device 1 which concerns on one Embodiment of this invention. It is a functional block diagram which shows the functional structure for performing a moving image recording process among the functional structures of the moving image recording device 1 of FIG. It is a figure which shows the image number index memorize | stored in the image memorize | stored in the image and image number index memory | storage part of an image stored in the image temporary storage part. It is a flowchart which shows the flow of the moving image recording process which the moving image recording device 1 of FIG. 1 which has the function structure of FIG. 2 performs. It is a flowchart which shows the 1st compression process of step S3 of the moving image recording process of FIG. It is a flowchart which shows the 2nd compression process of step S4 of the moving image recording process of FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[Constitution]

FIG. 1 is a block diagram showing a hardware configuration of a moving image recording apparatus 1 according to an embodiment of the present invention.
The moving picture recording apparatus 1 is configured as a digital camera, for example.

  The moving image recording apparatus 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an image processing unit 14, a bus 15, an input / output interface 16, and an imaging. A unit 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22 are provided.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 20 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The image processing unit 14 is configured by a DSP (Digital Signal Processor), a VRAM (Video Random Access Memory), and the like, and performs various image processing on image data in cooperation with the CPU 11.

  The CPU 11, ROM 12 and RAM 13 are connected to each other via a bus 15. An input / output interface 16 is also connected to the bus 15. An imaging unit 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22 are connected to the input / output interface 16.

  Although not shown, the imaging unit 17 includes an optical lens unit and an image sensor.

  The optical lens unit is configured by a lens that collects light, for example, a focus lens or a zoom lens, in order to photograph a subject. The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range. The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like. The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. A digital signal is generated by various signal processing and output as an output signal of the imaging unit 17.
Such an output signal of the imaging unit 17 is hereinafter referred to as “captured image data”. The captured image data is appropriately supplied to the CPU 11, the RAM 13, the image processing unit 14, and the like.
Here, in the present embodiment, for example, data of one captured image is sequentially output from the imaging unit 17 every 1/30 seconds, and moving image data is configured. That is, in the following, a captured image is assumed to be a unit image (frame image or field image) constituting a moving image unless otherwise specified.

The input unit 18 includes various buttons and the like, and inputs various types of information according to user instruction operations.
The output unit 19 includes a display, a speaker, and the like, and outputs images and sounds.
The storage unit 20 is configured by a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.
The communication unit 21 controls communication with other devices (not shown) via a network including the Internet.

  A removable medium 31 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 22. The program read from the removable medium 31 by the drive 22 is installed in the storage unit 20 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 20 in the same manner as the storage unit 20.

FIG. 2 is a functional block diagram showing a functional configuration for executing the moving image recording process among the functional configurations of the moving image recording apparatus 1.
The moving image recording process is a first process of compressing image data stored in a working memory (an image temporary storage unit 61 described later) in the storage unit 20 when a frame rate when capturing a moving image is greater than or equal to a predetermined value. This is a process of decompressing the image data compressed and stored by the compression process and the first compression process and storing it in the removable medium 31 which is an external memory.
In the present embodiment, in the first compression process, the difference between the captured image data and the image data stored most recently in the work memory (the image temporary storage unit 61 described later) in the storage unit 20. If the difference is less than or equal to a predetermined threshold, the captured image data is newly added and stored in the working memory. If the difference is less than the predetermined threshold, the captured image data is discarded. Then, a process of incrementing the image number index corresponding to the most recently stored image data by 1 is executed.
In the second compression process, the image data is converted into the image data based on the image data stored in the working memory in the storage unit 20 and the value of the image number index corresponding to the image data. The number of times of the value of the number index is recorded on the removable medium 31 that is an external memory.

When the moving image recording process is executed, as shown in FIG. 2, the main control unit 41, the imaging control unit 42, and the image acquisition unit 43 function in the CPU 11. In the image processing unit 14, a first compression unit 51, a second compression unit 52, and an erasing unit 53 function.
The first compression unit includes a difference calculation unit 511, a temporary storage control unit 512, and an index storage control unit 513. The second compression unit 52 includes an expansion unit 521 and a compression code unit 522.

When the moving image recording process is executed, an image temporary storage unit 61 and an index storage unit 62 provided as an area of the storage unit 20 are used.
In the temporary image storage unit 61, data of moving images (a plurality of captured images) output from the imaging unit 17 and acquired by the image acquisition unit 43 is temporarily stored.
The index storage unit 62 stores a value of an image number index (described later) corresponding to captured image data stored in the temporary image storage unit 61.

The imaging control unit 42 sets various imaging conditions input via the input unit 18 and controls the imaging operation in the imaging unit 17.
In the present embodiment, the imaging control unit 42 causes the imaging unit 17 to continuously capture a series of images and output them as moving image data.

  The image acquisition unit 43 acquires moving image data output from the imaging unit 17. Thereafter, the image acquisition unit 43 stores the acquired image data of the first frame in the image temporary storage unit 61, and sets the value of the image number index to 1 and associates it with the data of the image of the first frame. 62 is stored. In addition, the image acquisition unit 43 outputs the acquired second and subsequent image data to the difference calculation unit 511 included in the first compression unit 51 included in the image processing unit 14.

The difference calculation unit 511 sequentially calculates the difference between the image data of the second and subsequent frames output from the image acquisition unit 43 and the image data of the first frame stored most recently in the image temporary storage unit 61. Furthermore, the difference calculation unit 511 determines whether or not the sequentially calculated difference is equal to or greater than a predetermined threshold value.
When the difference calculation unit 511 determines that the difference is equal to or greater than a predetermined threshold, the temporary storage control unit 512 stores the image data of the frame that is the determination target in the image temporary storage unit 61. Further, the value of the image number index is set to 1, and stored in association with the image data of the frame. For example, until the 100th frame, the difference between the first frame image data and the first frame image data is not determined to be greater than or equal to a predetermined threshold, and the difference between the 101st frame image data and the first frame image data is a predetermined value. If it is equal to or greater than the threshold value, the image data of the 101st frame is stored in the image temporary storage unit 61, and further, the image number index value is set to 1 and stored in association with the image data of the 101st frame.
The index storage control unit 513 displays the first frame image stored in the temporary image storage unit 61 until the difference calculation unit 511 determines that the sequentially calculated difference is equal to or greater than a predetermined threshold. The process of incrementing the value of the image number index (hereinafter referred to as “first frame corresponding image index” as appropriate) stored in the index storage unit 62 in association with the data is repeatedly executed.

Therefore, for example, the difference calculation unit 511 does not determine that the difference is equal to or greater than a predetermined threshold until the 100th frame, and the difference between the image data of the 101st frame and the data of the first frame is the predetermined threshold. When it is determined that the above is true, the index storage control unit 513 sets the value of the first frame corresponding image index to 100. Further, in this case, the image data of the 101st frame is stored in the image temporary storage unit 61 by the temporary storage control unit 512, and the value of the image number index is set to 1 and associated with the image data of the 101st frame. It is stored in the index storage unit 62.
Next, the difference calculation unit 511 transmits the image data of the frame (101th frame in the above example) most recently stored in the image temporary storage unit 61 and the subsequent frames (102 frames in the above example). The difference between the first frame and the subsequent image data is sequentially calculated, and it is determined whether the sequentially calculated difference is equal to or greater than a predetermined threshold.
Thereafter, the above-described processing by the temporary storage control unit 512 and the processing by the index storage control unit 513 are executed in the same manner.

The processing by the first compression unit 51 will be described with reference to FIG.
FIG. 3 is a diagram showing the images stored in the temporary image storage unit 61 and the image number index stored in the index storage unit 62.
First, the first frame image is stored first in the image temporary storage unit 61 from the image acquisition unit 43. Thereafter, the difference calculation unit 511 does not determine that the difference is equal to or greater than the predetermined threshold until the 100th frame, and the difference between the image data of the 101st frame and the data of the first frame is equal to or greater than the predetermined threshold. A case where it is determined that there will be described. In this case, as shown in FIG. 3, the value of the image number index corresponding to the data of the image 81 of the first frame is 100, and the data of the image 82 of the 101st frame is stored in the image temporary storage unit 61 second. The value of the image number index corresponding to the data of the image 82 of the 101st frame is stored in the index storage unit 62 as 1.

  Further, it is determined that the difference value between the data of the image 83 of the 102nd frame and the data of the image 82 of the 101st frame calculated by the difference calculation unit 511 is equal to or greater than a predetermined threshold, and the temporary storage control unit 512 The data of the image 83 of the frame is stored in the image temporary storage unit 61 third. Further, the temporary storage control unit 512 stores the value of the image number index corresponding to the data of the image 83 of the 102nd frame as 1 in the index storage unit 62.

  Further, it is determined that the difference value between the data of the image 84 of the 103rd frame and the data of the image 83 of the 102nd frame calculated by the difference calculation unit 511 is equal to or greater than a predetermined threshold, and the temporary storage control unit 512 determines 103 The data of the frame image 84 is stored in the image temporary storage unit 61 fourth. Further, the temporary storage control unit 512 stores the image number index value corresponding to the data of the image 84 of the 103rd frame as 1 in the index storage unit 62.

  Further, it is determined that the difference value between the data of the image 85 of the 104th frame and the data of the image 84 of the 103th frame calculated by the difference calculation unit 511 is greater than or equal to a predetermined threshold, and the temporary storage control unit 512 The data of the image 85 of the frame is stored in the image temporary storage unit 61 fifth. Further, the temporary storage control unit 512 stores the image number index value corresponding to the data of the image 85 of the 104th frame as 1 in the index storage unit 62. Thereafter, the difference value between the data of the 105th to 203rd frame images and the 104th frame of the image 84 data is not determined to be greater than or equal to a predetermined threshold, and the index storage control unit 513 determines The value of the image number index corresponding to the data of the image 85 is 100. Note that the example of FIG. 3 shows that image data up to the 203rd frame in total has been recorded.

Returning to FIG. 2, the main control unit 41 receives the Nth image data stored in the image temporary storage unit 61 (N is an integer equal to or greater than 2). The decompression unit 521 included in the second compression unit 52 executes the decompression process of the image data stored in 61.
For example, referring to the example of FIG. 3, the main control unit 41 is first stored in the image temporary storage unit 61 when the data of the image 82 is stored in the image temporary storage unit 61 second. The decompression unit 521 executes the decompression process of the data of the image 81.

Returning to FIG. 2, the decompression unit 521 receives the data of the image 81 stored first in the image temporary storage unit 61 when the data of the image 82 is stored second in the image temporary storage unit 61. Execute decompression processing. Specifically, the decompression unit 521 reads the data of the image 81 and sequentially transfers the data of the image 81 to the compression encoding unit 522 for the number of times represented by the value of the image number index corresponding to the data of the image 81.
The compression encoding unit 522 records the image data on the removable medium 31 via the drive each time the image data stored in the N−1th image temporary storage unit 61 is sequentially transferred. For example, the compression encoding unit 522 records the data of the image 81 on the removable medium 31 via the drive 22 every time the data of the image 81 is sequentially transferred.

  The erasing unit 53 stores the data of the image stored in the (N−1) th image temporary storage unit 61 in the removable medium 31 as a trigger, and stores the data in the N−1th image temporary storage unit 61. The image data is erased from the image temporary storage unit 61.

  The main control unit 41 repeats the processing of the expansion unit 521, the compression encoding unit 522, and the deletion unit 53 described above until all the image data stored in the image temporary storage unit 61 is recorded in the removable medium 31.

[Movie recording process]
Next, the moving image recording process executed by the moving image recording apparatus 1 will be described.
FIG. 4 is a flowchart showing an example of a flow of a moving image recording process (main flow) executed by the moving image recording apparatus 1 of FIG. 1 having the functional configuration of FIG.

In FIG. 4, when the moving image recording process is started, the main control unit 41 determines whether or not the frame rate at the time of moving image capturing of the moving image recording apparatus 1 is greater than or equal to a predetermined value in step S1. If the frame rate is equal to or higher than the predetermined value, YES is determined in step S1, and the main control unit 41 shifts the processing to step S2.
In step S <b> 2, the image acquisition unit 43 acquires moving image data output from the imaging unit 17.
In step S3, the first compression unit 51 and the like execute a first compression process which will be described later with reference to FIG. Here, the first compression processing refers to data that is first captured among data of continuously captured images when the difference between the data of continuously captured images is less than a predetermined threshold. Only the process is recorded in the temporary image storage unit 61.
In step S4, the second compression unit 52 and the like execute a second compression process which will be described later with reference to FIG. Here, the second compression process is a process of decompressing the data of the image subjected to the first compression process and recording it on the removable medium 31.
Further, the second compression process in step S4 is executed in parallel with the first compression process in step S3. That is, the second compression process is started when the second image data is stored in the image temporary storage unit 61 in the first compression process.

On the other hand, when the frame rate at the time of moving image capturing of the moving image recording apparatus 1 is not equal to or higher than the predetermined value in step S1, NO is determined in step S1, and the main control unit 41 shifts the processing to step S5.
In step S5, the main control unit 41 and the like execute normal moving image recording processing. Here, the normal moving image recording processing means that the processing by the first compression unit is not performed on the data of the moving image (a plurality of captured images) output from the imaging unit 17 and acquired by the image acquisition unit 43. This process is written to the removable medium 31.
When the process of step S4 or step S5 ends, the moving image recording process ends.

[First compression processing]
Next, the 1st compression process which the moving image recording device 1 performs is demonstrated.
FIG. 5 is a flowchart showing an example of the flow of the first compression process executed by the moving picture recording apparatus 1 of FIG. 1 having the functional configuration of FIG.

In FIG. 5, when the first compression process is started, in step S <b> 11, the image acquisition unit 43 first stores the acquired image data of the first frame in the image temporary storage unit 61.
In step S <b> 12, the image acquisition unit 43 sets the image number index value to 1 and stores it in the index storage unit 62 in association with the image data of the first frame.
In step S <b> 13, the image acquisition unit 43 substitutes 1 for the variable N.

In step S14, the image acquisition unit 43 increases the variable N by one.
In step S <b> 15, the image acquisition unit 43 outputs the image data of the Nth frame to the difference calculation unit 511 included in the first compression unit 51 provided in the image processing unit 14.
In step S <b> 16, the difference calculation unit 511 calculates a difference between the image data of the Nth frame output in step S <b> 15 and the image data of the frame stored most recently in the image temporary storage unit 61. Furthermore, the difference calculation unit 511 determines whether the calculated difference is equal to or greater than a predetermined threshold.

If it is determined that the calculated difference is equal to or greater than the predetermined threshold value, YES is determined in step S16, and the difference calculation unit 511 shifts the processing to step S17.
In step S <b> 17, the temporary storage control unit 512 stores the Mth frame image data in the image temporary storage unit 61. Here, M is a value obtained by adding 1 to the number of times YES is determined in step S16.
In step S18, the temporary storage control unit 512 sets the value of the image number index to 1, and stores it in association with the data of the Nth frame image stored in the image temporary storage unit 61 in step S17.

On the other hand, if it is determined that the difference calculated in step S16 is not equal to or greater than the predetermined threshold value, NO is determined in step S16, and the difference calculation unit 511 shifts the process to step S19.
In step S <b> 19, the index storage control unit 513 increments the image number index associated with the image data of the frame most recently stored in the image temporary storage unit 61 by one.

  In step S <b> 20, the main control unit 41 determines whether the image data of the Nth frame is the image data captured last. If this determination is NO, the main control unit 41 shifts the processing to step S14. On the other hand, if this determination is YES, the main control unit 41 ends the first compression process.

[Second compression process]
Next, the 2nd compression process which the moving image recording device 1 performs is demonstrated.
6 is a flowchart showing an example of the flow of the second compression process executed by the moving picture recording apparatus 1 of FIG. 1 having the functional configuration of FIG. The second compression process is started when the second image data is stored in the image temporary storage unit 61 in the first compression process described with reference to FIG.

In FIG. 6, when the second compression process is started, the decompressing unit 521 reads the image data stored first in the image temporary storage unit 61 from the image temporary storage unit 61 in step S <b> 31.
In step S32, the decompression unit 521 determines whether or not the value of the image number index corresponding to the image data read from the image temporary storage unit 61 in step S31 or step S39 described later is 1. If the image number index value is not 1, NO is determined in step S32, and the following steps S33 to S35 are repeatedly executed until the image number index value becomes 1.

In step S <b> 33, the decompression unit 521 outputs the image data read from the image temporary storage unit 61 in step S <b> 31 or step S <b> 39 described later to the compression encoding unit 522.
In step S <b> 34, the compression encoding unit 522 records the image data output in step S <b> 33 on the removable medium 31 via the drive 22.
In step S35, the compression encoding unit 522 decrements the image number index value corresponding to the image data recorded in step S34 by one. Thereafter, the compression encoding unit 522 causes the process to proceed to step S <b> 32.
If the value of the image number index is 1 in step S32, YES is determined in step S32, and the process proceeds to step S36.

In step S36, the decompression unit 521 outputs the image data read from the image temporary storage unit 61 in step S31 or step S39 described later to the compression encoding unit 522.
In step S <b> 37, the compression encoding unit 522 records the image data output in step S <b> 36 on the removable medium 31 via the drive 22.

In step S38, it is determined whether image data stored in the image temporary storage unit 61 exists. If the image data exists, YES is determined in step S38, and the process proceeds to step S39.
In step S39, the erasing unit 53 erases the image data recorded on the removable medium 31 in step S37 from the image temporary storage unit 61. By doing so, it is possible to prevent the stored image data from exceeding the capacity of the temporary image storage unit 61.
In step S <b> 40, the decompression unit 521 reads the image data stored in the image temporary storage unit 61 next to the image data recorded in the removable medium 31 in step S <b> 37 from the image temporary storage unit 61. Thereafter, the decompressing unit 521 shifts the process to step S32.
On the other hand, if there is no image data stored in the temporary image storage unit 61 in step S38, NO is determined in step S38, and the second compression process ends.

The embodiment of the present invention has been described above.
The moving image recording apparatus 1 that executes the moving image recording process as described above includes a first compression unit 51 and a second compression unit 52.
The first compression unit 51 executes a first compression process that is executed when the image data of each frame sequentially acquired by moving image shooting is temporarily stored in the image temporary storage unit 61.
The second compression unit 52 executes a second compression process that is executed when the image data of each frame temporarily stored in the image temporary storage unit 61 is recorded on the removable medium 31.
Further, the contents of the compression process are different between the first compression process and the second compression process.
Therefore, for example, it is necessary even when the amount of moving image data to be recorded per unit time is large (when the frame rate is high or the image quality is high), and the recording speed to the recording medium is delayed. It is possible to record moving image data more effectively while reducing missing data. For example, when the processing speed of the first compression process can be made faster than the processing speed of the second compression process at least instantaneously, or the compression ratio of the first compression process is at least instantaneously changed to the compression ratio of the second compression process. If it can be increased, effective use of the working memory can reduce delay in the recording speed to the recording medium while reducing missing of necessary data.

In the moving image recording apparatus 1, the first compression processing and the second compression processing are different in processing speed or compression rate.
Therefore, for example, when the processing speed of the first compression processing can be made faster than the processing speed of the second compression processing at least instantaneously, or when the compression rate of the first compression processing is at least instantaneously If it can be higher than the compression rate, it is possible to prevent the recording speed from being delayed on the recording medium while effectively reducing the missing data by using the working memory effectively.

In the moving image recording apparatus 1, the first compression processing can be performed at a higher speed or higher compression rate than the second compression processing at least instantaneously.
Therefore, by effectively using the working memory, it is possible to prevent the recording speed from being recorded on the recording medium from being delayed while reducing the loss of necessary data.

In addition, the moving image recording apparatus 1 includes an erasing unit 53.
The image temporary storage unit 61 can store image data of a plurality of frames,
The first compression unit 51 temporarily stores the image data of each frame acquired in the temporary image storage unit 61 until the second compression process is performed and the image data is recorded on the removable medium 31. Part 512 is provided.
The erasing unit 53 erases the image data of each frame stored in the image temporary storage unit 61 after being subjected to the second compression process and recorded in the removable medium 31.
Therefore, it is possible to prevent the capacity of the stored image data from exceeding the capacity of the image temporary storage unit 61.

In addition, the moving image recording apparatus 1 includes an extension unit 521.
The decompression unit 521 performs decompression processing on the image data that has been subjected to the first compression processing and stored in the image temporary storage unit 61.
In the compression processing of the present embodiment, the second compression processing is performed on the removable media 31 while performing the decompression processing by the decompression unit 521 on the image data subjected to the first compression processing and stored in the image temporary storage unit 61. This is a process of recording.
Accordingly, since the first compression process and the second compression process are executed in parallel, it is possible to prevent the capacity of the stored image data from exceeding the capacity of the image temporary storage unit 61 and the efficiency of the second compression process. Can be improved.

The first compression processing is performed when the difference between the image data of the newly acquired frame and the image data of other frames already stored in the image temporary storage unit 61 is within a predetermined threshold. In the index storage unit 62, only the image number index indicating that the image data of the frame can be replaced by the image data of the other frame without storing the image data of the frame in the image temporary storage unit 61 is stored. It is processing to do.
Accordingly, since it is not necessary to store similar image data in the image temporary storage unit 61, it is possible to prevent the capacity of the stored image data from exceeding the capacity of the image temporary storage unit 61.

The decompression process according to the present embodiment is a process that regards image data of a frame to be subjected to the second compression process as image data of another frame indicated by the image number index when an image number index is stored.
Therefore, the second compression processing can be performed on the image data of other frames by the number of image number index values.

In the first compression process, when the difference between the image data of the newly acquired frame and the image data of the frame acquired immediately before is within a predetermined threshold, the image data of the newly acquired frame is This is a process of storing an image number index indicating that the image data of the frame acquired immediately before can be substituted.
Accordingly, since it is not necessary to store similar image data in the image temporary storage unit 61, it is possible to prevent the capacity of the stored image data from exceeding the capacity of the image temporary storage unit 61.

The first compression processing is continuously acquired when the difference between each of the image data of a plurality of frames acquired continuously and the image data of the frame acquired immediately before is within a predetermined threshold. In this processing, the number of frames is stored as an image number index indicating the number of consecutive frames that can be replaced by the image data of the immediately preceding frame.
Accordingly, since it is not necessary to continuously store similar image data in the image temporary storage unit 61, the capacity of the stored image data can be prevented from exceeding the capacity of the image temporary storage unit 61.

In addition, the moving image recording apparatus 1 includes a main control unit 41.
The main control unit 41 validates the first compression processing when the capacity of the image data stored in the temporary image storage unit 61 is in a predetermined situation exceeding the memory capacity available as the temporary image storage unit 61. If it is not the predetermined situation, the first compression process is invalidated.
Therefore, since the first compression process can be executed only in the predetermined situation, it is possible to prevent a part of the information of the original moving image data from being lost (the degree of lossy compression becomes strong).

The main control unit 41 determines that the predetermined situation exists when the frame rate of moving image shooting is equal to or higher than a predetermined level.
Therefore, since the first compression process can be executed only when the frame rate for moving image shooting is equal to or higher than a predetermined rate, a part of the information of the original moving image data is lost (the degree of irreversible compression becomes strong). Can be prevented.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

In the above-described embodiment, the moving image recording apparatus 1 to which the present invention is applied has been described by taking a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having an image processing function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 2 is merely an example and is not particularly limited. That is, it is sufficient that the image processing apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional blocks are used to realize this function is not particularly limited to the example of FIG. .
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. The recording medium etc. provided in The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disk is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), or the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which a program is recorded, the hard disk included in the storage unit 20 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the order, but is not necessarily performed in chronological order, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalents thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
A moving image recording apparatus for recording in a recording memory as moving image data while performing compression processing on image data of each frame sequentially acquired by moving image shooting,
First compression means for executing a first compression process executed when the image data of each frame sequentially acquired by moving image shooting is temporarily stored in a working memory;
Second compression means for executing a second compression process that is executed when the image data of each frame temporarily stored in the working memory is recorded in the recording memory;
The moving image recording apparatus according to claim 1, wherein the first compression process and the second compression process have different contents of the compression process.
[Appendix 2]
The moving image recording apparatus according to appendix 1, wherein the first compression processing and the second compression processing are different in processing speed or compression rate.
[Appendix 3]
The moving image recording apparatus according to appendix 2, wherein the first compression process can increase the processing speed or the compression rate higher than the second compression process at least instantaneously.
[Appendix 4]
The working memory is capable of storing a plurality of frames of image data,
The first compression means temporarily stores the sequentially acquired image data of each frame in the working memory until the second compression processing is performed and the image data is recorded in the recording memory. Temporary storage control means for causing
Erasing means for erasing the image data of each frame stored in the working memory after being subjected to the second compression processing and recorded in the recording memory;
The moving picture recording apparatus according to any one of appendices 1 to 3, wherein
[Appendix 5]
Decompression means for executing decompression processing on the image data that has been subjected to the first compression processing and stored in the working memory;
In the compression process, the second compression process is performed on the image data that has been subjected to the first compression process and stored in the working memory while performing the expansion process by the expansion unit, and the recording data The moving image recording apparatus according to attachment 4, wherein the moving image recording apparatus is a process of recording in a memory.
[Appendix 6]
The first compression process includes
When the difference between the image data of the newly acquired frame and the image data of the other frame already stored in the working memory is within a predetermined threshold, the newly acquired frame is It is a process of storing only replacement information indicating that the image data of the other frame can be replaced with the image data of the other frame without storing the image data of the frame in the work memory. The moving image recording apparatus according to appendix 5.
[Appendix 7]
The decompression process is a process in which, when the substitute information is stored, the image data of the frame subjected to the second compression process is regarded as the image data of the other frame indicated by the substitute information. The moving image recording apparatus according to appendix 6.
[Appendix 8]
The first compression process includes
When the difference between the image data of the newly acquired frame and the image data of the frame acquired immediately before is within a predetermined threshold, the image data of the newly acquired frame is acquired immediately before the frame. The moving image recording apparatus according to appendix 6 or 7, characterized in that it is a process of storing substitution information indicating that substitution is possible with image data of a frame.
[Appendix 9]
The first compression process includes
When the difference between each of the image data of a plurality of frames acquired continuously and the image data of the frame acquired immediately before is within a predetermined threshold, the number of the plurality of frames acquired continuously is calculated. 9. The moving image recording apparatus according to appendix 8, wherein the moving image recording apparatus stores the information as replacement information indicating a continuous number of frames that can be replaced with the image data of the immediately preceding frame.
[Appendix 10]
When the capacity of the image data stored in the working memory is in a predetermined situation exceeding the memory capacity available as the working memory, the first compression process is enabled, and when the capacity is not the prescribed situation 10. The moving image recording apparatus according to any one of appendices 1 to 9, further comprising: a first compression processing validation unit that invalidates the first compression processing.
[Appendix 11]
11. The moving image recording apparatus according to appendix 10, wherein the first compression processing enabling means determines that the predetermined situation occurs when a frame rate of moving image shooting is equal to or higher than a predetermined value.
[Appendix 12]
A moving image recording method executed by a moving image recording apparatus for recording in a recording memory as moving image data while performing compression processing on image data of each frame sequentially acquired by moving image shooting,
A first compression step of executing a first compression process that is executed when the image data of each frame sequentially acquired by moving image shooting is temporarily stored in a working memory;
A second compression step of performing a second compression process executed when recording the image data of each frame temporarily stored in the working memory in the recording memory,
The first compression process and the second compression process have different contents of the compression process.
Video recording method.
[Appendix 13]
In a computer used as a moving image recording apparatus that records data in a recording memory as moving image data while performing compression processing on image data of each frame sequentially acquired by moving image shooting,
A first compression step of executing a first compression process that is executed when the image data of each frame sequentially acquired by moving image shooting is temporarily stored in a working memory;
A second compression step for executing a second compression process executed when the image data of each frame temporarily stored in the working memory is recorded in the recording memory;
The first compression process and the second compression process have different contents of the compression process.
program.

  DESCRIPTION OF SYMBOLS 1 ... Movie recording device, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Image processing part, 15 ... Bus, 16 ... Input / output interface, 17. ..Imaging unit, 18 ... input unit, 19 ... output unit, 20 ... storage unit, 21 ... communication unit, 22 ... drive, 31 ... removable media, 41 ... Main control unit, 42... Imaging control unit, 43... Image acquisition unit, 51... First compression unit, 511 ... difference calculation unit, 512 ... temporary storage control unit, 513. Index storage control unit, 52... Second compression unit, 521... Decompression unit, 522... Compression encoding unit, 53. Storage unit, 81-85 ... Image

Claims (13)

A working memory having a predetermined storage capacity capable of storing a plurality of frames of image data constituting a video at a time;
Temporary storage control means for storing a plurality of frames of image data sequentially acquired at a predetermined speed by moving image shooting at a time in the working memory up to the predetermined storage capacity ;
When the plurality of frames of image data are stored in the working memory by the temporary storage control means, the working memory is subjected to a first compression process having a processing speed per unit frame higher than the predetermined speed. First compression means for storing at a time;
Wherein the working memory stored the relative image data given processing rate per unit frame is slower than the second compression alms second to be recorded in the recording memory of the plurality of frames at a time Compression means ;
Video recording apparatus comprising: a. The temporary storage control unit newly adds an area in which image data of a frame that has been subjected to the second compression processing and has been recorded in the recording memory is stored in the area in the working memory. Open sequentially so that the image data of the acquired frames can be stored,
The moving image recording apparatus according to claim 1. It is possible to change the frame rate, which is the speed at which the image data of each frame is acquired by movie shooting,
A control means for executing the first compression processing by the first compression means when the frame rate of the moving image shooting is a predetermined value or more;
The moving image recording apparatus according to claim 1 or 2, wherein The first compression unit executes a frame thinning process for reducing the number of frames when the temporary storage control unit stores the image data of the plurality of frames in the working memory.
The moving picture recording apparatus according to claim 1, wherein the moving picture recording apparatus is a moving picture recording apparatus. When the plurality of frames of image data stored in the working memory in a state where the first compression processing has been performed, the second compression processing is performed and recorded in the recording memory. Further comprising decompression means for performing decompression processing to decompress the image data of each frame and then performing the second compression processing;
The moving picture recording apparatus according to claim 1, wherein the moving picture recording apparatus is a moving picture recording apparatus. The first compression process includes
When the difference between the image data of the newly acquired frame and the image data of the other frame already stored in the working memory is within a predetermined threshold, the newly acquired frame is It is a process of storing only replacement information indicating that the image data of the other frame can be replaced with the image data of the other frame without storing the image data of the frame in the work memory. The moving image recording apparatus according to claim 5.   The decompression process is a process in which, when the substitute information is stored, the image data of the frame subjected to the second compression process is regarded as the image data of the other frame indicated by the substitute information. The moving image recording apparatus according to claim 6. The first compression process includes
When the difference between the image data of the newly acquired frame and the image data of the frame acquired immediately before is within a predetermined threshold, the image data of the newly acquired frame is acquired immediately before the frame. 8. The moving image recording apparatus according to claim 6 or 7, wherein the moving image recording apparatus stores the replacement information indicating that the image data of the frame can be replaced. The first compression process includes
When the difference between each of the image data of a plurality of frames acquired continuously and the image data of the frame acquired immediately before is within a predetermined threshold, the number of the plurality of frames acquired continuously is calculated. 9. The moving image recording apparatus according to claim 8, wherein the moving image recording apparatus stores the information as replacement information indicating a continuous number of frames that can be replaced with image data of the immediately preceding frame.   When the capacity of the image data stored in the working memory is in a predetermined situation exceeding the memory capacity available as the working memory, the first compression process is enabled, and when the capacity is not the prescribed situation The moving image recording apparatus according to claim 1, further comprising first compression processing enabling means for invalidating the first compression processing.   The moving image recording apparatus according to claim 10, wherein the first compression processing enabling unit determines that the predetermined state is satisfied when a frame rate of moving image shooting is equal to or higher than a predetermined value. A moving image recording method executed by a moving image recording apparatus including a working memory having a predetermined storage capacity capable of storing a plurality of frames of image data constituting a moving image at a time ,
A plurality of frames of image data sequentially acquired at a predetermined speed by moving image shooting are stored in the working memory at a time with the predetermined storage capacity as a limit ,
When storing the plurality of frames of image data in the working memory, the first compression processing having a processing speed per unit frame higher than the predetermined speed is performed and then stored in the working memory at a time,
Processing speed per unit frame is recorded in the slow second recording memory is subjected to compression processing than the predetermined speed relative to the stored image data of the plurality of frames has been at once the working memory,
And a moving picture recording method. A computer of a moving image recording apparatus provided with a working memory having a predetermined storage capacity capable of storing image data of a plurality of frames constituting a moving image at a time ,
Temporary storage control means for storing image data of a plurality of frames sequentially acquired at a predetermined speed by moving image shooting at a time in the working memory up to the predetermined storage capacity ;
When the plurality of frames of image data are stored in the working memory by the temporary storage control means, the working memory is subjected to a first compression process having a processing speed per unit frame higher than the predetermined speed. First compression means for storing at a time,
Wherein the working memory stored the relative image data given processing rate per unit frame is slower than the second compression alms second to be recorded in the recording memory of the plurality of frames at a time Compression means ,
A program characterized by functioning as

Images