JP5029348B2 - Imaging apparatus and program - Google Patents

Description

  The present invention relates to an imaging apparatus and a program for capturing a moving image.

2. Description of the Related Art Conventionally, a camera that can simultaneously capture both a moving image and a still image is known. In this camera, all the pixels obtained from the image sensor are recorded as they are in order to record and record a wider range in detail, but moving images can be recorded for a longer time. A technique is known in which only a narrower range is recorded in all pixels obtained from the image sensor (see, for example, Patent Document 1), or pixels are thinned out and recorded (see, for example, Patent Document 2). It has been.
JP 2007-36882 A JP 2007-150439 A

By the way, for example, when shooting an athlete race at a children's athletic meet, at first a video is shot with a wide angle of view so that the overall situation can be understood, but in order to capture the facial expression at the moment the child finishes, In addition to increasing the zoom magnification, it was necessary to redirect the camera lens toward the child.
However, in the above case, although the facial expression of the child at the moment of the goal can be captured, it is impossible to capture the whole image of the moment of competing with other children. In this case, if the image data is always recorded with a wider angle of view without thinning out, it is possible to capture the whole image of the moment the child finishes, but there is a problem that it is impossible to record a moving image for a long time. It will occur.
Further, even when the technique disclosed in Patent Document 1 is applied, it is impossible to simultaneously capture the facial expression of the child's face at the goal and the whole image at the goal while recording a moving image for a long time. .

  Therefore, an object of the present invention is to provide an imaging apparatus and program capable of recording detailed image data in a narrower shooting range when a wider shooting range is roughly taken as a moving image.

The image pickup apparatus according to the first aspect of the present invention is an image pickup device including an image pickup region for picking up a subject, and image data sequentially generated by picking up the subject in the first image pickup region among all the image pickup regions of the image pickup device. Moving image recording control means for sequentially recording the moving image data as moving image data, and at any timing during the recording operation of the moving image data by the moving image recording control means, out of the entire imaging area of the imaging device, the first Image recording instruction input means for allowing a user to input an instruction to record an image of a main subject in the subject imaged in a second imaging area narrower than one imaging area , and recording of the moving image data by the moving image recording control means During operation, the position and size of the second imaging area are sequentially changed in the entire imaging area based on the image data sequentially generated by the first imaging area. And second imaging area setting means, in response to an input of the recording instruction by the image recording instruction input means, in the position and dimensions of the second imaging area set by the this input timing second imaging area setting means, a main object image recording control means for recording image data generated by the imaging of the main subject according to the second imaging region, when the recording of the moving image data by the moving image recording control means, according to the main object image recording control means Compared to the time of recording image data, a data amount reduction process with a higher data amount reduction rate is performed, or the data amount reduction process is performed on the image data recorded by the main subject image recording control means. Data amount reduction processing with a predetermined data amount reduction rate for moving image data recorded by the moving image recording control means without being applied Is characterized by comprising a data amount reduction control means for performing, the.

The invention according to claim 2 further includes display control means for sequentially displaying on the display means a frame indicating the position and size of the second imaging area that is sequentially changed by the operation of the second imaging area setting means. It is characterized by that.

The invention according to claim 3 further includes main subject specifying means for sequentially specifying the main subject based on image data sequentially generated by the first image pickup area, and the second image pickup area setting means includes the main image pickup means. The position of the second imaging region is sequentially changed corresponding to the position of the main subject sequentially specified by the subject specifying means, and / or the size of the second imaging region is set corresponding to the size of the main subject. It is characterized by being changed sequentially .

The invention according to claim 4 further includes face detection means for sequentially detecting faces in the subject, wherein the main subject specifying means sequentially specifies the main subject based on faces sequentially detected by the face detection means. It is characterized by doing.

The invention according to claim 5 further includes main subject tracking means for tracking the main subject specified by the main subject specifying means based on a plurality of image data sequentially generated by the first imaging region, The second imaging region setting unit sequentially changes the position of the second imaging region in correspondence with the position of the main subject tracked by the main subject tracking unit and / or corresponds to the size of the main subject. The dimensions of the second imaging region are sequentially changed.

The invention described in claim 6 further includes selection instruction input means for inputting an instruction to select one main subject among the plurality of main subjects specified by the main subject specifying means .

The invention described in claim 7 is further characterized by further comprising first imaging area setting means for setting the position or size of the first imaging area in the entire imaging area of the imaging device .

The invention described in claim 8 is further characterized in that the data amount reduction processing reduces the data amount by thinning out a predetermined amount of data from image data obtained by imaging with the imaging device .

The invention according to claim 9 is characterized in that the data amount reduction processing compresses image data obtained by imaging with the imaging device to reduce the data amount .

The invention according to claim 10 is further characterized in that the first imaging area is a fixed area corresponding to the entire imaging area of the imaging device .

  The program according to an eleventh aspect of the invention is sequentially generated in an imaging apparatus including an imaging element having an imaging area for imaging a subject by imaging a subject in the first imaging area among all imaging areas of the imaging element. A function of sequentially recording image data as moving image data, and a second imaging that is narrower than the first imaging region among all the imaging regions of the image sensor at an arbitrary timing during the recording operation of the moving image data Based on the function of allowing the user to input an instruction to record an image of the main subject in the subject imaged by the region, and the image data sequentially generated by the first imaging region during the recording operation of the moving image data, In response to the function of sequentially changing the position and size of the second imaging area in the entire imaging area and the input of a recording instruction by the user, the second imaging area A function for recording image data generated by imaging the main subject and data having a higher data amount reduction rate when recording the moving image data than when recording image data relating to the main subject. The amount reduction processing is performed, or the image amount related to the main subject is not subjected to the data amount reduction processing, and the moving image data is subjected to the data amount reduction processing at a predetermined data amount reduction rate. It is characterized by realizing the functions to be applied.
  An image pickup apparatus according to a twelfth aspect of the present invention is an image pickup device having an image pickup region for picking up a subject, and image data sequentially generated by picking up the subject in the first image pickup region among all the image pickup regions of the image pickup device. The moving image recording control means for sequentially recording as moving image data, and the first image of all the imaging regions of the image sensor at any timing during the recording operation of the moving image data by the moving image recording control means. Based on image recording instruction input means for allowing a user to input a recording instruction of an image of the main subject in the subject imaged by the second imaging area narrower than the imaging area, and image data generated by the first imaging area A face detection means for detecting a face in the subject; a main subject specifying means for specifying the main subject based on the face detected by the face detection means; Based on selection instruction input means for inputting an instruction to select one main subject among the plurality of main subjects specified by the main subject specifying means, and a plurality of image data generated by the first imaging region, Main subject tracking means for tracking the main subject selected by the selection instruction input means; and the selection instruction input means in the entire imaging area during the moving image data recording operation by the moving image recording control means. The position of the second imaging area is changed in accordance with the position of the main subject that is selected by the main subject tracking unit and is tracked by the main subject tracking means, and the size of the second imaging area is set in correspondence with the size of the main subject. In response to the input of the recording instruction by the second imaging region setting means for changing the size and the image recording instruction input means, the second imaging area is set at this input timing. Main subject image recording control means for recording image data generated by imaging the main subject by the second imaging area at the position and size of the second imaging area set by the area setting means, and the moving image When the moving image data is recorded by the recording control unit, a data amount reduction process having a higher data amount reduction rate than that at the time of recording the image data by the main subject image recording control unit is performed, or the main subject The amount of data with a predetermined data amount reduction rate for the moving image data recorded by the moving image recording control means without performing the data amount reduction processing on the image data recorded by the image recording control means And a data amount reduction control means for performing reduction processing.
  According to a thirteenth aspect of the present invention, there is provided a program for an image pickup apparatus including an image pickup device that picks up an image of a subject. Moving image recording control means for sequentially recording the moving image data as moving image data, and at any timing during the recording operation of the moving image data by the moving image recording control means, out of the entire imaging area of the imaging device, the first Based on image recording instruction input means for allowing a user to input a recording instruction of an image of a main subject in the subject imaged by a second imaging area narrower than one imaging area, and image data generated by the first imaging area. A face detection unit for detecting a face in the subject, and a main subject for identifying the main subject based on the face detected by the face detection unit Determination means, selection instruction input means for inputting a selection instruction of one main subject among the plurality of main subjects specified by the main subject specifying means, and a plurality of image data generated by the first imaging region Based on the main subject tracking means for tracking the main subject selected by the selection instruction input means, and during the recording operation of the moving image data by the moving image recording control means, in the entire imaging area, The position of the second imaging region is changed corresponding to the position of the main subject selected by the selection instruction input means and tracked by the main subject tracking means, and the size of the main subject is changed to correspond to the size of the main subject. In response to the input of the recording instruction by the second imaging area setting means for changing the size of the second imaging area and the image recording instruction input means, the input timing The main subject image recording control means for recording the image data generated by the imaging of the main subject by the second imaging area at the position and size of the second imaging area set by the second imaging area setting means. And when recording the moving image data by the moving image recording control means, compared with the time of recording the image data by the main subject image recording control means, a data amount reduction process with a higher data amount reduction rate, Alternatively, the data amount reduction process is not performed on the image data recorded by the main subject image recording control unit, and the moving image data recorded by the moving image recording control unit has a predetermined data amount. It is characterized by functioning as a data amount reduction control means for performing a data amount reduction process of a reduction rate.

  According to the present invention, it is possible to record detailed image data of a narrower shooting range even when a wider shooting range is being roughly movie-recorded.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

[Embodiment 1]
FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to the first embodiment to which the present invention is applied.
The imaging apparatus 100 according to the first embodiment performs a data amount reduction process on image data generated by imaging a subject in the first imaging area A1 (see FIG. 3A) of the electronic imaging unit 12, and then performs a moving image When the image data is generated and recorded, the second imaging area A2 (see FIG. 3 (FIG. 3)) that is narrower than the first imaging area A1 of the electronic imaging unit 12 based on the input of the recording instruction of the still image of the main subject in the subject. In step b), still image data of the person H as the main subject is generated and recorded. Specifically, as illustrated in FIG. 1, the imaging apparatus 100 includes an imaging unit 1, an imaging auxiliary unit 2, a display unit 3, an operation unit 4, a recording medium 5, a USB terminal 6, and a control unit 7. Etc. are provided.

  The imaging unit 1, as an imaging unit, continuously captures a subject and generates a plurality of image frames. Specifically, the imaging unit 1 includes an imaging lens 11, an electronic imaging unit 12, a video signal processing unit 13, an image memory 14, a shooting control unit 15, and the like.

The imaging lens 11 is composed of a plurality of lenses.
The electronic imaging unit 12 is configured by a charge coupled device (CCD), a complementary metal-oxide semiconductor (CMOS), or the like that converts a subject image that has passed through the imaging lens 11 into a two-dimensional image signal. In addition, the electronic imaging unit 12 photoelectrically converts the subject image by the first imaging area A1 (see FIG. 3A) set in the first imaging area setting process (described later) and outputs an image signal related to the moving image. The main subject image is photoelectrically converted by the second imaging area A2 (see FIG. 3B) set in the second imaging area setting process (described later) and an image signal related to the still image is held.
The video signal processing unit 13 performs predetermined image processing on the image signal output from the electronic imaging unit 12.
The image memory 14 temporarily stores the image signal after image processing.

  The imaging control unit 15 controls the electronic imaging unit 12 and the video signal processing unit 13 under the control of the CPU 71. Specifically, the imaging control unit 15 causes the electronic imaging unit 12 to image a subject with a predetermined exposure time and reads an image signal (image frame) from the imaging area of the electronic imaging unit 12 at a predetermined frame rate. Control execution.

  The imaging assisting unit 2 is driven when the subject is imaged by the imaging unit 1, and includes a focus driving unit 21, a zoom driving unit 22, and the like.

The focus drive unit 21 drives a focus mechanism unit (not shown) connected to the imaging lens 11.
The zoom drive unit 22 drives a zoom mechanism unit (not shown) connected to the imaging lens 11.
The focus driving unit 21 and the zoom driving unit 22 are connected to the shooting control unit 15 and are driven under the control of the shooting control unit 15.

  The display unit 3 displays an image picked up by the image pickup unit 1 and is disposed, for example, so as to expose the display screen from the back side of the image pickup apparatus 100 (not shown). The display unit 3 includes a display control unit 31, an image display unit 32, and the like.

  The display control unit 31 includes a video memory (not shown) that temporarily stores display data appropriately output from the CPU 71.

The image display unit 32 displays the image captured by the imaging unit 1 on the display screen based on the output signal from the display control unit 31. Specifically, as illustrated in FIG. 2, the image display unit 32 sequentially displays a plurality of image frames generated by capturing an image of the subject in the first imaging region A1 of the electronic imaging unit 12.
Further, when the second imaging area A2 is set in the second imaging area setting process by the CPU 71, the image display unit 32 displays the still image shooting frame W corresponding to the second imaging area A2 (see FIG. 2). ).

  The operation unit 4 is for performing a predetermined operation of the imaging apparatus 100, and includes an operation input unit 41, an input circuit 42, and the like.

  The operation input unit 41 includes a shutter button 41a, a mode setting button 41b, a selection determination button 41c, and the like.

The shutter button 41 a is provided on the upper surface of the body of the imaging apparatus 100 and instructs the imaging unit 1 to image the subject. Further, the shutter button 41a is pressed by a user when recording moving image data, thereby instructing recording of a still image of a main subject in the subject imaged by the second imaging area A2 of the electronic imaging unit 12. To do. Then, when the still image recording instruction is output via the input circuit 42 and input to the CPU 71, the CPU 71 executes still image recording processing (described later) and controls the photographing control unit 15 to stop the recording. Record image data.
Here, the shutter button 41a constitutes an image recording instruction input unit that inputs an instruction to record an image of a main subject in the subject imaged by the second imaging area A2 of the electronic imaging unit 12.

The mode setting button 41b is provided on the back of the body of the imaging device 100, for example, and instructs selection setting of a predetermined operation mode among the plurality of operation modes of the imaging device 100.
Here, examples of the operation mode include a normal shooting mode for shooting a still image of a predetermined size, a moving image shooting mode for shooting a moving image at a predetermined frame rate, and the like.
When the user operates the mode setting button 41b for a predetermined operation to select a predetermined operation mode (for example, a moving image shooting mode), an instruction for setting the operation mode is output to the CPU 71 via the input circuit. When the setting instruction is input, the CPU 71 controls each unit and performs setting according to the operation mode.

  The selection determination button 41c is provided, for example, on the back side of the body of the imaging apparatus 100, and includes up / down / left / right cursor buttons for selecting various items, a determination button provided inside the cursor buttons, and the like.

  The input circuit 42 is for inputting the operation signal input from the operation input unit 41 to the CPU 71.

  The recording medium 5 is configured by, for example, a card-type nonvolatile memory (flash memory), a hard disk, and the like, and stores a plurality of image files of moving images and still images captured by the imaging unit 1.

  The USB terminal 6 is a terminal for connection with an external device, and transmits and receives data via a USB cable (not shown).

  The control unit 7 controls each unit of the imaging apparatus 100, and includes, for example, a CPU 71, a program memory 72, a data memory 73, and the like.

  The CPU 71 performs various control operations according to various processing programs for the imaging apparatus 100 stored in the program memory 72.

  The data memory 73 is composed of, for example, a flash memory and temporarily stores data processed by the CPU 71.

  The program memory 72 stores various programs and data necessary for the operation of the CPU 71. Specifically, the program memory 72 includes a first imaging area setting program 72a, a data amount reduction program 72b, a moving image recording control program 72c, a face detection program 72d, a main subject specifying program 72e, a second imaging area setting program 72f, A still image recording control program 72g and the like are stored.

  The first imaging area setting program 72a causes the CPU 71 to function as first imaging area setting means. That is, the first imaging area setting program 72a is for causing the CPU 71 to realize a function related to the first imaging area setting process for setting the position and size of the first imaging area A1 in all the imaging areas of the electronic imaging unit 12. It is a program. Specifically, the CPU 71 executes the first imaging region setting program 72a, so that the entire imaging region of the electronic imaging unit 12 is set as the first imaging region A1 based on a predetermined operation of the operation unit 4 by the user.

The data amount reduction program 72b causes the CPU 71 to function as data amount reduction means. In other words, the data amount reduction program 72b is a program for causing the CPU 71 to realize a function related to the data amount reduction processing for reducing the data amount of the image data generated by imaging the subject by the electronic imaging unit 12. Specifically, the CPU 71 executes the data amount reduction process, so that an odd-numbered image frame or an even-numbered image among a plurality of consecutive image frames generated by the first imaging region A1 of the electronic imaging unit 12 is used. Processing to reduce the amount of data by thinning out a predetermined amount of data by selecting a frame and thinning out, or by adding a predetermined number of adjacent pixel values (for example, 4, 9, 16, etc.) to generate one pixel I do. Thereby, for example, from the image data generated from all the pixels (10 million pixels) of the electronic imaging unit 12, the number of pixels is reduced without changing the angle of view (for example, about 1 million pixels). ) Generate image data.
Further, when the CPU 71 executes the data amount reduction process, the image data generated by the first imaging area A1 of the electronic imaging unit 12 is subjected to a predetermined moving image compression process, and the image data is compressed to be data. Reduce the amount. Thereby, for example, the data amount per image frame is reduced to about 1/5.

  The moving image recording control program 72c causes the CPU 71 to function as moving image recording control means. That is, the moving image recording control program 72c performs moving image recording processing for generating and recording moving image data (see FIG. 3A) based on the image data whose data amount has been reduced by the data amount reduction processing. It is a program for causing the CPU 71 to realize such a function.

The face detection program 72d causes the CPU 71 to function as face detection means. That is, the face detection program 72d is a program for causing the CPU 71 to realize a function related to execution of face detection processing for sequentially detecting a face in a subject from each of a plurality of image frames generated by the imaging unit 1.
Specifically, based on the execution of the face detection program 72d by the CPU 71, the face image search range for one image frame as a whole image among a plurality of image frames in which the number of pixels has been reduced by the data amount reduction processing. Scan the image search frame in a predetermined direction, identify the characteristic parts (face parts) corresponding to eyes, nose, batter, etc., determine whether the face is from the positional relationship of each face part, If it is determined that there is, the search frame area is regarded as a face. When a face is detected in a predetermined image frame, the face detection is performed in the next image frame using a predetermined area near the detected face as a face image search range.

  The main subject specifying program 72e causes the CPU 71 to function as main subject specifying means. That is, the main subject specifying program 72e is a program for causing the CPU 71 to realize a function related to the main subject specifying process for specifying the main subject in the subject based on the image data generated by the first imaging area A1. Specifically, as shown in FIG. 2 and the like, the CPU 71 executes the main subject specifying program 72e, thereby specifying the person H as the main subject based on the face detected in the face detection process.

  The second imaging area setting program 72f causes the CPU 71 to function as second imaging area setting means. In other words, the second imaging area setting program 72f stores the second imaging area A2 that is narrower than the first imaging area A1 among the entire imaging areas of the electronic imaging unit 12 when recording a moving image in the moving image recording process. This is a program for causing the CPU 71 to realize a function related to the second imaging region setting process for arbitrarily setting the position and the dimension. Specifically, the CPU 71 executes the second imaging area setting program 72f, so that the person H corresponds to the position and size of the person H as the main subject specified in the main subject specifying process. The position and size of the second imaging area A2 are set so as to exist within the area.

  The still image recording control program 72g causes the CPU 71 to function as main subject image recording control means. That is, the still image recording control program 72g is used as the main subject by the second imaging area A2 set in the second imaging area setting process based on the input of the still image recording instruction in response to the pressing operation of the shutter button 41a. 3 is a program for causing the CPU 71 to realize a function related to a still image recording process for recording still image data (see FIG. 3B) generated by imaging of the person H. Specifically, when the CPU 71 executes the still image recording control program 72g, the image data before the data amount reduction processing is read out from the image memory 14, and the second imaging area A2 is handled from the image data. The image data to be cut out is recorded and recorded in the recording medium 5 as still image data without being subjected to compression processing.

Next, a moving image recording process performed by the imaging apparatus 100 according to the first embodiment will be described with reference to FIGS. 4 and 5.
4 and 5 are flowcharts illustrating an example of an operation related to a moving image recording process performed by the imaging apparatus 100. FIG.
In the following moving image recording process, it is assumed that the moving image shooting mode is set in advance based on a predetermined operation of the mode setting button 41b by the user. In addition, it is assumed that the entire imaging area of the electronic imaging unit 12 is set as the first imaging area A1 in the first imaging area setting process.

  As shown in FIG. 4, when the imaging of the subject by the imaging unit 1 is started, the CPU 71 temporarily stores the image data captured and generated by the electronic imaging unit 12 in the image memory 14 and based on the image data. The through image is displayed on the image display unit 32 (step S1).

Then, the CPU 71 determines whether or not the start of moving image shooting is instructed based on the pressing operation of the shutter button 41a by the user (step S2).
Here, if it is determined that the start of moving image shooting has been instructed (step S2; YES), the CPU 71 executes the moving image recording control program 72c in the program memory 72, so A moving image recording process for generating and recording moving image data based on image data generated by photoelectric conversion by one imaging region (all imaging regions) A1 is started (step S3).
In this moving image recording process, the CPU 71 executes the data amount reduction program 72b in the program memory 72, and performs a thinning process on the image data generated by imaging the subject in the first imaging area A1. Then, image data obtained by thinning out a predetermined amount of data is created (step S4), a predetermined moving image compression process is performed on the image data, and the image data is compressed (step S5). The moving image data subjected to the data amount reduction processing to be reduced is generated and recorded on the recording medium 5.

  Thereafter, the CPU 71 determines whether or not an optical zoom magnification change is instructed based on a predetermined operation of a zoom magnification change button (not shown) of the operation unit 4 by the user (step S6). If it is determined that an instruction to change the magnification of the optical zoom is given (step S6; YES), the CPU 71 changes the magnification of the optical zoom according to the instruction (step S7).

  Next, as shown in FIG. 5, the CPU 71 determines whether or not an instruction to record a still image is given based on a re-pressing operation of the shutter button 41 a of the operation unit 4 by the user (step S <b> 8). If it is determined that recording of a still image is instructed (step S8; YES), the CPU 71 executes the face detection program 72d in the program memory 72, and the number of pixels is reduced in step S4. Based on the obtained image data, face detection processing for detecting the face in the subject is performed (step S9). Subsequently, the CPU 71 executes a main subject specifying program 72e in the program memory 72, and performs a main subject specifying process for specifying the person H as a main subject based on the face detected in the face detection process (step S10). ).

  Next, the CPU 71 executes the second imaging area setting program 72f in the program memory 72 to correspond to the position and size of the second imaging area A2 corresponding to the position and size of the person H specified in the main subject specifying process. A second imaging area setting process for setting dimensions is performed, and a still image shooting frame W corresponding to the second imaging area A2 is displayed on the image display unit 32 (step S11). Then, the CPU 71 executes the still image recording control program 72g in the program memory 72, and based on the image data before the data amount reduction processing is performed, the second imaging region setting processing sets the second imaging region setting processing. Still image recording processing is performed in which still image data (see FIG. 3B) generated by imaging the person H by the imaging area A2 is acquired and recorded on the recording medium 5 (step S12). When recording still image data, unlike the case of recording moving image data, recording is performed without performing thinning-out processing or compression processing. Note that the rate of data volume reduction is lower than when moving image data is recorded, and recording is performed with thinning or compression processing within the range where high quality or high definition images can be recorded. May be.

  If it is determined in step S8 that recording of a still image is not instructed (step S8; NO), the process proceeds to step S3.

Thereafter, the CPU 71 determines whether or not an instruction to end the shooting of the moving image has been issued based on the re-pressing operation of the shutter button 41a by the user (step S13).
If it is determined that the end of moving image shooting is not instructed (step S13; NO), the process proceeds to step S3. On the other hand, if it is determined that the end of moving image shooting is instructed (step S13). S13; YES), the moving image recording process is terminated.

As described above, according to the imaging apparatus 100 of the first embodiment, a predetermined amount of data is thinned out from the image data generated by the first imaging area (all imaging areas) A1 of the electronic imaging unit 12 in the data amount reduction process. The moving image data can be generated and recorded on the basis of the image data whose data amount is reduced by compressing the image data. When the moving image is recorded, the user presses the shutter button 41a. Based on this, it is possible to input to the CPU 71 an instruction to record the image of the main subject in the subject imaged by the second imaging area A2 that is narrower than the first imaging area A1 of the electronic imaging unit 12, and the CPU 71 The still image data generated by imaging the person H as the main subject in the second imaging area A2 can be recorded on the basis of the input.
Accordingly, the shutter button 41a can be used without interrupting the recording operation even when the subject is roughly captured in a wider range and the moving image is being recorded by the first imaging area A1 of the electronic imaging unit 12. Based on this pressing operation, detailed still image data of the main subject existing in a narrower range within the subject can be recorded.
In addition, when recording still image data, it is possible to record images with higher quality or higher definition than moving image data, so at the time of playback, details that cannot be confirmed with moving image data alone are confirmed with still image data. can do. In addition, even if irreversible conversion such as thinning-out processing or compression processing has been performed and thus the degraded image quality cannot be restored from moving image data, thinning-out processing or compression processing is not performed (or irreversible). It becomes possible to reproduce higher-quality or high-definition image data based on still image data (which has a low degree).
In addition, only when the main subject is in a state suitable for shooting, it is possible to cut out and record only the main subject portion, so that a high quality or high definition stillness with a low data amount reduction rate can be obtained. Even when image data is recorded, the memory capacity for recording the image data is not wasted.

In addition, since the position and size of the second imaging area A2 can be arbitrarily set in the entire imaging area of the electronic imaging unit 12, if it is a main subject existing in the subject, it is surely taken and still image data is captured. Can be recorded.
At this time, the person H as the main subject can be reliably identified based on the face detected by the face detection process. Furthermore, since the position and size of the second imaging area A2 can be set in correspondence with the position and size of the person H as the identified main subject, the position of the main subject as the main subject is within the angle of view of the second imaging area A2. The person H can be surely accommodated.

  In the first embodiment, in the second imaging region setting process, both the position and size of the second imaging region A2 are set in correspondence with the position and size of the person H as the main subject. However, the content of the second imaging area setting process is not limited to this. For example, only the position of the second imaging area A2 may be set corresponding to the position of the person H as the main subject, or only the dimension of the second imaging area A2 may be set corresponding to the dimension of the person H. You may make it do.

[Embodiment 2]
Hereinafter, the imaging apparatus 200 according to the second embodiment will be described with reference to FIGS.
FIG. 6 is a block diagram illustrating a schematic configuration of the imaging apparatus 200 according to the second embodiment to which the present invention is applied.

The imaging apparatus 200 according to the second embodiment tracks a main subject in a subject by moving body analysis, can change a tracking target based on a predetermined operation of the selection determination button 41c of the operation unit 4, and can also change the main subject. The position and size of the second imaging area A2 are set based on the position and size of.
The imaging apparatus 200 according to the second embodiment is substantially the same as the first embodiment except that the main subject is tracked by moving body analysis and the tracking target is changed, and thus the same components are denoted by the same reference numerals. Therefore, the description is omitted.

  As shown in FIG. 6, the program memory 72 includes a first imaging area setting program 72a, a data amount reduction program 72b, a moving image recording control program 72c, a face detection program 72d, a main subject specifying program 72e, and a second imaging area setting. In addition to the program 72f and the still image recording control program 72g, a main subject tracking program 72h is stored.

The main subject tracking program 72h causes the CPU 71 to function as main subject tracking means. That is, the main subject tracking program 72h performs main subject tracking processing for tracking the main subject specified in the main subject specifying processing based on the plurality of image data generated by the first imaging area A1 of the electronic imaging unit 12. It is a program for causing the CPU 71 to realize such a function.
Specifically, the CPU 71 executes the main subject tracking program 72h to obtain the face coordinates (face coordinates) of the person H detected by the face detection process in one of the adjacent image frames. After that, the imaging target (face corresponding part) in the area surrounded by the face coordinates is specified (see FIG. 7A). Then, using image information such as luminance information and color information of the face corresponding portion as a template, scanning within a predetermined moving object search range near the face coordinates in a predetermined direction in the next image frame, matching is performed, and the most approximate A high part is specified (refer FIG.7 (b)). Then, the edge of the portion determined to have the highest approximation is used as the tracking frame, and after obtaining the coordinates of each corner of the tracking frame, the face coordinates are updated with the coordinates of the corner. Further, image information such as luminance information and color information of the face corresponding portion in the tracking frame is updated as a template.
The template used for matching is updated by sequentially executing the above processing on each of successive image frames. As a result, even if the subject changes with time, the face corresponding portion can be tracked as a moving object.

  Then, the CPU 71 executes the second imaging region setting program 72f to correspond to the position and size of the person H as the main subject tracked in the main subject tracking process in the second imaging region setting process. The position and size of the second imaging area A2 are set.

The selection determination button 41c instructs selection of one main subject among the plurality of main subjects when the main subject specifying means specifies a plurality of main subjects. For example, by selecting one main subject among a plurality of main subjects based on a predetermined operation of the cursor button of the selection determination button 41c, the main subject to be imaged in the still image recording process can be changed. it can.
When the instruction to set the main subject is output via the input circuit 42 and input to the CPU 71, the CPU 71 specifies the selected main subject as an imaging target in the still image recording process.
Here, the selection determination button 41c constitutes a selection instruction input means for inputting an instruction to select one main subject among a plurality of main subjects specified in the main subject specifying process.

Next, a moving image recording process performed by the imaging apparatus 200 according to the second embodiment will be described with reference to FIG.
FIG. 8 is a flowchart illustrating an example of an operation related to a moving image recording process performed by the imaging apparatus 200.
In the following moving image recording process, the moving image recording process in the imaging apparatus 100 of the first embodiment and the process up to step S7 are common, and the description thereof is omitted.

In step S28, the CPU 71 executes the face detection program 72d in the program memory 72, and performs face detection processing for detecting the face in the subject based on the image data in which the number of pixels is reduced in step S4. . Subsequently, the CPU 71 executes a main subject specifying program 72e in the program memory 72, and performs a main subject specifying process for specifying the person H as a main subject based on the face detected in the face detection process (step S29). ).
Thereafter, the CPU 71 executes a main subject tracking program 72h in the program memory 72 to perform main subject tracking processing for tracking the main subject specified in the main subject specifying processing by moving body analysis (step S30).

  Thereafter, the CPU 71 determines whether or not a change of the main subject has been instructed based on a predetermined operation of the selection determination button 41c of the operation unit 4 by the user (step S31). If it is determined that the change of the main subject is instructed (step S31; YES), the CPU 71 specifies the main subject related to the change as a shooting target in the still image recording process (step S32), and then step. The process proceeds to S30.

  On the other hand, if it is determined in step S31 that the change of the main subject has not been instructed (step S31; NO), the CPU 71 executes the second imaging area setting program 72f in the program memory 72 to execute the main subject. A second imaging area setting process for setting the position and dimension of the second imaging area A2 in correspondence with the position and dimension of the person H tracked in the tracking process is performed, and the stationary corresponding to the second imaging area A2 is performed. The image shooting frame W is displayed (step S33).

  Thereafter, the CPU 71 determines whether or not an instruction to change the size of the second imaging region A2 is given based on a predetermined operation of the selection determination button 41c of the operation unit 4 by the user (step S34). Here, when it is determined that the change of the dimension of the second imaging area A2 is instructed (step S34; YES), the CPU 71 performs a process of changing the dimension of the second imaging area A2 in accordance with the instruction. Then, the still image shooting frame W is displayed according to the second imaging area A2 (step S35).

  Next, it is determined whether or not the recording of a still image is instructed based on the re-pressing operation of the shutter button 41a of the operation unit 4 by the user (step S36). If it is determined that still image recording is instructed (step S36; YES), the CPU 71 executes the still image recording control program 72g in the program memory 72 to perform data amount reduction processing. Still image recording generated by capturing still image data generated by imaging the person H by the second imaging area A2 set in the second imaging area setting process based on the previous image data and recording it on the recording medium 5 Processing is performed (step S37).

If it is determined in step S34 that an instruction to change the size of the second imaging area A2 is not given (step S34; NO), the process proceeds to step S36.
If it is determined in step S36 that recording of a still image has not been instructed (step S36; NO), the process proceeds to step S3 in the flowchart of FIG.

  As described above, according to the imaging apparatus 200 of the second embodiment, the person H as the main subject is tracked by moving body analysis, and the position and size of the second imaging region A2 are associated with the position and size of the person H. Therefore, the person H as the main subject can be reliably contained within the angle of view of the second imaging area A2.

  Further, when a plurality of persons H (main subjects) are specified in the main subject specifying process, a desired person H can be selected as the main subject among these, so the desired person H Can be reliably within the angle of view of the second imaging region A2.

  In the second embodiment, in the second imaging region setting process, the position and the size of the second imaging region A2 corresponding to the position and size of the person H as the main subject tracked by the main subject tracking process Although both the dimensions are set, the content of the second imaging area setting process is not limited to this. For example, only the position of the second imaging area A2 may be set corresponding to the position of the person H to be tracked, or only the dimension of the second imaging area A2 may be set corresponding to the dimension of the person H. You may do it.

  In the second embodiment, the main subject is changed (selected) based on a predetermined operation of the selection determination button 41c of the operation unit 4. However, the present invention is not limited to this. A touch panel may be provided on the touch panel, and the main subject may be selected according to the touch position of the touch panel.

The present invention is not limited to the first and second embodiments, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the first and second embodiments, the entire imaging area of the electronic imaging unit 12 is set as the first imaging area A1, but the position and size of the first imaging area A1 are limited to this. is not. That is, based on the execution of the first imaging area setting program 72a by the CPU 71, a predetermined area of all the imaging areas may be set as the first imaging area A1 (see FIG. 9). Thereby, 1st imaging area A1 can be arbitrarily set arbitrarily in all the imaging areas of the electronic imaging part 12. FIG.
Moreover, when the dimension of 1st imaging area A1 is changed, you may set the dimension of 2nd imaging area A2 smaller corresponding to this. Further, the data amount reduction rate may be automatically changed in accordance with the change in size, and the data amount reduction rate may be lowered as the size decreases. Further, the position and size of the second imaging area A2 may be arbitrarily set regardless of the position and size of the person H to be detected.

Furthermore, in the first and second embodiments, both the thinning process and the compression process are performed as the data amount reduction process, but only one of the processes may be performed. The data amount reduction processing is not limited to these, and any processing can be used as long as it can reduce the data amount of the image data generated based on imaging of the subject by the first imaging area A1. May be.
Furthermore, the data amount reduction process is performed on the moving image data, but the present invention is not limited to this, and the still image generated based on the imaging of the main subject by the second imaging area A2 of the electronic imaging unit 12 You may make it apply with respect to data. At this time, the data amount reduction rate of the data amount reduction process for still image data is smaller than the data amount reduction rate for moving image data, that is, still image data has higher image quality than moving image data. Thus, it is preferable to perform the data amount reduction process.

  In the first and second embodiments, the recording instruction of the image data of the main subject imaged in the second imaging area A2 is performed based on the pressing operation of the shutter button 41a. However, the present invention is not limited to this. For example, it may be performed based on a pressing operation by a user of a button different from the shutter button 41a, or automatically under the control of the CPU 71 after a predetermined time has elapsed since the start of moving image recording. For example, the image data of the main subject may be recorded.

  Furthermore, in the first and second embodiments, the still image data of the main subject imaged by the second imaging area A2 is recorded. However, the present invention is not limited to this, and the moving image data of the main subject is recorded. May be recorded.

  Further, the configurations of the imaging apparatuses 100 and 200 are merely examples as illustrated in the above-described embodiment, and are not limited thereto.

  In addition, in the first and second embodiments, data amount reduction means, moving image recording control means, main subject image recording control means, first imaging area setting means, second imaging area setting means, main subject specifying means The functions as the face detection means and the main subject tracking means are realized by executing a predetermined program or the like by the CPU 71. However, the present invention is not limited to this, and for example, to realize various functions. You may comprise from this logic circuit.

It is a block diagram which shows schematic structure of the imaging device of Embodiment 1 to which this invention is applied. It is a figure which shows typically an example of the image displayed on the image display part of the imaging device of FIG. It is a figure which shows typically an example of the imaging area of the electronic imaging part of the imaging device of FIG. 3 is a flowchart illustrating an example of an operation related to a moving image recording process by the imaging apparatus of FIG. 1. 5 is a flowchart showing a continuation of the moving image recording process of FIG. 4. It is a block diagram which shows schematic structure of the imaging device of Embodiment 2 to which this invention is applied. It is a figure which shows typically an example of the imaging area of the electronic imaging part of the imaging device of FIG. 7 is a flowchart illustrating an example of an operation related to a moving image recording process by the imaging apparatus of FIG. 6. It is a figure which shows typically an example of the imaging area of the electronic imaging part of the imaging device of the modification 1.

Explanation of symbols

100, 200 Imaging device 1 Imaging unit 12 Electronic imaging unit (imaging device)
3 Display unit 32 Image display unit 4 Operation unit 41a Shutter button (image recording instruction input means)
41c Selection decision button (selection instruction input means)
71 CPU (data amount reduction means, moving image recording control means, main subject image recording control means, first imaging area setting means, second imaging area setting means, main subject specifying means, face detection means, main subject tracking means)
A1 first imaging area A2 second imaging area

Claims (13)

An imaging device having an imaging region for imaging a subject;
A moving image recording control means for sequentially recording, as moving image data, image data sequentially generated by imaging of a subject in the first imaging region among all imaging regions of the imaging element;
Within the subject imaged by a second imaging area narrower than the first imaging area among all imaging areas of the imaging element at an arbitrary timing during the recording operation of the moving image data by the moving image recording control means Image recording instruction input means for allowing the user to input an instruction to record an image of the main subject,
During the recording operation of the moving image data by the moving image recording control means, the position and size of the second imaging area in the entire imaging area are determined based on the image data sequentially generated by the first imaging area. Second imaging area setting means for sequentially changing;
In response to an input of the recording instruction by the image recording instruction input means, in the position and dimensions of the second imaging area set by the this input timing second imaging area setting unit, wherein by said second imaging region Main subject image recording control means for recording image data generated by imaging the main subject;
When recording moving image data by the moving image recording control means, a data amount reduction process with a higher data amount reduction rate compared to when recording image data by the main subject image recording control means, or A reduction rate of a predetermined data amount for the moving image data recorded by the moving image recording control unit without performing the data amount reduction process on the image data recorded by the main subject image recording control unit Data amount reduction control means for performing the data amount reduction processing of
An imaging apparatus comprising: The display control means according to claim 1, further comprising a display control means for causing the display means to sequentially display a frame indicating the position and size of the second imaging area that is sequentially changed by the operation of the second imaging area setting means. The imaging device described. Main subject specifying means for sequentially specifying the main subject based on image data sequentially generated by the first imaging region;
The second imaging region setting unit sequentially changes the position of the second imaging region in correspondence with the position of the main subject sequentially specified by the main subject specifying unit and / or the size of the main subject. The imaging apparatus according to claim 1, wherein the size of the second imaging region is sequentially changed correspondingly. Comprising face detection means for sequentially detecting a face in the subject,
The imaging apparatus according to claim 3, wherein the main subject specifying unit sequentially specifies the main subject based on a face sequentially detected by the face detection unit. Main subject tracking means for tracking the main subject specified by the main subject specifying means based on a plurality of image data sequentially generated by the first imaging region;
The second imaging region setting unit sequentially changes the position of the second imaging region in correspondence with the position of the main subject tracked by the main subject tracking unit and / or corresponds to the size of the main subject. The imaging apparatus according to claim 3, wherein the size of the second imaging area is sequentially changed.   The selection instruction input means for inputting a selection instruction for selecting one main subject among the plurality of main subjects specified by the main subject specifying means. Imaging device.   The imaging according to any one of claims 1 to 6, further comprising first imaging area setting means for setting a position or a size of the first imaging area among all imaging areas of the imaging element. apparatus.   The imaging according to any one of claims 1 to 6, wherein the data amount reduction processing reduces a data amount by thinning out a predetermined amount of data from image data obtained by imaging with the imaging device. apparatus.   The imaging apparatus according to claim 1, wherein the data amount reduction processing compresses image data obtained by imaging with the imaging element to reduce the data amount.   The imaging apparatus according to claim 1, wherein the first imaging area is a fixed area corresponding to the entire imaging area of the imaging element. In an imaging device including an imaging device having an imaging region for imaging a subject,
A function of sequentially recording image data generated sequentially by imaging of a subject in the first imaging area out of all imaging areas of the imaging element as moving image data;
Recording of the image of the main subject in the subject imaged by the second imaging region that is narrower than the first imaging region among all the imaging regions of the imaging element at an arbitrary timing during the recording operation of the moving image data A function that allows the user to input instructions ;
A function of sequentially changing the position and size of the second imaging area in the entire imaging area based on the image data sequentially generated by the first imaging area during the moving image data recording operation;
A function of recording image data generated by imaging the main subject by the second imaging area in response to an input of a recording instruction by the user ;
At the time of recording the moving image data, a data amount reduction process having a higher data amount reduction rate than that at the time of recording the image data related to the main subject is performed, or the image data related to the main subject is processed. A function of performing a data amount reduction process at a predetermined data amount reduction rate on the moving image data without performing the data amount reduction process;
A program characterized by realizing.   An imaging device having an imaging region for imaging a subject;
  A moving image recording control means for sequentially recording, as moving image data, image data sequentially generated by imaging of a subject in the first imaging region among all imaging regions of the imaging element;
  Within the subject imaged by a second imaging area narrower than the first imaging area among all imaging areas of the imaging element at an arbitrary timing during the recording operation of the moving image data by the moving image recording control means Image recording instruction input means for allowing the user to input an instruction to record an image of the main subject,
  Face detection means for detecting a face in the subject based on image data generated by the first imaging region;
  Main subject specifying means for specifying the main subject based on the face detected by the face detecting means;
  A selection instruction input means for inputting a selection instruction for selecting one main subject among the plurality of main subjects specified by the main subject specifying means;
  Main subject tracking means for tracking the main subject selected by the selection instruction input means based on a plurality of image data generated by the first imaging region;
  Corresponding to the position of the main subject selected by the selection instruction input unit and tracked by the main subject tracking unit in the entire imaging area during the recording operation of the moving image data by the moving image recording control unit A second imaging area setting means for changing the position of the second imaging area and changing the dimension of the second imaging area in correspondence with the dimension of the main subject;
  In response to the input of the recording instruction by the image recording instruction input means, the position and size of the second imaging area set by the second imaging area setting means at this input timing, and the second imaging area by the second imaging area Main subject image recording control means for recording image data generated by imaging the main subject;
  When recording moving image data by the moving image recording control means, a data amount reduction process with a higher data amount reduction rate compared to when recording image data by the main subject image recording control means, or A reduction rate of a predetermined data amount for the moving image data recorded by the moving image recording control unit without performing the data amount reduction process on the image data recorded by the main subject image recording control unit Data amount reduction control means for performing the data amount reduction processing of
  An imaging apparatus comprising:   A computer of an image pickup apparatus having an image pickup device for picking up an image of a subject,
  A moving image recording control means for sequentially recording, as moving image data, image data sequentially generated by imaging of a subject in the first imaging region among all imaging regions of the imaging element;
  Within the subject imaged by a second imaging area narrower than the first imaging area among all imaging areas of the imaging element at an arbitrary timing during the recording operation of the moving image data by the moving image recording control means Image recording instruction input means for allowing the user to input an instruction to record an image of the main subject,
  Face detection means for detecting a face in the subject based on image data generated by the first imaging region;
  Main subject specifying means for specifying the main subject based on the face detected by the face detecting means;
  A selection instruction input means for inputting a selection instruction for selecting one main subject among the plurality of main subjects specified by the main subject specifying means;
  Main subject tracking means for tracking the main subject selected by the selection instruction input means based on a plurality of image data generated by the first imaging region;
  Corresponding to the position of the main subject selected by the selection instruction input unit and tracked by the main subject tracking unit in the entire imaging area during the recording operation of the moving image data by the moving image recording control unit A second imaging area setting means for changing the position of the second imaging area and changing the dimension of the second imaging area in correspondence with the dimension of the main subject;
  In response to the input of the recording instruction by the image recording instruction input means, the position and size of the second imaging area set by the second imaging area setting means at this input timing, and the second imaging area by the second imaging area Main subject image recording control means for recording image data generated by imaging the main subject;
  When recording moving image data by the moving image recording control means, a data amount reduction process with a higher data amount reduction rate compared to when recording image data by the main subject image recording control means, or A reduction rate of a predetermined data amount for the moving image data recorded by the moving image recording control unit without performing the data amount reduction process on the image data recorded by the main subject image recording control unit Data amount reduction control means for performing the data amount reduction processing of
  A program characterized by making it function.

Images