JP5482142B2 - Image processing apparatus, imaging apparatus, and image processing program - Google Patents

Description

  The present invention relates to an image processing device, an imaging device, and an image processing program.

  Trimming an image taken with an electronic camera or the like, creating and saving a new image, and creating a print from a trimming range are performed. A technique for trimming in accordance with the recognized face is known (see Patent Document 1).

JP 2005-267454 A

  By the way, when shooting a plurality of images with the same subject and the same scene in daily shooting, the size and position of the subject in the screen often differ slightly in these images. This is because the user shoots by changing the distance between the subject and the camera, changing the zooming, or changing the composition.

  There is no problem when only one best image is selected and trimmed from such a series of photographed images, but since the expression of the subject is different, multiple images can be selected and saved, or a print can be created. Many. At this time, if you want to trim each image to your liking while thinking individually, you can trim the first image to your liking. Is often "just need to be able to trim the subject in the same way as the first image".

  However, in the present situation, the trimming apparatus with a built-in camera and the image editing software used on a personal computer have a problem that trimming must be performed for each image. Although the trimming operation is a creative process for a user to complete an image as a photograph, the fact that the trimming operation has to be repeated several times for a similar image is a great burden both in terms of time and psychology. It has become.

  The present invention has been made in view of such circumstances, and an object thereof is an image processing apparatus capable of performing the same trimming on the second image in accordance with the trimming on the subject in the first image, To provide an imaging apparatus and an image processing program.

The present invention has been made to solve the above-described problem. A determination unit that determines whether or not the subject of the first image is similar to the subject of the second image, and the determination unit determines whether the second image If the subject is judged to be similar to the subject of the first image in the same conditions as the first trimming frame set for the first image, first against the second image a belt trimming frame setting unit automatically sets the 2 trimming frame is an image processing apparatus comprising: a.

  Moreover, this invention is an imaging device provided with the image processing apparatus as described above.

The present invention also provides a determination procedure for determining whether or not the subject of the first image and the subject of the second image are similar to the computer as the image processing apparatus, and the subject of the second image is determined by the determination procedure. wherein when it is determined that the first is similar to the subject of the image, under the same conditions as the first trimming frame condition set for the first image, a second trimming against the second image an image processing program for executing the belt trimming frame setting procedure automatically configures the frame.

  According to the present invention, the same trimming can be performed on the second image as the subject is trimmed on the first image.

1 is a block diagram illustrating a configuration of an imaging apparatus having an image processing apparatus according to an embodiment of the present invention. It is a figure of operation which selects "image editing" in a comprehensive menu. It is a figure of operation which selects "Trimming" from an image edit menu. It is a figure of operation which designates an object picture by trimming operation. It is a figure of operation which designates a print size in order to determine the aspect ratio of trimming. It is a figure which operates the trimming frame with respect to the selection image. It is a figure of operation which selects whether to perform automatic trimming with respect to a similar image. It is a figure of operation which chooses whether automatic trimming is made into the same aspect ratio as the first trimming frame. It is a figure of operation which selects the similar image used as the object to perform automatic trimming. It is a figure of operation which checks and changes the trimming frame set by automatic trimming. It is a figure explaining the analysis of the trimming frame which the user set with respect to the 1st image. It is a figure explaining the method of automatically trimming with respect to a similar image from the trimming frame analysis result of a 1st image. It is a figure explaining another method of the analysis of the trimming frame of a 1st image. 2 is a flowchart showing an operation of an imaging apparatus having the image processing apparatus of FIG.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic block diagram showing a configuration of an imaging apparatus having an image processing apparatus (trimming apparatus) according to an embodiment of the present invention. Here, a case where the image processing apparatus is configured as the microcomputer 1 will be described.

  The imaging apparatus includes a microcomputer 1 that controls each configuration of the imaging apparatus, an optical system control unit 2 that controls an optical system in photographing using the photographing lens 31, and light received through the photographing lens 31. An imaging unit 3 that converts a signal into an electrical signal and an operation unit 4 that a user operates are provided. The imaging apparatus includes an external interface 51, an image display control unit 61, a superimposed display control unit 62, a monitor 63, a driver circuit DR5, a photographing information monitor 64, a card connector 71, a memory card 72, an image storage memory 73, and a compression / decompression circuit. 74, a memory 75, a timer 76, a driver circuit DR6, a piezoelectric buzzer 77, a battery 81, and a battery check circuit 82.

  The optical system control unit 2 includes a photometry device 21, a driver circuit DR2, a driver circuit DR3, a driver circuit DR4, a shutter unit 22, an aperture mechanism unit 23, and a mirror mechanism unit 24. The photometric device 21 detects the luminance of the subject and sends a detection signal to the microcomputer 1. The driver circuit DR2 drives and controls the shutter unit 22 in accordance with a command from the microcomputer 1. The shutter unit 22 opens and closes shutter blades to block light. The driver circuit DR3 drives and controls the aperture mechanism unit 23 in accordance with a command from the microcomputer 1. The aperture mechanism unit 23 opens and closes the aperture of the taking lens 31. The driver circuit DR4 drives and controls the mirror mechanism unit 24 in accordance with a command from the microcomputer 1. The mirror mechanism unit 24 raises and lowers a mirror (not shown).

  The imaging unit 3 includes an imaging lens 31, an imaging device 32 such as a CCD (Charge Coupled Device), an imaging circuit 33, a driver circuit DR1, and a motor M1. The photographing lens 31 forms a subject image on the imaging surface of the image sensor 32. The imaging circuit 33 includes an A / D conversion circuit, converts an analog imaging signal output from the imaging element 32 into digital data, and performs predetermined image processing on the converted image data. Examples of the image processing include γ conversion processing and white balance adjustment processing. The driver circuit DR1 drives the motor M1 in response to a command from the microcomputer 1. For example, the motor M1 drives the focus lens of the photographing lens 31 to advance and retract in the optical axis direction. Note that the photographic lens 31 may be fixedly attached to the imaging device, or may be attached so as to be detachable from the imaging device.

  The operation unit 4 includes a main switch SW1, a release switch SW2, a cancel switch SW3, a mode switch SW4, a playback / menu switch SW5, a left selection switch SW6, a right selection switch SW7, an upper selection switch SW8, a lower selection switch SW9, and a confirmation switch SW10. , An operation switch SW11, an operation switch SW12, a command dial left rotation switch SW13, a command dial right rotation switch SW14, and an image deletion switch SW15.

  The main switch SW1 outputs an operation signal for instructing to power on or power off the imaging apparatus. The release switch SW2 outputs a half-press operation signal indicating the start of shooting when the release switch SW2 is pressed halfway, and a full-press operation signal indicating that shooting is performed when the release switch SW2 is fully pressed. Output. The cancel switch SW3 outputs an operation signal indicating operation cancellation.

  The mode switch SW4 outputs an operation signal for switching between the shooting mode and the playback mode of the imaging apparatus. The mode switch SW4 outputs an operation signal for switching to the comprehensive menu mode in response to being pressed in the reproduction mode. The reproduction / menu switch SW5 outputs an operation signal for selecting reproduction or menu.

  The left selection switch SW6, the right selection switch SW7, the upper selection switch SW8, and the lower selection switch SW9 each output an operation signal indicating a selection direction. Hereinafter, the combination of the left selection switch SW6 and the right selection switch SW7 will be referred to as a left / right selection switch SW6 • 7, and the combination of the upper selection switch SW8 and the lower selection switch SW9 will be referred to as an upper / lower selection switch SW8 • 9.

  The confirmation switch SW10 outputs an operation signal indicating operation confirmation. The operation switch SW11 is used in combination with the command dial left rotation switch SW13 or the command dial right rotation switch SW14, and an operation signal indicating that a trimming frame (a first trimming frame or a second trimming frame described later) is enlarged or reduced. Is output.

  The command dial left rotation switch SW13 or the command dial right rotation switch SW14 outputs an operation signal for sequentially switching in the forward direction or the reverse direction. The left rotation switch SW13 or the command dial right rotation switch SW14 is configured as one rotation switch, for example. When the rotation switch rotates left, the left rotation switch SW13 is pressed. When the rotation switch rotates right, the command dial right rotation switch SW14 is pressed.

  The image deletion switch SW15 outputs an operation signal indicating that an image is deleted. The preview switch SW16 outputs an operation signal indicating that an image is to be previewed.

  The external interface 51 is an interface circuit that outputs (transmits) data in the imaging apparatus to an external device such as a personal computer or another electronic camera. As an example of the external interface 51, there are communication standards such as RS232 (Recommended Standard 232), USB (Universal Serial Bus), IEEE1394 (Institute of Electrical and Electronic Engineers 1394).

  The image display control unit 61 generates a drive signal for displaying an image or a menu screen on the monitor 63 according to a command from the microcomputer 1 and outputs the drive signal to the monitor 63. The superimposition display control unit 62 generates a drive signal that causes character information such as shooting conditions and a trimming frame to be superimposed and displayed on the image displayed on the monitor 63 by the instruction from the microcomputer 1. And output to the monitor 63. The monitor 63 is, for example, a color liquid crystal display, and displays an image, an operation menu, and the like based on drive signals from the image display control unit 61 and the superimposed display control unit 62, and character information such as shooting conditions and a trimming frame. Is superimposed. Note that an EL display or the like may be used as the monitor 63 instead of the liquid crystal display.

  The driver circuit DR5 generates a drive signal for the photographing information monitor 64 according to a command from the microcomputer 1. The shooting information monitor 64 is, for example, a monochrome liquid crystal display, and displays character information indicating shooting conditions such as a code or mark indicating a set exposure mode and the number of shot frames.

  The memory card 72 is a recording medium that is attached to and detached from the imaging device via the card connector 71. The memory card 72 stores image data and trimmed image data. The image storage memory 73 temporarily stores image data during the above-described image processing, compression processing and decompression processing described later. The compression / decompression circuit 74 compresses image data in a predetermined image format such as JPEG (Joint Photographic Experts Group), or decompresses the compressed image data.

  The memory 75 has storage areas such as a RAM (Random Access Memory) area and a ROM (Read Only Memory) area, for example. The RAM area is used as a work area of the microcomputer 1, for example. In the ROM area, a program for controlling the entire imaging apparatus is stored in advance. The microcomputer 1 controls the entire imaging apparatus based on the program read from the ROM area.

  Further, the memory 75 has a trimming frame information storage unit 751. The trimming frame information storage unit 751 associates with the information indicating the print size, information indicating the aspect ratio of the trimming frame in the case of the print size, or the vertical value as the initial value of the trimming frame in the case of the print size. Information indicating the size of the horizontal and horizontal is stored in advance. The trimming frame information storage unit 751 is included in the ROM area, for example.

  The timer 76 measures the time designated by the microcomputer 1 and outputs a time-up signal or a signal indicating the current date and time. The driver circuit DR6 generates a drive signal for the piezoelectric buzzer 77 in response to a command from the microcomputer 1. The piezoelectric buzzer 77 vibrates a built-in piezoelectric element according to the input drive signal and outputs a buzzer sound. The battery 81 supplies power to each unit in the imaging device. The battery check circuit 82 monitors the power supplied from the battery 81 to the imaging device, and outputs the monitored result to the microcomputer 1.

  Next, the microcomputer 1 as the image processing apparatus according to the present embodiment will be described. Here, only the configuration related to the image processing apparatus in the configuration of the microcomputer 1 will be described. The microcomputer 1 includes a first trimming frame setting unit 11, a second trimming frame setting unit 12, a trimming unit 13, and a control unit 14.

The first trimming frame setting unit 11 sets a first trimming frame for the first image.
The second trimming frame setting unit 12 applies the second trimming frame to the second image so as to satisfy the same conditions as the first trimming frame conditions set for the first image by the first trimming frame setting unit 11. Set.

  Further, the second trimming frame setting unit 12 determines whether or not the subject in the first image is similar to the subject in the second image, and if the determined result is similar, A second trimming frame is set for the second image so that the same conditions as the first trimming frame for one image are satisfied.

  Further, the second trimming frame setting unit 12 detects a subject in the first image or a subject in the second image, a face recognition technique for the first image or the second image, or a subject detection technique based on color. To detect. As a subject detection technique based on the color in the screen, for example, a technique according to the following document is known.

(Reference) JP 2009-59326 A

  The second trimming frame setting unit 12 sets a second trimming frame for the second image on the condition that the position of the first trimming frame in the screen with respect to the subject in the first image is a condition.

  Further, the second trimming frame setting unit 12 calculates a ratio of the position of the first trimming frame in the screen to the subject in the first image, and with respect to the second image on the condition of the calculated position ratio. A second trimming frame is set.

  The second trimming frame setting unit 12 sets the aspect ratio of the second trimming frame to be the same as the aspect ratio of the first trimming frame when the second trimming frame is set for the second image. Whether or not to do so is selected and set. When the second trimming frame setting unit 12 is selected to set the aspect ratio of the second trimming frame so as to be the same as the aspect ratio of the first trimming frame, the second trimming frame setting unit 12 applies to the second image. When setting the second trimming frame, the second trimming frame is set to be the same as the aspect ratio of the first trimming frame.

  Further, the second trimming frame setting unit 12 sets the second trimming frame for the second image so that the same conditions as the first trimming frame conditions set for the first image are satisfied. When the second trimming frame is set outside the image area of the second image, the second trimming frame is set within the image area of the second image.

  The trimming unit 13 trims the first image based on the first trimming frame set by the first trimming frame setting unit 11. The trimming unit 13 trims the second image based on the second trimming frame set by the second trimming frame setting unit 12. The trimming unit 13 records the trimmed first image or second image on the memory card 72 via the card connector 71, for example.

  The control unit 14 controls each configuration included in the microcomputer 1 and each configuration included in the imaging apparatus.

  Next, using the screen diagrams of FIGS. 2 to 13 and the flowchart of FIG. 14, an image is displayed on the monitor 63, and an image processing apparatus included in the imaging apparatus when the user trims the displayed image. The operation will be described. 2 to 13 are images displayed on the monitor 63 of the imaging apparatus. The following step numbers are the step numbers in the flowchart of FIG. In the following, a case will be described in which the subject is a face or a person detected by face recognition technology. A similar image described later corresponds to the second image described above.

<1. Enter trimming mode>
First, when the user presses the mode switch SW4 (see FIG. 1), the control unit 14 switches from the shooting mode to the playback mode. When the user presses the mode switch SW4 (see FIG. 1) again, the control unit 14 displays the general menu. The mode is set (FIG. 2, step S101).

  Next, when the user selects “image editing” with the up / down selection switches SW8 and 9 and presses the confirmation switch SW10, the control unit 14 shifts to the image editing menu (step S103 in FIG. 3).

  Next, when the user selects “trimming” with the up / down selection switches SW8 and 9 and presses the confirm switch SW10, the control unit 14 shifts to a screen for selecting an image to be trimmed (steps in FIGS. 4 and 14). S105).

<2. Select the image to trim>
Next, when the user selects an image to be trimmed with the up / down selection switches SW8, 9 and the left / right selection switches SW6, 7 and presses the confirm switch SW10, the control unit 14 displays the selected image in full screen, A dialog for designating the first trimming frame is displayed again (FIG. 5, step S107, step S109).

<3. Select the first trimming frame (aspect ratio) and execute trimming>
Next, on the screen shown in FIG. 5, the user designates which print size is to be trimmed from among a plurality of predetermined print sizes using the up / down selection switches SW8 and 9. FIG. 5 shows a case where trimming is performed with an aspect ratio corresponding to six cuts as an example. When the user selects six cuts and presses the confirmation switch SW10 (step S109), the first trimming frame setting unit 11 Then, the screen shifts to a screen for setting the first trimming frame (FIG. 6, step S111).

<Enlargement / reduction / movement of the first trimming frame>
To operate the first trimming frame on the screen shown in FIG. 6, the user can move left / right / up / down with left / right selection switch SW6 / 7 and up / down selection switch SW8 / 9, and rotate command dial to the left while pressing operation switch SW11. The first trimming frame is enlarged or reduced by the switch SW13 or the right rotation switch SW14. In response to a user operation, the first trimming frame setting unit 11 sets the first trimming frame. When the user presses the confirmation switch SW10 after completing the setting of the first trimming frame, the control unit 14 shifts to a screen for determining whether or not to perform automatic trimming on a similar image (step S113 in FIG. 7). .

<4. Automatic trimming for similar images (1)-Initial setting, selection and checking of similar images>
When automatic trimming is performed on an image similar to the first image trimmed and set in the above (FIG. 7, step S113) in the same manner as the trimming of the first image, the user selects “automatic trimming of similar images”. Select with the up / down selector switch SW8 / 9 and press the confirm switch SW10. Then, the control unit 14 shifts to a screen for setting the second trimming frame of images after the similar image (step S115 in FIG. 8).

  On the other hand, when automatic trimming is not performed on a similar image in the above (FIG. 7, step S113), the user selects “single trimming” with the up / down selection switches SW8 and 9 and presses the confirmation switch SW10. Then, the control part 14 advances a process to below-mentioned step S141.

  Next, in the above (FIG. 7, step S113), the user selects “automatic trimming of similar images”, and the control unit 14 displays a screen for setting the second trimming frames of the images after the similar second image. In the case of transition (FIG. 8, step S115), in this FIG. 8 (step S115), the control unit 14 causes the user to select a method for creating the second trimming frame for the similar image.

  For example, when it is desired to set the second trimming frame for the similar image to the same aspect ratio as that of the first trimming frame of the first image, the user selects “automatically create with the same aspect ratio as the first trimming frame”. When the selection is made and the aspect ratio is not necessarily the same as that of the first trimming frame of the first image, the user selects “automatically create without limiting the aspect ratio”.

  As will be described later, when automatic trimming is performed on a similar image, the aspect ratio of the second trimming frame is not necessarily the same as the aspect ratio of the first trimming frame with respect to the first image to be referred to. Therefore, the control unit 14 allows the user to select whether or not to trim the similar image with the trimming aspect ratio of the first image trimmed by the user in FIG. 8 (step S115). Yes.

<Selection of similar images>
Next, in FIG. 8, when the user selects any one and presses the confirmation switch SW10, the control unit 14 shifts to a screen for selecting a similar image to be automatically trimmed (FIG. 9, step S117). Next, the user selects the image that he / she wants to automatically trim while moving left / right and up / down with the left / right selection switch SW6 / 7 and the up / down selection switch SW8 / 9, and presses the confirm switch SW10 while pressing the operation switch SW11. Press to select one or more self-images to be automatically trimmed. When the selection is completed, the user presses the confirmation switch SW10.

<Determination of similar images>
Next, the second trimming frame setting unit 12 determines whether or not the similar image to be automatically trimmed selected by the user as described above is similar to the first image that the user has already designated for trimming (step). S119).

  In step S119, if the second trimming frame setting unit 12 determines that the images are not similar, the second trimming frame setting unit 12 cancels the selection of the images and displays a message “The selection of images that cannot be recognized as similar images has been canceled”. indicate. The second trimming frame setting unit 12 may display the message together with the image on the screen of FIG. 9, for example, when displaying the message “The selection of an image that cannot be recognized as a similar image has been released”. . The user confirms the displayed message and presses the confirmation switch SW10 again (steps S125 and 127). In response to the depressing switch SW10 being pressed again, the second trimming frame setting unit 12 advances the process to step S121 described later.

  For example, the second trimming frame setting unit 12 determines whether the image is similar to the first image already specified by the user for trimming, that is, the determination of the similar image. Then, the number of faces of each designated similar image is compared (step S119), and a determination is made based on whether there is an image with a different number of faces. In addition, the determination of the similar image is performed based on the same number of faces, and whether or not the difference between the distance between each face in the similar image and the corresponding face distance in the first image is within a certain value. It may be determined by determining.

  If it is determined in step S119 that the second trimming frame setting unit 12 is similar, or if the confirmation switch SW10 is operated in step S117 described above, the second trimming frame setting unit 12 is set. The unit 12 generates a second trimming frame for the selected similar image by the processing from step S121 to step S139 described below.

<5. Automatic trimming of similar images (2)-Analysis of the first trimming frame of the first image>
Next, in order to automatically trim similar images after the second image, the second trimming frame setting unit 12 first sets the first trimming frame set by the user for the first image as follows. To analyze.

1) As shown in FIG. 11, face recognition, which is a known technique, is performed to recognize face areas F1, F2, and F3 (step S121).

2) Analysis of the left side of the first trimming frame: Obtain the width F1W of the recognized leftmost face F1 in the trimming screen and the distance SL from the left edge to the first trimming frame, and set the value (SL ÷ F1W) The characteristic value defining the left side of trimming is used (step S123).

3) Analysis of the right side of the first trimming frame: Obtain the width F3W of the rightmost recognized face F3 in the trimming screen and the distance SR from the right edge to the first trimming frame, and set the value (SR ÷ F3W) The characteristic value defining the right side of trimming is set (step S123).

4) Analysis of the upper side of the first trimming frame: Obtain the height F2H of the recognized face F2 at the top of the trimming screen and the distance SU from the top edge to the first trimming frame, and obtain the value (SU ÷ F2H) Is a characteristic value that defines the upper side of trimming (step S123).

5) Analysis of the lower side of the first trimming frame: the height F3H of the recognized face F3 at the bottom of the trimming screen and the distance SB from the lower end to the first trimming frame are obtained and the value (SB ÷ F3H) Is the characteristic value defining the trimming lower side (FIG. 12, step S123).

<6. Automatic Trimming for Similar Images (3)-Creation of Second Trimming Frame from Characteristic Values>
Next, using the four characteristic values obtained above, the second trimming frame setting unit 12 performs automatic trimming setting on a similar image as follows (step S129).

1) Face recognition is performed on similar images to be automatically trimmed, and face areas F1, F2, and F3 are recognized. However, the face areas F1, F2, and F3 recognized in the similar image may have different positions and sizes from the case of the first image.

2) Setting the left side of the second trimming frame: From the width F1W2 of the recognized leftmost face F1 in the screen and the above characteristic value (SL ÷ F1W), obtain the characteristic value SL2 by the following (Equation 1) Sets the left side of the second trimming frame.

  SL2 = F1W2 × (SL ÷ F1W) (Equation 1)

3) Setting the right side of the second trimming frame: From the width F3W2 of the recognized right face F3 in the screen and the above characteristic value (SR ÷ F3W), find the characteristic value SR2 by the following (Equation 2). Set the right side of the second trimming frame.

  SR2 = F3W2 × (SR ÷ F3W) (Formula 2)

4) Setting the upper side of the second trimming frame: From the height F2H2 of the recognized face F2 at the top of the screen and the above characteristic value (SU ÷ F2H), find the characteristic value SU2 by the following (Equation 3) The upper side of the second trimming frame is set.

  SU2 = F2H2 × (SU ÷ F2H) (Equation 3)

5) Setting the lower side of the second trimming frame: From the height F3H2 of the recognized face F3 at the bottom of the screen and the above characteristic value (SB ÷ F3H), obtain the characteristic value SB2 by the following (Equation 4) The lower side of the second trimming frame is set.

  SB2 = F3H2 × (SB ÷ F3H) (Formula 4)

<7. Automatic trimming of similar images (4)-Correction of aspect ratio of second trimming frame>
Next, the second trimming frame setting unit 12 determines whether or not maintaining the aspect ratio by automatic trimming has been selected in step S115 described above. That is, in step S115 described above, the second trimming frame setting unit 12 selects either “automatically create with the same aspect ratio as the first trimming frame” or “automatically create without limiting the aspect ratio”. Determine if selected. When “automatically create with the same aspect ratio as the first trimming frame” is selected, the second trimming frame setting unit 12 corrects the created second trimming frame (steps S131 and S133).

  Here, as described above, in FIG. 8, it is assumed that “automatically create with the same aspect ratio as the first trimming frame” is selected as the designation of the second trimming frame. In this case, the second trimming frame created with a similar image must also have a six aspect ratio as specified in the first image (FIG. 5). However, there is a possibility that the second trimming frame of FIG. 12 automatically created as described above (initially created second trimming frame) is eventually longer or longer than the six-cut aspect ratio. is there. In this case, a method of filling the horizontal width to obtain a six aspect ratio will be described below (steps S131 and S133).

  First, the second trimming frame setting unit 12 compares the aspect ratio (W1 ÷ H1) of the initial second trimming frame (width W1 / height H1) automatically created above with a six-cut aspect ratio 1.25. Then, it is determined whether the initial second trimming frame is vertically long or horizontally long. In this case, it is determined to be horizontally long. The six-cut aspect ratio is read from the trimming frame information storage unit 751 by the second trimming frame setting unit 12, for example. Then, the second trimming frame setting unit 12 calculates and obtains the target width W2 by W2 = H1 × 1.25. In this case, the sum of left and right is reduced to W2 by W1-W2.

  Therefore, if the second trimming frame setting unit 12 determines the amount to be squeezed according to the ratio of the leftmost space to left space SL2 and the rightmost face to right space SR2 in the previous period, New left and right spaces are obtained from (Expression 5) and (Expression 6). In this way, the second trimming frame setting unit 12 corrects the created second trimming frame.

  SL2 ’= (W1-W2) x (SL2 ÷ (SL2 + SR2)) (Equation 5)

  SR2 ’= (W1-W2) x (SR2 ÷ (SL2 + SR2)) (Equation 6)

  On the other hand, when it is necessary to pinch up and down, the second trimming frame setting unit 12 similarly corrects the vertical space in the vertical direction so that the selected aspect ratio can be obtained. Two trimming frames can be modified.

<8. Automatic Trimming for Similar Images (5) to Another Example for Determining Four Sides of Second Trimming Frame>
In the above example, the second trimming frame setting unit 12 obtains a characteristic value based on the recognized face width / height in steps S131 and S133, and adjusts the upper, lower, left, and right sides so that the ratio is equal. The second trimming frame was set by determining the space from the face.
As another method, the second trimming frame setting unit 12 may obtain the characteristic value in the same manner as described above from the overall width (F13W) and height (F23H) of a plurality of faces recognized as shown in FIG. Good.
Further, the second trimming frame setting unit 12 may recognize a part whose distance is within a predetermined range from the face as a subject, and determine the characteristic value from the width / height, without being limited to the face.

<9. Automatic trimming of similar images (6)-when the second trimming frame reaches the end of the image>
Next, the second trimming frame setting unit 12 determines whether or not the created second trimming frame exceeds the image area of the second image, and if so, the second trimming frame is set to the second image. The created second trimming frame is corrected so as to be within the image area (step S135, step S137).

  For example, in the above description, the second trimming frame can be set as calculated. However, in some cases, when any one of the upper, lower, left, and right second trimming frames calculated from the characteristic value protrudes from the image itself, that is, the calculation. In some cases, it is not possible to take the space just for the result. In that case, the second trimming frame setting unit 12 sets the outer edge of the image as the second trimming frame (steps S135 and S137).

  In this way, when the second trimming frame is corrected to the outer edge of the image, there is no problem if “automatically create without limiting the aspect ratio” is selected in FIG. However, when “automatically create with the same aspect ratio as the first trimming frame” is selected in FIG. 8, the second trimming frame setting unit 12 displays, for example, “Image space is displayed on the confirmation screen in FIG. 10. A message stating that “the aspect ratio of the trimming frame has been changed because it was insufficient” is displayed.

<10. Automatic trimming of similar images (7)-Confirmation / change of results and termination of trimming work>
Next, the second trimming frame is set by the second trimming frame setting unit 12 in the similar image specified above, and the control unit 14 is a screen for confirming the similar image with the second trimming frame set for each image. The process proceeds to (FIG. 10, step S139).

  If the second trimming frame is acceptable as it is, the user presses the confirmation switch SW10. If the user wants to change the automatically generated second trimming frame, use the left / right selection switch SW6 / 7 and the up / down selection switch SW8 / 9 to move left / right / up / down, while holding down the operation switch SW11, Using the rotation switch SW13 / right rotation switch SW14, the second trimming frame is enlarged / reduced and changed, and the confirmation switch SW10 is pressed.

  Further, when there is a next similar image to be automatically trimmed, the second trimming frame proceeds to the next similar image in order and performs the same operation. If there is no similar image set for automatic trimming, the second trimming frame finishes the operation of setting a series of second trimming frames, and then the trimming unit 13 cuts out the original image with each trimming frame and creates a new one. A trimmed image is generated and stored in a recording medium (for example, memory card 72) (step S141).

  That is, the trimming unit 13 cuts out an image with the first trimming frame and saves it on a recording medium such as the memory card 72, and cuts out a similar image with the second trimming frame and saves it on the recording medium. Thereafter, the control unit 14 returns the process to step S101, for example, and the general menu display is restored (FIG. 2, step S143).

As described above, the image processing apparatus according to the present embodiment performs the following operation.
(1) The user designates the first trimming frame for the first image.
(2) The user selects an image (similar image) to be trimmed in the same manner as the first image with trimming settings for the subject, and instructs execution of automatic trimming.
(3) The second trimming frame setting unit 12 of the image processing apparatus recognizes a subject in the first image by scene recognition / face recognition, and obtains a positional relationship between the subject and the first trimming frame set by the user. Similarly, the second trimming frame is automatically set for the second and subsequent images (similar images) selected by the user.
(4) The user checks and corrects whether the second trimming frame automatically set for the second and subsequent images is appropriate.
(5) The user instructs the confirmation of the second trimming frame, image generation / storage or printing.
(6) The image processing apparatus performs image generation, storage, or printing in accordance with the above instructions.

<Effect>
With the configuration of the second trimming frame setting unit 12 that performs the above-described operation, the image processing apparatus according to the present embodiment has the following effects.

1. If the user sets the first trimming frame only for the first image, the relationship between the subject and the first trimming frame is automatically set in the same manner as the first image for a series of images similar to the first image. Since two trimming frames are set, the trimming operation can be performed efficiently in a short time without trouble.
2. Since automatic trimming can be specified to be performed with the same trimming aspect ratio as that of the first image, trimming can be performed with the same aspect ratio for all trimming target images.
3. Since automatic trimming can be specified to be performed with a trimming aspect ratio different from that of the first image, optimal trimming can be performed for each image.
4. Since the second trimming frame that has been automatically trimmed can be confirmed and the second trimming frame can be changed as necessary, trimming can be performed according to the user's wishes.
5. Since the image selected by the user as a similar image before execution of automatic trimming is checked whether it can be handled as a similar image, even if the user mistakenly selects an image that is not similar to the first image as the target for automatic trimming, Automatic trimming can be prevented from causing undesirable results.

  As described above, according to the image processing apparatus of the present embodiment, the first trimming frame for the first image is set according to the user's preference, orientation, or intention. For example, the position of the subject in the screen is set according to the user's preference, orientation, or intention. Then, in accordance with the first trimming frame, the user's preference, orientation, or intention is reflected, and in the same manner as in the first trimming frame, the same subject as the first image is captured in the second image. Again, the second trimming frame is set.

  In this way, the image processing apparatus according to the present embodiment can not only perform the same trimming on the second image in accordance with the trimming on the subject in the first image, but also the user's preference, orientation, Alternatively, the second image can be similarly trimmed to reflect the intention. Further, by determining whether or not the subject in the first image and the subject in the second image are similar, the same applies to the second image in which the same subject as the subject in the first image is captured. Can be trimmed.

<Application of the embodiment>
1. In the embodiment, the face is recognized, the first trimming frame for the first image set by the user is analyzed based on the position / size, and automatic trimming is performed based on the first trimming frame. In addition to recognizing the face, the subject area is recognized from the color and shape of the image and the relationship between this and the first trimming frame set by the user is analyzed, and automatic trimming is performed based on this (setting of the second trimming frame) ).
2. In the embodiment, an example in which the trimming apparatus of the present invention is mounted on an imaging apparatus such as a camera is shown. However, in addition to this, it is also possible to mount it on image editing application software or a printer used on a PC. The operation interface may be performed in a form suitable for each.
3. In the setting of the first trimming frame to the first image of the embodiment, the first trimming frame is horizontally long, but the user may first select whether the first trimming frame is horizontally long or vertically long. Furthermore, it is also possible to recognize a face or a subject and automatically select either landscape or portrait from the layout.

  In the above description, the second trimming frame setting unit 12 has the second condition so that the second trimming frame setting unit 12 has the same condition as the first trimming frame condition set for the first image by the first trimming frame setting unit 11. It has been described that the second trimming frame is set for the image. However, the present embodiment is not limited to this, and the second trimming frame setting unit 12 has the same condition as the condition of the first trimming frame set for the first image. For this, a second trimming frame may be set.

  For example, when there is a first image that has already been trimmed in the first trimming frame, the second trimming frame setting unit 12 has the same condition as the condition of the first trimming frame set for the first image. A second trimming frame may be set for the second image.

  In addition, the first image that has already been trimmed with the first trimming frame may not be trimmed with the first trimming frame, and may remain photographed. In this case, for example, the second trimming frame setting unit 12 regards the first trimming frame as a frame corresponding to the entire first image, and sets the conditions of the first trimming frame set for the first image. A second trimming frame is set for the second image so as to satisfy the same conditions as in FIG.

  Even in this case, the second trimming frame setting unit 12 can trim the second image so that the position of the subject in the first image is the same in the screen. Therefore, the image processing apparatus including the second trimming frame setting unit 12 can perform the same trimming of the second image in accordance with the trimming of the subject in the first image.

  The second trimming frame setting unit 12 described above detects a subject in the image by using a face recognition technique or a subject detection technique based on color. As described above, the microcomputer 1 or the imaging apparatus includes a configuration for detecting a subject in an image by using a face recognition technology or a subject detection technology based on color as a configuration of a face recognition unit or an image recognition unit. It may be. Then, the second trimming frame setting unit 12 may detect a subject in the image by using a face recognition technology or a subject detection technology based on a color by a configuration of a face recognition unit or an image recognition unit.

  In the description of the above embodiment, the second image (similar image) is described as being selected by the user, but the present invention is not limited to this. For example, the second trimming frame setting unit 12 selects a second image similar to the first image selected by the user from the storage unit (for example, the memory card 72) in which the image is stored, and the selected image May be executed as the second image. In this way, the user can trim the second image in the same manner as the first image without selecting an image to be trimmed.

  In the selection of the second image similar to the first image, the second trimming frame setting unit 12 continuously captures the shooting times of the first image and the second image in addition to the determination based on the number of faces described above. An image having a similar image or an image having the same shooting condition such as a shooting mode may be used as a similar image. The shooting conditions such as the shooting time and the shooting mode are information added to the image by the imaging device when the image is taken, for example.

  In the embodiment described above with reference to FIGS. 1 to 14, the case where the imaging apparatus includes the image processing apparatus has been described. However, the present invention is not limited to this, and the function as the image processing apparatus is performed on the computer. You may make it implement | achieve. That is, each configuration of the first trimming frame setting unit 11, the second trimming frame setting unit 12, the trimming unit 13, and the control unit 14 included in the image processing apparatus in FIG. 1 is realized by dedicated hardware. Each of these components may be configured by a memory and a CPU (central processing unit), and a program for realizing the function of each component is loaded into the memory and executed to realize the function. It may be.

  1 is recorded in a computer-readable recording medium, and the program recorded in the recording medium is read into a computer system and executed. Thus, the function as an image processing apparatus may be realized. Here, the “computer system” includes an OS and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, it also includes those that hold a program for a certain period of time, such as a volatile memory inside a computer system serving as a server or client in that case. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  11 ... 1st trimming frame setting part, 12 ... 2nd trimming frame setting part

Claims (10)

Determination means for determining whether the subject of the first image and the subject of the second image are similar;
When the determination unit determines that the subject of the second image is similar to the subject of the first image, the same condition as the first trimming frame condition set for the first image is used. a belt trimming frame setting unit automatically sets the second trimming frame against the second image,
An image processing apparatus comprising: The determination means includes
The determination as to whether the subject of the first image and the subject of the second image are similar based on the number of faces of the subject included in the first image and the second image. Item 8. The image processing apparatus according to Item 1. The determination means includes
It is determined whether the subject of the first image and the subject of the second image are similar by a face recognition technology for the first image or the second image or a subject detection technology based on color. The image processing apparatus according to claim 1 , wherein the image processing apparatus is an image processing apparatus. The trimming frame setting unit
  The second trimming frame for the second image is automatically set using the characteristic value based on the position of the first trimming frame on the screen and the position of the subject of the first image on the screen as the condition.
  The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The characteristic value is the ratio of the position of the first trimming frame in the screen to the subject of the first image,
Prior to Quito trimming frame setting section,
Calculating a ratio of the position in the first trimming frame screen of respect to the Utsushitai of the first image, the ratio of the position the calculated as the condition, automatically the second trimming frame relative to the second image To set
The image processing apparatus according to claim 4 . The front Quito trimming frame setting section,
When setting the second trimming frame for the second image, it is selected whether to set the aspect ratio of the second trimming frame to be the same as the aspect ratio of the first trimming frame. Set,
The image processing apparatus according to any one of claims 1 to 5, characterized in that. Prior to Quito trimming frame setting section,
If the aspect ratio of the second trimming frame is selected to be the same as the aspect ratio of the first trimming frame, the second trimming frame is set for the second image. Automatically setting the second trimming frame to be the same as the aspect ratio of the first trimming frame,
The image processing apparatus according to claim 6 . Prior to Quito trimming frame setting section,
When setting the second trimming frame for the second image so that the same condition as the first trimming frame set for the first image is satisfied, the second trimming frame is When the second trimming frame is set outside the image area of the second image, the second trimming frame is automatically set within the image area of the second image;
That the image processing apparatus according to item 1 to any of claims 1 to 7, characterized in. The image processing apparatus according to any one of claims 1 to 8 ,
An imaging apparatus comprising: In a computer as an image processing device,
A determination procedure for determining whether the subject of the first image and the subject of the second image are similar;
If it is determined by the determination procedure that the subject of the second image is similar to the subject of the first image, the same condition as the condition of the first trimming frame set for the first image is used. an image processing program for executing the automatic setting to belt trimming frame setting procedure of the second trimming frame against the second image.

Images