JP6273766B2 - Image processing apparatus, imaging apparatus, and image processing program - Google Patents

Description

  The present invention relates to an image processing device, an imaging device, and an image processing program.

  Conventionally, various techniques relating to focus adjustment have been considered. For example, the invention of Patent Document 1 discloses an imaging apparatus that performs focus adjustment using a subject extraction technique. In the invention of Patent Document 1, it is possible to optimally perform automatic focus adjustment on a subject even when the subject moves in the camera direction by deforming the AF distance measurement frame in accordance with the amount of change in the subject shape. Yes.

JP 2009-069748 A

  By the way, when there are a plurality of subjects in the object scene, a plurality of specific regions (for example, a subject region and a region of interest) are extracted by the subject extraction method described above. In such a case, it is difficult for the user to determine the specific area that is to be imaged, and generally the specific area on the near side is the AF target. However, in some cases, it is not correct to set a specific area on the near side as an AF target.

  The present invention has been made in view of the above points, and an object of the present invention is to enable a user to easily select any one of the specific areas when there are a plurality of specific areas.

In one aspect, the image processing apparatus of the present invention includes a detection unit that detects a plurality of subject regions included in an image based on a feature amount of the image, and at least of the plurality of subject regions detected by the detection unit. A display control unit for displaying an index indicating two subject areas on the display unit, and an index indicating the first subject area and the second subject area among the plurality of subject areas detected by the detection unit is displayed on the display unit. In the case of being displayed, an index indicating the first subject region and the second subject region is used as the first subject region and the second subject region among the plurality of subject regions detected by the detection unit. Is changed to an index indicating a different third subject area and displayed on the display unit, and the display mode of the index indicating the first subject area and the second subject area is changed and the table is changed. And the second mode to be displayed on the part, the and an operation unit for causing the display control unit.
The imaging device of the present invention includes the above-described image processing device.

In another aspect, the image processing apparatus of the present invention calculates an image feature amount indicated by the acquisition unit that acquires image data to be processed, and detects a specific region based on the feature amount. When a plurality of specific areas are detected by the area detection section, a display section that displays the specific area detected by the area detection section or an area based on the specific area, and the area detection section, The display unit includes a display control unit that performs display for selecting at least one specific region among the plurality of specific regions.
The acquisition unit sequentially acquires a plurality of pieces of image data generated continuously in time, and the region detection unit acquires the specific region each time a predetermined number of pieces of image data are acquired by the acquisition unit. May be detected.

  In addition, the display control unit may switch a plurality of the specific areas and display them on the display unit.

  The display control unit may determine the display order based on the feature amount when switching the plurality of specific regions.

  In addition, the display control unit may perform display on the display unit only when a predetermined condition based on a detection result by the region detection unit is satisfied.

  In addition, the display control unit may prohibit display on the display unit when a predetermined condition based on a detection result by the region detection unit is satisfied.

  Further, the predetermined condition may be a condition based on whether or not the specific area can be detected by the area detecting unit.

In addition, the predetermined condition may be a condition based on whether or not there is a specific region that is not suitable for selection when performing selection based on display by the display unit .
An imaging apparatus according to the present invention includes an imaging unit that captures a subject image to generate an image and any one of the image processing devices described above, and the imaging unit continuously generates the image data for composition confirmation. The acquisition unit sequentially acquires the image data from the imaging unit.

  Note that a control unit that executes a preparatory operation for main photographing by the imaging unit based on at least one specific region selected based on the display by the display unit may be provided.

  The imaging unit captures the subject image incident through an optical system to generate the image data, and the control unit performs an operation including focusing control related to the optical system as the preparation operation. You may do it.

  In addition, the display control unit may perform display on the display unit only when a predetermined condition based on a detection result by the region detection unit is satisfied.

  In addition, the display control unit may prohibit display on the display unit when a predetermined condition based on a detection result by the region detection unit is satisfied.

  Further, the display control unit performs display on the display unit for selecting at least one specific region of the plurality of specific regions as the focus control target, and the predetermined condition is the focus A condition based on whether or not the specific region suitable as a control target is detected by the region detection unit may be used.

  In addition, a tracking unit that sets at least one specific region selected based on display by the display unit as a tracking target and detects the tracking target from the plurality of images may be provided.

  In addition, the display control unit may perform display on the display unit only when a predetermined condition based on a detection result by the region detection unit is satisfied.

  In addition, the display control unit may prohibit display on the display unit when a predetermined condition based on a detection result by the region detection unit is satisfied.

  In addition, the display control unit performs display on the display unit for selecting at least one specific region of the plurality of specific regions as the tracking target, and the predetermined condition is suitable as the tracking target. A condition based on whether or not the specific area is detected by the area detection unit may be used.

  In addition, the area detection unit detects the specific area every time n (where n is an integer of 1 or more) of the image data is acquired by the acquisition unit before tracking by the tracking unit is started. When tracking by the tracking unit is started, the specific region is detected every time the acquisition unit acquires m (where m is an integer equal to or greater than 1 and n> m). good.

  In addition, when the plurality of specific areas are switched by the display control unit and displayed on the display unit, a reception unit that receives a user operation for switching display may be provided.

  Further, the display unit may include a touch panel unit that receives a user operation for selecting at least one specific region among the plurality of specific regions.

  An image processing program according to the present invention includes an acquisition procedure for acquiring image data to be processed in a computer, and a region detection for calculating a feature amount of an image indicated by the image data and detecting a specific region based on the feature amount And when the plurality of specific areas are detected by the area detection procedure, the display unit executes a display control procedure for performing display for selecting at least one specific area among the plurality of specific areas. .

  According to the present invention, when there are a plurality of specific areas, any one of the specific areas can be easily selected by the user.

2 is a block diagram illustrating configurations of a lens barrel 10, an imaging device 20, and a storage medium 40. FIG. It is a flowchart which shows operation | movement of CPU26 at the time of automatic detection mode execution of 1st Embodiment. It is a figure explaining a main subject change process. It is a figure explaining main subject selection processing. It is a flowchart which shows operation | movement of CPU26 at the time of automatic detection mode execution of 2nd Embodiment. It is a flowchart (continuation) which shows operation | movement of CPU26 at the time of execution of automatic detection mode of 2nd Embodiment. It is a figure explaining the setting process regarding tracking. It is a flowchart which shows operation | movement of CPU26 at the time of automatic detection mode execution of 3rd Embodiment.

<First Embodiment>
Hereinafter, a first embodiment will be described in detail with reference to the drawings.

  In the first embodiment, a description will be given by taking as an example an apparatus including a lens barrel 10, an imaging device 20, and a storage medium 40 as shown in FIG.

  The imaging device 20 captures an optical image incident from the lens barrel 10. The obtained image is stored in the storage medium 40 as a still image or a moving image.

  The lens barrel 10 includes a focus adjustment lens (hereinafter referred to as an “AF (Auto Focus) lens”) 11, a lens driving unit 12, an AF encoder 13, and a lens barrel control unit 14. The lens barrel 10 may be detachably connected to the imaging device 20 or may be integrated with the imaging device 20.

  The imaging device 20 includes an imaging unit 21, an image processing device 22, a display unit 23, a buffer memory unit 24, a storage unit 25, a CPU 26, an operation unit 27, and a communication unit 28. The imaging unit 21 includes an imaging element (not shown), and is controlled by the CPU 26 according to set imaging conditions (for example, an aperture value, an exposure value, etc.).

  In the lens barrel 10, the AF lens 11 is driven by the lens driving unit 12, and guides an optical image to a light receiving surface (photoelectric conversion surface) of an imaging element (not shown) in the imaging unit 21 of the imaging device 20. The AF encoder 13 detects the movement of the AF lens 11 and outputs a signal corresponding to the movement amount of the AF lens 11 to the lens barrel control unit 14. Here, the signal corresponding to the movement amount of the AF lens 11 may be, for example, a sine wave signal whose phase changes according to the movement amount of the AF lens 11.

  The lens barrel control unit 14 controls the lens driving unit 12 in accordance with a drive control signal input from the CPU 26 of the imaging device 20. Here, the drive control signal is a control signal for driving the AF lens 11 in the optical axis direction. The lens barrel control unit 14 changes, for example, the number of steps of the pulse voltage output to the lens driving unit 12 according to the drive control signal. Further, the lens barrel control unit 14 outputs the position (focus position) of the AF lens 11 in the lens barrel 10 to the CPU 26 of the imaging device 20 based on a signal corresponding to the movement amount of the AF lens 11. Here, the lens barrel control unit 14 integrates, for example, signals according to the movement amount of the AF lens 11 according to the movement direction of the AF lens 11, thereby moving the AF lens 11 in the lens barrel 10 ( Lens position) may be calculated. The lens driving unit 12 drives the AF lens 11 according to the control of the lens barrel control unit 14 and moves the AF lens 11 in the optical axis direction within the lens barrel 10.

  In the imaging device 20, the imaging unit 21 may include, for example, an imaging element that converts an optical image formed on the photoelectric conversion surface by the lens barrel 10 (optical system) into a digital signal and outputs the digital signal. good. In addition, for example, the imaging unit 21 includes an imaging device and an A / D conversion unit, and the imaging device converts an optical image formed on the photoelectric conversion surface by the lens barrel 10 (optical system) into an electrical signal and converts it into an A signal. The A / D converter may output to the / D converter, and the A / D converter may digitize the electrical signal converted by the image sensor and output the digital signal. Note that the imaging element is configured by a photoelectric conversion element such as a CMOS (Complementary Metal Oxide Semiconductor), for example. Further, the image sensor may convert an optical image into an electric signal for a partial region of the photoelectric conversion surface (image clipping). Further, the imaging unit 21 outputs a recording image obtained when a shooting instruction from the user is received via the operation unit 27 to the storage medium 40 via the communication unit 28. On the other hand, the imaging unit 21 outputs continuously obtained images to the buffer memory unit 24 and the display unit 23 as through images in a state before receiving a shooting instruction from the user via the operation unit 27.

  The image processing device 22 performs image processing on the image temporarily stored in the buffer memory unit 24 based on the image processing conditions stored in the storage unit 25. The image after image processing is stored in the storage medium 40 via the communication unit 28. Further, the image processing device 22 performs mask extraction processing on the image temporarily stored in the buffer memory unit 24 (details will be described later). The extracted mask information is output to the CPU 26 and stored in the storage unit 25, the storage medium 40, and the like.

  The display unit 23 is, for example, a liquid crystal display, and displays an image generated by the imaging unit 21, an operation screen, and the like. The buffer memory unit 24 temporarily stores the image generated by the imaging unit 21. The storage unit 25 stores imaging conditions, determination conditions referred to by the CPU 26 in various determinations, and the like.

  The CPU 26 includes an area detection unit 31, a display control unit 32, an AF control unit 33, and a tracking control unit 34. The CPU 26 acquires necessary information from the image processing unit 22, the storage unit 25, and the like, and based on the acquired information. Thus, each unit in the imaging device 20 is controlled in an integrated manner. Specific operations of each part will be described later. For control by the CPU 26, focus adjustment (AF) setting, exposure adjustment (AE) setting, white balance adjustment (WB) setting, flash emission amount change setting, subject tracking setting, various shooting mode settings, etc. , Various image processing settings, various display settings, brightness optimization settings linked to zoom magnification, and the like. In addition, the CPU 26 monitors the operation state of the operation unit 27 and outputs image data to the display unit 23.

  The operation unit 27 includes, for example, a power switch, a shutter button, a multi-selector (cross key), or other operation keys. The operation unit 27 receives a user operation input when operated by the user, and outputs a signal corresponding to the operation input to the CPU 26. Output to. It should be noted that a shutter button (not shown) can be operated in two stages, known half-press (S1) and full-press (S2). As for half-pressing (S1), ON which is a normal pressing operation and long-pressing operation which is an operation of continuing pressing for a predetermined time or more are possible. In addition, the multi-selector (not shown) is provided with an OK button used for the determination operation, similarly to a known one.

  The communication unit 28 is connected to a removable storage medium 40 such as a card memory, and writes, reads, or deletes information (image data, area information, etc.) to the storage medium 40.

  The storage medium 40 is a storage unit that is detachably connected to the imaging device 20 and stores information (image data, area information, and the like). Note that the storage medium 40 may be integrated with the imaging device 20.

  The imaging device 20 includes an automatic detection mode for automatically detecting a specific area in addition to a normal mode for detecting a specific area (for example, a main subject area or a region of interest) based on focus adjustment information during shooting. The automatic detection mode is a mode in which a specific region is automatically and continuously detected based on a through image for composition confirmation and the like, and each unit is controlled based on information on the detected specific region. This automatic detection mode may be set by a user operation via the operation unit 27, or may be automatically set by the CPU.

  The operation of the CPU 26 when executing the automatic detection mode for detecting the main subject area as the specific area will be described below with reference to the flowchart of FIG.

  In step S <b> 101, the CPU 26 controls the imaging unit 21 to start acquiring a through image. The acquired image information of the through image is temporarily stored in the buffer memory unit 24. This through image is continuously generated at a predetermined time interval. The acquisition of the through image by the CPU 26 is sequentially performed sequentially in time.

  In step S102, the CPU 26 controls the image processing device 22 to perform normal image processing. Normal image processing includes white balance adjustment, interpolation processing, color tone correction processing, gradation conversion processing, and the like. Since the specific method of each process is the same as that of a well-known technique, description is abbreviate | omitted. The image processing device 22 acquires the image data of the target image from the buffer memory unit 24, performs image processing, and then outputs the image data to the buffer memory unit 24 again.

  In step S <b> 103, the CPU 26 performs mask extraction processing by the area detection unit 31. The mask extraction process is a technique for calculating a feature amount in an image and detecting a main subject region based on a similar feature amount (mask). For example, the evaluation value is obtained from the feature amount in the image, and the mask extraction is performed by obtaining the continuous region of the evaluation value that can be regarded as the same or the same. Any method of mask extraction may be used. In addition, since a specific method for extracting a mask is the same as that of a known technique, description thereof is omitted. This mask extraction process is continuously performed until an imaging instruction to be described later is performed. That is, when the through image changes, the extracted mask is updated as needed.

  In step S104, the CPU 26 determines whether or not the subject area has been extracted. If the CPU 26 determines that one or more subject areas have been extracted, the process proceeds to step S105. On the other hand, if it is determined that no subject area can be extracted, the CPU 26 returns to step S102, and performs the processing from step S102 onward for the image of the next frame.

  In step S105, the CPU 26 records mask information. The CPU 26 records information about the result of the mask extraction process executed in step S103 in the buffer memory unit 24, the storage unit 25, and the like as mask information. The mask information includes information such as the extraction conditions (color classification, mask classification, etc.) of the mask extraction processing in step S103, the position of the mask, the size and shape of the mask, and the rank of each mask based on the evaluation value.

  In step S106, the CPU 26 determines whether or not the same mask has been extracted continuously n times (n frames) or more. If the CPU 26 determines that the same mask has been extracted continuously n times or more, the CPU 26 proceeds to step S107 described later. On the other hand, when determining that the same mask has not been extracted n times or more in succession, the CPU 26 returns to step S102 described above, and performs the processing from step S102 onward for the next through image.

  The case where the same mask is extracted is a case where masks of substantially the same color and size are extracted at substantially the same position in a plurality of frames. For this determination, the mask information described in step S105 may be used. In any case, when the amount of change between frames is within a specified range, it can be determined that they are the same. Based on the mask information or the like described in step S105, the tendency of mask extraction performed in the past (extracted mask type, appearance frequency, etc.) is obtained, and the amount of change described above is within the specified range according to this tendency. It may be possible to appropriately change the threshold for determining whether or not. For example, the threshold value may be changed to a larger value for a mask extracted at a high frequency in the past.

  Note that n described above is a predetermined threshold (for example, n = 7), and is appropriately determined based on the frame rate at the time of image capturing by the image capturing unit 21, the zoom magnification in the lens barrel 10, the user operation via the operation unit 27, and the like. It may be changeable. Further, the tendency of mask extraction performed in the past (the type of extracted mask, the appearance frequency, etc.) is obtained based on the mask information described in step S105, and the value of n described above is appropriately set according to this tendency. It may be changeable. For example, for a mask extracted at a high frequency in the past, the value of n may be changed to a smaller value.

  Further, the contents of the determination made in step S106 may be recorded in addition to the mask information described in step S105, and used in subsequent processing relating to frames.

  Moreover, it is good also as a structure which determines whether the mask extraction process is performed stably by methods other than the above-mentioned. For example, the determination may be performed in consideration of whether the same mask has been extracted continuously until the previous time. With this configuration, even if temporary unextraction occurs only this time, if the same mask is extracted in the next frame without invalidating the previous accumulation, the previous stable state is maintained. Can be considered.

  In step S <b> 107, the CPU 26 controls the display unit 23 with the display control unit 32 to display the main subject area on the display unit 23. In step S107, the display control unit 32 sets the areas corresponding to the two masks in descending order of evaluation based on the result of the mask extraction process executed in step S103 as main subject areas, respectively, and information on the main subject area. Is displayed so as to be visible. For example, as illustrated in FIG. 3A, the display control unit 32 sets a frame (a frame corresponding to the first mask) in the main subject region corresponding to the first rank mask and the second rank mask. By displaying F1 and the frame F2) corresponding to the second-order mask, the subject area corresponding to the mask to be photographed is displayed so as to be visible. The frame may be in accordance with the shape of the subject area, or may be a predetermined shape such as a rectangle or a circle. Also, the line thickness, shading, color, etc. may be anything. In any case, by performing such display, the user can easily grasp the currently extracted mask or the subject area corresponding to the mask. In the present embodiment, an example is shown in which the top two masks with high evaluation are displayed. However, the number of masks to be displayed is not limited to two as long as the number is appropriate. Further, the number of masks to be displayed may be specified by a user operation via the operation unit 27.

  In step S108, the CPU 26 determines whether or not S1 is long pressed. If the CPU 26 determines that S1 (half-press) has been pressed for a shutter button (not shown) of the operation unit 27, the process proceeds to step S109. On the other hand, if it is determined that S1 is not pressed for a long time even after a predetermined time has elapsed, the CPU 26 proceeds to step S110 described later. In the present embodiment, the case where the user presses and holds S1 is a case where the user issues an instruction to change the two main subject areas displayed on the display unit 23 in step S107. For example, when the two main subject areas displayed on the display unit 23 in step S107 are different from the user's request, the user long presses S1 (half press) of a shutter button (not shown) of the operation unit 27. Thus, an instruction to change the main subject area is issued.

  In step S109, the CPU 26 controls the display control unit 32 to perform main subject change processing. As illustrated in FIG. 3A, when S1 is long pressed in a state where the frame F1 corresponding to the first mask and the frame F2 corresponding to the second mask are displayed, the display control unit 32 As illustrated in FIG. 3B, instead of the frames F1 and F2, a frame (a frame F3 corresponding to the third mask, and a frame in the main subject area corresponding to the third mask and the fourth mask, and A frame F4) corresponding to the fourth mask is displayed. Further, as illustrated in FIG. 3B, when S1 is long pressed while the frame F3 corresponding to the third-order mask and the frame F4 corresponding to the fourth-order mask are displayed, the display control unit 32 As shown in FIG. 3C, instead of the frames F3 and F4, a frame (a frame F5 corresponding to the fifth mask, a main subject region corresponding to the fifth mask and the sixth mask). And the frame F6) corresponding to the 6th mask is displayed.

  The display control unit 32 changes the display according to the ranking of the evaluation values every time S1 is pressed. If there is no mask to be displayed, the display control unit 32 is a so-called footstep processing target in the mask extraction process. It may be configured to display a frame corresponding to the mask. For example, in the example of FIG. 3D, in the mask extraction process, a frame F7 corresponding to a mask that is considered inappropriate as a mask because the area is too large, and a mask that is considered inappropriate as a mask because the area is too small. An example of displaying a corresponding frame F8 is shown.

  In the above example, the display order is determined according to the evaluation value order. However, the mask display order may be determined according to other criteria. For example, the display order may be determined from the mask near the center of the image to the mask far from the mask position. Further, for example, the display order may be determined from a mask near the upper left of the image to a mask near the lower right.

  In step S110, the CPU 26 determines whether or not S1 is turned on. If the CPU 26 determines that S1 (half-pressed) is turned on (normally pressed) for a shutter button (not shown) of the operation unit 27, the process proceeds to step S111. On the other hand, if it is determined that S1 is not turned on even after a predetermined time has elapsed, the CPU 26 proceeds to step S112 described later. In the present embodiment, the case where the user turns on S1 means that the user issues an instruction to select one of the two main subject areas displayed on the display unit 23 in step S107. It is. For example, when one of the two main subject areas displayed on the display unit 23 in step S107 is selected for some reason, the user selects the shutter button S1 (half) (not shown) of the operation unit 27. An instruction to select the main subject area is issued by turning ON (push).

  In step S111, the CPU 26 controls the display control unit 32 to perform main subject selection processing. As illustrated in FIG. 4A, when S1 is turned on in a state where the frame F1 corresponding to the first mask and the frame F2 corresponding to the second mask are displayed, the display control unit 32 As illustrated in 4B, out of the frames F1 and F2, the frame F1 is a solid line, the frame F2 is a dotted line, and the mask corresponding to the frame F1 is selected. Further, as illustrated in FIG. 4B, when S1 is further turned on in a state where the frame F1 is a solid line, the frame F2 is a dotted line, and the frame F1 is in a selected state, the display control unit 32 is illustrated in FIG. 4C. The frame F1 is a dotted line, the frame F2 is a solid line, and the mask corresponding to the frame F2 is selected. Then, as illustrated in FIG. 4C, when S1 is further turned on in a state where the frame F1 is a dotted line, the frame F2 is a solid line, and the frame F2 is in a selected state, the display control unit 32 is illustrated in FIG. 4D. In addition, both the frames F1 and F2 are solid lines, and the two masks corresponding to both the frames F1 and F2 are selected. As illustrated in FIG. 4D, when both the frames F1 and F2 are solid lines and two masks corresponding to both the frames F1 and F2 are selected, and S1 is further turned on. For example, the configuration returns to the state of FIG. 4B. That is, the display control unit 32 changes the selection state every time S1 is turned on.

  In step S112, the CPU 26 determines whether or not a predetermined time has elapsed. If the predetermined time has elapsed, the CPU 26 determines that the main subject change process described in step S109 and the main subject selection process described in step S111 have ended, and the process proceeds to step S113. On the other hand, if the predetermined time has not elapsed, the CPU 26 determines that the main subject change process described in step S109 and the main subject selection process described in step S111 are ongoing, and the process proceeds to step S108 described above. Return.

  In step S <b> 113, the CPU 26 sets a main subject area by the AF control unit 33. The CPU 26 sets an area corresponding to the mask selected when it is determined in step S112 that the predetermined time has elapsed as a main subject area. This main subject area can be used for a shooting preparation operation.

  In step S114, the CPU 26 determines whether or not S2 is turned on. If the CPU 26 determines that the shutter button (not shown) of the operation unit 27 is turned on (fully pressed) and a shooting instruction is given, the process proceeds to step S115. On the other hand, if it is determined that S2 is not turned ON even after a predetermined time has elapsed, the CPU 26 returns to step S102 described above, and performs the processing from step S102 onward for the next through image.

  In step S115, the CPU 26 controls each unit to perform shooting. Note that processing such as AE, AF, and WB is performed based on information on the main subject region set in step S113.

  In step S116, the CPU 26 records the image data of the image generated by the shooting executed in step S115 in the storage medium 40 via the communication unit 28, and ends the series of processes.

  As described above, according to the first embodiment, the feature amount of the image indicated by the acquired image data is calculated, and the specific region (for example, the subject region or the attention region) determined based on the feature amount is detected. When a plurality of specific regions are detected by the region detection unit, the display unit includes a region detection unit and a display unit that displays the specific region detected by the region detection unit or the region based on the specific region. Display for selecting at least one specific area from among the plurality of specific areas is performed. Therefore, according to the above-described configuration, when there are a plurality of specific areas, the user can easily select any specific area.

  Further, according to the present embodiment, the area detection unit detects a specific area every time a predetermined number of image data is acquired. Therefore, the displayed specific area is updated to the latest one at any time according to the change of the subject.

  Further, according to the present embodiment, a plurality of specific areas are switched and displayed on the display unit. Therefore, the operability when the user selects a specific area can be improved.

  Further, according to the present embodiment, when switching between a plurality of specific areas, the display order is determined based on the feature amount. Therefore, it is possible to sequentially display the specific areas in the order in which the possibility of being selected by the user is high.

  According to the present embodiment, image data for composition confirmation is continuously generated, the generated image data is sequentially acquired, and the above-described processing is performed. Therefore, the specific area can be efficiently detected based on the through image for composition confirmation.

  Further, according to the present embodiment, a preparatory operation (for example, focusing control) for the main photographing is executed based on at least one specific area selected based on the display by the display unit. Therefore, since the preparatory operation can be performed based on the specific area selected by the user before shooting, the certainty of shooting can be improved.

  In the first embodiment, when the user issues an instruction to change the two main subject areas displayed on the display unit 23 in step S107, the user presses and holds S1, and the user displays in step S107. The example in which the user turns on S1 when giving an instruction to select one of the two main subject areas displayed on the unit 23 is shown. With such a configuration, there is an advantage that the user can perform an operation while maintaining a state of looking through a finder (not shown). However, this is merely an example, and any operations can be associated as long as the two types of operations can be distinguished. For example, an operation may be assigned to a multi selector (not shown) of the operation unit 27, or an operation may be assigned to a dedicated member. Moreover, it is good also as a structure which equips the surface of the display part 23 with the touch panel part which responds to the contact by a user, and receives operation via a touch panel part. According to the touch panel unit, the user can change the two main subject areas displayed on the display unit 23 in step S107 by directly touching the area to be changed or the vicinity thereof. In addition, when the user selects any one of the two main subject areas displayed on the display unit 23 in step S107, the user can select the area by directly touching the area to be selected or the vicinity thereof.

Second Embodiment
Hereinafter, the second embodiment will be described in detail with reference to the drawings. The second embodiment is a modification of the first embodiment. Therefore, only the parts different from the first embodiment will be described, and the description of the same parts as the first embodiment will be omitted.

  In the second embodiment, a description will be given by taking as an example an apparatus including the lens barrel 10, the imaging device 20, and the storage medium 40 shown in FIG. 1 of the first embodiment.

  Hereinafter, the operation of the CPU 26 when executing the automatic detection mode for detecting the main subject area as the specific area will be described with reference to the flowcharts of FIGS. 5 and 6.

  In step S201 to step S207, the CPU 26 executes the same processing as in step S101 to step S107 (see FIG. 2) of the first embodiment.

  In step S208, the CPU 26 determines whether or not S1 is turned on. If the CPU 26 determines that S1 (half-press) is turned on (normally pressed) for a shutter button (not shown) of the operation unit 27, the process proceeds to step S209. On the other hand, if it is determined that S1 is not turned on even after a predetermined time has elapsed, the CPU 26 returns to step S202 described above. In the present embodiment, when the user turns on S1, the user selects one of the two main subject areas displayed on the display unit 23 in step S107 as a tracking target. This is the case when giving instructions.

  In step S209, the CPU 26 controls the display control unit 32 to perform main subject selection processing. The main subject selection process is the same as step S111 (see FIG. 2) of the first embodiment. For example, as illustrated in FIG. 7A, when S1 is turned on in a state where the frame F1 corresponding to the first-order mask and the frame F2 corresponding to the second-order mask are displayed, the display control unit 32 7B, out of the frames F1 and F2, the frame F1 is a solid line, the frame F2 is a dotted line, and the mask corresponding to the frame F1 is selected. In the following description, it is assumed that the mask corresponding to the frame F1 is selected.

  In step S <b> 210, the CPU 26 sets a main subject area by the AF control unit 33. The CPU 26 sets an area corresponding to the mask selected in the main subject selection process in step S209 as the main subject area. This main subject area can be used for a shooting preparation operation.

  In step S211, the CPU 26 determines whether or not the OK button is turned on. If the CPU 26 determines that an OK button provided in a multi-selector (not shown) of the operation unit 27 has been turned on, the CPU 26 proceeds to step S212. On the other hand, if it is determined that the OK button is not turned on even after a predetermined time has elapsed, the CPU 26 proceeds to step S219 described later. In the present embodiment, the case where the user turns on the OK button means that the user determines the main subject area selected in the main subject selection process in step S209 as the target of the tracking process and starts the tracking process. This is the case.

  In step S212, the CPU 26 turns on a tracking lock flag indicating the start of the tracking process.

  In step S <b> 213, the CPU 26 executes contrast AF by the AF control unit 33. The AF control unit 33 controls the lens driving unit 12 via the lens barrel control unit 14, and moves the AF lens 11 in a predetermined direction from a predetermined start position while performing the tracking process started in step S <b> 211. A contrast evaluation value in a certain main subject region is acquired. Then, based on the acquired evaluation value, the lens driving unit 12 is controlled via the lens barrel control unit 14, and focusing control based on contrast AF is performed.

  In step S <b> 214, the CPU 26 acquires the next through image from the imaging unit 21. The CPU 26 temporarily stores the acquired image information of the through image in the buffer memory unit 24, and proceeds to step S215.

  In step S215, the CPU 26 controls the image processing device 22 to perform normal image processing. Normal image processing is the same as step S102 (see FIG. 2) of the first embodiment.

  In step S216, the CPU 26 performs mask extraction processing based on the tracking lock described in step S212 by the region detection unit 31. The area detection unit 31 extracts only the mask corresponding to the main subject area set as the target of the tracking process. That is, unlike the mask extraction process in step S103 (see FIG. 2) of the first embodiment and the step S203 of the second embodiment, the mask extraction process is performed under limited conditions. Therefore, the processing load is significantly lighter than the mask extraction process in step S103 (see FIG. 2) of the first embodiment and step S203 of the second embodiment. The mask extraction process based on the tracking lock is performed at a faster frame rate than the mask extraction process in step S103 (see FIG. 2) of the first embodiment and step S203 of the second embodiment. For example, the mask extraction process in step S103 (see FIG. 2) of the first embodiment and step S203 of the second embodiment performed before tracking is started acquires n (for example, n = 6) image data. The mask extraction process based on the tracking lock after the tracking is started is performed each time m (for example, m = 3, where n> m) image data is acquired.

  In step S217, the CPU 26 determines whether or not the subject area has been extracted. If the CPU 26 determines that one or more subject areas have been extracted, the process proceeds to step S218. On the other hand, if it is determined that no subject region can be extracted, the CPU 26 returns to step S214, and performs the processing from step S214 on the image of the next frame.

  In step S <b> 218, the CPU 26 controls the display unit 23 with the display control unit 32 to display a tracking frame on the display unit 23. The tracking frame may be in accordance with the shape of the subject area, or may be a predetermined shape such as a rectangle or a circle. Also, the line thickness, shading, color, etc. may be anything. By displaying the tracking frame, the user can easily grasp the mask currently being tracked or the subject area corresponding to the mask being tracked. As illustrated in FIG. 7B, the OK button is turned on in step S211 in a state where the frame F1 of the frames F1 and F2 is a solid line, the frame F2 is a dotted line, and the mask corresponding to the frame F1 is selected. Then, as illustrated in FIG. 7C, the display control unit 32 displays the frame F1 as a solid line so that the mask corresponding to the frame F1 is selected. And the tracking control part 34 performs a tracking process continuously, even when the frame F1 exists in a screen edge etc. so that it may illustrate in FIG. 7D.

  If the tracking frame is displayed in step S218, or if it is determined in step S211 that the OK button is not turned on even after a predetermined time has elapsed, in step S219, the CPU 26 determines whether or not S2 is turned on. If the CPU 26 determines that the shutter button (not shown) of the operation unit 27 is turned on (fully pressed) and a shooting instruction is given, the CPU 26 proceeds to step S221 described later. On the other hand, if it is determined that S2 is not turned on even after a predetermined time has elapsed, the CPU 26 proceeds to step S220.

  In step S220, the CPU 26 determines whether the tracking lock flag is ON. If the CPU 26 determines that the tracking lock flag described in step S212 is ON, the CPU 26 returns to step S214, and performs the processing from step S214 on for the next frame image. That is, the CPU 26 performs continuous AF on the main subject area selected as the tracking target by the AF control unit 33. On the other hand, if it is determined that the tracking lock flag is not turned on, the CPU 26 returns to step S202, and performs the processing from step S202 onward for the image of the next frame. That is, the CPU 26 newly executes a mask extraction process by the area detection unit 31.

  If it is determined in step S219 that S2 has been turned on, in step S221, the CPU 26 controls each unit to perform shooting. Note that processing such as AE, AF, and WB is performed based on information on the main subject area set in step S210 when it is determined in step S211 that the OK button is not turned on even after a predetermined time has elapsed. Is called. When the tracking frame is displayed in step S218, processing such as AE, AF, and WB is performed based on the information on the main subject area corresponding to the tracking frame displayed in step S218.

  In step S222, the CPU 26 records the image data of the image generated by the shooting executed in step S221 on the storage medium 40 via the communication unit 28, and ends the series of processes.

  As described above, according to the second embodiment, at least one specific area (for example, a subject area or an attention area) selected based on display on the display unit is set as a tracking target, and the tracking target is an image. Detect from. Therefore, it is possible to improve the operability of selecting the tracking target and improve the certainty of shooting.

  In addition, according to the second embodiment, the area detection unit detects a specific area every time n (where n is an integer equal to or greater than 1) image data is acquired before tracking is started. When started, the specific area is detected every time m (where m is an integer of 1 or more and n> m) image data is acquired. Therefore, it is possible to improve the accuracy of processing after the start of tracking and improve the certainty of shooting.

  In the second embodiment, when the user issues an instruction to select one of the two main subject areas displayed on the display unit 23 in step S207, the user turns on S1, and the user However, the example in which the user turns on the OK button when giving an instruction to determine the main subject region as the target of the tracking process has been shown. However, this is merely an example, and any operations can be associated as long as the two types of operations can be distinguished. For example, an operation may be assigned to a multi selector (not shown) of the operation unit 27, or an operation may be assigned to a dedicated member. Moreover, it is good also as a structure which equips the surface of the display part 23 with the touch panel part which responds to the contact by a user, and receives operation via a touch panel part. According to the touch panel unit, when the user selects one of the two main subject areas displayed on the display unit 23 in step S207, the user selects the area by directly touching the area to be selected or the vicinity thereof. Is possible. Further, when determining the main subject area as the target of the tracking process, the user can determine by directly touching the area desired to be determined as the target of the tracking process or its vicinity.

<Third Embodiment>
Hereinafter, a third embodiment will be described in detail with reference to the drawings. The third embodiment is a modification of the first embodiment and the second embodiment. Therefore, only different parts from the first embodiment and the second embodiment will be described, and the description of the same parts as the first embodiment and the second embodiment will be omitted.

  In the third embodiment, a description will be given by taking as an example an apparatus including the lens barrel 10, the imaging device 20, and the storage medium 40 shown in FIG. 1 of the first embodiment.

The third embodiment is a modification regarding display timing. Basically, display is performed according to the following two points.
1) Display is performed only when a predetermined condition based on a detection result of a specific area (for example, a subject area or an attention area) based on a mask extraction process is satisfied.
2) Display is prohibited when a predetermined condition based on a detection result of a specific region (for example, a subject region or a region of interest) based on the mask extraction process is satisfied.

  Hereinafter, the operation of the CPU 26 when executing the automatic detection mode for detecting the main subject area as the specific area will be described with reference to the flowchart of FIG.

  In step S301 to step S303, the CPU 26 executes the same processing as in step S101 to step S103 (see FIG. 2) of the first embodiment.

  In step S304, the CPU 26 determines whether or not the subject area has been extracted. If the CPU 26 determines that one or more subject areas have been extracted, the process proceeds to step S305. On the other hand, if it is determined that no subject area can be extracted, the CPU 26 proceeds to step S307 to be described later.

  In step S305, the CPU 26 records mask information. The CPU 26 records information about the result of the mask extraction process executed in step S303 in the buffer memory unit 24, the storage unit 25, and the like as mask information. The mask information includes information such as the extraction conditions (color classification, mask classification, etc.) of the mask extraction processing in step S103, the position of the mask, the size and shape of the mask, and the rank of each mask based on the evaluation value.

  In step S306, the CPU 26 determines whether or not the same mask has been extracted n times (n frames) or more, as in step S106 of the first embodiment. When the CPU 26 determines that the same mask has been extracted continuously n times or more, the CPU 26 proceeds to step S308 described later. On the other hand, when determining that the same mask has not been extracted n times or more in succession, the CPU 26 proceeds to step S307.

  If it is determined in step S304 that no subject area can be extracted, or if it is determined in step S306 that the same mask has not been extracted n or more times consecutively, in step S307, the CPU 26 controls each unit. To perform warning processing. The warning process is a process for notifying the user that no subject area can be extracted or that the mask extraction is unstable because the same mask is not extracted continuously n times or more. CPU26 controls the display part 23 by the display control part 32, for example, and displays the message which shows the alerting | reporting content mentioned above on the display part 23. FIG. Further, for example, the CPU 26 may notify the user using an audio output or a lamp. When the warning process is executed, the CPU 26 proceeds to step S315 described later.

  Further, in the warning process, the CPU 26 is not able to extract any subject area in step S304, or even if the same mask is not extracted in succession n times or more in step S306, a shooting instruction to be described later. The temporary area is set so that the The temporary area is, for example, a central area of a predetermined image.

  If it is determined in step S306 that the same mask has been extracted n times or more consecutively, in step S308, the CPU 26 determines whether the background mask or the background has moved. If the CPU 26 determines that the background mask or the background has moved, the process proceeds to step S309. On the other hand, when determining that the background mask or the background has not moved, the CPU 26 proceeds to step S312 described later. Note that whether or not the background mask or the background has moved is determined by changing the position (time-dependent change) between a plurality of through images for various masks determined to have been extracted n times or more consecutively in step S306. It is determined by seeking. The position change can be obtained based on the subject information described in step S305, and it is determined whether the background mask or the background has moved by comparing a value indicating the position change with a predetermined threshold value. it can. Furthermore, image motion information may be used. For example, the motion of the imaging device 20 itself may be obtained based on a sensor (not shown) or a generated image to obtain image motion information, and the above-described determination may be performed in consideration of the obtained motion information of the image. good.

  In step S <b> 309, the CPU 26 controls the display unit 23 with the display control unit 32 to display the tracking candidate frame on the display unit 23. The tracking candidate frame corresponds to a mask that is considered preferable as a tracking target. When the background mask or the background is moved according to the determination in step S308 described above, it can be determined that the main subject area is suitable as a tracking target because the main subject is considered to be moving. That is, the CPU 26 displays the tracking candidate frame based on whether or not a subject region suitable as a tracking target is detected based on the mask extraction process. The tracking candidate frame may be in accordance with the shape of the subject area, or may be a predetermined shape such as a rectangle or a circle. Also, the line thickness, shading, color, etc. may be anything. By displaying the tracking candidate frame, the user can easily grasp a mask that can be estimated to be suitable as a tracking target at the present time.

  In step S310, the CPU 26 determines whether or not the OK button is turned on. If the CPU 26 determines that an OK button provided in a multi-selector (not shown) of the operation unit 27 has been turned on, the CPU 26 proceeds to step S311. On the other hand, if it is determined that the OK button is not turned on even after a predetermined time has elapsed, the CPU 26 proceeds to step S315 described later. In the present embodiment, the case where the user turns on the OK button means that the user determines the main subject area of the tracking candidate frame displayed in step S309 as the target of the tracking process and starts the tracking process. This is the case.

  In step S311, the CPU 26 turns on a tracking lock flag indicating the start of the tracking process, and proceeds to step S315 described later.

  If it is determined in step S308 that the background mask or the background has not moved, in step S312, the CPU 26 determines whether there are a plurality of subjects. If the CPU 26 determines that there are a plurality of subjects, the CPU 26 proceeds to step S313. On the other hand, when determining that the subject is singular, the CPU 26 proceeds to step S315 described later.

  In step S313, the CPU 26 controls the display unit 23 by the display control unit 32 to display the main subject area on the display unit 23, as in step S107 of the first embodiment. Note that the case where it is determined in step S312 that there are a plurality of subjects is a case where the main subject change processing and the main subject selection processing described in the first embodiment and the second embodiment are useful.

  In step S314, the CPU 26 controls the display control unit 32 to perform main subject selection processing. The main subject selection process is the same as step S111 (see FIG. 2) of the first embodiment.

When a warning process is performed in step S307 (hereinafter referred to as case 1), or when the tracking lock flag is turned on in step S311 (hereinafter referred to as case 2), or there is a single subject in step S312. (Hereinafter referred to as case 3), or when main subject selection processing is performed in step S314 (hereinafter referred to as case 4), in step S315, the CPU 26 causes the AF control unit 33 to execute the main subject region. Set. The CPU 26 sets the following areas as main subject areas for each case. This main subject area can be used for a shooting preparation operation.
Case 1... The temporary area described in step S307 is set as the main subject area.
Case 2... When the OK button is turned on in step S310, the area corresponding to the mask set as the target of the tracking process is set as the main subject area.
Case 3... The area corresponding to the mask determined to have been extracted continuously n times or more in step S306 is set as the main subject area.
Case 4... An area corresponding to the mask selected in the main subject selection process in step S314 is set as the main subject area.

  In step S316, the CPU 26 determines whether or not a shooting instruction has been issued. If the CPU 26 determines that a shooting instruction has been given, the process proceeds to step S317. On the other hand, if it is determined that no shooting instruction is given even after a predetermined time has elapsed, the CPU 26 returns to step S302 described above, and performs the processing from step S302 onward for the next through image. The photographing instruction is performed by a user operation via the shutter button of the operation unit 27. This user operation may be either so-called S1 (half press) or S2 (full press).

  If it is determined in step S316 that a shooting instruction has been issued, in step S317, the CPU 26 controls each unit to perform shooting. Note that processing such as AE, AF, and WB is performed based on information on the main subject area set in step S315.

  In step S318, the CPU 26 records the image data of the image generated by the shooting executed in step S317 on the storage medium 40 via the communication unit 28, and ends the series of processes.

  As described above, according to the third embodiment, display on the display unit is performed only when a predetermined condition based on the detection result by the region detection unit is satisfied. Alternatively, when a predetermined condition based on the detection result by the area detection unit is satisfied, display on the display unit is prohibited. Therefore, unnecessary display can be avoided and display can be performed only when necessary and useful.

  Further, according to the third embodiment, the predetermined condition described above is a condition based on whether or not a specific area (for example, a subject area or an attention area) can be detected by the area detection unit. Therefore, unnecessary display can be avoided and display can be performed only when necessary and useful according to the detection result by the region detection unit.

  Further, according to the third embodiment, the predetermined condition described above is a condition based on whether or not there is a specific region that is not suitable for selection when making a selection based on the display by the display unit. Therefore, depending on whether or not there is a specific area that is not suitable for selection, unnecessary display can be avoided and display can be performed only when necessary and useful.

  According to the third embodiment, the predetermined condition described above is a condition based on whether or not a specific area suitable as a focus control target is detected by the area detection unit. Therefore, for example, display is performed only when a specific area suitable as a focus control target is detected, or display is prohibited when a specific area suitable as a focus control target is not detected. Therefore, unnecessary display can be avoided and display can be performed only when necessary and useful, depending on whether or not a specific region suitable as a focus control target has been detected by the region detection unit.

  Further, according to the third embodiment, the predetermined condition described above is a condition based on whether or not a specific area suitable as a tracking target has been detected by the area detection unit. Therefore, for example, display is performed only when a specific area suitable as a tracking target is detected, or display is prohibited when a specific area suitable as a tracking target is not detected. Therefore, unnecessary display can be avoided and display can be performed only when necessary and useful, depending on whether or not a specific region suitable as a tracking target has been detected by the region detection unit.

  In addition, the timing which performs the display demonstrated in 3rd Embodiment, and the timing which prohibits a display are examples, and this invention is not limited to this example. As described above, the display may be performed only when a predetermined condition based on the detection result of the specific area based on the mask extraction process is satisfied, or the predetermined condition based on the detection result of the specific area based on the mask extraction process If the above is satisfied, the display may be prohibited. For example, when unnecessary display becomes annoying, such as a user with abundant shooting experience, only minimal display is performed. Also, for example, when an unnecessary display causes confusion, such as a beginner with little shooting experience, it is preferable to perform only a display that is helpful, a warning display, or a prior notice of failure.

  In the third embodiment, an example in which the user turns on the OK button when giving an instruction to determine the main subject region as the target of the tracking process has been described. However, this is merely an example, and any operations can be associated. For example, an operation may be assigned to a multi selector (not shown) of the operation unit 27, or an operation may be assigned to a dedicated member. Moreover, it is good also as a structure which equips the surface of the display part 23 with the touch panel part which responds to the contact by a user, and receives operation via a touch panel part.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

  In each of the above embodiments, the shutter button, the multi-selector, the touch panel unit, and the like are illustrated as members that receive user operations, but the present invention is not limited to this example. For example, any device such as voice recognition, motion capture, and biosensor may be used.

  In each of the above embodiments, an example in which a series of processing is performed based on a through image for composition confirmation has been described, but the present invention is not limited to this example. For example, the present invention can be similarly applied to a case where a live view image for composition confirmation generated in a single-lens reflex camera or the like is targeted. Further, the present invention can be similarly applied to a case where a moving image recorded in the storage medium 40 or the like is a target. In this case, for example, when the user gives a pause instruction when playing back and editing a moving image, the processing described in each of the above embodiments may be automatically started.

  A part or all of the processes described in the above-described embodiments may be appropriately combined and executed.

  In each of the above embodiments, an example in which a series of processing is performed for all frames has been described. However, the present invention is not limited to this example. For example, a plurality of images generated intermittently in time may be targeted. Specifically, a plurality of images subjected to frame thinning as appropriate may be targeted. In this case, a series of processing in each of the above embodiments may be performed for a plurality of thinned images, and display may be performed for all images. By performing such processing, the processing load can be reduced.

  Further, the image processing described in each of the above-described embodiments may be realized by software by a “computer system” including a computer and an image processing program. In this case, the computer system may be configured to execute part or all of the processing of the flowcharts described in the embodiments. For example, part or all of the processing from step S102 to step S113 in FIG. 2 may be executed by a computer. Further, part or all of the processing from step S202 in FIG. 5 to step S218 in FIG. 6 may be executed by a computer. Further, part or all of the processing from step S302 to step S315 in FIG. 8 may be executed by a computer. By adopting such a configuration, it is possible to perform the same processing as in the above-described embodiments.

  Further, the “computer system” includes a homepage providing environment (or display environment) if a www system is used. The computer-readable recording medium is a writable nonvolatile memory such as a flexible disk, a magneto-optical disk, a ROM, or a flash memory, a portable medium such as a CD-ROM, and a storage such as a hard disk built in the computer system. Refers to the device.

  Further, the computer-readable recording medium is a volatile memory (for example, DRAM (Dynamic Random Access) in a computer system serving as a server or a client when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. Memory)) that holds a program for a certain period of time is also included.

  The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.

The program may be for realizing a part of the functions described above.
Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 20 ... Imaging device, 21 ... Imaging part, 22 ... Image processing apparatus, 23 ... Display part, 26 ... CPU

Claims (11)

A detection unit for detecting a plurality of subject areas included in the image based on the feature amount of the image;
A display control unit for displaying an index indicating at least two subject regions among the plurality of subject regions detected by the detection unit;
Among the plurality of subject areas detected by the detection unit, when an indicator indicating the first subject area and the second subject area is displayed on the display unit, the first subject area and the second subject area Is changed to an index indicating a third subject region different from the first subject region and the second subject region among the plurality of subject regions detected by the detection unit and displayed on the display unit An operation unit for causing the display control unit to perform a first mode to be displayed and a second mode to display on the display unit by changing a display mode of an index indicating the first subject region and the second subject region When,
An image processing apparatus comprising: The image processing apparatus according to claim 1.
The image processing apparatus , wherein the detection unit detects the subject region for each of a plurality of acquired images. The image processing apparatus according to claim 1 or 2,
The display control unit, when performing the first mode, determines the third subject region from a plurality of the subject regions detected by the detection unit based on an image feature amount. . The image processing apparatus according to any one of claims 1 to 3 ,
Wherein the display control unit only when a predetermined condition is satisfied based on the detection result by the pre-dangerous out section, an image processing apparatus, characterized in that to perform the display an indication that the subject region on the display unit. The image processing apparatus according to any one of claims 1 to 3 ,
Wherein the display control unit, when a predetermined condition is satisfied based on the detection result by the front danger out portion, wherein the benzalkonium be prohibited to perform the display an indication that the subject region on the display unit An image processing apparatus. The image processing apparatus according to claim 4 or 5 ,
Wherein the predetermined condition, the image processing device comprising a condition der Turkey based on whether the detection of the object area by front dangerous out portion. The image processing apparatus according to claim 4 or 5 ,
Wherein the predetermined condition, when a selection based on displayed by the display unit, the image processing device comprising a condition der Turkey based on whether the object area that is not suitable for selection is present. An image pickup apparatus comprising the image processing apparatus according to claim 1 .   The imaging device according to claim 8,
  An imaging apparatus comprising the display unit. The imaging device according to claim 9,
The display controller, based on said at least one of the subject region is selected based on the display by the display unit, the imaging device comprising a benzalkonium perform a preparatory operation for the shot. The imaging device according to claim 10.
An imaging unit for receiving light from the optical system;
The display controller, as the preparation operation, the imaging device comprising a benzalkonium perform operations including focus control related to the optical system.

Images