JP5458877B2 - Imaging apparatus and imaging program - Google Patents

Description

  This case relates to an imaging apparatus and an imaging program.

  In recent years, with the spread of digital cameras and camera-equipped mobile phones, there are increasing opportunities for users to upload digital images taken on the web or attach them to e-mails. When a subject is photographed with a digital camera or the like, the user performs photographing while confirming the subject with a display device provided in the digital camera, but a portion that is not desired to be photographed may be included in the photographing region. In this case, it is possible to cut out only the part that was desired to be taken after the photographing, but it is necessary to move the image data to a personal computer (hereinafter referred to as a PC) and process the image data using special software. Yes, the work is complicated. In view of this, an imaging apparatus that saves only a partial area of a captured image has been proposed (for example, Patent Documents 1 and 2).

JP 2002-101378 A JP-A-5-191769

  However, since the techniques of Patent Documents 1 and 2 cut out and save only the portion that was desired to be captured from the entire captured image, even a digital camera that can capture a high-resolution image has sufficient performance. There is a possibility that it is not fully utilized.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an imaging apparatus and an imaging program that can easily take an image using the performance of the imaging apparatus.

In order to solve the above problems, an imaging device disclosed in the specification includes a display unit that displays an image captured by an imaging unit, a region designation receiving unit that accepts designation of a region including an object to be captured, and the imaging unit that captures an image. In the first image, the position and size of the region that maintains the positional relationship between the region and the object to be imaged in the second image captured by the imaging unit before the first image. An area calculation unit that calculates the image, and a display control unit that displays the frame indicating the region in the first image, the center of the region, and the center of the first image on the display unit , The area designation receiving unit defines a first area that includes the object to be imaged and is designated on a third image displayed on the display unit using a pointer that is fixedly displayed on the display unit. After specifying the point and the first point, From said third image represented specified using the pointer on different fourth image, and a second point defining the region, based on, accepts the designation of the area.

In order to solve the above-described problem, an imaging program disclosed in the specification includes: an area designation receiving step for accepting designation of an area including an object to be captured in an image captured by an imaging apparatus; and a first image captured by the imaging apparatus. A calculation step for calculating a position and a size of the region so as to maintain a positional relationship between the region and the object to be imaged in the second image captured by the imaging device before the first image; And a display step of displaying a frame indicating the region in the first image, a center of the region, and a center of the first image on a display unit included in the imaging device based on a calculation result in the calculation step. preparative, cause the computer to execute, in the area designation accepting step, a finger in the third image on which is displayed on the display unit the display unit using a pointer that is fixedly displayed on the The first point defining the region including the object to be imaged and the fourth image different from the third image displayed on the display unit after the first point is designated The designation of the region is accepted based on a second point that defines the region, designated using a pointer.

  According to the imaging device and the imaging program disclosed in the specification, it is possible to easily capture an image using the performance of the imaging device.

1 is a diagram illustrating an example of a configuration of an imaging apparatus according to Embodiment 1. FIG. It is a figure which shows an example of the hardware constitutions of a control part. It is a figure for demonstrating the outline | summary of the function which an imaging device has. It is a figure for demonstrating the outline | summary of the function which an imaging device has. It is a figure for demonstrating the outline | summary of the function which an imaging device has. It is a functional block diagram which shows an example of the function which a control part has. An example of data stored in the storage unit is shown. An example of the image imaged by the imaging part is represented. It is a figure explaining the outline | summary of the function of an acquisition part. It is a figure explaining the outline | summary of the trapezoid correction process which an image correction part performs. It is a figure explaining the outline | summary of the inclination correction process which an image correction part performs. It is a flowchart which shows an example of the main process which a control part performs. It is a flowchart which shows an example of the main process which a control part performs. It is a flowchart which shows an example of the detailed process of step S100. It is a flowchart which shows an example of the detailed process of step S200. FIG. 16A shows the outline of the image of the previous frame, and FIG. 16B shows the outline of the image of the current frame. It is a flowchart which shows an example of the detailed process of step S208. It is a flowchart which shows an example of the detailed process of step S208. It is a figure for demonstrating the detailed process of step S208 concretely. It is a figure for demonstrating an inner product. It is a figure explaining an example of the method of calculating | requiring the feature point of the present frame corresponding to the feature point of a front frame. It is a flowchart which shows an example of the detailed process of step S300. It is a flowchart which shows an example of the detailed process of step S400. 6 is a functional block diagram illustrating an example of functions of an imaging apparatus according to Embodiment 2. FIG. 12 is a flowchart illustrating an example of processing for capturing an image using the imaging apparatus according to the second embodiment. It is a figure which shows another example of the shape of a designation | designated area | region.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

  First, the configuration of the imaging apparatus according to the first embodiment will be described. FIG. 1 is a diagram illustrating an example of the configuration of the imaging apparatus according to the first embodiment.

  As illustrated in FIG. 1A, the imaging apparatus 100 according to the first embodiment includes an imaging unit 10, a display unit 20, an operation unit 30, a control unit 40, and a storage unit 50. When the imaging device 100 is, for example, a mobile phone shown in FIG. 1B, the imaging unit 10 is a camera provided in the mobile phone body, the display unit 20 is a display screen, the operation unit 30 is an operation button, a touch panel, or a control. The unit 40 may be a computing device built in the mobile phone, and the storage unit 50 may be a memory built in or added to the mobile phone body. When the imaging apparatus 100 is a notebook PC shown in FIG. 1C, the imaging unit 10 is built in or attached to the notebook PC body, the display unit 20 is a display, and the operation unit 30 is The keyboard, mouse, or touch panel, the control unit 40 may be a CPU that executes a program, and the storage unit 50 may be a hard disk drive or the like. When the imaging device 100 is a digital camera shown in FIG. 1D, the imaging unit 10 is a camera, the display unit 20 is a display provided in the digital camera body, and the operation unit 30 is provided in the digital camera body. The buttons and touch panel, the control unit 40 can be an arithmetic unit, and the storage unit 50 can be a non-volatile internal memory or an external memory such as an SD card. In the present embodiment, description will be made assuming that the imaging apparatus 100 is a mobile phone.

  The imaging unit 10 captures an image and outputs the captured image to the control unit 40. Further, the imaging unit 10 includes an optical zoom mechanism. The imaging unit 10 drives the optical zoom mechanism based on the control of the control unit 40, whereby the zoom magnification of the optical system is changed.

  The display unit 20 displays the image data output from the control unit 40 to the display unit 20 based on the control of the control unit 40. Further, the display unit 20 displays the center of the image captured by the imaging unit 10 and the center of an area specified by the user (details will be described later) based on the control of the control unit 40.

  The operation unit 30 receives an operation from the user and outputs an operation signal indicating the operation content to the control unit 40.

  The control unit 40 receives an operation signal from the operation unit 30 and controls the imaging unit 10 and the display unit 20 based on the operation signal. The control unit 40 outputs the image data of the image received from the imaging unit 10 to the display unit 20 and causes the display unit 20 to display the image data. The control unit 40 stores the image data of the image received from the imaging unit 10 in the storage unit 50. In addition, the control unit 40 controls the display unit 20 to display the center of the image captured by the imaging unit 10, a frame indicating an area designated by the user, and the center thereof on the display unit 20.

  The storage unit 50 stores an image captured by the imaging unit 10.

  Next, a hardware configuration of the control unit 40 of the imaging apparatus 100 will be described. FIG. 2 is a diagram illustrating an example of a hardware configuration of the control unit 40. The control unit 40 includes an input / output unit 401, a ROM (Read Only Memory) 402, a central processing unit (CPU: Central Processing Unit) 403, and a RAM (Random Access Memory) 404.

  The input / output unit 401 transmits and receives data and signals to and from the imaging unit 10, the display unit 20, the operation unit 30, and the storage unit 50. The ROM 402 stores a program and the like for maintaining the positional relationship between the object to be imaged and the area designated by the user. The CPU 403 reads and executes a program stored in the ROM 402. Further, by the calculation by the CPU 403 of the program stored in the ROM 402, an area designation receiving unit 411, an area calculating unit 412, a display control unit 414, a zoom magnification changing unit 415, an image correcting unit 416, and an acquiring unit 417 shown in FIG. The function it has is executed. The RAM 404 stores temporary data used when executing the program.

  Next, an overview of the functions of the imaging apparatus 100 will be described with reference to FIGS. 3-5 is a figure for demonstrating the outline | summary of the function which the imaging device 100 has.

  FIG. 3A shows a state in which no function is selected in the imaging apparatus 100. In FIG. 3A, since no function is selected, no image is displayed on the display unit 20. In this state, when an image capturing function using the image capturing unit 10 (hereinafter referred to as a camera mode) is selected by the user, the image capturing apparatus 100 displays the image capturing unit on the display unit 20 as illustrated in FIG. 10 displays an image to be captured. In addition, when the user selects a function (hereinafter, referred to as an area designation mode) that can designate an area for an image in a state where the camera mode is selected, the imaging apparatus 100 is displayed in FIG. The pointer is displayed at the center of the display unit 20 as shown in FIG.

  In FIG. 3C, it is assumed that the user wants to designate a rectangular area including a house as an object to be imaged. In this case, as shown in FIG. 3C, the user places the pointer displayed on the display unit 20 on the upper left of the area to be designated and presses a button provided on the operation unit 30. Next, the user moves the camera while holding down the button to move the pointer to the lower right position of the area to be designated as shown in FIG. 4A, and releases the button. Thereby, the user can designate a rectangular area indicated by hatching in FIG. As illustrated in FIG. 4B, the imaging apparatus 100 displays a frame representing a region designated by the user (hereinafter referred to as a designated region) on the display unit 20. Thereby, the user can easily confirm the designated area on the display unit 20. Note that after the designated area is set, the imaging apparatus 100 according to the present embodiment changes the zoom magnification of the optical system so that the designated area is included in the display unit 20 as illustrated in FIG. Yes. The method of designating the area is not limited to the present embodiment. After pressing the button at the upper left position, release the button and press the same button again at the lower right position, or press another button to change the area. May be specified.

  In the imaging apparatus 100 according to the present embodiment, even if the imaging apparatus 100 is moved or the zoom magnification is changed, the positional relationship between the designated area and the house that is the object to be imaged in the image displayed on the display unit 20. Is maintained. That is, the imaging apparatus 100 changes the display position and size of the designated area in accordance with the imaging object displayed on the display unit 20, and maintains the positional relationship between the imaging object and the designated area. In addition, as illustrated in FIG. 4C, the imaging apparatus 100 displays the center of the image captured by the imaging unit 10, that is, the center of the display unit 20 and the center of the designated area on the display unit 20.

  In addition, when the center of the display unit 20 and the center of the designated area overlap, the imaging apparatus 100 changes the zoom magnification of the optical system as illustrated in FIG. By changing the zoom magnification of the optical system so that the specified area is displayed in the display unit 20 as shown in FIG. 5B, the resolution of the imaging apparatus 100 for the image included in the specified area. You can take pictures using the Further, as shown in FIG. 5C, the user can further enlarge the designated area and take an image by changing the orientation of the imaging apparatus 100 in the vertical and horizontal directions.

  Next, an example of functions provided in the control unit 40 in order to realize the functions of the imaging apparatus 100 described above will be described. FIG. 6 is a functional block diagram illustrating an example of functions that the control unit 40 has.

  The control unit 40 includes an area designation receiving unit 411, an area calculation unit 412, a storage unit 413, a display control unit 414, a zoom magnification change unit 415, an image correction unit 416, and an acquisition unit 417.

  The area designation receiving unit 411 acquires an image captured by the imaging unit 10 and sets feature points for the image. The area designation receiving unit 411 stores the set feature point data in the storage unit 413. Here, the feature point is a point indicating a specific part of the object to be imaged included in the image, and when there is a vertex, an edge point, or a pattern, it indicates a pattern point, a color boundary point, or the like. In addition, when the camera mode is selected, the area designation receiving unit 411 displays a pointer at the center of the display unit 20 as illustrated in FIG. The area designation receiving unit 411 also saves points defining the designated area designated by the user in the storage unit 413 as feature points.

  The area calculation unit 412 uses the feature point data stored in the storage unit 413 and the image data captured by the imaging unit 10 to determine the positional relationship between the specified area and the object to be captured included in the specified area. The position of the designated area and its size are calculated so that is maintained. That is, the area calculation unit 412 calculates the display position and size of a frame indicating the designated area. In the example of FIG. 4 described above, the area calculation unit 412 displays the display position and size of the frame indicating the designated area so that the positional relationship between the rectangular area designated by the user and the house included in the rectangular area is maintained. Calculate The area calculation unit 412 stores in the storage unit 413 based on the result of calculation processing (details will be described later) for calculating the position and size of the specified area that maintains the positional relationship between the specified area and the object to be imaged. The stored feature point data is updated.

  The storage unit 413 can be, for example, the RAM 403, and stores an image captured by the image capturing unit 10, feature point data, and data related to the designated area. Here, data stored in the storage unit 413 will be described.

  FIG. 7 shows an example of data stored in the storage unit 413. The storage unit 413 stores the feature point array data shown in FIG. 7A and the designated area data shown in FIG. 7B. The feature point array data in FIG. 7A includes feature points set for the image captured by the region designation receiving unit 411 and points designated when the user sets the designated region (points defining the designated region). ). The feature point array data includes the feature point type, the coordinates in the previous frame, the feature amount in the previous frame, the state of the feature point (previous), the flag in the specified area (previous), the coordinates in the current frame, the current frame It includes items of feature amount, feature point state (current), designated area flag (current), position validity, and feature point reliability.

Here, with reference to FIGS. 7 and 8, each item of the feature point array data and an example of data stored in each item will be described. FIG. 8 illustrates an example of an image captured by the imaging unit 10. FIG. 8B illustrates an example of an image (current frame image: first image) newly captured by the image capturing unit 10, and FIG. 8A illustrates the image capturing unit before capturing the current frame image. 10 shows an example of an image (image of the previous frame: second image) that has been captured. In the image of the previous frame shown in FIG. 8A, P _{1 to} P ₈ represent feature points selected by the area designation receiving unit 411, and P ₉ and P ₁₀ represent points that define the designated area. . Further, P ₁ ′ to P ₁₀ ′ shown in FIG. 8B are points corresponding to P _{1 to} P ₁₀ of the previous frame, respectively, by processing (details will be described later) performed by the region calculation unit 412. It represents the determined point.

The “type of feature point” item indicates whether the feature point is a feature point set by the region designation receiving unit 411 or a point designated by the user when setting the designated region. In the example of FIG. 8, since P _{1 to} P ₈ are points set by the area designation receiving unit 411, “AUTO_ADD” which is set by the area designation receiving unit 411 is set. Since P ₉ and P ₁₀ are points designated by the user, “USER_ADD”, which means that the user has designated, is set.

The “coordinate in the previous frame” item represents the coordinates of the feature point set in the image of the previous frame. That is, in the example of FIG. 8, the coordinates of P _{1 to} P ₁₀ shown in FIG. 8A are stored.

The “feature amount in the previous frame” item indicates the feature amount of the feature point in the previous frame. That is, in the example of FIG. 8, the feature quantities P _{1 to} P ₁₀ shown in FIG. 8A are stored. The feature quantity may be a scalar value, or may not be a scalar value as long as it is a data structure necessary to represent the feature quantity to be used.

The “feature point state (previous)” item indicates whether or not the feature point exists in the screen of the display unit 20 in the previous frame. In the example of FIG. 8A, since all feature points P _{1 to} P ₁₀ exist in the screen, “STAT_IN” indicating that the feature points exist in the screen is set. . If no feature point exists in the screen, “STAT_OUT” is set.

The “designated area flag (previous)” item indicates whether or not a feature point exists in the designated area in the previous frame. In FIG. 8A, the feature points P _{1 to} P ₇ of the previous frame are present in the designated area defined by the feature points P ₉ and P ₁₀ , so that the feature points are present in the designated area. “FLAG_IN” is set. Further, since the feature point P ₈ exists outside the designated area defined by the feature points P ₉ and P ₁₀ , “FLAG_OUT” is set, which means that the feature point exists outside the designated area. . Note that the feature point P ₉ and P ₁₀ to define a specified area, the item "selection area flag (before)", may be set to "FLAG_IN" may be blank.

The item “coordinates in current frame” represents the coordinates of feature points in the current frame. In the example of FIG. 8, the coordinates of the feature points P ₁ ′ to P ₁₀ ′ of FIG. 8B, which are determined to correspond to the feature points P _{1 to} P ₁₀ of the previous frame, are stored.

The “feature amount in the current frame” item represents the feature amounts of the feature points P ₁ ′ to P ₁₀ ′ in the current frame. In the example of FIG. 8, the feature amounts of the feature points P ₁ ′ to P ₁₀ ′ shown in FIG. 8B are stored.

The “feature point state (current)” item indicates whether or not the feature point of the current frame exists in the screen of the display unit 20. In the example of FIG. 8B, since all the feature points P ₁ ′ to P ₁₀ ′ are present in the screen, “STAT_IN” indicating that the feature points are present in the screen is set. . If no feature point exists in the screen, “STAT_OUT” is set.

The “designated area flag (current)” item indicates whether or not the feature point of the current frame is in the designated area. In FIG. 8B, since the feature points P ₂ ′ to P ₈ ′ are present in the designated area defined by the feature points P ₉ ′ and P ₁₀ ′, the feature points are present in the designated area. “FLAG_IN” is set to indicate this. Since the feature point P ₁ ′ is outside the designated area defined by the feature points P ₉ ′ and P ₁₀ ′, “FLAG_OUT” which means that the feature point exists outside the designated area is set. .

The “position validity” item represents whether the position of the feature point in the current frame is normal or abnormal. In the example of FIG. 8, the value of “VALID” indicating that the position is normal is set to the feature points P ₁ ′ to P ₉ ′ of the current frame determined to correspond to the feature points P _{1 to} P ₉ of the previous frame. Is set. Wherein point _P 1 to P ₉ of the previous frame, because the correspondence is taken from the feature point _{P 1'~P 9} 'of the current frame. However, the feature point P ₁₀ ′ of the current frame determined to correspond to the feature point P ₁₀ of the previous frame should originally exist at the position of P ₁₀ indicated by a black circle in FIG. 8B. _Therefore, the _{P 10,} the value of "INVALID" indicating that the position is abnormal is set.

  The “feature point reliability” item represents the ease of tracking the feature point. A large value is set in the “feature point reliability” item when tracking feature points is easy, and a small value is set when tracking feature points is difficult.

  Next, the designated area data in FIG. 7B will be described. The designated area data is data for defining the designated area, and includes items of the shape of the area, the arrangement of designated designated points, circumscribed rectangle center coordinates, circumscribed rectangle coordinates (upper left), and circumscribed rectangle coordinates (lower right). Including.

  The “region shape” item represents the shape (eg, rectangle, circle, etc.) of the designated region. In the example of FIG. 8, since the shape of the designated area is a rectangle, “rectangle” is set in the “area shape” item.

  The “arrangement of designated points to be configured” item represents an arrangement of points necessary for expressing a graphic represented by the shape of the designated area. For example, if the shape of the designated area is a rectangle, there are two points at the upper left and the lower right, and if it is a circle, there are two points: a center point and a radius. In the example of FIG. 8, since the shape of the designated area is a rectangle, “rectangular 2 points” is set in the “arrangement of designated points to be configured” item.

The item “circumscribed rectangle center coordinates” represents the center coordinates of the designated area. The “circumscribed rectangular coordinates (upper left)” item represents the coordinates of the upper left point indicating the designated area when the shape of the area is a rectangle. Further, the “circumscribed rectangular coordinates (lower right)” item represents the coordinates of the lower right point indicating the designated area when the shape of the area is a rectangle. When the shape of the area is a circle, the “circumscribed rectangle coordinate (upper left)” item is the circle center coordinate representing the center of the circle, and the “circumscribed rectangle coordinate (lower right)” item is the radius point coordinate representing the radius point. May be used. In the example of FIG. 8, the feature point P ₁₀ ′ is the upper left point, and P ₉ ′ is the lower right point. Accordingly, the coordinates (x ₁₀ ′, y ₁₀ ′) of the feature point P ₁₀ ′ of the current frame are set in the “circumscribed rectangular coordinates (upper left)” item. In addition, the coordinates (x ₉ ′, y ₉ ′) of the feature point P ₉ ′ of the current frame are set in the “circumscribed rectangular coordinates (lower right)” item. Further, the center coordinates (cx, cy) of the designated area are obtained by cx = (x ₉ ′ + x ₁₀ ′) / 2 and cy = (y ₉ ′ + y ₁₀ ′) / 2. Note that the coordinates of the designated area data may be expressed using coordinates in the display unit 20 (coordinates on the screen) instead of coordinates in the image captured by the imaging unit 10.

  Returning to FIG. 6 again, the description will be continued. The display control unit 414 displays the center of the image captured by the imaging unit 10 based on the image captured by the imaging unit 10. In addition, the display control unit 414 acquires designated area data stored in the storage unit 413 and displays a frame indicating the designated area and the center of the designated area on the display unit 20. Thus, the user can easily operate the orientation and position of the camera using the frame indicating the designated area, the center of the designated area, and the center of the image as marks.

  The zoom magnification changing unit 415 changes the zoom magnification of the optical system by controlling the optical system zoom mechanism provided in the imaging unit 10. When the distance between the center of the specified area and the center of the image captured by the image capturing unit 10 is within a predetermined range, the zoom magnification changing unit 415 displays the specified area in the full display unit 20. Change the zoom magnification of the optical system. The zoom magnification changing unit 415 determines whether or not the designated area is displayed in full on the display unit 20 depending on, for example, whether or not the distance between a part of the designated area and the end of the display unit 20 is within a predetermined range. Can be judged.

  The acquisition unit 417 acquires only the image included in the designated area among the images captured by the imaging unit 10 and stores the acquired image in the storage unit 413. FIG. 9 is a diagram for explaining an outline of the function of the acquisition unit 417. Here, it is assumed that the designated area is set as shown in FIG. In this case, the acquisition unit 417 does not acquire the entire image displayed on the display unit 20 illustrated in FIG. 9B but acquires only the image included in the designated area as illustrated in FIG. 9C. To do.

  Returning to FIG. The image correction unit 416 performs correction processing on the image stored in the storage unit 413 by the acquisition unit 417. Specifically, when the image stored in the storage unit 413 is distorted, the image correction unit 416 performs a trapezoidal correction process for directly facing the image on the image. For example, it is assumed that the image stored in the storage unit 413 has a trapezoid as shown in FIG. 10A even though the designated area is designated as a rectangle. In this case, the image correction unit 416 determines that the image is distorted, and executes a trapezoidal correction process for facing the image as shown in FIG.

  In addition, when the image stored in the storage unit 413 is tilted, the image correcting unit 416 executes tilt correction processing for correcting the tilt of the image. For example, it is assumed that the imaging device 100 is tilted as shown in FIG. Here, when the zoom magnification changing unit 415 changes the magnification of the optical system zoom so that the designated region is displayed in the full display unit 20, the relationship between the designated region and the display unit 20 is as shown in FIG. . When an image is captured in this state, the image acquired by the acquisition unit 417 becomes FIG. 11C, and a blank portion (margin) indicated by hatching is generated in the image stored in the storage unit 413. In this case, the image correction unit 416 rotates the image obtained by tilting, and corrects the image so that the lower end of the designated area is horizontal as shown in FIG. The image correction unit 416 stores the corrected image in the storage unit 50. Further, the image correction unit 416 stores the image stored in the storage unit 413 as it is in the storage unit 50 when it is not necessary to correct the image.

  Next, an example of processing executed by the control unit 40 will be described using a flowchart. 12 and 13 are flowcharts illustrating an example of main processing executed by the control unit 40.

  When the camera mode is selected by the user, the processing of the flowchart shown in FIG. 12 is started. The area designation receiving unit 411 acquires an image captured by the imaging unit 10 as a frame image (step S10). Next, the area designation receiving unit 411 determines whether or not an area selection mode has been designated by the user (step S11). When the region selection mode is designated (step S11 / YES), the region designation receiving unit 411 displays a pointer on the display unit 20 (step S12).

  Next, the region designation receiving unit 411 selects feature points in the frame image acquired in step S10, and stores the feature points in the storage unit 413 (step S100). Here, the details of feature point selection and storage processing will be described. FIG. 14 is a flowchart illustrating an example of detailed processing in step S100.

In FIG. 14, the region designation receiving unit 411 selects a target pixel from the frame image and obtains the feature amount v (step S101). Then, the area designation receiving section 411 determines whether or not larger than the threshold value T _v by the feature v is a predetermined pixel of interest selected (Step S102). This is because the region calculation unit 412 determines whether or not the selected feature point has a feature amount sufficient to track the feature point.

If the feature quantity v of the selected target pixel is the threshold value _{T v} is smaller than a predetermined (step S102 / NO), the area designation receiving section 411 returns to step S101 to process the next pixel of interest. If the feature quantity v of the selected target pixel is greater than the threshold value T _v (step S102 / YES), the area designation receiving section 411 determines whether the distance between the target pixel and the other feature points selected is equal to or greater than a predetermined value (Step S103). That is, in step S103, the region designation receiving unit 411 determines whether the distance between the selected target pixel and the already determined feature point is not too close.

When the determination in step S103 is NO, the region designation receiving unit 411 returns to step S101 to process the next pixel of interest. When the determination in step S103 is YES, the region designation receiving unit 411 adds the selected target pixel as a feature point to the feature point array data (step S104). Then the area designation receiving section 411 determines, with respect to the threshold T _v, whether all the pixels are processed in the frame image (step S105). When the determination in step S105 is NO, the region designation receiving unit 411 returns to step S101 to process the remaining pixels. When the determination in step S105 is YES, the region designation receiving unit 411 determines whether or not the number of feature points in the acquired frame image is greater than a predetermined threshold value T _{v_num} (step S106).

If the determination in step S <b> 106 is YES, it is determined that a sufficient number of feature points have been extracted, and the region designation receiving unit 411 ends this processing. If step S106 is NO, the area designation receiving section 411 lowers the value of the threshold _{T v} of the feature amount, executes the processing of step S101~ step S106 again.

  When the process shown in FIG. 14 is completed, the area designation receiving unit 411 determines whether or not the user is designating an area in FIG. 12 (step S13). Whether or not the user is designating an area can be determined by, for example, whether or not the user is pressing a predetermined button on the operation unit 30.

  When the user is designating an area (step S13 / YES), the area designation receiving unit 411 determines whether or not a process for setting points that define the designated area (feature point addition process) has been performed (step S14). . When the feature point addition process is performed (step S14 / YES), the region designation receiving unit 411 adds the point designated by the user to the feature point array data as a feature point (step S15). Then, since the designated area is set by the process of step S15, the area designation receiving unit 411 stores the “designated area flag (current)” item of each feature point stored in the feature point array data by the process of step S100. The value is updated (step S16).

  When the determination in step S14 is NO, or when the process in step S16 ends, the area calculation unit 412 determines whether information related to the feature point of the previous frame exists in the storage unit 413 (step S17). When there is information on the feature point of the previous frame (step S17 / YES), the process proceeds to C in FIG. 13, and the area calculation unit 412 associates the feature point of the previous frame with the feature point of the current frame. The validity of the position of the feature point of the current frame is verified (step S200). Here, details of the processing in step S200 will be described. FIG. 15 is a flowchart illustrating an example of detailed processing in step S200.

In FIG. 15, the region calculation unit 412 determines whether or not there is a feature point (unprocessed feature point) that has not been subjected to a process for verifying the validity of the position described later (step S201). When an unprocessed feature point exists (step S201 / YES), the region calculation unit 412 selects one feature point _Pn (step S202). The area calculation unit 412 extracts a local area around the coordinates (x _n , y _n ) of the feature point P _n in the previous frame (step S203). Next, the area calculation unit 412 scans the image data of the current frame and obtains the similarity with the local area extracted in step S203. Then, the area calculation unit 412 searches for the coordinates (x _n ′, y _n ′) of the local area having the highest similarity with the local area extracted in step S203 in the current frame (step S204). FIG. 16 is a diagram for explaining the outline of the processing in step S203 and step S204.

FIG. 16A shows the outline of the image of the previous frame, and FIG. 16B shows the outline of the image of the current frame. In FIG. 16A, the area calculation unit 412 extracts a local area (displayed with a thick frame) around the coordinates (x ₁ , y ₁ ) of the feature point P ₁ indicated by the oblique lines in the figure (step S203). Next, the area calculation unit 412 scans the image data of the current frame shown in FIG. 16B, and obtains the similarity to the local area extracted in FIG. 16A at each coordinate. Then, the region calculation unit 412 searches for the coordinates (x ₁ ′, y ₁ ′) of the local region having the highest similarity with the local region extracted in FIG. 16A (step S204). Note that the method of detecting the destination of the feature point is not limited to the method shown in step S203 and step S204 of the present embodiment, and the feature point is detected using other methods such as optical flow and pattern matching. May be detected.

Returning to the flowchart of FIG. When the process of step S204 ends, the area calculation unit 412 determines whether or not (x _n , y _n ) and (x _n ′, y _n ′) can be regarded as corresponding points (step S205). . For example, the area calculation unit 412 can be regarded as a point where (x _n , y _n ) and (x _n ′, y _n ′) correspond to each other when the similarity exceeds a predetermined threshold. Is determined.

  If the determination in step S205 is NO, the area calculation unit 412 assumes that the corresponding point has gone out of the screen, and the feature point is displayed in the “feature point state (current)” item of the feature point array data. “STAT_OUT” which means that it exists outside is set (step S207). Then, the area calculation unit 412 returns to step S201.

If the determination at step S205 is YES, the region calculation unit 412, a corresponding point is _{found, (x n, y} n) in association with, the item "coordinate of the current frame" _{(x n} ', _y n ′) Is stored, and “STAT_IN” which means that the feature point of the current frame exists inside the screen is set in the “feature point state (current)” item (step S206). Next, the area calculation unit 412 performs validity verification between corresponding feature points and coordinate correction processing (step S208). Here, details of the processing in step S208 will be described with reference to FIGS. 17 and 18 are flowcharts illustrating an example of detailed processing in step S208. FIG. 19 is a diagram for specifically explaining the detailed processing of step S208.

The region calculation unit 412 determines whether or not processing described later has been executed for all feature points for which “STAT_IN” is set in the “feature point state (current)” item (step S211). If the determination in step S211 is NO, the region calculation unit 412 selects one feature point P _n from among the feature points for which “STAT_IN” is set in the “feature point state (current)” item ( Step S212). Next, the area calculation unit 412 sets “STAT_IN” in the “feature point state (previous)” item, that is, a combination of two feature points that existed in the screen in the previous frame image (P _l , P _m ) (l ≠ m ≠ n, where l and m are arbitrary numbers equal to or less than T _{v_num} ) are selected k sets (step S214). _Here, a combination of _(P l, P _m), referred to as _{P (i) (P l,} P m) (i = 1~k).

Here, with reference to FIG. 19, the above-described processing will be specifically described. 19, the left diagram in FIG. 19A is an example of feature points set for the image of the previous frame, and the right diagram in FIG. 19A is determined to correspond to the feature points in the previous frame. It is an example of the feature point of the current frame. Here, feature point region calculation unit 412 selects the processing of step S212 is assumed to be _{P 1} shown in FIG. 19 (A). In this case, the region calculation unit 412 may use, for example, P (1) (P ₂ , P ₃ ), P (2) (P ₃ , P ₄ ), and P (3) (P) as other combinations of feature points. ₂ , P ₄ ) are selected in step S213.

Returning to the flowchart of FIG. The region calculation unit 412 obtains all (k sets) inner products of the feature points P _n and P (i) (P _l , P _m ) of the previous frame (step S215). Here, obtaining the inner product of P _n and P (i) (P _l , P _m ) means obtaining the inner product of the vector P _nl and the vector P _nm in FIG. In the following description, the inner product of P _n and P (i) (P _l , P _m ) is described as cos θ (P (i) (P _l , P _m )) or cos θ (P _ni ). To do. For example, in FIG. 20B, the inner product of P ₁ and P (1) (P ₂ , P ₃ ) is cos θ (P (1) (P ₂ , P ₃ )) or cos θ (P ₁₁ ). It is described.

Again, it demonstrates concretely using FIG. Left diagram of FIG. 19 (B) ~ Figure 19 (D) includes a feature point _{P 1} the area calculation section 412 selects at step S212, the the combination of the feature points region calculation unit 412 selects the processing of step S213 The relationship in the previous frame is shown. In the example of FIG. 19, the region calculation unit 412 obtains cos θ (P ₁₁ ), cos θ (P ₁₂ ), and cos θ (P ₁₃ ) in step S214.

Next, in the flowchart of FIG. 17, the area calculation unit 412 calculates all inner products of the feature points P _n ′ and P (i) ′ (P _l ′, P _m ′) of the current frame (step S214). k sets) (step S215). 19B to 19D show the relationship between feature points in the current frame. In step S215, the region calculation unit 412 obtains cos θ (P ₁₁ ′), cos θ (P ₁₂ ′), and cos θ (P ₁₃ ′).

  Next, the area calculation unit 412 initializes the value of the variable long to 0 (step S216). Here, the variable “long” is a variable for counting the number of abnormal feature points.

The area calculation unit 412 determines whether the value calculated by the expression (1) is equal to or less than the threshold value T _{inner_product} (step S217). If the positional relationship between the three points is the same in the current frame and the previous frame, the inner product value in the previous frame is equal to the inner product value in the current frame. Therefore, when the value represented by Expression (1) is equal to or greater than the threshold value, the positional relationship between the feature point selected in step S212 and the combination of the feature points selected in step S213 is different between the previous frame and the current frame. Because it is considered.

  When the determination in step S217 is NO, the area calculation unit 412 increases the value of the variable long (step S218). If the determination in step S217 is YES, or after the process in step S218, the region calculation unit 412 determines whether or not the process in step S217 has been performed for all the groups for which the inner product has been obtained (step S219). When the processing has not been completed for all (step S219 / NO), the region calculation unit 412 repeats the processing of steps S217 to S219. When the processing has been completed for all (step S219 / YES), the area calculation unit 412 determines whether or not the value obtained by dividing the variable ong by the number of sets k is smaller than a predetermined value C (step S220). .

  If the determination in step S220 is NO, “INVALID” indicating that the position of the feature point in the current frame is abnormal is set in the “positional validity” item (step S222). When the determination in step S220 is YES, “VALID” indicating that the position is normal is set in the “position validity” item (step S221). Then, the area calculation unit 412 returns to step S211.

In the example of FIG. 19, as shown in the right diagrams of FIGS. 19B to _19D , two sets of values are larger than the threshold T _{inner_product} among the three sets. Therefore, the value of the variable long is 2. Since the value obtained by dividing the variable worn (= 2) by the number of sets k (= 3) is 0.66, if the predetermined value C is 0.25, the determination result of step S220 in the example of FIG. Is NO, and “INVALID” is set in the “position validity” item of the feature point P ₁ .

  Returning to FIG. 17, the description of the flowchart will be continued. When the determination in step S211 is YES, the area calculation unit 412 proceeds to F of FIG. 18 and “STAT_OUT” is set in the “feature point state (current)” item, or “positional validity”. It is determined whether or not processing described later has been executed for all feature points for which “INVALID” is set in the item (step S223). If the determination in step S223 is yes, the area calculation unit 412 ends this process.

When the determination in step S223 is NO, the area calculation unit 412 uses the feature point in which “VALID” is set in the “position validity” item to determine the coordinates of the current frame corresponding to the coordinates of the previous frame. Obtained (step S224). Specifically, using the equation (2), the coordinates (x _n ′, y _n ′) of the feature point P _n ′ of the current frame are obtained from the coordinates (x _n , y _n ) of the feature point of the previous frame. .

_If the coordinates (x _n , y _n ) of the feature point P _n of the previous frame have moved to the coordinates (x _n ′, y _n ′) of the feature point P _n ′ of the current frame, parallel movement, enlargement / reduction, The mapping by rotation can be expressed as in equation (2).

Therefore, from the feature point other than the feature point P _n of the current frame and “VALID” set in the “positional validity” item, and the feature point in the previous frame, it is expressed by Expression (3). Matrix A is obtained. Then, the movement destination P _n ′ of P _n is obtained using Expression (2).

When the number of feature points necessary for the calculation is insufficient, as shown in FIG. 21A, in the previous frame, straight lines P ₁ P _m , ∠P _n P ₁ P _m , and ∠P _n P _m P _{Find l} . Then, assuming that the feature points P ₁ , P _m , and P _n are moving in a similar manner from the previous frame to the current frame, as shown in FIG. 21B, a straight line P _n ′ P _l ′, 'by determining the intersection of the destination _{P n} of _{P n'} linearly _P n'P _m may be obtained.

Next, the region calculation unit 412 determines whether or not the corresponding point P _n ′ has been obtained (step S225). When the corresponding point P _n ′ is obtained (step S225 / YES), the region calculation unit 412 lowers the value of the “feature point reliability” item (step S226). This is because it is a feature point whose position is corrected using another feature point, and it is considered that tracking is not easy.

When the corresponding point P _n ′ is not obtained (step S225 / NO), the region calculation unit 412 determines whether or not the feature point P _n is a point designated by the user (step S227). That is, the area calculation unit 412 determines whether or not “USER_ADD” is set in the “feature point type” item.

If the feature point P _n is not a point designated by the user (step S227 / NO), the region calculation unit 412 uses the feature point array data to obtain the data of P _n in order to stop using P _n as the feature point. Delete (step S228), and return to step S223. When _Pn is a point designated by the user (step S227 / YES), the area calculation unit 412 proceeds to G of FIG. 13 and clears all the data stored in the feature point array data (step S22). As a result, the designated area is cleared, and a pointer is displayed on the display unit 20 through steps S10 and S11 (step S12).

  Returning to FIG. 13, the description of the flowchart will be continued. When the process of step S200 is completed or when the determination in step S17 is NO, the area calculation unit 412 determines whether or not the designated area exists (step S18). When the designated area exists (step S18 / YES), the area calculation unit 412 verifies the validity of the designated area (step S300). Here, details of the processing in step S300 will be described. FIG. 22 is a flowchart illustrating an example of detailed processing in step S300.

In FIG. 22, the region calculation unit 412 determines whether or not processing described later has been performed on all feature points P _n included in the feature point array data (step S301). When all the feature points P _n have been processed (step S301), the area calculation unit 412 determines that the designated area is in an appropriate state (step S303), and ends the process.

When all the feature points _Pn are not processed (step S301 / NO), the region calculation unit 412 selects one feature point _Pn (step S302). Next, the area calculation unit 412 determines whether or not the feature point P _n ′ of the current frame exists in the designated area, that is, “FLAG_IN” is set in the “selected area flag (current)” item. It is determined whether or not there is (step S304).

When the determination in step S304 is YES, the area calculation unit 412 determines whether or not “FLAG_IN” is set in the “selection area flag (previous)” item, whether or not the feature point P _n of the previous frame is in the designated area. It is determined whether it is set (step S305). If the determination in step S305 is NO, the area calculation unit 412 determines that the specified area is in an abnormal state (step S307). The fact that the feature points that exist in the specified area in the current frame did not exist in the specified area in the previous frame means that the positional relationship between the feature points and the specified area has changed. It is.

  When the determination in step S305 is YES, the area calculation unit 412 returns to step S301 and continues the process. This is because if the feature point existing in the designated area in the current frame is also in the designated area in the previous frame, it is considered that the positional relationship between the designated area and the feature point is not changed.

When the determination in step S304 is NO, the area calculation unit 412 determines whether the feature point P _n of the previous frame is outside the designated area, that is, “FLAG_OUT” is set in the “selected area flag (previous)” item. It is determined whether or not (step S306). If the determination in step S306 is YES, the area calculation unit 412 returns to step S301 and continues the process. The fact that the feature point outside the designated area in the current frame was outside the designated area in the previous frame is because there is no change in the positional relationship between the designated area and the feature point.

  When the determination in step S306 is NO, the region calculation unit 412 determines that the designated region is in an abnormal state (step S307) and ends the process. The feature points that exist outside the specified area in the current frame exist in the specified area in the previous frame because it is considered that the positional relationship between the feature points and the specified area has changed. is there.

  Returning to FIG. After the process of step S300, the area calculation unit 412 determines whether or not the designated area is in an appropriate state (step S19). If the designated region is not valid (step S19 / NO), the region calculation unit 412 clears all the data stored in the feature point array data (step S22). As a result, the designated area is cleared, and a pointer is displayed on the display unit 20 through steps S10 and S11 (step S12).

  When the designated area is in an appropriate state (step S19 / YES), the display control unit 414 draws the designated area and its center position on the display unit 20 (step S20).

  The area calculation unit 412 determines whether or not the designated area is cleared when the determination in step S18 is NO or after the process of step S20 is completed (step S21). When the determination in step S21 is YES, the region calculation unit 412 clears all the data stored in the feature point array data (step S22). As a result, the designated area is cleared, and the pointer is displayed on the display unit 20 by the area designation receiving unit 411 through the processes of steps S10 and S11 (step S12).

  If the designated area is not cleared (step S21 / NO), or if the determination in step S11 is NO, the zoom magnification changing unit 415 executes a photographing process (step S400). Here, details of the processing in step S400 will be described. FIG. 23 is a flowchart illustrating an example of detailed processing in step S400.

  The zoom magnification changing unit 415 determines whether or not the shutter is pressed by the user (step S401). In this embodiment, it is assumed that “shutter is pressed” in step S401 is “shutter is pressed halfway”.

  When the shutter is pressed (YES in step S401), the zoom magnification changing unit 415 determines that the zoom magnification changing unit 415 determines that the center of the screen matches the center of the designated area. It is determined whether or not the distance from the center of the designated area is small (step S402). If the determination in step S402 is NO, the zoom magnification changing unit 415 prompts the user to match the center of the screen and the center of the designated area by displaying a message on the display unit 20 (step S403). When the process of step S403 ends, the zoom magnification changing unit 415 continues the process from step S402.

  If the determination in step S402 is YES, the zoom magnification changing unit 415 adjusts the zoom magnification of the optical system so that the designated area is maximized in the screen (step S404). Next, the zoom magnification changing unit 415 determines whether or not the shutter has been pushed to the end (step S405). That is, in this embodiment, in step S405, it is determined whether or not the shutter half-pressed in step S401 has been pressed by the user. Note that the determination as to whether or not the user is performing a shooting operation need not be based on the pressed state of the shutter. For example, it is assumed that the zoom magnification change and the photographing operation are executed by operating different buttons. In this case, it may be determined whether or not a predetermined button has been pressed in step S401, and in step S405, it may be determined whether or not a predetermined button different from step S401 has been pressed.

  If the determination in step S405 is NO, or if the determination in step S401 is NO, the zoom magnification changing unit 415 determines that the user is not performing a shooting operation and is in an unshooting state (step S408).

  When the determination in step S405 is YES, the acquisition unit 417 stores the image in the designated area in the storage unit 413 (step S406). The acquisition unit 417 determines that an image has been shot by the user performing a shooting operation (step S407), and the process ends.

  Returning to FIG. The image correction unit 416 determines whether or not an image has been taken by the user (step S23). When an image is captured by the user (step S23 / YES), the image correction unit 416 performs image correction processing such as keystone correction and tilt correction on the image stored in the storage unit 413, and the corrected image. Is stored in the storage unit 50 (step S24). The image correction unit 416 ends the process.

  When an image is not photographed by the user (step S23 / NO), the process proceeds to D in FIG. 12, and the region designation receiving unit 411 executes the process from step S10 again.

  As is clear from the above description, according to the first embodiment, when the distance between the center of the designated region and the center of the image captured by the imaging unit 10 is within a predetermined range, the zoom magnification changing unit 415 Changes the zoom magnification of the optical system so that the designated area is displayed in full on the display unit 20. As a result, it is possible to photograph the object to be imaged included in the designated area at a higher resolution than when the entire image is photographed and then the image of the designated area is cut out.

  The area designation receiving unit 411 accepts designation of a point that defines the designated area based on a user operation using a pointer displayed on the display unit 20. As a result, the user can easily set the designated area by an intuitive operation.

  Further, the area calculation unit 412 uses the positional relationship between the plurality of feature points in the previous frame and the points that define the specified area, and the position of the specified area in the previous frame and the object to be imaged included in the specified area. Calculate the position and size of the designated area in the current frame so that the relationship is maintained. Then, the display control unit 414 displays a frame indicating the designated region in the current frame on the display unit 20 based on the calculation result by the region calculation unit 412. Thus, the user can easily grasp the relationship between the entire image and the designated area by using the frame indicating the designated area as a guide.

  In addition, since the acquisition unit 417 acquires only the image included in the designated area, the user does not need to perform operations such as cutting out the designated area after shooting, and the convenience for the user is improved.

  In the second embodiment, an imaging device 100 ′ having only some functions of the imaging device 100 according to the first embodiment will be described. FIG. 24 is a functional block diagram illustrating an example of functions of the imaging apparatus 100 ′ according to the second embodiment. As illustrated in FIG. 24, the imaging apparatus 100 ′ does not include the zoom magnification changing unit 415, the acquisition unit 417, and the image correction unit 416. The imaging apparatus 100 ′ performs a process of storing an image captured by the imaging unit 10 in the storage unit 50. A processing unit 418 is provided. The storage processing unit 418 receives a user's shooting operation and stores the image captured by the imaging unit 10 in the storage unit 50.

  When the imaging apparatus 100 ′ has the configuration shown in FIG. 24, the processing for capturing an image can be the processing shown in the flowchart of FIG. FIG. 25 is a flowchart illustrating an example of processing for capturing an image using the imaging apparatus 100 ′.

  In FIG. 25, the storage processing unit 418 determines whether or not the shutter is pressed by the user (step S501). If the shutter is pressed (step S401 / YES), the storage processing unit 418 determines whether the designated area and the screen size of the display unit 20 are the same size (step S502). For example, the storage processing unit 418 determines whether the distance between a part of the designated area and the end of the display unit 20 is equal to or less than a predetermined value.

  If the determination in step S502 is NO, the storage processing unit 418 determines whether the designated area is larger than the screen size (step S503). When the designated area is larger than the screen size (step S503 / YES), the storage processing unit 418 displays a message on the display unit 20 for requesting the zoom magnification to be reduced so that the designated area enters the screen (step S503 / YES). Step S504). If the designated area is smaller than the screen size (step S503 / NO), the storage processing unit 418 displays a message on the display unit 20 requesting that the zoom magnification be increased so that the designated area is displayed on the full screen ( Step S505).

  If the determination in step S502 is YES, or after the processing in step S504 or S505, the storage processing unit 418 determines whether the shutter has been pushed to the end (step 506).

  When determination of step S506 is NO, it progresses to D of FIG. 12, and the area | region designation | designated reception part 411 continues a process from step S10.

  If the determination in step S506 is YES, the storage processing unit 418 stores the image captured by the imaging unit 10 in the storage unit 50 (step S507), and ends the process.

  As is clear from the above description, according to the second embodiment, the area calculation unit 412 performs the current frame in which the positional relationship between the designated area in the previous frame and the imaging target included in the designated area is maintained. Based on the calculation result of the area calculation unit 412, the display control unit 414 calculates the frame indicating the specified area, the center of the specified area, and the imaging unit 10 based on the calculation result of the area calculation unit 412. Displays the center of the image to be captured. Thus, the user can easily capture an image centered on the designated area by aligning the center of the designated area with the center of the display unit 20. In addition, since a frame representing the designated area is displayed on the display unit 20, the user manually changes the zoom magnification of the optical system while confirming the relationship between the designated area and the entire image, and the designated area is displayed. It can be easily operated so that the part 20 is displayed in full. Instead of changing the zoom magnification of the optical system, the user can bring the imaging device 100 ′ itself closer to the object to be picked up so that the designated area is displayed in full on the display unit 20. In addition, the user adjusts the resolution of the imaging device 100 ′ by operating the imaging device 100 ′ so that the specified region is displayed in the display unit 20 while aligning the center of the specified region with the center of the display unit 20. Taking advantage of this is easy.

  As described above, the embodiments of the present invention have been described in detail. However, the present invention is not limited to the specific embodiments, and various modifications and changes can be made within the scope of the gist of the present invention described in the claims. It can be changed.

  For example, in the first embodiment, the shape of the designated area is the rectangle shown in FIG. 26A, but the shape of the designated area is a circle, an ellipse, or a heart shape as shown in FIGS. , And any shape. When the shape of the designated area is a circle, as shown in FIG. 26B, the user can designate the area by designating two points, which are a center point and a radius. When the shape of the designated area is an ellipse, the user can designate the area by designating the center point and the points having the major axis and the minor axis as shown in FIG. When the shape of the designated area is a heart shape, the user designates the center point and the vertex of the circumscribed rectangle as shown in FIG. 26D, or the upper left and lower right as shown in FIG. An area can be specified by specifying a point. Alternatively, as shown in FIG. 26E, a heart-shaped region can be designated by designating the center point and the radius of the circumscribed circle. Also, as shown in FIG. 26 (F), the user can designate an arbitrary shape by designating a point sequence.

  Note that the functions of the imaging apparatus described above can be realized by a computer including a CPU, a ROM, a RAM, and the like. In that case, a program describing the processing contents of the functions that the imaging apparatus should have is provided. By executing the program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium.

  When the program is distributed, for example, it is sold in the form of a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

  The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. Further, each time the program is transferred from the server computer, the computer can sequentially execute processing according to the received program.

  Further, for example, a function provided by the above-described imaging device may be provided as a service from a server computer to a communication device such as a personal computer connected to a server computer connected to a communication network such as the Internet (ASP ( Application Service Provider)).

DESCRIPTION OF SYMBOLS 100, 100 '... Imaging device 10 ... Imaging part 20 ... Display part 411 ... Area designation reception part 412 ... Area calculation part 414 ... Display control part 415 ... Zoom magnification change part 416 ... Image correction part 417 ... Acquisition part

Claims (6)

A display unit for displaying an image captured by the imaging unit;
An area designation receiving unit for accepting designation of an area including an object to be imaged;
In the first image captured by the imaging unit, the region that maintains the positional relationship between the region and the object to be captured in the second image captured by the imaging unit before the first image. An area calculation unit for calculating the position and size of
A display control unit for displaying a frame indicating the region in the first image, a center of the region, and a center of the first image on the display unit;
Equipped with a,
The region designation receiving unit defines a region including the object to be imaged, which is designated on a third image displayed on the display unit using a pointer fixedly displayed on the display unit. And a region defining the region designated using the pointer on a fourth image different from the third image displayed on the display unit after the first point is designated. An image pickup apparatus that accepts designation of the region based on two points .   When the distance between the center of the region and the center of the image captured by the imaging unit is within a predetermined range, the distance between a part of the frame indicating the region and any side of the display unit is The imaging apparatus according to claim 1, further comprising a zoom magnification changing unit that changes a zoom magnification of the optical system so as to be within a predetermined range. The region calculation unit is configured to determine the region in the first image based on a positional relationship between a plurality of feature points set in the second image and points defining the region in the second image. the imaging apparatus according to claim 1 or 2 for calculating the position and size of the. Imaging device according to any one of claims 1-3 comprising an acquisition unit for acquiring only the image included in the region. The imaging apparatus according to claim 4 , further comprising an image correction unit that corrects a captured image based on a shape of the region and an image acquired by the acquisition unit. An area designation receiving step for accepting designation of an area including an object to be captured in an image captured by the imaging apparatus;
In the first image captured by the imaging device, the region that maintains the positional relationship between the region and the object to be imaged in the second image captured by the imaging device before the first image A calculation step for calculating the position and size of
A display step of displaying a frame indicating the region in the first image, a center of the region, and a center of the first image on a display unit included in the imaging device based on a calculation result in the calculation step; To the computer ,
In the region designation receiving step, a first region defining the region including the object to be imaged designated on a third image displayed on the display unit using a pointer fixedly displayed on the display unit is defined. And a region defining the region designated using the pointer on a fourth image different from the third image displayed on the display unit after the first point is designated. An imaging program that accepts designation of the region based on two points .

Images