JP4934982B2 - Image processing apparatus, image processing method, portable terminal with image processing apparatus, and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve usability of an imaging apparatus such as a digital camera. <P>SOLUTION: If a color temperature of illumination light is out of an auto-mode control range, an optimal control mode is automatically searched and a message urging a user for switching is displayed. <P>COPYRIGHT: (C)2007,JPO&amp;INPIT

Description

  The present invention relates to a technique for taking an image. For example, the present invention relates to an image processing technique of an imaging apparatus such as a digital video camera or a digital camera that captures an image, and an image processing technique of an imaging apparatus mounted on a portable terminal or the like.

  With recent advances in digital technology, conventional cameras and video cameras are being replaced by digital cameras and digital video cameras. A digital camera or digital video is a device that converts reflected light from a subject into an electrical signal using a semiconductor element that reacts to light such as a CCD or CMOS, and stores it as a digital data in a storage medium such as a flash memory.

  Imaging devices such as digital cameras and digital video cameras may be sold and used as stand-alone devices, or sold as part of mobile terminals such as mobile phones, PHS, PDC, and notebook PCs. Sometimes used.

  Incidentally, illumination light has a characteristic called color temperature. The color temperature represents the color characteristics of illumination light as temperature. Color temperature is defined as the temperature of a black body when a full black body emits that color. FIG. 5 is a graph showing the color temperature of typical illumination light. Incandescent lights are more reddish than in sunny weather, and sunlight during cloudy days is more bluish than in sunny weather.

  Various types of fluorescent lamps are currently on the market, and it is generally difficult to specify the color temperature range in the category of fluorescent lamps. In addition, it is difficult to clarify the temperature range for clear sky, cloudy sky, and incandescent lamp categories. The numerical values in FIG. 5 are merely examples, and other numerical value settings are not excluded.

  The imaging device records the subject affected by the color temperature of the illumination light as it is in order to accurately record the reflected light from the subject. On the other hand, humans tend to recognize white objects as white regardless of the color temperature of the illumination light. As a result, the color recognized by the imaging device may be different from the color recognized by humans.

  In order to make the color recognized by the imaging device the same as the color recognized by humans, it is necessary to add a function for adjusting the captured image based on the color temperature of the illumination light to the imaging device. In general, adjusting a color component included in a captured image based on the color temperature of illumination light is called white balance adjustment, white balance correction, or simply white balance.

  White balance adjustment is a function that corrects the color component of a captured image of a subject based on the color temperature of the subject and brings the captured image recorded by the imaging device closer to a color recognized by a human. In general, an R (red) component and a B (blue) component are often used as color components of a captured image to be corrected.

  Next, a conventional technique related to white balance adjustment will be disclosed. Patent Document 1 discloses a white balance adjustment device. The prior art white balance adjusting device of Patent Document 1 has a fixed white balance mode corresponding to the type of illumination light. Since the color temperature range of illumination light assigned to one fixed white balance mode is wide, appropriate white balance adjustment could not be performed.

  The white balance adjustment device of the invention of Patent Document 1 can perform more appropriate white balance adjustment by further subdividing the color temperature range assigned to the fixed white balance mode.

  Patent Document 2 also discloses a white balance adjustment device. In the prior art of Patent Document 2, white balance adjustment is realized by adjusting the gains of the R (red) component and B (blue) component of the captured image. Further, the range of the gain, that is, the adjustable range of white balance adjustment is limited based on the luminance of the subject. When the brightness of the subject is sufficiently high, the white balance adjustment range is set to be narrow. Conversely, when the brightness of the subject is low, the white balance adjustment range is set to be wide. In this prior art, when the brightness of the subject is low, the subject region sometimes becomes achromatic.

  The white balance adjustment device according to the invention of Patent Document 2 is provided with a means for measuring outside light, and by appropriately controlling the white balance adjustment range based on the measurement result of outside light, the luminance of the subject is low To solve the above problem.

  Patent Document 3 also discloses a white balance adjustment device. In the prior art of Patent Document 3, the fluorescent lamp mode is used as the white balance adjustment mode under the fluorescent lamp use environment. However, there are various types of fluorescent lamps, and even though they have various emission colors, there is only one type of adjustment value for the fluorescent lamp mode, so the color of the subject cannot be accurately reproduced.

  When the fluorescent lamp mode is selected, the white balance adjusting device according to the invention of publication 3 performs further subdivided white balance adjustment in accordance with the type of fluorescent lamp based on the color temperature of the subject, Reproduce colors more accurately.

JP 2001-268589 JP2003-134551A The prior art of the white balance adjusting device is as described above. It is possible to provide the imaging apparatus with various adjustment modes for white balance adjustment according to the illumination light. However, the more adjustment modes are provided in the imaging apparatus, the more difficult the user is to make settings.

  In order to release the user from troublesome settings, there is also an image pickup apparatus that includes an automatic adjustment mode as an adjustment mode for white balance adjustment.

  The automatic adjustment mode is an adjustment mode corresponding to standard illumination light. It will function properly as long as you use it in a standard lighting environment. The color temperature range of illumination light is generally set to about 3000K to 5500K. However, depending on the model, the corresponding color temperature range of the automatic adjustment mode may be different from the above range.

  The wider the color temperature range of illumination light that can be adjusted in the automatic adjustment mode, the more environments that can be handled in the automatic adjustment mode.

  However, it is not preferable to unnecessarily widen the adjustable color temperature range in the automatic adjustment mode. When the setting is wide, an imaging apparatus that measures the color temperature of illumination light and shoots a subject with the same camera has the following problems.

  For example, when a bright red subject is photographed in an environment under fine weather, it is determined that the color temperature of the illumination light is low (red) because there are many R components in the photographed image. The larger the subject is photographed, the greater the tendency for the imaging device to determine that the color temperature of the illumination light is low. Since the color temperature of the illumination light is low, correction is applied in the direction of making the subject color blue, and the original color cannot be reproduced.

  In Patent Documents 2 and 3, since the means for measuring the color temperature of the external light is provided separately from the camera for photographing the subject, such a problem is unlikely to occur. However, Patent Documents 2 and 3 have a problem that the circuit becomes large and the manufacturing cost and the development cost increase because a means for measuring the color temperature of the external light is provided separately.

  In an imaging apparatus that measures the color temperature of illumination light and shoots a subject with the same camera, the automatic adjustment mode is generally 3000K to 5500K in consideration of the balance between user convenience and accurate color reproduction of the subject. In many cases, the color temperature range is set to be adjustable.

  Because of the troublesome operations, the user often continues to use the imaging apparatus while being set to the automatic correction mode. However, as described above, since the range of the adjustable color temperature is limited in the automatic correction mode, for example, an accurate color of the subject cannot be reproduced under an environment using an incandescent lamp (about 2600 K).

  This invention exists in improving the usability of an imaging device.

  Another object of the present invention is to solve the problem that an image pickup apparatus having a plurality of white balance adjustment modes can be appropriately selected with a simple operation.

  Another object of the present invention is to prevent the automatic adjustment mode from being selected under an inappropriate environment in an imaging apparatus having the automatic adjustment mode as the white balance adjustment mode.

  Another object of the present invention is to make it possible to select a more appropriate adjustment mode with a simple additional function without excessively expanding the adjustable range of the white balance adjustment mode.

An image processing apparatus according to the present invention includes an imaging unit that generates a captured image of a subject, a color temperature determination unit that determines a color temperature of the captured image, and a memory that holds a white balance adjustment mode of two or more captured images. an image correcting unit for correcting the captured image based on the determination result and set adjustment mode of the color temperature determining section, and a display unit for displaying the corrected captured image, determined by the color temperature determining part When the color temperature of the captured image is outside the predetermined range of the set adjustment mode, the adjustment mode is searched based on the determined color temperature, and when a suitable adjustment mode is searched Then, a predetermined message for allowing the user to confirm that the illumination light corresponds to the searched adjustment mode is displayed on the display unit, and the setting is changed to the searched adjustment mode by the user's confirmation input. Characterized in that it has an image processing control section for, a.

The portable terminal of the present invention includes an imaging unit that generates a captured image of a subject, a color temperature determination unit that determines a color temperature of the captured image, a memory that holds a white balance adjustment mode of two or more captured images, An image correction unit that corrects the captured image based on a determination result of the color temperature determination unit and a set adjustment mode, a display unit that displays the corrected captured image, and the color temperature determination unit. When the color temperature of the captured image is outside the predetermined range of the set adjustment mode, the adjustment mode is searched based on the determined color temperature, and when a suitable adjustment mode is searched, A predetermined message for allowing the user to confirm that the illumination light corresponds to the searched adjustment mode is displayed on the display unit, and the setting is changed to the searched adjustment mode by the user's confirmation input. Characterized by comprising an image processing apparatus having an image processing control unit.

An image processing method of the present invention includes an imaging unit that generates a captured image of a subject, a color temperature determination unit that determines a color temperature of the captured image, and a memory that holds a white balance adjustment mode of two or more captured images. An image correction unit that corrects the captured image based on a determination result of the color temperature determination unit and a set adjustment mode, a display unit that displays the corrected captured image, and an image processing control unit. In the image processing method of the image processing apparatus, the image processing control unit determines when the color temperature of the captured image determined by the color temperature determination unit is outside a predetermined range of the set adjustment mode. The adjustment mode is searched based on the obtained color temperature, and when a suitable adjustment mode is searched, a predetermined message for allowing the user to confirm that the illumination light corresponds to the searched adjustment mode. To display di on the display unit, and changes the setting to the searched adjustment mode by a user's confirmation input.

An image processing program of the present invention holds an arithmetic processing unit of an image processing apparatus, a color temperature determination unit that determines a color temperature of a captured image captured by an imaging unit, and a white balance adjustment mode of two or more captured images. An image correction unit that corrects the captured image based on an adjustment mode set from a memory and a determination result of the color temperature determination unit; and the corrected captured image is displayed on an external display unit, and the color temperature determination When the color temperature of the photographed image determined by the unit is outside the predetermined range of the set adjustment mode, the adjustment mode is searched based on the determined color temperature, and a suitable adjustment mode is searched. In this case, a predetermined message for allowing the user to confirm that the illumination light corresponds to the searched adjustment mode is displayed on the display unit, and the searched adjustment is performed by the user's confirmation input. And an image processing control unit to change the setting mode, is characterized in that to function with.

  According to the present invention, the usability of the white balance adjustment of the imaging apparatus is improved.

  In addition, according to the present invention, an image pickup apparatus having a plurality of white balance adjustment modes can be appropriately selected with a simple operation.

  Further, according to the present invention, it is possible to prevent the automatic adjustment mode from being selected under an inappropriate environment in an imaging apparatus having the automatic adjustment mode as the white balance adjustment mode.

  Further, according to the present invention, it is possible to select a more appropriate adjustment mode with a simple additional function without excessively expanding the adjustable range of the white balance adjustment mode.

  The best mode for carrying out the present invention will be described. However, this embodiment does not limit the technical scope of the present invention.

  An image processing apparatus according to this embodiment will be described. The image processing apparatus includes at least an imaging unit 3, a DSP 6, an image processing memory 7, and a display unit 10, and is built in the imaging apparatus 1. FIG. 1 is a diagram illustrating a configuration of an imaging apparatus 1 according to the present embodiment.

  The imaging apparatus 1 includes a camera module 8, a CPU 9, a display unit 10, an input unit 11, and a memory 12. The camera module 8 includes a camera unit 4, an AD converter 5, a DSP 6, and an image processing memory 7.

  The camera unit 4 includes a photographing lens 2 and an imaging unit 3. The taking lens 2 condenses the reflected light from the subject on the imaging unit 3. The imaging unit 3 includes a CCD, a CMOS sensor, or the like, and has a function of converting an optical signal into an electrical signal.

  The AD converter 5 is a circuit that converts an analog signal into a digital signal. The signal from the imaging unit 3 is converted into a digital signal and input to the DSP 6. The DSP 6 is an arithmetic device capable of performing various signal processing, and is used for white balance adjustment, for example.

  The image processing memory 7 is a memory for storing various data used for white balance adjustment. Various adjustment modes exist for white balance adjustment, and control data relating to each adjustment mode is stored in the image processing memory 7. In this embodiment, there are two types of adjustment modes: an eigenvalue adjustment mode corresponding to unique illumination light, and an automatic adjustment mode corresponding to illumination light with a color width (3000K to 5500K) that is somewhat wide for general purposes. Has a mode. In this embodiment, the imaging apparatus 1 has a plurality of eigenvalue adjustment modes, and has an incandescent lamp mode corresponding to an incandescent lamp and a cloudy mode corresponding to cloudy. These adjustment modes are examples, and the present invention is not limited to these modes.

  The CPU 9 is a central processing unit and controls the operation of the entire imaging apparatus. The CPU 9 controls the camera module 8, the display unit 10, the input unit 11, and the memory 12 via a bus. The display unit 10 is a display made of an LCD or an organic EL, and displays captured images, various messages, and control icons.

  The input unit 11 is an input device such as a button, a keypad, or a keyboard. The user operates the imaging device 1 by operating the CPU 9 using the input unit 11. The memory 12 is used to store an operation program for the CPU 9, a captured image, and various data. When the imaging device is built in a mobile phone or the like, it is also used for storing information such as a telephone number.

  The CPU 9 can transmit captured image data, icons, data such as predetermined messages to the display unit 10 via the bus, and cause the display unit 10 to display the data. The CPU 9 can control the memory 12, the display unit 10, and the camera module 8 via a bus based on an input signal from the input unit 11. The CPU 9 can read or write captured image data and data related to various controls from the memory 12.

  Next, the operation of the imaging apparatus 1 in FIG. 1 will be described. Reflected light from the subject is incident on the imaging unit 3 via the photographing lens 2. The incident reflected light is converted into an electrical signal by the imaging unit 3 and output to the AD converter 5. The AD converter 5 converts an electrical signal (analog signal) of a captured image into a digital signal. The digitized image data is input to the DSP 6 and used for signal processing such as white balance adjustment. The DSP 6 performs white balance adjustment of the digitized photographed image data using the control data stored in the image processing memory 7. Details of processing performed by the DSP 6 will be described later.

  The data of the photographic image adjusted for white balance is transmitted to the display unit 10 via the bus under the control of the CPU 9. The display unit 10 displays captured image data.

  The AD converter 5 digitizes the captured image at regular intervals based on a clock output from a clock source (not shown), and outputs the digitized captured image data to the DSP 6. The DSP 6 rewrites the captured image displayed on the display unit 10 at regular intervals, whereby a preview display described later is performed. In the preview display state, the display unit 10 reproduces a moving image that follows the movement of the subject.

  The DSP 6 switches the adjustment mode used for white balance adjustment when a predetermined instruction is given from the CPU 9. The CPU 9 is instructed to switch the adjustment mode when the user inputs a predetermined input for instructing the input unit 11 to switch the adjustment mode. The DSP 6 can also cause the display unit 10 to display a message that prompts the user to switch the adjustment mode by outputting a predetermined control signal to the CPU 9.

  FIG. 2 is a diagram for explaining the internal functions of the DSP 6. Hereinafter, each functional block will be described.

  The DSP 6 has a color temperature determination function, an image adjustment function, and an image processing control function, and is represented as a color temperature determination unit 100, an image adjustment unit 101, and an image processing control unit 102, respectively. These functions are realized by software.

  The photographed image data is input to the DSP 6 from the AD converter 5 in FIG. The image processing memory 7, CPU 9, display unit 10, input unit 11, and memory 12 have the same configuration as that shown in FIG.

  The color temperature determination unit 100 determines the color temperature of the illumination light from the captured image data. The determination is made based on the ratio of the RGB components of the captured image. Information regarding the relationship between the RGB component ratio and the temperature is received from the image processing memory 7 via the image processing control unit 102.

  The image adjustment unit 101 performs white balance adjustment of the captured image data by correcting the RGB components of the captured image data. The correction gain applied to the RGB components of the captured image data at the time of correction is set by the image processing control unit 102.

  Based on the color temperature of the captured image determined by the color temperature determination unit 100 and the control data corresponding to the currently set adjustment mode stored in the image processing memory 7, the image processing control unit 102 The correction gain of the RGB component performed by the adjustment unit 101 is transmitted. Further, the image processing control unit 102 determines whether or not the color temperature obtained from the captured image data is outside the adjustment range of the currently set adjustment mode. Further, when the adjustment mode is outside the adjustment range, a message prompting the user to switch the adjustment mode is displayed on the display unit 10. When the CPU 9 is instructed to switch the adjustment mode, the correction gain of the RGB components is transmitted from the image processing memory 7 to the image adjustment unit 101 using the control data corresponding to the supported adjustment mode. .

  As described above, the image processing memory 7 stores control data corresponding to various adjustment modes, and is controlled by the image processing control unit 102.

  The CPU 9 receives image data after white balance adjustment from the image adjustment unit 101, receives a signal from the image processing control unit 102, and transmits a signal to the image processing control unit 102.

  The display unit 10, the input unit 11, and the memory 12 are connected to the DSP 6 via a bus. Since the imaging apparatus 1 has a bus configuration with the CPU 9 as a master, the DSP 6 cannot directly control those devices. Therefore, the DSP 6 always exchanges information with the display unit 10 and the like via the CPU 9.

  Before describing the operation of the functional diagram shown in FIG. 2, white balance adjustment will be described.

  FIG. 3 schematically shows control data for one adjustment mode among the adjustment modes stored in the image processing memory 7. Here, the automatic adjustment mode will be described as an example of the adjustment mode. The adjustment memory 7 stores a plurality of control data for such adjustment modes. In FIG. 3, the horizontal axis indicates the color temperature of the captured image, and the vertical axis indicates the correction gain. The horizontal axis shows a higher color temperature as it goes to the right, and the vertical axis shows a larger correction gain as it goes up.

  A line 203 indicates an R component correction gain, and a line 204 indicates a B component correction gain. The higher the color temperature, the higher the R component correction gain and the lower the B component correction gain. For example, when a photographed image with a high color temperature is input, the photographed image is adjusted in a reddish direction. A high color temperature means that the image is bluish. Therefore, the white balance of the captured image is appropriately adjusted by correcting the RB component of the captured image in a reddish direction.

  A line 202 is an upper limit value of the color temperature that can be adjusted in the automatic adjustment mode. Even if the color temperature of the photographed image is higher than the color temperature indicated by the line 202, the gain greater than the correction gain indicated by the line 205 is not applied to the R component in the adjustment mode, and the gain less than the correction gain indicated by the line 206 is applied to the B component. Can't be applied.

  A line 201 is a lower limit value of the color temperature that can be adjusted in the automatic adjustment mode. Similar to the line 202, it functions as a limit value for the correction gain.

  In FIG. 3, the control data is schematically shown as a two-dimensional graph. However, the storage format in the image processing memory 7 may be a table format or a mathematical formula format.

  In FIG. 3, the R component is expressed as an increase function with respect to the color temperature, and the B component is expressed as a decrease function. However, different characteristics may be used depending on the design of the automatic adjustment mode. For example, in the vicinity of the center of the color temperature range in which the automatic adjustment mode can be adjusted, the R component and the B component may have a characteristic that no correction gain is applied. In short, it is sufficient that the data is such that the correction gain of the R component and the B component and the adjustable color temperature range can be understood, and the white balance adjustment may be performed appropriately. The above is the same in other fixed value adjustment modes.

  Next, the operation of each function block in FIG. 2 will be described. The captured image data digitized by the AD converter 5 in FIG. 1 is input to the color temperature determination unit 100 and the image adjustment unit 101.

  The color temperature determination unit 100 extracts the R (red) component, G (green) component, and B (blue) component of the captured image data, and determines the color temperature of the captured image based on the ratio of the RGB components. . The correspondence relationship between the color temperature and the ratio of each component of RGB is stored in advance in the image processing memory 7. The color temperature determination unit 100 acquires information on the correspondence between the ratio of each RGB component and the color temperature from the image processing memory 7 via the image processing control unit 102. The color temperature determination unit 100 transmits the determined color temperature information of the captured image to the image processing control unit 102.

  The image adjustment unit 101 performs white balance adjustment of the captured image data by adjusting the color components of the captured image data. Specifically, the R component and B component values of the captured image data are calculated according to the R component and B component correction gains set by the image processing control unit 102. For example, when the correction gain set by the image processing unit 102 is 2 for the R component and 1/2 for the B component, an operation is performed to double the R component of the captured image data and halve the B component. The captured image data adjusted for white balance is output to the CPU 9 and displayed on the display unit 10.

  The image processing control unit 102 performs white balance adjustment of the captured image data in the adjustment mode set by the CPU 9. If the CPU 9 instructs the image processing control unit 102 to change the adjustment mode in accordance with the input from the input unit 11, the image processing control unit 102 performs white balance adjustment in the changed adjustment mode.

  Specifically, it is performed as follows. The image processing control unit 102 reads control data corresponding to the set adjustment mode from the image processing memory 7. The control data includes a correction gain of the RB component and an adjustable color temperature limit range. If the color temperature information obtained from the color temperature determination unit 100 is within the adjustment range of the color temperature in the adjustment mode (above the color temperature indicated by the line 201 and below the color temperature indicated by the line 202), the image processing control unit 102 The white balance adjustment is controlled in the adjustment mode. On the other hand, if the color temperature information obtained from the color temperature determination unit 100 is outside the adjustment range, the CPU 9 is instructed to display a predetermined message on the display unit 10.

  When the change of the white balance adjustment mode is instructed from the CPU 9, the image processing control unit 102 reads the instructed adjustment mode control data from the image processing memory 7, and the color temperature determination unit 100. The R component and B component correction gains are transmitted to the image adjustment unit 101 based on the color temperature and the control data determined.

  The image adjustment unit 101 performs white balance adjustment of the captured image data as described above using the R component and B component correction gains set again. The adjustment mode is changed using a signal input from the input unit 11 as a trigger.

  Next, the operation of the entire imaging apparatus 1 will be described with reference to FIG. The camera function of the imaging device 1 is activated (300). The activation of the camera function is triggered by an input signal from the input unit 11 or a call from another process. The CPU 9 reads a program related to camera activation from the memory 12 and starts executing the program.

  Next, the adjustment mode is read (301). The CPU 9 reads from the memory 12 the adjustment mode that is set in advance to operate when the camera function is activated. If not set in advance, the automatic adjustment mode is read. In the following description, it is assumed that the automatic adjustment mode is read immediately after the camera function is activated.

  Following the reading of the adjustment mode (301), the color temperature is determined (302). This is performed in the automatic adjustment mode read in 301. Data indicating the correspondence between the RGB components of the captured image and the color temperature is read from the image processing memory 7 by the image processing control unit 102 and transmitted to the color temperature determination unit 100. The color temperature determination unit 100 determines the color temperature from the captured image data based on the control data. The determined color temperature information is transmitted to the image processing control unit 102. The image processing control unit 102 compares the adjustable range of the automatic adjustment mode read from the image processing memory 7 with the color temperature of the captured image.

  If the color temperature of the photographed image is within the adjustment range of the automatic adjustment mode, the operation proceeds to the preview display (313) operation. If the color temperature is outside the adjustment range, the operation proceeds to the search for the alternative adjustment mode (310).

  The preview display (313) will be described. The preview display operation includes two operations of white balance adjustment (303) and image display (304) as internal operations. As will be described later, the two operations are repeatedly executed alternately. When the preview display (313) operation starts, white balance adjustment (303) is executed first. On the other hand, when the preview display (313) operation is ended, after the image display (304) operation is ended, the operation proceeds to another operation.

  The operation of white balance adjustment (303) will be described. The image processing control unit 102 determines the correction gain of the RB component from the color temperature determined by the color temperature determination unit 100 and the control data in the image processing memory 7 and transmits the correction gain to the image adjustment unit 101. The image adjustment unit 101 applies a correction gain to the RB component of the captured image data and performs white balance adjustment.

  In the image display (304), the photographic image data adjusted for white balance is transmitted from the image adjustment unit 101 to the CPU 9. The CPU 9 displays the photographed image data adjusted for white balance on the display unit 10.

  The AD converter 5 inputs photographed image data to the DSP 6 at a constant cycle. The white balance adjustment (303) and the preview display (304) are repeatedly performed every cycle. By this operation, even when the subject moves, the subject can be preview-displayed in real time by updating the display of the captured image with the operation cycle of the AD converter 5.

  During the preview display (313) operation, the user can change the adjustment mode (305) or take an image displayed in the preview (306) by operating the input unit 11.

  The image shooting (306) starts the operation triggered by a predetermined operation performed on the input unit 11 during the preview display (313) operation. The captured image displayed on the display unit 10 when the input unit 11 is operated is temporarily stored in the memory 12 or a buffer memory (not shown).

  The captured image display (307) is an operation for displaying the temporarily stored captured image on the display unit 10. This is realized by the CPU 9 controlling the display unit 10. When a captured image is displayed (307), if a predetermined operation is performed on the input unit 11, the CPU 9 stores the captured image in the memory 12 (308). On the other hand, when another predetermined operation is performed on the input unit 11 when the captured image is displayed (307), the display returns to the preview display (313).

  In the image storage (308), the CPU 9 stores the captured image temporarily stored in the memory 12 or a buffer memory (not shown) in a predetermined image storage area of the memory 12. When the image storage (308) is performed, the imaging apparatus 1 returns to the preview display (313) operation.

  Next, the search (310) for alternative adjustment mode will be described. The image processing control unit 102 searches the image processing memory 7 to determine whether there is a fixed value mode suitable for the color temperature of the captured image obtained in the color temperature determination (302).

  If there is no suitable fixed value mode, the process proceeds to preview display (313). If there is a suitable fixed mode, a predetermined message is displayed (311). The predetermined message is realized by causing the CPU 9 to display the predetermined message on the display unit 10.

  The predetermined message causes the user to confirm whether or not the searched adjustment mode is the corresponding illumination light. For example, if it is determined that the fluorescent lamp mode is suitable as the fixed value mode as a result of the search, a message “Is the lighting a fluorescent lamp?” Is displayed on the display unit 10. Further, for example, when it is determined that the cloudy mode is suitable as the eigenvalue mode as a search result, a message “Is it cloudy or shaded?” Is displayed. In the following description, it is assumed that the fluorescent lamp mode has been searched.

  The user performs a predetermined operation that means YES to a predetermined message at the input unit 11. The CPU 9 that has received the signal from the input unit 11 instructs the image processing control unit 102 to change to the fluorescent lamp mode.

  In the adjustment mode change (312), the image processing control unit 102 reads out the control data in the fixed value mode instructed from the CPU 9 from the image processing memory 7. Thereafter, the operation proceeds to preview display (313).

  On the other hand, when a predetermined message is displayed on the display unit 10 (311), if the user performs a predetermined operation meaning NO on the input unit 11, the preview display (313) operation is performed in the automatic adjustment mode. Transition.

  By the above operation, for example, when shooting in an environment under an incandescent lamp, if the subject's unique color is pure blue, and “is it cloudy or shaded?” Is displayed as a predetermined message, The user can perform a predetermined operation that means NO on the input unit 11 to prevent an erroneous fixed value mode from being set. Moreover, the user's usability improves by selecting more suitable adjustment mode only by selecting YES and NO whether the display content of a message and actual illumination light correspond.

  In the preview display (313) operation, if the user does not like the photographed image adjusted for white balance, the adjustment mode can be changed (305) by performing a predetermined operation on the input unit 11. .

  In the operation of changing the adjustment mode (305), a predetermined display is made on the display unit 11 so that the adjustment mode stored in the image processing memory 7 can be selected. When a predetermined input is input to the input unit 11, the CPU 9 instructs the image processing unit 102 to change the adjustment mode. The image processing control unit 102 reads out the control data in the fixed value mode instructed from the CPU 9 from the image processing memory 7. Thereafter, the operation proceeds to preview display (313).

  In all the states of FIG. 4, when a predetermined end operation is performed at the input unit 11, the camera operation ends (309). The CPU 9 instructs the DSP 6 to end the operation of the camera module 8, and ends the camera function program being executed by itself.

  In the above-mentioned embodiment, “Is the illumination a fluorescent lamp?” Or “Is it cloudy or shaded?” Is exemplified as the predetermined message display, and it is confirmed whether the illumination light is retrieved from the color temperature of the photographed image. However, other modes may be used. For example, “Would you like to change the white balance setting to a more appropriate adjustment mode?” Or just “Fluorescent lamp?” May be displayed.

  In the above-described embodiment, the functions are separated by the DSP 6 and the CPU 9, but the present invention may be in other modes. For example, the functions realized by the DSP 6 and the CPU 9 of the above-described embodiment may be realized by the same arithmetic processing unit. Further, the DSP 6 may be another type of processor instead of the DSP, and the functions realized by the DSP 6 may be realized by programmable hardware such as an FPGA.

  In the above-described embodiment, the imaging apparatus 1 has been described. However, the present invention can be similarly applied to a mobile terminal including the imaging apparatus 1. In the above-described embodiment, when the user has not set in advance, the automatic adjustment mode is set as the adjustment mode executed when the camera is activated. However, another fixed value mode may be set.

  In the above-described embodiment, as shown in FIG. 4, once the adjustment mode is set, the operation of the color temperature determination (302) is not executed unless the camera function is restarted. However, the present invention is limited to this mode. Not. For example, when the illumination environment changes in the preview display (313) and the color temperature of the captured image data deviates from the adjustment range of the adjustment mode selected at that time, a search for a more appropriate alternative adjustment mode is performed. Processing similar to that performed (310), message display (311), and adjustment mode change (312) may be performed.

  By doing so, it is possible to always select an appropriate adjustment mode for white balance adjustment when the lighting environment changes in real time, such as when the user carries the imaging device 1 and takes a picture.

  In the above-described embodiment, the memory 12 and the image processing memory 7 are used. However, the memory 12 and the image processing memory 7 may be arranged in a single memory so as to be accessible from the DSP 6 and the CPU 9.

  The image pickup apparatus 1 according to the present invention can display to prompt the user to switch the adjustment mode when the color temperature is outside the adjustment range of the automatic adjustment mode by performing the operation described with reference to FIG. An imaging device that targets non-professional users rather than an imaging device intended for specialized users is designed to save as much effort as possible by the user.

  In an imaging apparatus having an automatic adjustment mode, the automatic adjustment mode is often expressed as “auto white balance mode” or “standard”. From these names, the user often misunderstands that the adjustment mode corresponds to any environment. In an environment where the automatic adjustment mode cannot be adjusted, the user can be prompted to select an appropriate adjustment mode by a predetermined message.

1 is a diagram illustrating a configuration of an image processing apparatus according to an embodiment of the present application. It is a figure showing the relation of the function of the image processing apparatus which concerns on an Example of this application. It is the graph which showed the correction gain in the image adjustment part 101 concerning an example of this application. It is a figure which shows the relationship of the operation state of the image processing apparatus which concerns on an Example of this application. It is the figure which showed the color temperature of typical illumination light.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Shooting lens 3 Imaging part 4 Camera part 5 AD converter 6 DSP
7 Image processing memory 8 Camera module 9 CPU
DESCRIPTION OF SYMBOLS 10 Display part 11 Input part 12 Memory 100 Color temperature determination part 101 Image adjustment part 102 Image processing control part

Claims (4)

An imaging unit that generates a captured image of the subject;
A color temperature determination unit for determining a color temperature of the captured image;
A memory for holding a white balance adjustment mode of two or more captured images;
An image correction unit that corrects the captured image based on the determination result of the color temperature determination unit and the set adjustment mode;
A display unit for displaying the corrected captured image;
When the color temperature of the photographed image determined by the color temperature determination unit is outside the predetermined range of the set adjustment mode, the adjustment mode is searched based on the determined color temperature, and the adjustment mode is adapted. Is retrieved, a predetermined message for allowing the user to confirm that the illumination light corresponds to the retrieved adjustment mode is displayed on the display unit, and the retrieved adjustment mode is set by the user's confirmation input. An image processing control unit for changing
An image processing apparatus comprising: An imaging unit that generates a captured image of the subject;
A color temperature determination unit for determining a color temperature of the captured image;
A memory for holding a white balance adjustment mode of two or more captured images;
An image correction unit that corrects the captured image based on the determination result of the color temperature determination unit and the set adjustment mode;
A display unit for displaying the corrected captured image;
When the color temperature of the photographed image determined by the color temperature determination unit is outside the predetermined range of the set adjustment mode, the adjustment mode is searched based on the determined color temperature, and the adjustment mode is adapted. Is retrieved, a predetermined message for allowing the user to confirm that the illumination light corresponds to the retrieved adjustment mode is displayed on the display unit, and the retrieved adjustment mode is set by the user's confirmation input. An image processing control unit for changing
A portable terminal comprising an image processing apparatus having An imaging unit that generates a captured image of the subject;
A color temperature determination unit for determining a color temperature of the captured image;
A memory for holding a white balance adjustment mode of two or more captured images;
An image correction unit that corrects the captured image based on the determination result of the color temperature determination unit and the set adjustment mode;
A display unit for displaying the corrected captured image;
An image processing control unit;
In an image processing method of an image processing apparatus having
The image processing control unit selects an adjustment mode based on the determined color temperature when the color temperature of the captured image determined by the color temperature determination unit is outside a predetermined range of the set adjustment mode. If a matching adjustment mode is searched, a predetermined message for allowing the user to confirm that the illumination light corresponds to the searched adjustment mode is displayed on the display unit. An image processing method, wherein the setting is changed to the searched adjustment mode. The arithmetic processing device of the image processing device
A color temperature determination unit that determines a color temperature of a captured image captured by the imaging unit;
An image correction unit that corrects the captured image based on an adjustment mode set from a memory that holds a white balance adjustment mode of two or more captured images and a determination result of the color temperature determination unit;
The corrected captured image is displayed on an external display unit, and the color temperature of the photographed image determined by the color temperature determination unit is determined when it is outside the predetermined range of the set adjustment mode. When the adjustment mode is searched based on the color temperature and a suitable adjustment mode is searched, a predetermined message for allowing the user to confirm that the illumination light corresponds to the searched adjustment mode is displayed on the display unit. An image processing control unit that changes the setting to the searched adjustment mode by a user's confirmation input;
An image processing program characterized by being made to function.

Images