JP4887775B2 - Image reproduction system and program - Google Patents

Description

  The present invention relates to a technique of an imaging device to which an interchangeable lens can be attached and detached.

  Many digital camera bodies (camera bodies) to which an interchangeable lens can be mounted are equipped with an image pickup device provided with an APS size image pickup surface (exposure surface). On the other hand, products having an image sensor provided with a large image size larger than the APS size, for example, an image surface having a full size of 35 mm, are being commercialized.

  However, when an interchangeable lens designed for an APS size image sensor is attached to a camera body equipped with a large image sensor, vignetting occurs due to insufficient image circles in the captured image, making it difficult to perform proper shooting. It becomes.

  Thus, an electronic camera that copes with such a change in the size of the image circle has been proposed (for example, Patent Document 1). In this electronic camera, image circle information related to so-called shading correction is added to an image signal and stored at the time of shooting. Then, shading correction based on the image circle information is performed on the image signal by an external information device or the like.

JP 2000-241868 A

  However, the electronic camera proposed in Patent Document 1 relates to a shading correction technique according to a change in the size of an image circle, and does not deal with vignetting of a captured image caused by an image circle shortage.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a technique that can cope with vignetting of a captured image that occurs in association with a change of an interchangeable lens.

In order to solve such a problem, in the image reproduction system of the present invention, information for acquiring lens information related to the interchangeable lens from the interchangeable lens after mounting the interchangeable lens designed for the imaging apparatus and having the exposure surface of the first size. Based on the lens information, the acquisition unit, the determination unit that determines whether the first size is smaller than the second size, and, if the size does not match, the entire image obtained on the exposure surface of the image sensor is reversibly compressed. Or an image pickup apparatus having a storage means for storing in an uncompressed state, a reading means for reading the entire image in a reversibly compressed or uncompressed state from the storage means, and a partial region of the vignetting portion due to the lack of an image circle of the interchangeable lens in the entire image A partial image generating means for generating a partial image including a luminance correction to compensate for a shortage of luminance of the vignetting portion in the partial image. Ri, a luminance correction means for eliminating the influence of vignetting portion was to the luminance-corrected partial images provided reproduction apparatus and having an image output means for outputting visually by the luminance correction means.

  The invention according to claim 2 is the imaging apparatus according to claim 1, wherein a partial image obtained by removing a vignetting portion due to a lack of an image circle of the interchangeable lens is extracted from the whole image based on the lens information. And a compressed image generating means for generating a partial compressed image obtained by performing irreversible compression processing on the partial image, and the storage means stores the partial compressed image.

  The invention according to claim 3 is the image pickup apparatus according to claim 2, wherein when the size does not match, the storage means adds the lens information in a reversible compression or non-compression state to the whole image. And a second mode for extracting the partial image from the whole image based on the lens information, performing an irreversible compression process, and storing it in the storage means when the size does not match. It further comprises a mode switching means for switching modes among a plurality of modes including.

  According to a fourth aspect of the present invention, in the imaging apparatus according to the second aspect, when the size does not match, the storage unit adds the lens information to the whole image in a reversibly compressed or uncompressed state. And a control means for extracting the partial image from the whole image based on the lens information, performing an irreversible compression process, and storing it in the storage means.

  The invention according to claim 5 is a program for causing the imaging apparatus to function as the imaging apparatus according to any one of claims 1 to 4 by being executed by a computer included in the imaging apparatus.

  The invention of claim 6 is an imaging system having an interchangeable lens and an imaging device to which the interchangeable lens can be attached and detached, wherein the interchangeable lens is designed for an imaging device having an exposure surface of the first size. The imaging device is provided with an imaging element provided with an exposure surface having a second size, and information acquisition means for acquiring lens information relating to the interchangeable lens from the interchangeable lens after the interchangeable lens is mounted; Based on lens information, determination means for determining a size mismatch that the first size is smaller than the second size, and if the size does not match, the entire image obtained on the exposure surface of the image sensor is reversibly compressed or Storage means for adding and storing the lens information in an uncompressed state.

  The invention of claim 7 is an image reproduction system comprising the imaging device according to any one of claims 1 to 4 and a reproduction device, wherein the reproduction device is reversibly compressed or stored from the storage means. Using the readout means for reading out the uncompressed whole image and the lens information, and the whole image and lens information read out by the readout means, the whole image is subjected to image processing including clipping processing. A partial image generating unit that generates a partial image that eliminates the influence of the vignetting portion due to a lack of an image circle of the interchangeable lens, and an image output unit that visually outputs the partial image generated by the partial image generating unit. It is characterized by providing.

  The invention of claim 8 is a program for causing the playback device to function as the playback device according to claim 7 when executed by a computer included in the playback device.

According to the present invention, the playback device extracts a region including a partial region with a relatively small luminance deficiency in the vignetting portion of the entire image, and therefore, compared with a case where a region excluding the vignetting portion is extracted. An image capturing a wide range can be acquired. Accordingly, it is possible to acquire an image capturing a wider range while removing vignetting in accordance with the user's intention.

  According to the second aspect of the present invention, based on the lens information, a partial image is extracted from the entire image obtained on the exposure surface of the image sensor, excluding the vignetting due to the lack of the image circle of the interchangeable lens, and irreversible compression is performed. Since processing is performed and stored, it is possible to prevent vignetting from being included in the stored captured image.

  According to the third aspect of the present invention, after mounting an interchangeable lens designed for an imaging apparatus having an exposure surface of the first size, the first size is larger than the second size of the exposure surface provided on the imaging device. If it is determined that the size mismatch is small, the entire image obtained on the exposure surface of the image sensor is stored with the lens information added in a reversible compression or non-compression state, or the vignetting portion is removed from the entire image based on the lens information. Since it is possible to switch whether the removed partial image is extracted and stored, it is possible to cope with vignetting of a captured image that occurs due to a change of the interchangeable lens by a desired method.

  According to the fourth aspect of the present invention, after mounting an interchangeable lens designed for an imaging apparatus having an exposure surface of the first size, the first size is larger than the second size of the exposure surface provided on the imaging device. When it is determined that the size mismatch is small, the entire image obtained on the exposure surface of the image sensor is stored by adding lens information in a reversible compression or non-compression state, and the vignetting portion is stored from the entire image based on the lens information. Since the excluded partial images are extracted and stored, it is possible to cope with vignetting of a captured image that occurs due to the change of the interchangeable lens without complicated operations.

  Further, according to the invention described in claim 5, it is possible to obtain the same effect as the invention described in any one of claims 1 to 4.

  Further, according to the invention described in claim 6, the same effect as that of the invention described in claim 1 can be obtained.

  According to the seventh aspect of the present invention, in the playback device, the entire image stored in the imaging device and the lens information are used to perform image processing including clipping processing on the entire image. Since a partial image in which the influence of the portion is excluded is generated and output visually, it is possible to cope with vignetting of a captured image that occurs due to the change of the interchangeable lens.

  Further, according to the invention described in claim 8, the same effect as that of the invention described in claim 7 can be obtained.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<Image playback system>
FIG. 1 is a diagram showing an overview of an image reproduction system 1 according to an embodiment of the present invention.

  As shown in FIG. 1, the image reproduction system 1 includes an imaging system 100 and an image reproduction device 500. The imaging system 100 is configured as a digital camera, and has a configuration in which a memory card 176 as a storage medium is detachable. The image reproduction apparatus 500 is configured by a personal computer (hereinafter “personal computer”) or the like.

  Then, by removing the memory card 176 from the imaging system 100 and inserting it into the card slot of the image playback device 500, the image data obtained by the imaging system 100 is transferred to the image playback device 500 via the memory card 176. Can be transferred. Although omitted in FIG. 1, a communication cable is connected to the communication I / F 177 (see FIG. 5) of the imaging system 100, and the image data obtained by the imaging system 100 is transmitted through the communication cable. Can be transferred to the image reproduction device 500. Image processing and image playback processing in the image playback device 500 will be described later.

<Imaging system>
2 and 3 are diagrams showing an external configuration of the imaging system 100 according to the embodiment of the present invention. 2 is a front external view of the imaging system 100, and FIG. 3 is a rear external view of the imaging system 100. 4 is a conceptual diagram showing a cross section viewed from the position of III-III in FIG.

  As shown in FIG. 2, an imaging system 100 includes a single-lens reflex digital still camera that includes a camera body (camera body) 101 and an interchangeable lens 102 that is detachably mounted at the front center of the camera body 101. It is configured as.

  In FIG. 2, a camera body (imaging device) 101 includes a mount portion Mt on which the interchangeable lens 102 is mounted at the front center, an attach / detach button 149 for attaching / detaching the interchangeable lens near the mount portion Mt, and a left end portion on the front surface. A grip unit 110 for a photographer to hold and an AF auxiliary light emitting unit 163 that emits auxiliary light for AF are provided.

  The camera body 101 has a control value setting dial 146 for setting a control value at the upper right portion of the front surface, a mode setting dial 142 for switching the shooting mode at the upper left portion of the front surface, and an exposure surface on the upper surface of the grip portion 110. A release button 147 for instructing the start is provided, and for example, a pop-up flash 162 that emits light for irradiating the subject at the time of flash photography is incorporated. The mount portion Mt is provided with a connector EC for electrical connection with the CPU 181 in the attached interchangeable lens 102 and a coupler MC for mechanical connection.

  The connector EC transmits lens information such as the model and model number of the lens from the lens ROM (read only memory) 182 built in the interchangeable lens 102 to the overall control unit 121 in the camera body 101 via the CPU 181, This is for sending the position of the focus lens 103 and the like detected by the position detection unit 123 to the overall control unit 121. The overall control unit 121 stores lens information acquired from the lens ROM 182 in a built-in RAM or the like.

  The coupler MC transmits the driving force of the focus lens driving motor M1 provided in the camera body 101 to the lens driving mechanism 104 in the interchangeable lens 102. The lens driving mechanism 104 causes the focus lens 103 to move in the optical axis direction. It will move to LX.

  In FIG. 2, a battery storage chamber and a card storage chamber are provided inside the grip portion 110. For example, four AA batteries are housed in the battery compartment as a power source for the camera, and a memory card 176 for storing image data of a photographed image is detachably housed in the card compartment. It is like that.

  The mode setting dial 142 is used for various camera modes (still image shooting mode for shooting still images, movie shooting mode for shooting movies, playback mode for playing back captured images, and communication for data communication with external devices. Mode, etc.).

  The release button 147 is a two-stage switch configured to be able to perform an operation in the “half-pressed state S1” that is pressed halfway and an operation in the “full-pressed state S2” that is further pressed. When the release button 147 is half-pressed in the still image shooting mode, a preparation operation for shooting a still image of the subject (preparation operations such as setting of exposure control values and focus adjustment) is executed, and the release button 147 is fully pressed. When pressed, a shooting operation (a series of operations for exposing an image sensor 116 described later and performing predetermined image processing on an image signal obtained by the exposure) is performed.

  In FIG. 3, a finder window 108 is provided in the upper center of the back surface of the camera body 101. A subject image from the interchangeable lens 102 is guided to the finder window 108. The photographer can view the subject by looking through the viewfinder window 108. More specifically, the subject image that has passed through the interchangeable lens 102 is reflected upward by the mirror mechanism 126 (see FIG. 5), thereby forming the subject image on the focusing screen and the image that has passed through the pentaprism. The subject image can be visually recognized by looking through the eyepiece. The finder window 108 incorporates a liquid crystal display unit for displaying various information indicating the shutter speed, aperture value, and other states of the imaging system 100. Therefore, the photographer can check various states of the imaging system 100 by looking through the finder window 108.

  A rear monitor 107 is provided at substantially the center of the rear surface of the camera body 101. The rear monitor 107 is configured, for example, as a color liquid crystal display, and displays a menu screen for setting shooting conditions and the like, and plays back and displays the shot image stored in the memory card 176 in the playback mode. is there.

  A main switch 141 is provided at the upper left of the rear monitor 107. The main switch 141 is a two-point slide switch. When the contact is set to the left “OFF” position, the power is turned off. When the contact is set to the right “ON” position, the power is turned on.

  A direction selection key 144 is provided on the right side of the rear monitor 107. This direction selection key 144 has a circular operation button, and it is possible to detect the upper, lower, left and right four-direction pressing operations and the upper right, upper left, lower right, and lower left pressing directions in the operation buttons. It has become. Note that the direction selection key 144 is configured to detect a pressing operation of a push button in the center, in addition to the pressing operations in the eight directions.

  A setting button group 143 including a plurality of buttons for setting a menu screen, deleting an image, and the like is provided at the left position of the rear monitor 107. When the still image shooting mode is set, the camera body 101 can be operated in a RAW data storage mode, a trimming data storage mode, and a RAW / trimming data storage mode, which will be described later, by appropriately operating the setting button group 143. One of the storage modes can be set.

  Hereinafter, the RAW data storage mode is abbreviated as “RAW mode”, and the trimming data storage mode is abbreviated as “trimming mode”. Further, the RAW / trimming data storage mode is a storage mode in which operations in both the RAW mode and the rimming mode are used in combination, and will be hereinafter referred to as “combination mode”.

  Further, by appropriately operating the setting button group 143, the compression rate K when performing the later-described image data storage process can be selectively set to 1/8 or 1/20.

  FIG. 5 is a block diagram illustrating a functional configuration of the imaging system 100.

  In the imaging system 100, the overall control unit 121 comprehensively controls the imaging system 100 based on an instruction from the photographer input from the operation unit 140, the position of the focus lens 103 detected by the lens position detection unit 123, and the like. It is the main microcomputer.

  The operation unit 140 includes the main switch 141, the mode setting dial 142, the setting button group 143, the release button 147, and the like.

  The overall control unit 121 uses the CPU 181 in the interchangeable lens 102 to detect a lens position such as the focus lens 103 detected by the lens position detection unit 123. The overall control unit 121 drives the focus lens 103 in the interchangeable lens 102 by controlling the motor M1 using the focus control unit 124. Here, the focus control can be performed by moving the focus lens 103 in accordance with the defocus amount obtained by the phase difference AF module 114.

  The overall control unit 121 drives the quick return mirror or the like in the mirror mechanism 126 by controlling the motor M2 using the mirror control unit 125.

  The overall control unit 121 drives the shutter 115 by controlling the motor M3 using the shutter control unit 127.

  The overall control unit 121 uses the timing control circuit 128 to control the image sensor 116 configured as, for example, a CCD, the signal processing unit 129, and the A / D conversion unit 130.

  The image pickup device 116 has an image pickup surface size (36 mm × 24 mm) corresponding to, for example, a 35 mm full-size film, and an analog signal image picked up by the image pickup device 116 is the signal processing unit 129 and the A / D. The conversion unit 130 converts the image data into digital signal image data.

  The A / D conversion unit 130 normally outputs digital image data to the image processing unit 150. However, if the camera body 101 is set to the RAW mode or the combination mode and it is determined that the size does not match, which will be described later, the digital control is not performed from the A / D conversion unit 130 to the overall control unit 121. Digital image data (hereinafter also referred to as “RAW image data”) is output.

  The image data input to the image processing unit 150 is subjected to image processing by the black level correction circuit 151, the WB correction circuit 152, and the γ correction circuit 153 in the image processing unit 150, and is stored in the image memory 154.

  The image data processed by the image processing unit 150 is displayed on the rear monitor 107 using the VRAM 171.

  The overall control unit 121 acquires lens information from the interchangeable lens 102. When the camera body 101 is set to the trimming mode or the combination mode and is determined to be a lens mismatch described later based on the lens information, the image data (image) stored in the image memory 154 is stored. A process of trimming a partial area image (trimming process) is performed. This trimming process is an extraction process for cutting out a region image (partial image) near the center of the image data so as to eliminate vignetting Kr (see FIG. 8) described later. Note that the image data after the trimming process may be displayed on the rear monitor 107 using the VRAM 171.

  In addition, the overall control unit 121 performs a JPEG method such as two-dimensional DCT conversion, Huffman coding, or the like according to a set compression rate (K = 1/8 or 1/20) as necessary during a shooting operation. Compressed image data (for example, 2560 × 1920 pixels) is generated by the compression processing (that is, lossy compression processing). The compressed image data is stored in the memory card 176 using the card I / F 175. The irreversible compression process is also performed on the partial image obtained by the trimming process. Hereinafter, the image data of the partial image after the irreversible compression process is referred to as “partially compressed image data (partially compressed image)”. Called.

  When image data is stored in the memory card 176, so-called thumbnail image data (for example, 90 × 60 pixels) and tag information (frame number, exposure value, shutter speed, compression rate K, shooting date, scene information, image Information such as a determination result) is generated and stored together with the compressed image data.

  FIG. 6 is a schematic diagram illustrating the stored contents of the memory card 176.

  As shown in FIG. 6, for example, the memory card 176 stores a large number of Exif format image files (230 frames in the figure). Each image file stores a set of high-resolution image data corresponding to the compressed image data, thumbnail image data, and tag information.

  However, when it is determined that the camera body 101 is set to the RAW mode or the combination mode and is in a size mismatch described later, the overall control unit 121 uses the card I / O in a format in which lens information is added to the RAW image data. The data is stored in the memory card 176 using F175. At this time, RAW image data is stored as high-resolution image data stored in one image file shown in FIG. 6, and the lens information is stored in the tag information.

  The image data stored in the memory card 176 can be transmitted to the outside using a communication I / F 177 standardized by USB or the like.

  The overall control unit 121 causes the flash 162 to emit light or the AF auxiliary light emitting unit 163 to emit light via the flash circuit 161 as necessary.

  In addition, in the still image shooting mode, the overall control unit 121 responds to a user operation on the setting button group 143 and sets the camera body 101 to one of the storage modes of the RAW mode, the trimming mode, and the combined mode. .

  Note that various functions in the overall control unit 121 and overall control of the imaging system 100 by the overall control unit 121 are executed by a CPU or the like in the overall control unit 121 reading a program stored in a ROM or the like in the overall control unit 121. This is realized.

<Inappropriate wearing of interchangeable lens 102>
In the imaging system 100, any interchangeable lens 102 with a suitable mount Mt can be attached to the camera body 101, but an inappropriate interchangeable lens 102 described below may be attached.

  When the interchangeable lens 102 that fits the image pickup surface size of the image pickup element 116 in the camera body 101 is attached, for example, the image pickup surface 116f of the image pickup element 116 is formed on the image circle ICa defined by the interchangeable lens 102 as shown in FIG. Can be captured properly.

  On the other hand, an interchangeable lens 102 that does not match the image pickup surface size of the image pickup element 116, for example, an interchangeable lens 102 designed for an image pickup surface (23 mm × 16 mm) having an APS size smaller than the full size (36 mm × 24 mm) is mounted. In this case, for example, as shown in FIG. 7, the imaging surface 116 f of the imaging element 116 is not included in the image circle ICb defined by the interchangeable lens 102. As a result, in the image acquired by the image sensor 116, the luminance at the end of the image in the longitudinal direction (particularly, the four corners of the image) decreases as in the image Go shown in FIG. Will occur.

  In response to the occurrence of the vignetting Kr, the image reproduction system 1 generates an image that does not include the vignetting Kr in the imaging system 100 under the condition that the vignetting Kr is generated, or the image reproduction apparatus 500 generates the vignetting Kr. The vignetting Kr is dealt with by generating an image that does not include. In order to generate an image that does not include the vignetting Kr from the image Go illustrated in FIG. 8, an image signal obtained from the region 116 g (FIG. 7) near the center of the imaging surface corresponding to the effective pixel of the imaging element 116. Should be adopted.

  Hereinafter, a coping operation for vignetting Kr in the image reproduction system 1 will be described. The operation of the image reproduction system 1 is mainly divided into an operation in the imaging system 100 and an operation in the image reproduction apparatus 500. Therefore, hereinafter, the operation in the image reproduction apparatus 500 will be described after the operation in the imaging system 100 is described.

<Operation in imaging system>
<Storage mode switching operation>
FIG. 9 is a flowchart showing a mode switching operation between three storage modes such as a RAW mode, a trimming mode, and a combined mode in the still image shooting mode. This operation flow is realized under the control of the overall control unit 121. When the imaging system 100 is set to the still image shooting mode by operating the mode setting dial 142, the process proceeds to step S1 in FIG.

  In step S1, it is determined whether or not there has been an instruction to change the storage mode. Here, by appropriately operating the setting button group 143, the determination in step S1 is repeated until there is a storage mode change instruction, and if there is a change instruction, the process proceeds to step S2.

  In step S2, it is determined which storage mode has been instructed to change. If it is determined that there is an instruction to change to the RAW mode, the camera body 101 is set to the RAW mode in step S3, and this operation flow ends. If it is determined that there is an instruction to change to the trimming mode, the camera body 101 is set to the trimming mode in step S4, and this operation flow is terminated. If it is determined that there is an instruction to change to the combined mode, the camera body 101 is set to the combined mode in step S5, and this operation flow is ended.

<Operation in RAW mode>
FIG. 10 is a flowchart showing an operation flow in the RAW mode. This operation flow is realized under the control of the overall control unit 121. In the operation flow of FIG. 9, when the camera body 101 is set to the RAW mode, the operation flow of FIG. 10 is executed.

  In step S11, it is detected that the interchangeable lens 102 is attached. Here, for example, by determining whether or not communication with the CPU 181 is possible via the connector EC, it is determined that the interchangeable lens 102 is attached to the mount portion Mt.

  In step S <b> 12, information on the interchangeable lens 102 (lens information) stored in the ROM 182 is received by the overall control unit 121 of the camera body 101.

  In step S13, based on the information of the interchangeable lens 102 received in step S12, the image pickup surface size of the image pickup element 116 in the camera main body 101, and the image pickup surface size of the image pickup element in the camera body to which the interchangeable lens 102 should be attached. Discrepancy is determined. That is, after the interchangeable lens 102 designed for a camera body having an exposure surface of a predetermined size (first size) is mounted, the predetermined size is smaller than the size of the imaging surface on which the image sensor 116 is provided (second size). It is determined whether or not the size does not match.

  Specifically, when, for example, the model or model number of the interchangeable lens 102 is received as the unique information of the lens in step S12, the imaging surface size of the image sensor to which the interchangeable lens 102 fits is ascertained from this unique information. Compared with the imaging surface size of 116. Here, for example, if a data table in which the model number of the interchangeable lens and the like and the image pickup surface size of the image sensor corresponding thereto is stored in the memory of the overall control unit 121, the interchangeable lens can be referred to by referring to this data table. Therefore, the size of the image sensor can be grasped from the model number and the like.

  In step S13, if the image sensor sizes do not match, the process proceeds to step ST14, and if they match, the process proceeds to step S17.

  In step S14, the RAW data is set to be stored in the memory card 176. That is, a setting is made so that the RAW image data input from the A / D conversion unit 130 to the overall control unit 121 during the shooting operation is stored in the memory card 176 without being subjected to compression processing.

  In step S15, when the release button 147 is fully pressed by the user, a shooting operation is performed. Thereby, the image signal related to the subject is acquired by the image sensor 116.

  In step S <b> 16, RAW image data based on the image signal acquired by the image sensor 116 in step S <b> 15 is stored in the memory card 176 together with the lens information acquired from the lens ROM 182 of the interchangeable lens 102. Specifically, RAW image data is stored as high-resolution image data stored in one image file shown in FIG. 6, and lens information and information related to the imaging surface size of the image sensor 116 are included in the tag information. Included and stored.

  In step S17, the same operation as in step S15 is performed.

  In step S18, normal storage processing is performed. That is, various analog processing and digital processing are performed on the image signal acquired by the image sensor 116 in step S <b> 17, compression processing is performed, and the data is stored in the memory card 176.

<Operation in trimming mode>
FIG. 11 is a flowchart showing an operation flow in the trimming mode. This operation flow is realized under the control of the overall control unit 121. In the operation flow of FIG. 9, when the camera body 101 is set to the trimming mode, the operation flow of FIG. 11 is executed.

  In steps S21 to S23, processing similar to the processing of steps S11 to S13 in FIG. 10 is performed. In step S23, if the image sensor sizes do not match, the process proceeds to step ST24, and if they match, the process proceeds to step S28.

  In step S 24, the image data after trimming (trimmed image data) is set to be stored in the memory card 176. Specifically, a trimming process is performed to extract a partial image from an area corresponding to lens information in a predetermined range near the center from the entire image corresponding to the image data stored in the image memory 154 during the shooting operation, and the compression process Is set so as to be stored in the memory card 176. At this time, for example, when the lens information is the model or model number of the interchangeable lens 102, the image capturing surface size of the image capturing element 116 is obtained by grasping the image capturing surface size of the image capturing element to which the interchangeable lens 102 is compatible. As a result, the size and position (trimming condition) of the area near the center to be extracted by trimming are set.

  In step S25, processing similar to that in step S15 in FIG. 10 is performed.

  In step S26, a trimming process based on the trimming condition set in step S24 is performed on the image data acquired by the image sensor 116 in step S25 and subjected to various analog and digital processes.

  12 and 13 are diagrams for explaining image data trimming processing. Here, for convenience, an image corresponding to the image data is shown and described.

  As shown in FIG. 12, in the entire image G1 corresponding to the image data acquired in step S25, vignetting Kr caused by so-called image circle shortage occurs. Therefore, by extracting a partial image from the area Ta near the center excluding the vignetting Kr, a good image G2 having no vignetting Kr as shown in FIG. 13 is acquired.

  In step S27, the image data obtained in step S26 is subjected to compression processing such as JPEG format and stored in the memory card 176.

  In steps S28 and S29, operations similar to those in steps S17 and S18 in FIG. 10 are performed.

<Operation in combined mode>
FIG. 14 is a flowchart showing an operation flow in the combined mode. This operation flow is realized under the control of the overall control unit 121. In the operation flow of FIG. 9, when the camera body 101 is set to the combined mode, the operation flow of FIG. 14 is executed.

  In steps S31 to S33, processing similar to the processing in steps S11 to S13 of FIG. 10 is performed. In step S33, if the image sensor sizes do not match, the process proceeds to step ST34, and if they match, the process proceeds to step S39.

  In step S34, the RAW data is stored in the memory card 176 and the trimming data is stored in the memory card 176. That is, the same processing as that in both steps S14 and S24 is performed.

  In step S35, processing similar to that in step S15 in FIG. 10 is performed.

  In step S36, processing similar to that in step S16 in FIG. 10 is performed.

  In steps S37 and S38, processing similar to that in steps S26 and S27 in FIG. 11 is performed.

  In steps S39 and S40, operations similar to those in steps S17 and S18 in FIG. 10 are performed.

<Operation in Image Playback Device>
FIG. 15 is a block diagram illustrating a functional configuration of the image reproduction device 500.

  As shown in FIG. 15, the image reproduction device 500 mainly includes a processing unit 511, an operation unit 512 configured with a keyboard, a mouse, and the like, and a display unit 513 configured with a CRT screen and the like.

  The processing unit 511 includes an input / output I / F 514 connected to the operation unit 512 and the display unit 513 and a control unit 515 electrically connected to the input / output I / F 514. Further, the processing unit 511 includes a storage unit 516 that is electrically connected to the control unit 515 and an input / output I / F 517.

  The input / output I / F 514 is an interface for controlling transmission / reception of data between the operation unit 512, the display unit 513, and the control unit 515.

  The storage unit 516 includes, for example, a hard disk, and is installed with an operating system (hereinafter also referred to as “OS”) 561 that defines the basic operation of a personal computer that implements the image playback device 500. The storage unit 516 is also installed with an image processing / playback program 562 executed under the management of the OS 561.

  The input / output I / F 517 is an interface for inputting / outputting data to / from the optical disk 476 or the memory card 176 as a storage medium via various drives arranged on the front surface of the processing unit 511.

  The control unit 515 includes a CPU 515a and a memory 515b, and performs overall control of the operation of the personal computer, that is, the image reproduction apparatus 500. Further, in the image reproduction apparatus 500, the control unit 515 reads and executes the image processing / reproduction program 562 and reads various data stored in the memory card 176, thereby performing image processing and image reproduction processing described later. Is realized.

  The control unit 515 can read various data and programs recorded on the optical disk 476 and the memory card 176 via the input / output I / F 517 and execute various controls.

  Hereinafter, the image processing and the image playback processing in the image playback apparatus 500 will be described.

  FIG. 16 is a flowchart illustrating an operation flow of image processing and image playback processing in the image playback device 500. 17 to 23 illustrate screens and images displayed on the display unit 513 in the image processing and image reproduction processing operations.

  Hereinafter, the operation flow of FIG. 16 will be described with reference to FIGS. 17 to 23.

  The operation flow shown in FIG. 16 is realized by the control of the control unit 515. First, when the control unit 515 reads the image processing / reproduction program 562 and the operations of the image processing and the image reproduction processing are started, the process proceeds to step S51 in FIG.

  In step S51, it is determined whether or not RAW image data to be processed has been designated. At this time, a screen (vignetting countermeasure screen) KG for realizing image processing and image reproduction processing for dealing with vignetting is displayed on the display unit 513. Here, the process of step S51 is repeated until image data is designated on the vignetting countermeasure screen KG, and if image data is designated, the process proceeds to step S52.

  FIG. 17 is a schematic diagram illustrating the vignetting countermeasure screen KG. As shown in FIG. 17, the vignetting countermeasure screen KG mainly executes one image process selectively from an area (list display area) A1 in which a list of image file names is displayed and a plurality of image processes. An area (command area) A2 in which displays of commands to be instructed are listed, and an area (image display area) A3 in which an image to be subjected to image processing is displayed are configured.

  For example, when the control unit 515 refers to the data in the memory card 176, the file name of the image file including the RAW image data stored in the memory card 176 is displayed in the list display area A1 as shown in FIG. A list of (here, ML0001.raw,...) Is displayed. Then, the user appropriately operates the operation unit 512 and selects the desired file name by placing the cursor CS1 on the desired file name, so that a desired image file to be subjected to image processing (that is, a plurality of image files displayed on the list) (ie, a desired image file) RAW image data) can be designated. In FIG. 18, only the file name and the shooting date / time are displayed in the list display area A1, but the present invention is not limited to this. For example, the thumbnail image data stored in each image file together with the file name is visible. If output, it becomes easy to specify an image file.

  In step S52, the entire image is displayed in the image display area A3 based on the RAW image data stored in the image file designated when the process in step S51 is repeated. In this entire image, as shown in FIG. 8, the luminance at the end of the entire image in the longitudinal direction (particularly, the four corners of the image) is lowered, and vignetting Kr occurs in the peripheral portion of the image.

  In step S53, it is determined whether there is an instruction to change the RAW image data to be processed. Here, if the image data to be processed is changed by the user appropriately operating the operation unit 512, the process returns to step S52, and the entire image based on the RAW image data after the change instruction is displayed. If there is no instruction to change the RAW image data, the process proceeds to step S54.

  In step S54, it is determined whether or not a command for executing image processing has been designated. Here, if a command is not specified in the command area A2 of the vignetting countermeasure screen KG, the process returns to step S53, and if a command is specified, the process proceeds to step S55.

  In the command area A2, as shown in FIG. 19, the names (namely, normal trimming, circular trimming, enlargement trimming,...) Indicating the names of a plurality of image processes, that is, execution commands are listed. Then, the user can designate the execution of the desired image processing by appropriately operating the operation unit 512 and selecting the desired image processing execution command in accordance with the cursor CS2.

  In step S55, image processing corresponding to the command designated from step S53 to step S54 is executed on the entire image displayed in the image display area A3. At this time, when execution of various trimming processes is designated, the lens information included in the tag information of the image file storing the RAW image data to be processed and the information related to the imaging surface size of the imaging element 116 are included. By referencing, the area of the vignetting Kr and the like are grasped. Then, a trimming process according to the position of the vignetting Kr and the like is executed.

  For example, when normal trimming is designated in the command area A2 shown in FIG. 19, as shown in FIG. 12, a partial image is extracted from a rectangular area Ta near the center of the entire image G1 excluding the vignetting Kr. Thus, a good image G2 having no vignetting Kr as shown in FIG. 13 is acquired.

  When circular trimming is designated in the command area A2 shown in FIG. 19, as shown in FIG. 20, a partial image is extracted from the area CF near the center excluding the vignetting Kr, as shown in FIG. Thus, a good image G3 having no vignetting Kr as shown in FIG. 21 is acquired.

  This image G3 is an image obtained by substantially extracting the entire other region excluding the vignetting Kr portion from the entire image G1, and is an image capturing a wider range than the image G2 (FIG. 13). Yes. Therefore, it is possible to acquire an image capturing a wider range in accordance with the user's intention while excluding the vignetting Kr.

  Further, when enlargement trimming is designated in the command area A2 shown in FIG. 19, as shown in FIG. 22, a partial image is extracted from a rectangular area Tb near the center in the entire image G1. At this time, the four corners of the region Tb include the partial region LB of the vignetting Kr having a low luminance due to the lack of the image circle. Therefore, if the partial image is extracted as it is from the region Tb, the vignetting Kr cannot be completely eliminated.

  However, in the area of the vignetting Kr that is relatively close to the center of the image, the decrease in luminance is relatively small.

  Therefore, in the enlargement trimming process, luminance correction is performed for the partial region LB to compensate for the insufficient luminance. The condition for this brightness correction may be determined from information obtained from the lens information, or may be determined from brightness information of a region not included in the vignetting Kr inside the partial region LB. By such processing, the influence of vignetting Kr can be eliminated, and as a result, a good image G4 from which the influence of vignetting Kr as shown in FIG. 23 is eliminated is acquired.

  This image G4 is obtained by extracting a region including a partial region LB having a relatively small luminance deficit in the vignetting Kr from the entire image G1, and has a wider range than the image G2 (FIG. 13). It is an image that captures. Therefore, it is possible to acquire an image capturing a wider range in accordance with the user's intention while excluding the vignetting Kr.

  In step S56, the image data (image) obtained by the image processing including the trimming process in step S55 is visibly output to the image display area A3, and this operation flow ends.

  As described above, in the image reproduction system 1 according to the embodiment of the present invention, the camera body 101 is mounted with the interchangeable lens designed for the imaging apparatus whose exposure surface is the first size. If it is determined that the first size is smaller than the second size of the exposure surface provided on the image sensor 116 after the mounting, the RAW image data corresponding to the entire image obtained on the exposure surface of the image sensor 116. Is added to the lens information acquired from the interchangeable lens and stored in the memory card 176. Therefore, for example, in an external image reproduction device 500 such as a personal computer, RAW image data and lens information can be read from the memory card 176, and vignetting Kr of the RAW image data can be removed based on the lens information. Therefore, it is possible to cope with vignetting of a captured image that occurs with the change of the interchangeable lens.

  The reason why the irreversible compression processing such as the JPEG method is not performed on the RAW image data is that the pixel value located in the vicinity of the vignetting Kr greatly changes in the compression processing due to the vignetting Kr.

  Further, based on the lens information, a partial image obtained by removing the vignetting portion Kr due to the lack of the image circle of the interchangeable lens from the entire image obtained on the exposure surface of the image sensor 116 is extracted and subjected to irreversible compression processing such as JPEG method. Store in the memory card 176. For this reason, vignetting can be prevented from being included in the captured image stored in the memory card 176.

  In addition, since the mode can be switched between a plurality of storage modes including the RAW mode and the trimming mode, it is possible to cope with vignetting of a captured image that occurs due to the change of the interchangeable lens by a desired method. .

  In addition, since it is possible to set to a combined mode capable of executing both functions of the RAW mode and the trimming mode, it is necessary to separately perform shooting in both the RAW mode and the trimming mode in order to take a desired vignetting countermeasure. There is no. Therefore, it is possible to cope with the vignetting of the captured image that occurs due to the change of the interchangeable lens without complicated operation.

  Further, in the image reproduction device 500, based on the lens information, the entire image based on the RAW image data is subjected to image processing including a desired trimming process, thereby generating a partial image in which the influence of the vignetting portion is eliminated and visible. Can be output automatically. Therefore, it is possible to cope with vignetting of a captured image that occurs with the change of the interchangeable lens.

<Modification>
As mentioned above, although embodiment of this invention was described, this invention is not limited to the thing of the content demonstrated above.

  For example, in the above-described embodiment, when the sizes do not match in the RAW mode, the digital image data obtained from the A / D conversion unit 130 is stored as RAW image data in the memory card 176 with lens information added. However, the present invention is not limited to this. For example, digital image data may be stored in the memory card 176 together with lens information without performing irreversible compression processing.

  Specifically, at least a part of processing included in various digital image processing such as black level correction, WB correction, and γ correction may be performed, or so-called lossless compression processing may be performed. That is, in the RAW mode, if the sizes do not match, the entire image obtained on the exposure surface of the image sensor 116 may be stored in the memory card 176 with the lens information added in a reversible or uncompressed state. good. Even with this configuration, it is possible to obtain the same effects as in the above embodiment.

  In the above embodiment, when the still image shooting mode is set, the RAW mode, the trimming mode, and the combined mode can be set. However, the present invention is not limited to this. For example, the moving image shooting mode is set. Even in the case where it is set, the RAW mode, the trimming mode, and the combined mode may be set.

  In the above embodiment, the image data is stored in the memory card 176 at the time of shooting in the imaging system 100. However, the present invention is not limited to this. For example, the image data is not stored in the memory card 176, such as USB. It may be transmitted to the outside using the communication I / F 177 standardized in the above.

  In the above embodiment, the image sensor 116 is a CCD. However, the image sensor 116 is not limited to this, and may be another image sensor such as a C-MOS sensor.

It is a figure which illustrates the outline | summary of the image reproduction system which concerns on embodiment of this invention. 1 is a front view showing an external configuration of an imaging system according to an embodiment of the present invention. It is a rear view which shows the external appearance structure of the imaging system which concerns on embodiment of this invention. It is a conceptual diagram which shows the cross section seen from the III-III position of FIG. It is a block diagram which shows the function structure of an imaging system. It is a schematic diagram which illustrates the memory content of a memory card. It is a figure for demonstrating mounting | wearing of an inappropriate interchangeable lens. It is a figure which shows the picked-up image acquired when an inappropriate interchangeable lens is mounted | worn. It is a flowchart which shows the switching operation | movement flow of a memory mode. It is a flowchart which shows the operation | movement flow in RAW mode. It is a flowchart which shows the operation | movement flow in trimming mode. It is a figure explaining the trimming process of a picked-up image. It is a figure explaining the trimming process of a picked-up image. It is a flowchart which shows the operation | movement flow in combined mode. It is a block diagram which shows the function structure of an image reproduction apparatus. It is a flowchart which shows the operation | movement flow which concerns on the image processing and image reproduction in an image reproduction apparatus. It is a figure which illustrates the screen which performs the image processing and image reproduction which cope with vignetting. It is a figure which illustrates the list display of an image file. It is a figure which illustrates the command display concerning image processing. It is a figure for demonstrating a special trimming process. It is a figure for demonstrating a special trimming process. It is a figure for demonstrating a special trimming process. It is a figure for demonstrating a special trimming process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image reproduction system 100 Imaging system 101 Camera main body 102 Interchangeable lens 116 Image pick-up element 116f Imaging surface 121 Whole control part 143 Setting button group 176 Memory card 500 Image reproduction apparatus 511 Processing part 512 Operation part 513 Display part 515 Control part 516 Storage part 562 Program G1 Whole image ICa, ICb Image circle Kr Kerare

Claims (4)

An image sensor provided with an exposure surface having a second size;
Information acquisition means for acquiring lens information related to the interchangeable lens from the interchangeable lens after mounting the interchangeable lens designed for the imaging apparatus and having an exposure surface of the first size;
Determination means for determining a size mismatch that the first size is smaller than the second size based on the lens information;
Storage means for storing the entire image obtained on the exposure surface of the image sensor in a reversible compression or non-compression state when the sizes do not match;
An imaging device having
Reading means for reading the entire image in a reversible compression or non-compression state from the storage means ;
A partial image generating means for generating a partial image including a partial region of a vignetting portion due to a lack of an image circle of the interchangeable lens in the entire image;
Luminance correction means for eliminating the influence of the vignetting portion by performing luminance correction that compensates for an insufficient luminance of the vignetting portion in the partial image;
An image output means for outputting the partial image which is luminance correction by the luminance correction means visually
An image reproduction system comprising: a reproduction apparatus having: The storage means is
Add to the whole image and store the lens information,
The reading means is
Read the lens information from the storage means,
The brightness correction means is
The brightness correction is performed using the lens information read by the reading means.
The image reproduction system according to claim 1. The brightness correction means is
The brightness correction is performed based on brightness information of an area inside the vignetting part in the partial image.
The image reproduction system according to claim 1. By being executed by a computer included in the reproduction apparatus, a program that causes a corresponding reproducing apparatus, as a reproduction apparatus according to claim 1.

Images