JP5470164B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus capable of recording and reproducing image data captured by an imaging element in a nonvolatile memory.

  In a conventional digital camera or the like, an imaging device capable of recording captured image data is non-volatile after performing signal processing such as white balance and image quality on the captured raw data (hereinafter referred to as RAW image data). Recorded in memory etc. Therefore, if you want to re-adjust white balance, image quality, etc. of image data that has already been recorded in a non-volatile memory, etc., results that satisfy the user, such as causing image quality degradation even if the image data is captured and processed by a PC, etc. It was not obtained.

  As an improvement measure, before the captured RAW image data is subjected to signal processing, signals such as white balance and image quality are temporarily stored in the frame memory (RAW image storage memory) and read from the frame memory. After processing, the data is written to and read from another frame memory (display image storage memory) again, and the image is displayed on the display unit, so that the user can check the white balance, image quality, etc. There is a configuration in which a satisfactory signal processing parameter and RAW image data can be recorded in a nonvolatile memory as a pair (see, for example, Patent Document 1).

Japanese Patent No. 4126640 (Claim 1, FIG. 1)

  However, as described in Patent Document 1, in an imaging apparatus capable of recording RAW image data and signal processing parameters in pairs in a nonvolatile memory, the RAW image data captured by the imaging element is temporarily stored in a frame memory (RAW Signal processing is performed on the RAW image data stored in the image storage memory and read out from the frame memory, then stored again in another frame memory (display image storage memory), and further read out from the frame memory. Since the processed display image data is transferred to the display unit and displayed on the display device, when recording the RAW image data in the nonvolatile memory, the two frame memories must be processed at different timings, There was a need to generate complex control signals.

  The present invention has been made in view of the above points, and is a delay between an operation of storing RAW image data in a frame memory and an operation of storing display image data obtained by adding signal processing to the RAW image data in another frame memory. Since the time always matches and parallel operation is possible, even when processing to record RAW image data in the nonvolatile memory, processing in both frame memories can be performed at the same control timing. It is an object of the present invention to obtain an imaging device that can simplify the process and improve the efficiency of image recording in a nonvolatile memory.

  An image pickup apparatus according to the present invention includes an image pickup element that converts an incident optical signal into an electric signal, an A / D converter that samples an analog electric signal output from the image pickup element and converts it into RAW image data, A first signal processing unit that performs signal processing on the RAW image data output from the A / D converter and generates display image data to be displayed on a display device, and a delay in the first signal processing unit A delay adjustment unit that performs delay adjustment equivalent to the first frame memory, a first frame memory that stores display image data from the first signal processing unit, and a second frame memory that stores RAW image data from the delay adjustment unit A third memory for storing signal processing parameters used in the first signal processing unit, a display unit for displaying display image data on a display device, and the second frame. A non-volatile memory that records the RAW image data stored in the memory memory and the signal processing parameters stored in the third memory as a pair of data, and a fourth frame that stores the RAW image data read from the non-volatile memory A second image is generated by subjecting the RAW image data read from the fourth frame memory to signal processing according to signal processing parameters stored in the third memory and read from the non-volatile memory and the third memory. Signal processing unit, a fifth frame memory for storing reproduced image data generated by the second signal processing unit, a microcomputer for performing internal control, and an external operation for operating the microcomputer by a user Display image data stored in the first frame memory by the delay adjustment unit. And the RAW image data stored in the second frame memory are adjusted so that the delay time from imaging can be matched, and both processes in the subsequent stage are processed in parallel. A reproduction image is displayed on a display device using RAW image data recorded in a nonvolatile memory and a signal processing parameter recorded as a pair with the RAW image data.

  According to the present invention, the delay time of the operation of storing the RAW image data in the frame memory and the operation of storing the display image data obtained by performing signal processing on the RAW image data in another frame memory always match each other. Since it is operable, even when processing to record RAW image data in a nonvolatile memory, processing in both frame memories can be performed at the same control timing, and control can be simplified. When displaying the RAW image data recorded on the display device as a reproduced image on the display device, the image recording to the non-volatile memory is not only the large-capacity display image data but only the small-capacity RAW image data and the reproduction signal processing parameters. Thus, the image recording efficiency to the nonvolatile memory can be improved.

It is a block diagram which shows the structure of the imaging device which concerns on Embodiment 1 of this invention. It is a flowchart in the case of performing reproduction image display.

Embodiment 1 FIG.
FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to Embodiment 1 of the present invention. The image pickup apparatus shown in FIG. 1 has an image pickup device 1 such as a CCD or CMOS that outputs an analog electric signal according to the amount of incident light, and an analog electric signal input from the image pickup device 1 is converted into digital data (hereinafter referred to as RAW image data). A / D converter 2 to be converted to a first signal processor 3, a first signal processing unit 3 that performs signal processing on the RAW image data from the A / D converter 2 and generates display image data, and an input RAW image A delay adjustment unit 4 that adjusts and adds a delay time equivalent to the delay of the first signal processing unit 3 to the data, and a first frame memory (display image) that stores display image data from the first signal processing unit 3 Storage memory) 5, a second frame memory (RAW image storage memory) 6 for storing RAW image data output from the delay adjustment unit 4, and a signal to the RAW image data by the first signal processing unit 3. place A third memory (signal processing parameter storage memory) 7 for storing signal processing parameters used when performing the operation, and a display unit 8 for displaying image data input from the previous stage on a display device such as an LCD The RAW image data stored in the second frame memory 6 and the signal processing parameters stored in the third memory 7 are read from the nonvolatile memory 9 and a nonvolatile memory 9 for recording a pair. The fourth frame memory (RAW image reproduction memory) 12 for storing the RAW image reproduction data and the RAW image reproduction data read from the fourth frame memory (RAW image reproduction memory) 12 are subjected to signal processing, and the reproduced image A second signal processor 13 for generating data, and a fifth frame memory (reproduced image storage) for storing the generated reproduced image data. Memory) 14, display image switching means 15 for switching the display image data stored in the first frame memory 5 and the reproduction image data stored in the fifth frame memory 14 and outputting them to the display unit 8, An internal control microcomputer 10 that sets signal processing parameters of the first signal processing unit 3 and the second signal processing unit 13 and generates an imaging timing, an image data recording timing, an image reproduction timing, and the like is operated by a user. And an external operation means 11 for giving a control instruction to the microcomputer 10.

  Next, the operation will be described. The imaging element 1 generates and outputs an analog electrical signal according to the amount of incident light. The output analog electric signal is sampled by the A / D converter 2 and converted into RAW image data. The converted RAW image data is input in parallel to both the first signal processing unit 3 and the delay adjustment unit 4 in the subsequent stage. In the first signal processing unit 3, input RAW image data is subjected to signal processing, converted into display image data, and stored in a first frame memory (display image storage memory) 5. The display image data stored in the first frame memory 5 is read again, selected by the display image switching means 15 in the subsequent stage, transmitted to the display unit 8, and displayed on a display device such as an LCD.

  On the other hand, the delay adjusting unit 4 adds a delay equivalent to that of the first signal processing unit 3 to the input RAW image data, and stores it in the second frame memory (RAW image recording memory) 6 at the subsequent stage. The microcomputer 10 generates an internal control signal in response to an instruction from the external operation means 11 operated by the user, performs signal processing parameter setting in the first signal processing unit 3, and stores the signal processing parameter itself in the third memory. (Signal processing parameter storage memory) 7

  Further, when a RAW image data recording instruction is received from the external operation means 11, both the RAW image data stored in the second frame memory 6 and the signal processing parameters stored in the third memory 7 are read out. Is recorded in the nonvolatile memory 9 as a pair of data.

  As described above, the operation of storing the RAW image data in the second frame memory (RAW image storage memory) 6 and the display image data generated by performing signal processing on the RAW image data are displayed in the first frame memory (display). Since the delay time with the operation stored in the image storage memory (5) always matches and the parallel operation is possible, even in the case where the processing to record the RAW image data in the nonvolatile memory 9 is performed, the processing in both frame memories Can be performed at the same control timing, and the control can be simplified.

  When the RAW image data recorded in the non-volatile memory 9 is displayed as a reproduced image on the display device, a fourth frame memory (RAW image reproducing memory) 12 and a second signal processing unit (reproduced image generation) are displayed. ) 13 and a fifth frame memory (reproduced image storage memory) 14, so that image data can be recorded in the non-volatile memory 9 instead of display image data having a large capacity. This can be limited to only RAW image data with a small capacity and playback signal processing parameters, and there is an effect that the efficiency of image recording in the nonvolatile memory 9 can be improved.

  FIG. 2 shows a flowchart in the case of displaying a reproduced image, and the operation in the case of displaying the reproduced image will be described in accordance with the flowchart. When a reproduction image display instruction is received from the external operation means 11 (step S1), the RAW image data recorded in the nonvolatile memory 9 and the signal processing parameters paired with the RAW image data are read out, respectively. It is stored in the fourth frame memory (RAW image reproduction memory) 12 and the third memory 7 (step S2).

  Thereafter, the signal processing parameters stored in the third memory 7 are read by the microcomputer 10 and set in the second signal processing unit 13 (step S3), and the RAW image data read from the fourth frame memory 12 is read. Thus, reproduced image data is generated and stored in the fifth frame memory (reproduced image storage memory) 14 (step S4). The reproduced image data stored in the fifth frame memory 14 is read again and sent to the display image switching means 15 in the subsequent stage, where an output image to the display unit 8 is selected (step S5). Are displayed on a display device such as an LCD (step S6).

  Further, the user evaluates the image quality of the reproduced image displayed on the display device (step S7). As a result, if the user desires to change the signal processing parameter, the user can reproduce the reproduced image data from the operation means 11. A signal processing parameter change instruction is issued (step S8). At this time, the microcomputer 10 changes the signal processing parameter to be set in the second signal processing unit 13 (step S9), and reproduces from the RAW image data read from the fourth frame memory 12 using the changed parameter. Image data is generated (step S3) and stored in the fifth frame memory 14 (step S4). The reproduced image data stored in the fifth frame memory 14 is read again and sent to the display image switching means 15 at the subsequent stage, where an output image to the display unit 8 is selected (step S5). It is transmitted to the display unit 8 at the subsequent stage and displayed on a display device such as an LCD (step S6). The reproduced image display is completed by the above operation flow (step S10).

  As described above, the second signal processing unit (for reproduction image generation) 13 can change the signal processing parameters extracted from the non-volatile memory 9 according to the user's preference. Since the playback image can be generated, the user can arbitrarily change the signal processing parameters while viewing the playback image.

  Further, in accordance with an instruction from the user, the display image switching means 15 switches between display image data captured in real time output from the first frame memory and reproduced image data output from the fifth frame memory. (Step 5), the image data to be output to the display unit is arbitrarily switched and output.

  As described above, the real-time display image stored in the first frame memory (display image storage memory) 5 and the reproduction image stored in the fifth frame memory (reproduction image storage memory) 14 are switched. Since the switching unit 15 is disposed immediately before the display unit 8, the display image captured in real time and the reproduced image recorded in the nonvolatile memory can be switched instantaneously and displayed for comparison at the user's will. There is.

  DESCRIPTION OF SYMBOLS 1 Image pick-up element, 2 A / D converter, 3 1st signal processing part, 4 delay adjustment part, 5 1st frame memory, 6 2nd frame memory, 7 3rd memory, 8 display part, 9 non-volatile 10 memory, 10 microcomputer, 11 external operation means, 12 fourth frame memory, 13 second signal processing unit, 14 fifth frame memory, 15 display image switching means.

Claims (3)

An image sensor that converts an incident optical signal into an electrical signal;
An A / D converter that samples an analog electrical signal output from the image sensor and converts it into RAW image data;
A first signal processing unit for performing signal processing on the RAW image data output from the A / D converter and generating display image data for display on a display device;
A delay adjustment unit that performs a delay adjustment equivalent to the delay in the first signal processing unit;
A first frame memory for storing display image data from the first signal processing unit;
A second frame memory for storing RAW image data from the delay adjustment unit;
A third memory for storing signal processing parameters used in the first signal processing unit;
A display unit for displaying display image data on a display device;
A non-volatile memory that records RAW image data stored in the second frame memory and a signal processing parameter stored in the third memory as a pair of data;
A fourth frame memory for storing RAW image data read from the nonvolatile memory;
Second signal processing for generating reproduced image data by performing signal processing on RAW image data read from the fourth frame memory in accordance with signal processing parameters read from the nonvolatile memory and stored in the third memory And
A fifth frame memory for storing reproduced image data generated by the second signal processing unit;
A microcomputer for internal control,
External operation means for operating the microcomputer by a user, and display image data stored in the first frame memory and raw image data stored in the second frame memory by the delay adjustment unit The delay time from imaging is adjusted so that they can be matched, and both processes in the subsequent stage are processed in parallel. The microcomputer is configured to generate RAW image data recorded in the nonvolatile memory, the RAW image data, An image pickup apparatus that displays a reproduced image on a display device using a pair of signal processing parameters recorded. The imaging device according to claim 1,
The microcomputer changes a signal processing parameter paired with the RAW image data read from the nonvolatile memory and stored in the third memory, and reproduces the reproduced image data in the second signal processing unit. An image pickup apparatus that performs signal processing using the changed parameter when generating. The imaging device according to claim 1 or 2,
A display image switching means for switching between display image data output from the first frame memory and reproduced image data output from the fifth frame memory;
The microcomputer controls display image switching means in accordance with an instruction from a user and performs display switching between display image data and reproduction image data.

Images