JP4533396B2 - Image processing apparatus, image processing method, and storage medium - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and a storage medium for correcting a plurality of image data.

  Conventionally, when a plurality of images are laid out and output in one page, the feature amount of each multi-value image data is acquired and suitable image correction is performed, and should be recorded in advance on the corresponding page The feature amount of all images was acquired, and a suitable image correction parameter was calculated.

  According to the conventional method, for example, when 8 images are laid out and output on one page, it is necessary to analyze all 8 images and calculate parameters before actually starting printing. was there. Therefore, there is a problem that the waiting time until the printing is actually started is long, and the length becomes longer as the number of images laid out on one page increases.

  In order to achieve the above object, the present invention is an image processing apparatus having an image selection function and a printing function, and a selection means for selecting a plurality of images as print targets based on the image selection function; An output means for outputting cooperation data using information for determining the continuation of the selected state and information on the selected image; an input means for inputting the cooperation data output by the output means based on the printing function; When the selection state continues, the image data selected based on the image selection function is recognized by referring to the linkage data, and the number of prints is designated for the image selected by the image selection means. And setting means for creating setting data using information on the number of printed sheets designated by the designation means and a copy of information for determining the continuation of the selected state. If the information for determining the continuation of the selected state in the data matches the information for determining the continuation of the selected state in the setting data, the continuation state is determined. It has the discrimination means which discriminate | determines that it is not, It is characterized by the above-mentioned.

  As described above, if the present invention is applied, the minimum necessary image analysis and parameter calculation are performed before actually starting printing, printing is started, and other image analysis and parameter calculation are performed. By performing it at a necessary timing during printing, it is possible to realize an image processing apparatus and an image processing method that shorten the waiting time until the start of printing, the entire printing time, the waiting time of the image processing unit, and the like.

(First embodiment)
The first embodiment of the present invention will be described below. First, a photo direct (PD) printer to which the present invention can be applied will be described with reference to FIGS.

  FIG. 1 is an external perspective view of a photo direct printer apparatus 1000 according to an embodiment of the present invention. This photo direct printer receives and prints data from a host computer (PC), functions as a normal PC printer, and directly reads and prints image data stored in a storage medium such as a memory card, Alternatively, it has a function of receiving and printing image data from a digital camera.

  In FIG. 1, the main body that forms the outer shell of the photo direct printer 1000 according to the present embodiment includes a lower case 1001, an upper case 1002, an access cover 1003, and an exterior tray 1004. The lower case 1001 forms a substantially lower half of the apparatus 1000, and the upper case 1002 forms a substantially upper half of the main body. A combination of both cases provides a storage space for storing each mechanism described below. A hollow body structure is formed, and openings are formed on the upper surface portion and the front surface portion, respectively. Further, one end of the discharge tray 1004 is rotatably held by the lower case 1001, and an opening formed on the front surface of the lower case 1001 can be opened and closed by the rotation. For this reason, when executing the recording operation, the discharge tray 1004 is rotated to the front side to open the opening, so that the recording sheets can be discharged from here and the discharged recording sheets are sequentially stacked. It has come to be able to do. The paper discharge tray 1004 stores two auxiliary trays 1004a and 1004b. By pulling out the respective trays to the front as needed, the sheet support area can be expanded and reduced in three stages. It has become.

  One end of the access cover 1003 is rotatably held by the upper case 1002 so that an opening formed on the upper surface can be opened and closed. By opening the access cover 1003, the access cover 1003 is accommodated inside the main body. It is possible to replace the recording head cartridge (not shown) or the ink tank (not shown). Although not particularly shown here, when the access cover 1003 is opened and closed, the protrusion formed on the back surface rotates the cover opening and closing lever, and the rotation position of the lever is detected by a micro switch or the like. Thus, the open / closed state of the access cover can be detected.

  A power key 1005 is provided on the upper surface of the upper case 1002 so that it can be pressed. An operation panel 1010 including a liquid crystal display unit 1006 and various key switches is provided on the right side of the upper case 1002. The structure of the operation panel 1010 will be described in detail later with reference to FIG. An automatic feeding unit 1007 automatically feeds the recording sheet into the apparatus main body. Reference numeral 1008 denotes a paper interval selection lever which is used to adjust the interval between the recording head and the recording sheet. Reference numeral 1009 denotes a card slot, into which an adapter capable of mounting a memory card is inserted, through which image data stored in the memory card can be directly captured and printed. Examples of the memory card (PC) include a compact flash (registered trademark) memory, smart media, and a memory stick. Reference numeral 1011 denotes a viewer (liquid crystal display unit) which can be attached to and detached from the main body of the apparatus. When searching for an image to be printed from images stored in a PC card, an image or index image for each frame is displayed. Used to display. Reference numeral 1012 denotes a terminal for connecting a digital camera, which will be described later, and 1013 denotes a USB bus connector for connecting a personal computer (PC).

  FIG. 2 is an external perspective view showing the configuration of the recording head of the photo direct printer 1000 according to the present embodiment. As shown in FIG. 2, the recording head cartridge 1200 in this embodiment has an ink tank 1300 for storing ink and a recording head 1301 for discharging ink supplied from the ink tank 1300 from nozzles in accordance with recording information. The recording head 1301 adopts a so-called cartridge system that is detachably mounted on the carriage 1102. At the time of recording, the recording head cartridge 1200 is reciprocated along the carriage axis, and a color image is recorded on the recording sheet accordingly. In the recording head cartridge 1301 shown here, for example, black, light cyan (LC), light magenta (LM), cyan, magenta, and yellow are independently used as ink tanks in order to enable photographic-tone high-quality color recording. Ink tanks are prepared, and each is detachable from the recording head 1301.

  In the present embodiment, the case where the above-described six colors of ink are used will be described. However, the present invention is not limited to the case where these six colors of ink are used. For example, black, cyan, magenta, and An ink jet printer that performs recording using four colors of yellow ink may be used. In that case, the ink tanks independent of each of the four colors may be detachable from the recording head 1301.

  FIG. 3 is a schematic view of operation panel 1010 according to the present embodiment. In the figure, the liquid crystal display unit 1006 displays menu items for setting various data relating to items printed on the left and right. The displayed items include the first photo number of the range to be printed, the designated frame number (start / designation), the last photo number of the range to be printed (end), the number of copies (number of copies), and the paper ( (Recording sheet) type (paper type), number of photos to be printed on one sheet (layout), print quality specification (quality), whether to print the date of shooting (date printing), photo For specifying whether or not to print the image (image correction), displaying the number of sheets necessary for printing (number of sheets), and the like. These items are selected or designated using the cursor keys 2001. 2002 is a mode key, and each time this key 2002 is pressed, the type of printing (index printing, full-frame printing, single-frame printing, etc.) can be switched, and the corresponding LED of the LED group 2003 is lit accordingly. Is done. A maintenance key 2004 is a key for performing maintenance of the printer such as cleaning of the recording head 1301. Reference numeral 2005 denotes a print start key which is pressed when instructing the start of printing or when establishing maintenance settings. Reference numeral 2006 denotes a print cancel key which is pressed when printing is stopped or when maintenance is instructed.

  With reference to FIG. 4, the configuration of the main part relating to the control of the photo direct printer 1000 according to the present embodiment will be described. In FIG. 4, parts common to the above-mentioned drawings are given the same symbols, and explanations thereof are omitted.

  In FIG. 4, reference numeral 3000 denotes a control unit (control board). Reference numeral 3001 denotes an ASIC (dedicated custom LSI), the configuration of which will be described later in detail with reference to the block diagram of FIG. Reference numeral 3002 denotes a DSP (digital signal processor, for example, DSP-C6211 manufactured by Texas Instruments, USA), which has a CPU therein, and performs various control processes, conversion from luminance signal (RGB) to density signal (CMYK), and scaling. I am in charge of image processing such as gamma conversion and error diffusion. A memory 3003 has a program memory 3003a that stores a control program for the CPU of the DSP 3002, a RAM area that stores a program at the time of execution, and a memory area that functions as a work memory that stores image data and the like. Reference numeral 3004 denotes a printer engine. Here, a printer engine of an ink jet printer that prints a color image using a plurality of color inks is installed. Reference numeral 3005 denotes a USB bus connector as a port for connecting the digital camera 3012. Reference numeral 3006 denotes a connector for connecting the viewer 1011. Reference numeral 3008 denotes a USB bus hub (USB HUB). When the printer apparatus 1000 performs printing based on image data from the PC 3010, the data from the PC 3010 is directly passed through and output to the printer engine 3004 via the USB bus 3021. To do. As a result, the connected PC 3010 can directly perform printing by exchanging data and signals with the printer engine 3004 (functions as a general PC printer). Reference numeral 3009 denotes a power connector which inputs a DC voltage converted from commercial AC by a power source 3013. A PC 3010 is a general personal computer, 3011 is the memory card (PC card) described above, and 3012 is a digital camera.

  Note that the exchange of signals between the control unit 3000 and the printer engine 3004 is performed via the USB bus 3021 or the IEEE 1284 bus 3022 described above.

  FIG. 5 is a block diagram showing the configuration of the ASIC 3001 in FIG. 4. In FIG. 5 as well, portions common to the above-mentioned drawings are given the same symbols, and descriptions thereof are omitted.

  Reference numeral 4001 denotes a PC card interface unit that reads image data stored in the attached PC card 3011 or writes data to the PC card 3011. Reference numeral 4002 denotes an IEEE 1284 interface unit that exchanges data with the printer engine 3004. The IEEE 1284 interface unit is a bus used when printing image data stored in the recording medium of the digital camera 3012 or the PC card 3011. A USB interface unit 4003 exchanges data with the PC 3010. A USB host interface unit 4004 exchanges data with the digital camera 3012. Reference numeral 4005 denotes an operation panel / interface unit which inputs various operation signals from the operation panel 1010 and outputs display data to the display unit 1006. A viewer interface unit 4006 controls display of image data on the viewer 1011. Reference numeral 4007 denotes an interface unit that controls an interface with various switches and LEDs 4009. A CPU interface unit 4008 controls data exchange with the DSP 3002. Reference numeral 4010 denotes an internal bus (ASIC bus) that connects these units.

  FIG. 6 is a functional block diagram showing a functional configuration related to the interface and image processing control of the photo direct printer 1000 according to the present embodiment. In FIG. 6 as well, portions common to the above-mentioned drawings are given the same symbols, and description thereof is omitted.

  Reference numeral 6000 corresponds to a host (image data source) when viewed from the photodirect printer 1000. The host 6000 includes the PC 3010, the digital camera 3012, the PC card 3011, and the host computer described above. A game machine and a television device (not shown) are also included. Such a host 6000 is connected via a wired interface such as a USB bus, IEEE1284, or IEEE1394. In addition, a wireless interface such as Bluetooth may be used.

  The above-described functions of the control board 3000 include a data input / storage processing unit 6001 realized by the ASIC 3001, a printer interface unit 6004 for outputting print data to the printer engine 3004, and a multi-renderer processing 6002 executed by the DSP 3002. , Image processing and process processing 6003 are included.

  First, image data is read from the host 6000 via the IF and first stored in the data input storage unit 6001. The stored data is restored by performing multi-renderer processing by the DSP 3002 and converted into data that can be processed by the image processing / process processing unit 6003. An image processing / process processing unit 6003 performs processing similar to size conversion / color conversion / quantization performed by a printer driver on a normal host PC. Here, in color processing, R′G′B, which is conversion from RGB to R′G′B ′ for correcting a shift between the color space of the original image and the output color space of the printer, and further color conversion to the color material component of the printer. In addition to general color conversion such as “from CMYK and output gamma correction”, image correction processing for appropriately expressing the color of an image photographed with a digital camera is included. Thereafter, print data is sent to the printer engine 3004 via the printer IF 6004. The operation in the printer engine unit is not described in detail here, but various controls such as control of the main body motor and transfer of data to the recording head are performed by a known method to record an image on a recording medium. .

  The above is a schematic description of a photo direct (PD) printer to which the present invention is applied. What is characteristic here is that processing is performed using a DSP (digital signal processor). In general, DSPs are good at product-sum operations. In particular, a high-functional DSP having a large number of arithmetic elements as used in this embodiment can advantageously perform parallel processing such as a plurality of product-sum operations. In particular, in a normal processor, the DSP of the present embodiment is suitable for operations such as color processing and quantization, which are heavy loads during direct printing.

  The controller unit of the PD printer of this embodiment uses a DSP to perform main processing by software processing. However, some of these processing is implemented by hardware, and some processing is software processing and others are hardware processing. Even the controller unit used in processing does not affect the main purpose of the present invention. However, by increasing the number of hardware processes, the expandability and flexibility of adding functions can be reduced compared to software processes compared to software processes. By using a high-function type DSP as in this embodiment, a system that is excellent in high speed, expandability, and flexibility can be realized.

  In particular, in the process of recognizing the problem that has led to the present invention, when such a high-function type DSP is used, other processing such as image processing is performed at a relatively high speed, and therefore takes up the processing time. It became clear that one of the processes with a large ratio is the time for accessing a storage medium such as a PC card. Therefore, when the present invention is applied to a PD printer using a high-function type DSP, it has been recognized that the performance improvement becomes clearer.

  In this embodiment, before starting actual printing, the minimum necessary image analysis and parameter calculation are performed to start printing, and the analysis of other images and parameter calculation are performed at the necessary timing during printing. Thus, an image processing apparatus and an image processing method that can shorten the waiting time until the start of printing will be described.

  FIG. 7 shows a layout example of images and pages to be printed in this embodiment. In the page, there are eight different photos, Photo1 to Photo8, and each of these photos is individually subjected to optimum image correction for the characteristics of each photo image.

  In this embodiment, this image correction uses the method described in Japanese Patent Laid-Open No. 2000-11152. Also, a method described in JP-A-2001-186365 and other methods may be used.

  The above method is a method for acquiring a brightness histogram of an image in advance and correcting the color cast, contrast, and saturation based on the color difference between the highlight point and the shadow point. In this embodiment, all of these are executed. However, at least one of them may be executed. In any case, it is necessary to analyze the image information once and create the image correction parameters before creating the print data of the photographic image.

  FIG. 8 shows the transition of each process and time in the actual photo output of the conventional example. The right part of FIG. 8 shows the processing contents of the image processing part (Image Data Processor) for each time, and the left part of FIG. 8 shows the processing contents of the printing part (Printer) for each time.

The down arrow is the time axis.
T1 to T13 indicate the timing shown below.
T1: Photo 1 to 8 image analysis and correction parameter calculation start T2: Photo 1 to 8 image analysis and correction parameter calculation end T3: Image data processor instructs paper feed & Printer paper feed start T4: Photo 1-2 image Print data creation & actual printing start (Printer paper feed end)
T5: Photo print data creation of Photo 1-2 is completed T6: Photo print data creation of Photo 3-4 and actual printing start (photo printing 1-2 actual printing end)
T7: Creation of image print data for Photo 3 to 4 T8: Creation of image print data for Photo 5 to 6 and start of actual printing (end of actual printing of Photo 3 to 4)
T9: Creation of image print data for Photo 5 to 6 is completed. T10: Creation of image print data for Photo 7 to 8 and start of actual printing (end of actual printing of Photo 5 to 6).
T11: Photo 7 to 8 image print data creation end T12: Photo 7 to 8 actual print end T13: Printer-side paper discharge FIG. 8 shows the print data creation speed in the image processing unit compared to the actual print speed of the print unit An example of a relatively fast case is shown. Therefore, during T5 to T6, T7 to T8, and T9 to T10, the image processing unit waits for the printing unit to finish the actual printing at these three timings.

  FIG. 9 shows the transition of each process and time in actual photo output of the present invention. The right part of FIG. 9 shows the processing contents for each time of the image processing portion (Image Data Processor), and the left part of FIG. 9 shows the processing contents for each time of the printing part (Printer).

  As an outline, the correction unit corrects a plurality of images arranged in the main scanning direction according to the determination of the correction amount for the image data arranged in the main scanning direction, and prints the image data corrected by the correcting unit. Outputting to the device.

  In other words, if the short side in FIG. 7 is the main scanning direction, the correction processing and output to the printing apparatus are started for these two images from the point in time when the correction amounts for the two photos 1 and 2 are obtained. . Then, while the printing apparatus is printing these two sheets, the DSP starts analysis of Photo3 and Photo4 to be output next.

  This process is effective for a printing apparatus that outputs an image dot-sequentially.

Hereinafter, while the printing apparatus is printing the image data output by the output unit, the correction amount determination unit starts a process for determining a correction amount for an image to be output next. .
T1 to T13 indicate the timing shown below.
T1: Photo 1-2 image analysis and correction parameter calculation start T3: Image Data Processor instructs paper feed & Printer paper feed start T4: Photo 1-2 image analysis and correction parameter calculation end &
Photo 1-2 data print data creation & actual printing start (Printer paper feed end)
T5: Photo print data creation for Photo 1-2 completed
Photo 3-4 image analysis and correction parameter calculation start T6: Photo 3-4 image analysis and correction parameter calculation end &
Photo 3-4 image print data creation & actual printing start (Photo 1-2 actual printing end)
T7: Photo 3 to 4 image print data creation complete &
Photo 5-6 image analysis and correction parameter calculation start T8: Photo 5-6 image analysis and correction parameter calculation end &
Photo 5-6 image print data creation and actual print start (Photo 3-4 actual print end)
T9: Photo 5 to 6 image print data creation end Photo 7 to 8 image analysis and correction parameter calculation start T10: Photo 7 to 8 image analysis and correction parameter calculation end Photo 7 to 8 image print data creation & actual printing Start (photo printing ends for Photo 5-6)
T11: Photo print data creation end of Photo 7 to 8 T12: Actual print end of Photo 7 to 8 T13: Print on the printer side FIG. 9 is compared with FIG. 8 between T5 and T6, between T7 and T8, and between T9 and T9. During T10, the analysis of the photographic image and the creation of the correction parameters that are continued at these three timings are performed, so the time that the image processing unit waits for the end of the actual printing of the printing unit is shortened accordingly.

In FIG. 9, ideally,
Analysis & correction parameter calculation time = (actual printing time-print data creation time)
However, for example, the analysis & correction parameter calculation time> (actual printing time−print data creation time)
Or
Analysis & correction parameter calculation time <(actual printing time-print data creation time)
In this case, the time that the image processing unit waits for the end of the actual printing of the printing unit is shortened by the shorter time of the right side and the left side of the above formula.

  Further, when a high-speed processing element such as the DSP described above is applied to the present invention, the time of T1 to T2 in FIG. 8 is shortened, so that the effect of the present invention is likely to be reduced. And the effect will be greater. The reason will be described below.

In the actual usage mode, the analysis & correction parameter calculation time (a) is actually (a) = image file access time + actual analysis & correction parameter calculation time. The file access time is more than the processing speed of the CPU. More determined from restrictions on file control hardware. For example, in the case of an image file stored on a card medium such as Compact Flash (CF), the processing speed of the CF card controller, the standard of the CF card, etc. define the upper limit of the actual processing speed.

Therefore, the more real image processing can be performed using a DSP for a photo direct printer,
(A) ≒ approaching the image file access time.

Therefore, the time (b) that can be actually shortened by the present invention is:
(B) = min ((a), (actual printing time−print data creation time))
If the processing is performed at a higher speed, the print data creation time is shortened and (actual print time-print data creation time) is increased, so that the effect is further increased.

  In addition, the present invention is applied to a system in which the print data creation speed in the image processing unit is relatively slow compared to the actual printing speed of the print unit and the printing unit side is waiting for the processing of the image processing unit. The effect of shortening the overall printing time is not obtained. However, the time T1 to T3 until the paper feeding is very short as is clear when FIG. 8 and FIG. 9 are compared. This is more effective because the slower the image processing speed, the longer the shortening time.

  Another effect is that the image correction parameters that need to be held at the same time are juxtaposed in the horizontal direction, and only the number of images that need to be printed at the same time is required. For example, in the case of the 8-sheet layout of FIG. 8, only the correction parameters for two sheets need to be held at the same time, which is ¼ that of the conventional eight-sheet layout.

  In the present embodiment, the description has been given of the case where eight photographs are printed on one page. However, the present invention can be applied to the two-sheet layout shown in FIG. Needless to say.

  Further, the photo direct printer has been described as an example, but the same thing may be performed on a printer driver operating on a PC or using other image processing means.

  In addition, although processing using a DSP has been described as an example, it may be realized using another processor, ASIC, or the like.

  The present invention can be applied to a system composed of a plurality of devices (for example, a host computer, interface device, reader, printer, etc.) or to an apparatus composed of a single device (for example, a copying machine, a facsimile machine). May be.

  In addition, program code of software for realizing the functions of the embodiment is supplied to an apparatus or a computer in the system connected to the various devices so as to operate the various devices so as to realize the functions of the above-described embodiments. However, the present invention is also included in the scope of the present invention in which a computer (CPU or MPU) of the system or apparatus is operated by operating the various devices according to a stored program.

  In this case, the program code of the software itself realizes the functions of the above-described embodiments, and the program code itself and means for supplying the program code to the computer, for example, a memory storing the program code The medium constitutes the present invention.

  As a storage medium for storing the program code, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  Further, when the computer executes the supplied program code, not only the functions of the above-described embodiments are realized, but also the OS (operating system) or other application in which the program code is running on the computer. It goes without saying that such program code is also included in the embodiment of the present invention even when the functions of the above-described embodiment are realized in cooperation with software or the like.

  Further, the supplied program code is stored in the memory provided in the function expansion board of the computer or the function expansion unit connected to the computer, and then the CPU provided in the function expansion board or function storage unit based on the instruction of the program code However, it is needless to say that the present invention also includes a case where the function of the above-described embodiment is realized by performing part or all of the actual processing.

It is a general-view perspective view of a photo direct printer device. FIG. 2 is an overview perspective view illustrating a configuration of a recording head. It is a general-view figure of an operation panel. It is a figure explaining the structure of the principal part which concerns on control of a photo direct printer apparatus. It is a block diagram which shows the structure of ASIC. FIG. 3 is a functional block diagram illustrating a functional configuration related to an interface and image processing control of a photo direct printer device. It is a figure which shows the output image and layout example of 1st Embodiment. It is a figure which shows the relationship between each process of an image processing part and a printing part of a prior art example, and time. It is a figure which shows the relationship between each process of an image processing part of this invention, and a printing part, and time. It is a figure which shows the other example of the output image and layout of 1st Embodiment.

Claims (5)

In order to determine individual correction amounts for a plurality of image data that are laid out and printed on one sheet of paper, at least the brightness histogram of the image data or the color difference between the highlight point and the shadow point An analysis means for analyzing each data,
Correction amount determination means for determining individual correction amounts for a plurality of image data based on the analysis result of the analysis means;
Correction means for correcting the image based on the individual correction amount;
Control means for causing the printing apparatus to print the image corrected by the correction means;
With
For each number of images juxtaposed in the main scanning direction of the recording head of the printing apparatus on a sheet of paper, the analysis means includes one sheet while the image corrected by the correction means is being printed by the printing apparatus. Of the plurality of images printed on the paper, the number of images juxtaposed in the main scanning direction, the number of images to be laid out after the image being printed, is analyzed, and the correction amount determining means An image processing apparatus for performing a process for determining a correction amount based on an analysis result of the analysis means .   The image processing apparatus according to claim 1, wherein the printing apparatus is an ink jet printer that prints an image dot-sequentially. In order to determine individual correction amounts for a plurality of image data that are laid out and printed on one sheet of paper, at least the brightness histogram of the image data or the color difference between the highlight point and the shadow point An analysis process for analyzing each data,
A correction amount determination step for determining individual correction amounts for a plurality of image data based on the analysis result of the analysis means ;
A correction step of correcting the image based on the individual correction amount;
A control step of causing the printing apparatus to print the image corrected by the correcting means;
With
For each number of images juxtaposed in the main scanning direction of the recording head of the printing apparatus on the paper, the analysis process includes one sheet while the image corrected in the correction process is printed by the printing apparatus. Of the plurality of images printed on the paper, the number of images juxtaposed in the main scanning direction, the number of images to be laid out after the image being printed is analyzed, and the correction amount determining step includes An image processing method comprising performing a process for determining a correction amount based on an analysis result of the analysis step . The image processing method according to claim 3 , wherein the printing apparatus is an ink jet printer that prints an image dot-sequentially. A storage medium storing a program for executing the image processing method according to claim 3 on a computer.

Images