JPH0682392B2 - Image processing method - Google Patents

Description

Description: BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing method for inputting an original image and converting the input image into a pictorial image.

<Prior Art> Conventionally, as one of the image processing methods of this type, an electronic plate making technology in the printing industry and a professional lab technology applying computer photographic image processing in the photo lab industry are known.

For example, when a reproduced image is obtained by photoelectric scanning with a high-precision scanner such as a layout scanner or a laser color printer on the image original, a signal processing unit is provided in the middle of the process to correct the density expression (γ correction) for the input density signal. , Gradation setting,
The following effects are obtained by performing processing such as color correction and clipping synthesis.

 Restoration of fading color film.

Adjust the gradation of highlights and shades to exaggerate the color expression.

 Relief of equipment failure, shooting error, development error, etc.

Expressing creative images, expanding the image area, and creating new designs.

When performing such special processing, a digital image such as a density signal or a luminance signal of the film original obtained by photoelectrically scanning the film original with a high-precision scanner of a color scanner or a color image pickup tube, a color image pickup plate (for example, CCD), etc. Processing the signal.

To obtain a pictorial image from the input image data, R, G,
It is necessary to input B data and convert it to data having a smaller number of gradations than the input gradation number. This is because the number of paints is limited.

However, if the R, G, and B data values become equal due to the conversion of the number of gradations, the image may be output as an achromatic color.

Generally, since there are almost no achromatic parts in paintings, R,
Since the G and B data are the same, there is a drawback that painting-like color reproduction cannot be performed if an achromatic portion occurs.

<Purpose> The present invention has been made in view of the above-described drawbacks of the prior art. When converting an input image into a pictorial image, the R, G, B data become equal due to the gradation number conversion of the data, and an achromatic color is obtained. It is an object of the present invention to provide an image processing method that makes it possible to reproduce a painterly color by making B data larger than R and G data when a part occurs.

<Example> Specifically, the processing method to be proposed in this example is image processing for converting a natural image into a painting style of a pointillistic touch drawn by a neo-impressionist painter typified by Seurer in France. The characteristic of the new impressionist pointillism painting is that you do not mix the paints on the pallet and draw the dots on the canvas with the primary colors.When you need a color mixture, line up those colors, and when you need a dark color, you can add a complementary color. By arranging the colors, the colors appear mixed or dark on the human retina when viewed at a distance.

In the present embodiment, the above-described advanced painting technique is easily performed by image processing, and thus a person who does not have the ability to draw a painting can easily obtain a neo-impressionist painting.

An embodiment of the present invention will be described in detail below with reference to the drawings.

FIG. 1 is a block diagram of an apparatus used in an image processing method according to an embodiment of the present invention.

Reference numeral 1 is an image input device such as a TV camera or a drum scanner, and if a natural image such as a photographic film or a print is set, it is sampled and A / D converted to form a digital image. This digital image is processed by the central processing unit 2
Is sent to the image memory 3 via. This image memory 3
The original image, the processed image, and the image for the work necessary during the processing are stored in the. 4 is a command input device such as a keyboard or a digitizer for inputting image processing commands. In the case of a keyboard, a desired processing command is tapped to input a key, and in the case of a digitizer, it is drawn on the upper surface of the digitizer. Hold the stylus pen on the desired command from the menu and press it, or if the menu is displayed on the monitor TV5 described later, select the cursor displayed on the monitor TV5 according to the position of the stylus pen. Move it over the menu and press the stylus pen at that position. 5 is a monitor TV
Image of the image memory 3 (original image, processed image,
A work image) or an image processing menu input from the command input device 4 can be displayed as necessary.
The central processing unit 2 controls various devices and reads color information from the original image data in response to an instructed processing command to create a processed image. As a result, the processed image created is sent to the output device 6 such as a printer or a film recorder to output the processing result.

By the way, when painters paint a picture, if all three primary colors are mixed, it will become a muddy dark gray color, so Impressionist painters prepare only a few kinds of paint on the palette and use it directly or Mix white,
Carry a paintbrush on the canvas with a saturated color.

Then, a small primary color point was juxtaposed on the canvas, and when viewed from a certain distance, it was perceived as "mixed color" on the retina. Regarding the depiction of dark areas, instead of drawing with dark paint, a method of expressing that it is a dark area by arranging a color close to the above-mentioned primary color or saturated color and a complementary color thereof is used. It was

As is clear from this, each brush touch on the canvas has a color that is relatively close to the primary color, and thus painting-like color reproduction is realized in the painting processing in the conventional computer image processing. Not not. Furthermore, the brush strokes of paintings are not uniform, and are often drawn by brush strokes that have directionality along the edge lines of the image.

Therefore, in the present embodiment, (1) "direction extraction processing" for extracting the directionality of the original image and creating directionality image data (2) "painting-like color reproduction processing" for performing painterly color reproduction (3) Using the directional image data of (1), "directional random mosaic processing" that imparts directionality to the touch of the brush (4) consists of "dark complementary color mosaic processing" that reproduces dark areas with complementary colors, (1), By performing the processing in the order of (2), (3), and (4), the painting processing that compensates for the above-mentioned conventional defects is realized.

Hereinafter, processing examples will be described step by step.

(1) Directionality Extraction Process Generally, the brush strokes of a painting are not uniform, and are often drawn by brush strokes having a directionality along the edge line of an image. Therefore, in order to carry out the brush touch processing with directionality, it is necessary to first extract the directionality of the original image. Therefore, in this embodiment, first, the difference processing is performed on the original image,
The directionality of edges is extracted, direction image data is created in advance, and this direction image data is used when performing mosaic processing to generate a mosaic pattern with directionality to realize a mosaic image expressing brush strokes. did.

The outline of the directionality extraction process will be described with reference to FIGS.

Explanation of step 1) The input original image is a color image, but it is not necessarily a color image in order to extract the directionality. Therefore, the input color image is converted into a monochrome image.

Explanation of step 2) The black-and-white image created in step 1 is subjected to a difference process with a window size m × n to create direction image data.

Next, the black-and-white image creating process of step 1 and the direction image data creating process of step 2 will be described in detail.

-Black and White Image Creating Process- The black and white image creating process will be described with reference to FIGS.

Explanation of step 11) Original image data is stored in memory -X (x
a, ya, za). Here, Za = 1 = R, Za = 2 = G, Z
a = 3 = B, respectively indicating a red component image, a green component image, and a blue component image.

Explanation of step 12) Black-and-white image data memory Xw to be output
Set 1 to initialize the line counter Y of (xa, ya).

Explanation of step 13) 1 is set to initialize the column counter x of the black and white image data memory.

Explanation of step 14) The red, green and blue components of the original image data are input from the memory X (xa, ya, za) and averaged as shown in the following equation to calculate black and white image data.

W = {X (x, y, 1) + X (x, y, 2) + X (x, y, 3)} 13 Explanation of step 15) The black-and-white image data w calculated in step 14 is converted into the black-and-white image memory Xw (xa, ya).

Description of steps 16 and 17) The column counter x is counted up, and steps 14, 15, and 16 are repeated until the column size becomes larger than the column size xa of the original image.

Description of steps 18 and 19) The line counter y is counted up, and steps 13, 14, 15, 16, 17, and 18 are repeated until the line size becomes larger than the line size ya of the original image. As a result, monochrome image data is created.

—Direction Data Image Creation Process— The concept of the direction data image creation process will be described with reference to FIGS. 2-1 and 2-2.

Black and white image Xw output by the black and white image creation process
The axb window is scanned with respect to (xa, ya), the difference processing within the window (for example, 5x5) is performed, and the direction is detected. Figure 2-1 shows the difference processing in the window and the directionality detected at that time. Right 45
Detection in 4 directions: ° direction (maximum difference in 0 direction), horizontal direction (maximum difference in 1 direction), left 45 ° direction (maximum difference in 2 directions), vertical direction (maximum difference in 3 directions). Is possible.
As an example, a state of detecting the directionality of a picture as shown in Fig. 2-2 is shown.

When the difference processing in the 5 × 5 window shown in FIG. 2-2 is performed, the difference value in the direction of 0 is the largest, so the directionality of the center pixel of the window is detected as 45 ° to the right, and 0 is used as the direction data. Is output.

Next, the processing contents of the direction data image creation processing will be described based on FIG. 2-5.

Explanation of step21) Line counter y of the black and white image data memory Xw (xa, ya) output by the black and white image creation processing
To initialize To set.

Explanation of step22) To initialize the column counter x of the above memory To set.

Explanation of step 23) Differences in four directions within the window size a × b are calculated by the following formula.

Explanation of step 24) The maximum value IDmax of the absolute values of the difference values obtained from step 23 to is obtained.

Explanation of step25) Direction data is the direction data image memory XD
Output to (x, y), but 1) If the maximum absolute value of the difference value is, output 0 to the direction data image memory XD,
2) 1 is output when the maximum value is, 3) 2 is output when the maximum value is, and 4) 3 is output when the maximum value is.

Explanation of steps 26 and 27) Count up the column counter x and the counter will Repeat steps 23, 24, 25 and 26 until it becomes larger. The value of the counter stop is This is because the image is scanned in the axb window.

Explanation of steps 28 and 29) Count up the column counter y, and the counter Repeat steps 22,23,24,25,26,27,28 until it becomes larger. Thereby, the directivity at each pixel position of the original image is determined.

(2) Painting-like color reproduction processing As mentioned before, each brush touch on the canvas has a color that is relatively close to the primary color, but this was implemented to achieve painterly color reproduction. In the example, the R, G, B data used is limited, and the limited R, G, B data is used to represent the original image data as accurately as possible.

The painting-style color reproduction processing will be described with reference to FIGS. 3-1 to 3-2 and 3-3. Figure 3-1 is a schematic flow chart of this process.

Explanation of step31) Original image data is stored in memory X (xa, y
a, za). Here, Z ₁ = R, Z ₂ = G, Z ₃ = B, and the red component image, the green component image, and the blue component image are shown in order.

Explanation of step32) Determine the number of colors to use.

Here, the operator inputs the number of colors i using an external input device such as a keyboard. For example, if i is input as 3, R, G,
Each B has 3 colors, and there are 27 combinations of R, G, and B. However, if the number of colors i is increased too much, the color reproduction gradually approaches the original color, so i is preferably 3 to 4. Then, according to the selected value of i, R (l), R (i), G (l), G
The values of (i), B (l), and B (i) are read out, and the 3 × i color is determined. In addition, the color values in the file prepared here are selected so as to be a color close to the primary color or the saturated color in order to take advantage of the features of the usage of the neo-impressionist color.

Explanation of step 33) Color separation image output pixel block size m, n by an operator using an external input device such as a keyboard
Enter. For example, if m = 3 and n = 3 are input, one pixel of the original image is output as a 3 × 3 pixel block by the color separation processing of step 36.

Explanation of step 34) 1 is substituted into the line counter y of the memory X (xa, ya, za).

Explanation of step 35) 1 is substituted into the column counter x of the memory X (xa, ya, za).

Explanation of step 36) This is a process for expressing the original image data by the number of colors limited in step 12, and the details will be described later.

(Explanation of step37) If the pixel block data output in step36 is output as it is, the pixel block unit becomes conspicuous. Therefore, by making the arrangement within the pixel block unit random, the conspicuousness for each pixel block unit is reduced. The details of this process will be described later.

Description of step 38) Count up the column counter x.

Explanation of step39) Until the column counter becomes larger than xa
Repeat steps 6, 7, and 8.

Explanation of step 40) The line counter y is counted up.

Explanation of step 41) Steps 6, 7, 8, 9, and 10 are repeated until the line counter y becomes larger than ya.

Next, the principle of color separation processing will be described.

The color separation process is a process to reproduce the data of the original image as accurately as possible with a limited number of colors, and to represent one pixel of the original image by using a limited number of pixels. is there. For example, a case where one pixel of the original image is output with 2 × 2 pixels at the time of color separation processing will be described.

R = G of original image data
(X, y, 1) = 70, X = (x, y, 2) = 140, X = (x, y, 3) = 180
(The following is written as (70,140,180)), and the number of colors i = 3
(50,100,200).

Table 1 shows a case where the data of one pixel of X = (70,140,180) is processed by 2 × 2 pixels with the color number i = 3.

In the calculation contents in Table 1, the first pixel of the output data is the color number data closest to the original image data (70,140,180) is (50,100,200), so this value is determined. Here, the error amount with the original image data is +20 for R, -40 for G, and +20 for B. Therefore, when obtaining the next output, this error amount is taken into consideration. That is, since R is 20 short, 20 is added to 70 of R of the original image data, and the color number data closest to this value is extracted. Similar processing is performed for G and B. Then, this calculation is repeated for 2 × 2 pixels.

The data thus output will be referred to as color-separated image data, but since one pixel of the original image is output to 2 × 2 pixels, the output image size is also doubled × 2 times. If one pixel of the original image is output by one pixel during color separation processing, the output error of the output image data with respect to the original image data is as shown in Table 2. Is. However, if 2 × 2 pixels are processed during color separation processing, the output error of the original image data will also be increased if one pixel is expanded to 2 × 2 pixels. So it is much smaller than the former. That is, by making the output image larger than the original image at the time of color separation processing, the original image can be expressed with a relatively small number of errors even with a limited number of colors.

Next, the color separation process will be described with reference to the flow chart of FIG. 3-2.

Explanation of step61) Original image data cumulative value counter Rs
um, Gsum, Bsum, output data cumulative value counter Rout, Gout, Bo
Clear ut.

Explanation of step 62) 1 is assigned to the output pixel block line sy.

Explanation of step63) 1 for output pixel block column counter sx
Is substituted.

Explanation of step64) The first loop jumps to step67.

Explanation of steps 65 and 66) Obtain the cumulative value of the original image data and the output data.

Explanation of step 67) The error amount between the original image data up to the previous pixel (pixel) and the output data is calculated, and this error amount and the original image data are added to obtain the target value for determining the output data.

Explanation of step68) The color number data closest to the target value is R, G,
Obtain in the order of B and use as output data.

(Explanation of step69) If the R, G, and B data of the data output in step68 are the same, they are output as achromatic colors.
However, in general, when you look at how to use colors in paintings, there are almost no achromatic parts, and especially dot painting is the most
It is common to express achromatic parts in paintings using dark blue enugu. Therefore, when the output data of step 68 is judged to be achromatic in order to make it more like a painting, achromatic expression is performed by slightly strengthening the blue component.

Explanation of step 610) The color separated image data output by the above method is output to the color separated image sub-memory mX (sx, sy, z).

Description of steps 611 and 612) Count up the output pixel block column counter until the counter becomes larger than m.
Repeat steps 64,65,66,67,68,69,610,611.

Explanation of steps 613 and 614) Count up the output pixel block line, and repeat steps 64 and 6 until the counter becomes larger than n.
Repeat 5,66,67,68,69,610,611,612,613.

Next, the random coordinate conversion process of step 37 in FIG. 3-1 will be described with reference to FIG. 3-3.

In the painting-like color reproduction processing, since the output is output in m × n pixel units, if it is output as it is, the pixel block units become conspicuous. Therefore, it is necessary to randomize the arrangement within the block units for each pixel block unit. .

Explanation of steps 71 and 72) Output pixel block line counter,
Substitute 1 for the column counters sy and sx.

Explanation of step73) Random numbers are generated to obtain random coordinates (IX, IY) in the color separation image sub-memory. In this case, control is performed by the following equation so that IX and IY fall within the range of the output pixel block size m × n.

Xadress = INT (RAN (1) ・ m ・ n) +1 IX = MOD (Xadress, m) +1 IY = INT (Xadress / n) +1 explanation of step74) Same when calculating random coordinates of color separation image sub-memory Since random coordinates may be calculated, when random coordinates having the same value are calculated, random numbers are generated until different random coordinates are output.

Explanation of step75) When the output pixel block size m, n is larger than 1, one pixel of the original image is output to m × n pixels, so the address of the original image data memory X and the output image memory Xout are 1 Does not correspond to one-to-one. Therefore, here, the address of the output image memory Xout is obtained by the calculation of the following equation, and the value of the color separation image sub-memory of the random coordinates (IX, IY) calculated in steps 73 and 74 is input.

JX = m (x-1) + sx JY = n (y-1) + sy where JX is the output image memory column address JY is the output image memory line address Explanation of step76,77) Output image block Column counter is counted up and the column Until the counter becomes larger than the column size m of the output pixel block step73,74,75,76
Repeat.

(Explanation of steps 78, 79) The output image block line counter is counted up, and steps 72, 73, 74, 75, until the line counter becomes larger than the line size n of the output pixel block.
Repeat 76, 77, 78.

(3) Directional Random Mosaic Processing Directional random mosaic processing will be described with reference to FIGS. 4-1, 4-2, and 4-3.

Explanation of step 81) The color separated image data created by the painting-style color reproduction processing is stored in the memory Xout (JX, JY, JZ). However, JZ = 1 indicates red component image data, JZ = 2 indicates green component image data, and JZ = 3 indicates blue component image data. still,
Original image data X in memory Xout (JX, JY, JZ)
Data obtained by processing (xa, ya, za) is stored. For example, when processing is performed with 1 pixel 3 × 3, Xout stores 9 times the data of X.

Description of step 82) The direction image data created by the directionality extraction processing is stored in the memory X _D (xa, ya).

Explanation of step 83) Here, the parameters necessary for the calculation are set. A mosaic pattern type number and its pixel block sizes m ', n'stored in the parameter memory in advance are input. As an example, FIG. 4-2 shows pixel blocks in each direction in which the pixel block sizes m ′ and n ′ are 5 × 5 in which the mosaic pattern has a relatively elliptical shape. still,
FIG. 4-2 shows a mosaic pattern in which 9 pixels in the block size of 5 × 5 are 1, but the number is not limited to this. Further, enter the area ratio of the mosaic occupied on the screen. For example, if the operator wants to set this area ratio to 80%, he or she inputs 80 by key input on a keyboard or the like, and the number of times of occurrence of mosaic pixel block is determined by the following equation.

NSTOP = (JX / m ′) × (JY / n ′) × p / 100 where JX, JY: color separation image size m ′, n ′: mosaic image block size p: key input area ratio (%) NSTOP: mosaic Number of pixel block occurrences step84) 1 for mosaic pixel block occurrence counter
Is substituted.

Explanation of step85) Generate a random number and find the center value (x _R , y _R ) when the mosaics are superimposed. In this case, the range of random numbers is set so that the values of x _R and y _R fall within the area of the image. In this embodiment, x _R ≤JX and y _R ≤JY.

Explanation of step86) The memory address of the directional image data corresponding to the center value (xr, yr) at the time of overlapping the mosaics calculated in step85 is calculated. In the painting-like color reproduction processing, one pixel of the original image is output for each m × n block unit. Of course, when m = 1 and n = 1, the original image and the color-separated image have a one-to-one correspondence, and therefore the direction image data also have a one-to-one correspondence. However, when m> 1 and n> 1, the color separation image is enlarged and output, so there is no one-to-one correspondence with the direction image data. Therefore, the center value (x _R , y _R ) is calculated by the following equation.
The directional image data memory address ix, iy corresponding to is calculated.

ix ＝ x _R / m, iy ＝ y _R / n Explanation of step87) Direction image data X _D (ix, iy) of address ix, iy obtained in step 86 is set to the center value (x _R , y _R ) of the mosaic. Use as direction data.

Explanation of step 88) The mosaic pixel pattern corresponding to the direction data is obtained from the parameter memory. Figure 4-2 shows the direction data and mosaic pixel pattern.

Explanation of step 89) Output mosaic pixel data is obtained from the mosaic pixel pattern and the color separated image data and is output to the color separated image data memory. This will be described with reference to FIG. 4-3.

FIG. 4-3 shows the case where the direction data is 0, and the mosaic image pattern corresponding to the direction data 0 is a 5 × 5 mosaic pixel pattern inclined to the right 45 ° as shown in FIG. Here, at 1 in the pixel pattern, color separation image data of coordinates (x _R , y _R ) is substituted by performing calculation, and the data is rewritten, and at 0, the original image value is maintained.

Explanation of step 810) Count up the mosaic pixel block generation counter.

Description of step 811) If the processing has been performed for the number of times of occurrence of mosaic pixels, the directional random mosaic processing is ended.

(4) Dark Part Complementary Color Mosaic Process Next, the dark part complementary color mosaic process will be described with reference to the float charts of FIGS. 4-4 and 4-5.

In this flow chart, steps having the same processing contents as those of the flow chart of FIG. 4-1 of the above-described direction-oriented random mosaic processing are given the same step numbers and only different processing contents will be described.

(Explanation of step 82 ′) Because brightness information is required to judge dark areas,
Monochrome black and white image data shown in 2-4 FIG image memory X _W
Enter in (xa, ya).

(Explanation of step 83 ') In this step, parameters are set. The first parameter required here is a threshold level DP for determining whether or not it is a dark part, and this is input from a command input device such as a keyboard. As the value to be input here, the lightness may be directly input, or a method of calculating the lightness to be determined from the histogram of the image by inputting the ratio to be determined as the dark part of the entire image may be used. Next, another parameter required here is the number of dark mosaics NSTOP ', which can also be input directly from a command input device such as a keyboard, or as shown in FIG. Ratio to the number of mosaic pixel occurrences NSTOP obtained in step 3 of the flow (eg 30%
Or 50%) can be entered.

(Explanation of step86 ′) It is determined whether the brightness X _W (ix, iy) of the random coordinates created in step 85 is brighter or darker than the dark part threshold level DP, that is, smaller or larger than DP. , Random generation is repeated until a dark area is selected.

(Description of step 88 ') In order to perform mosaic processing with complementary colors, the complementary color of the color of the current color-separated image data having the coordinate value (x _R , y _R ) is obtained. The processing flow for obtaining complementary colors is shown in FIG. 4-5. First, R, G, B colors are once converted into H, L, S (hue / brightness / saturation) (step 813), Next, the hue is inverted by 180 ° (step 814), and the inverted H, L, and S are converted again into R, G, and B (step 815) to obtain the value. In addition, the process of converting from R, G, B to H / L / S, and H / L
The method of converting from S to R, G, B can be obtained by a known matrix calculation. Although the complementary color of the color-separated image data after the direction random mosaic processing is obtained here, the complementary color may be obtained using the original color-separated image data created in FIG. 3-2.

(Explanation of step 89 ') Using the complementary color obtained in step 88',
Random mosaic processing with direction is performed. Except that the color used is a complementary color, the processing contents are the same as step 89 in FIG. 4-1.

(Explanation of step 811 ') Follow steps 85 to 810
Repeat NSTOP ′ times.

By this process, the random mosaic process with direction is performed, and the dots of the complementary color are imprinted only on the dark part, thereby completing the painting of the stippled Tachi that is faithful to the idea of the neo-impressionist.

The above description is the processing flow when the conversion processing is performed using the image processing apparatus of the type that performs sequential processing. Next, regarding the processing procedure when the image processing apparatus having the parallel processing capability is used explain.

First, the processing procedure when the directionality extraction processing is performed by the image processing apparatus having the capability of parallel processing is shown in FIG.
A description will be given based on the flow chart of FIG.

Explanation of step 91) Original image data is stored in memory X (xa, y
a, za).

Here, Za = 1 = R, Za = 2 = G, Za = 3 = B, which respectively represent a red component image, a green component image, and a blue component image.

Explanation of step92) The value of all pixels is multiplied by 1/3.

Explanation of step93) Add R, G, and B values. This produces black and white image data. This is the black and white image memory X _W
Put it in (xa, ya). This completes the black-and-white conversion of the image. Based on this black and white image, the next step 94-
At 904, four directions of vertical direction, horizontal direction, right 45 ° direction, left 45 ° direction are extracted.

Explanation of step 94) 0 is substituted into the counter D indicating the direction.

(Explanation of step95) As shown in FIG. 5-3 (FIG. 5-3 is a diagram when the difference calculation is performed in a 7 × 7 window) P ₁ (D) (in this case, P ₁ ( 0) That is, the monochrome image memory X _W (xa, ya) is shifted until the position of the upper left pixel of the window) reaches the position of the central pixel 0. No. 5-
In the case of the window size of 7 × 7 in FIG. 3, it is sufficient to shift the pixel by 3 pixels to the right and 3 pixels downward. Then, the value of the shifted black-and-white image memory X _W (xa, ya) is set to the difference calculation memory X (D) (xa, ya) (in this case, X (D) (x
a, ya)).

Explanation of step96) This time, until the position of P ₂ (D) (in this case P ₂ (D), that is, the lower right pixel of the window) reaches the position of the center pixel 0, the monochrome image memory X _W (xa, ya) Shift. In this case, at step 95, P ₁ (0) is the central pixel position 0.
Therefore, in order for P ₂ (0) to reach the central pixel position 0, it is sufficient to shift 6 pixels to the left by 6 pixels.
Then, shifted monochrome image memory X _W (xa, ya) difference calculation memory X in (D) (xa, ya) ( currently X (O) (xa, y
The absolute value of the difference between the values in a) is taken, and this is again substituted into the difference calculation memory X (D) (xa, ya).

Then, add 1 to D in step97,98) (that is, D = 1) and go back to step95 again, this time in the vertical direction (from P ₁ (1) to P
₂ ) A difference calculation is performed for (direction toward (1)), and this result is stored in the difference calculation memory X (1) (xa, ya). Similarly, in the case of the directions 2 and 3, the difference calculation is performed.

Explanation of step99) Difference calculation memory X obtained by the above calculation
The maximum value of the values (0) (xa, ya) to X (3) (xa, ya) is calculated and stored in Xmax (xa, ya).

Explanation of steps 901 to 904) Xmax (xa, y
a) and X (D) (xa, ya) (D = 0,1,2,3) are compared, and X (D) (xa, y) that matches Xmax (xa, ya) at each pixel
The value of D in a) is substituted into the direction image data memory X _D (xa, ya). Specifically, Xmax (xa, ya) and X
(D) For a pixel having the same pixel value of (xa, ya), a value of 0 is assigned to the direction image data memory X _D (xa, ya), and X (1) (xa, ya) 1 is substituted for the pixel whose pixel value is the same, and this is repeated until D = 3.

This completes the orientation image data. When processing is performed using parallel processing in this way, processing of all pixels can be performed at once, and extremely high-speed processing is possible.

Next, a case where parallel processing is performed for the painting-style color reproduction processing will be described. FIG. 6-1 is a flow chart of this process.

Description of step 101) The number of colors i to be used is determined. Here, the operator inputs the number of colors i by an external input device such as a keyboard. For example, if i is input as 3, R
・ There are 27 combinations of G and B.

Explanation of step 102) Make a lookup table that matches the number of colors created in step 101. The look-up table is a conversion table for converting an actual memory value into a desired value. Specifically, the lookup table for R is as follows.

As a result, the color that looks like Fig. 6-2 is
As shown in Fig. 3, the number of colors will be limited. (However, in FIG. 6-3, when i = 3) Explanation of step 103) The operator inputs the color-separated image output pixel block m, n by an external input device such as a keyboard. For example, if m = 3 and n = 3 are input, one pixel of the original image is output as a 3 × 3 pixel block by the following color separation processing.

Explanation of step104) Original image data is stored in memory (x ₀ ,
Store at y ₀ , z ₀ ). However, in the case of parallel processing, it is impossible to perform calculations between different memory sizes, so the original image data should be expanded in m × n times in advance (m in the horizontal direction).
(By inserting the same value for each of n and n vertically) so that the subsequent processing can be easily performed.

Explanation of step 107) The value of the memory X (x ₀ , y ₀ , z ₀ ) is rewritten through the look-up table defined in step 102 and is again substituted into the memory X (x ₀ , y ₀ , z ₀ ). As a result, the value in the memory is converted into the color having the designated number of colors at first.

Description of steps 108 and 109) If the values of R, G, and B are exactly the same as the result of step 107, Bias is added to the value of B. This is step 69 in FIG. 3-2 of the first embodiment of the present invention.
This is the same processing as.

Explanation of step110) Although the color was decided in step107 and step109,
In order to correct the difference between the determined color and the actual color in the next process, the memory X (x ₀ , y ₀ , z ₀ ) and the work memory X _W (x ₀ , y ₀ , z ₀ ) is added to the memory X (x ₀ , y ₀ , z ₀ ).

Explanation of step111) In order to randomly arrange the selected colors, random coordinates are generated one by one in an m × n window, and this is used as a random memory X _R (x ₀ , y ₀ ).
Put in. At this time, if the coordinate values selected in the previous processing are duplicated, random coordinates are generated again so that the coordinate values are not duplicated. This is step73,7 in Figure 3-3.
The processing content is similar to 4.

Explanation of step 112) The value of the work memory X _W (x ₀ , y ₀ , z ₀ ) for the random coordinate value selected in step 111 is put into the output inter-image memory Xout (x ₀ , y ₀ , z ₀ ).

Description of steps 105, 106, 113, 114, 115, 116) m
× Repeat n times.

By the above processing, the original image is multiplied by m × n,
Moreover, it means that the color has been converted to the selected color. When a device capable of performing parallel processing is used in this manner, conversion using a lookup table can be performed simultaneously for all pixels, resulting in extremely high processing speed.

Next, using an image processing device with the capability of parallel processing,
A processing procedure in the case of performing the directional random mosaic processing will be described based on the flow charts of FIGS. 7-1 and 7-2. In this process, the same step number is assigned to the part that performs the same process as in the first embodiment, and the description of the process content is omitted.

'The direction image data created by the description) direction extraction processing memory X _D' STEP 82 stores the (x _0, y _0). However, in the case of parallel processing, unlike the case of the first embodiment described above, since calculation between different memory sizes is not possible, the directional image data is also enlarged m × n times (m pieces horizontally,
The same memory size as the color-separated image data is set by inserting the same value for each n pieces vertically. step's
The 130 series is a flow in which all random coordinates are generated in advance in order to take advantage of parallel processing.

Explanation of step 131) A random position memory X _R (x ₀ , y ₀ ) for storing randomly generated coordinate positions is prepared, and all values are set to 0. This random position memory
One bit is sufficient for X _R (x ₀ , y ₀ ), as long as it can determine whether the random coordinates are ON or OFF.

Explanation of step132) The counter count that counts the number of random coordinates is set to 1.

Description of step 133) This is a step of generating random coordinates and obtaining a coordinate position, which is the same as step 85 of the first embodiment.

Explanation of step 134) The random position memory corresponding to the generated random coordinates x _R , y _R is set to 1.

Description of step135) Counter c that counts the number of random coordinates
Count up the ount.

Description of step136) Counter c that counts the number of random coordinates
Repeat step 33 to step 35 until the number of random coordinates required for ount reaches NSTOP, and if NSTOP is reached, proceed to the next step.

The 140 series of steps is a flow of processing for each direction data with respect to the random coordinates created in the 130 series.

Explanation of step 141) Direction data Idirection is set to 0. As a result, the following processing is performed in the lower right 45 ° direction.

Explanation of step142) In the case of parallel processing, pixel values will be synthesized while shifting, so a shift memory X _S (x ₀ , y ₀ , z ₀ ) for this purpose is prepared, and all the values To 0.

Explanation of step 143) Coordinates in which 1 is set in the random position memory X _R (x ₀ , y ₀ ) (that is, random coordinate values) and the direction image data X _W ′ (x ₀ , y ₀ ) is Idirection.
Select the coordinate value that is (currently 0). As a result, the random coordinate value to be processed in the 45 ° direction is selected. Then, the color value of the color-separated image data X (x ₀ , y ₀ , z ₀ ) is converted into the shift memory X _{S with} respect to the selected coordinate value.
Move to (x ₀ , y ₀ , z ₀ ).

(Explanation of step 144) A mosaic pixel pattern whose direction data is Idirection (currently 0) is read out from a file created in advance. FIG. 7-3 shows an example of a 7 × 7 mosaic pixel pattern in the lower right direction. In this example, 1
The point marked with is the pixel 0 to be processed as a mosaic, and the point marked with 0 is not processed and the original color remains.

Explanation of step 145) The shift memory is moved pixel by pixel for processing the mosaic image pattern. At each pixel position, the color information stored in the shift memory and the color separation image memory corresponding to that position are stored. Put in. 7th-3
The mosaic image pattern of 7 × 7 shown in FIG. 7 will be taken as an example to explain in more detail in FIG. 7-4. First, the color information held in the shift memory is the center position (0
Of the pixel position). Next, the shift memory is moved rightward by 1 pixel by 3 pixels so as to be at the first pixel position (1 pixel position) of the mosaic image pattern. At this position, the color stored in the shift memory is transferred to the color separated image data memory. As a result, the color at the center position (0 pixel) is also arranged at the 1 pixel position.
Next, the shift memory is moved to the pixel position of 2, that is, to the right by one pixel. Then, the color stored in the shift memory at this position is transferred to the color separated image data memory. As a result, the color at the 6th central position (0 pixel) is transferred to the 2nd position. If you repeat this step up to 28,
This means that the color of the central pixel is arranged in all the pixels specified by the mosaic image pattern.

Explanation of step 147) Add 1 to the direction data Idirection.
This sets Idirection to 1.

Explanation of step147) Return to step142 and the direction data is 1
In the case of (that is, in the horizontal direction), the processing is performed.

The above processing is repeated until the direction data exceeds 3, and this processing is completed. In this way, if a device capable of parallel processing is used, mosaic processing with the same direction data can be performed at one time, which is much shorter than the mosaic processing for each random coordinate pixel. Processing can be performed.

Next, the procedure of the dark part complementary color mosaic processing is described in FIG. 7-5 and FIG.
A description will be given based on the flowchart of FIG. Also in this flow, as in the case of the above-described first embodiment, the processing content is similar to the direction-oriented random mosaic processing, and therefore, the 7-1
Only the part different from the flow of the directed random mosaic processing of FIGS. 7 and 2 will be described.

Explanation of step82 ″) Lightness information is required to judge dark areas,
The monochrome image data created in step 93 of FIG. 5-1 is input to the monochrome image memory X _W (x ₀ , y ₀ ).

However, in the case of parallel processing, unlike the case of the first embodiment described above, calculation between different memory sizes is not possible, so black and white image data is also enlarged m × n times (m pieces horizontally,
The same memory size as the color-separated image data is set by inserting the same value for each n pixels vertically.

Explanation of step 83 ') Set parameters. The tenth parameter required here is a threshold level DP for determining whether or not it is a dark part, and this is input from a command input device such as a keyboard. As the value to be input here, the brightness may be directly input, or a method of inputting a ratio to be determined as the dark part of the entire image and calculating from the histogram of the image to obtain the brightness to be determined, Another one
The parameter required here is the number of dark mosaics
NSTOP '. This number is also input from a command input device such as a keyboard, but in the present embodiment, unlike the case of the first embodiment described above, in step 137, which will be described later, according to the ratio of dark areas to the entire screen, The number of dots is adjusted, so it is necessary to consider the value.

Explanation of step 136 ′) Steps 133 to 135 are repeated until NSTOP ′ random coordinate values are generated.

Explanation of step137) NSTOP ′ random coordinates are X _R (x ₀ ,
Although stored in y ₀ ), if the position of these NSTOP ′ random coordinates is a part brighter than DP in X _W (x ₀ , y ₀ ), the coordinates are canceled. As a result, the complementary color mosaic process is performed only on the portion whose brightness is lower than DP in the subsequent process.

(Explanation of step 143 ′) Shift memory X _S (x ₀ , y ₀ , z ₀ ) is converted into a complementary color and the shift memory X is converted again.
Put it in _S (x ₀ , y ₀ , z ₀ ). The conversion processing to the complementary color may use parallel processing or the flow described in FIG. 4-5. As a result, the shift memory X _S (x ₀ , y ₀ , z ₀ ) storing the complementary color is moved in accordance with the mosaic shape in step 145, and the complementary color is stored in the color separation image data memory X.
It will be drawn on (x ₀ , y ₀ , z ₀ ).

As described above, when the processing is performed using the parallel processing, even coordinate positions randomly generated can be processed at once, so that the processing can be completed in a short time.

As described above, the following effects are obtained by using this embodiment.

By adding directionality to the mosaic, it is possible to express the directionality of the pictures compared to the conventional single directionality mosaic.

 A more painting-like color reproduction is possible.

Rather than dark stippling in dark areas with low lightness,
By arranging the complementary colors in parallel, much more realistic painting processing becomes possible compared to conventional image processing, and even people who do not have the ability to draw paintings can easily obtain neo-impressionist paintings.

"Dark room treatment" that was performed by the conventional silver salt system
Moreover, it is possible to provide a new image, which was not possible with the electronic plate making of the printing system, and increase the degree of freedom in drawing.

Since the image processing process can be unmanned, it can be expected to spread in a laboratory.

In the present embodiment, the image is input from the film, but even if the image data is directly taken in from the subject from the still video camera, the video camera, etc. The same effect can be obtained by inputting image data.

<Effect> As described above, according to the present invention, when the input image is converted into a pictorial image, the R, G, B data become equal due to the gradation number conversion of the data, and an achromatic portion occurs. Makes the B data larger than the R and G data, which enables painterly color reproduction.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of the present invention, FIGS. 2-1 and 2-2 are principle diagrams of directionality extraction processing, and FIGS. 2-3 are schematic flow chart diagrams of directionality extraction processing. Figure 2-4 is a flow chart for black and white image creation processing, Figure 2-5 is a flow chart for direction data image creation processing, Figure 3-1 is a schematic flow chart for painting style color reproduction processing, and Figure 3-2 is Color separation processing flow chart, Figure 3-3 is random coordinate transformation flow chart, Figure 4-1 is random mosaic processing flow chart with directionality, Figure 4-2 is pixel block diagram of each directionality, Fig. 4-3 is a principle diagram of mosaic operation processing, Fig. 4-4 is a flow chart of dark complementary color mosaic processing, Fig. 4-5 is a flow chart of complementary color conversion, Fig. 5-1 and Fig. 5-2. The figure shows the image processing with parallel processing capability for directionality extraction processing. FIG. 5-3 shows a 7 × 7 window difference calculation example, and FIG. 6-1 shows a painting-style color reproduction process performed by an image processing device having parallel processing capability. Fig. 6-2, Fig. 6-3 show the contents of the look-up table for limiting the number of colors, Fig. 7-1, Fig. 7-2 show the direction Flowchart diagram when random mosaic processing is performed by an image processing apparatus having parallel processing capability, FIG. 7-3 is a diagram showing a 7 × 7 mosaic image pattern example, and FIG. 7-4 is a mosaic image output example. FIG. 7-5, FIG. 7-5, and FIG. 7-6 are flow charts when the dark part complementary color mosaic processing is performed by an image processing apparatus having a parallel processing capability. In the figure, 1 is an image input device, 2 is a central processing unit, 3 is a memory, 4 is a keyboard and digitizer, 5 is a monitor TV, and 6 is a printer.

Claims (1)

[Claims] 1. An original image has R data and G per pixel.
Data and B data are input as data of a plurality of gradation levels, and the input R data, G data, and B data of one pixel have a smaller number of gradations than the input data, and R data of a plurality of pixels. In the image processing method of converting into G data and B data, when the values of R data, G data and B data obtained by the conversion are converted into achromatic data equally, the B data of the conversion data is converted into R data, An image processing method characterized by correcting to a value larger than G data.