JP6051890B2 - Image processing apparatus, image processing method, image display method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, an image display method, and a program for displaying printed matter.

  Various image processing apparatuses having a function of displaying the finished state of a printed matter on a display device such as a display and previewing the finished state of the printed matter have been proposed. The purpose of such preview includes checking the color of the printed material, checking additional information in the output device (printer), and checking the so-called texture of the paper. The function of previewing the finished state of the printed matter can be presented to the user in an easy-to-understand manner so that the actual state of the printed matter is not necessary. It has the advantage that the occurrence of work can be suppressed.

  Among such print product preview functions, a so-called 3D (three-dimensional) display preview function has also been proposed, in which a print product can be previewed by changing the illumination position or the viewpoint position. The lighting position and viewpoint position can be changed especially when performing color reproduction that takes into account the effects of specular reflection light and gloss on the surface of the printed material, or when trying to reproduce the glossiness and texture of the actual printed material. 3D preview function is effective.

  For example, in Patent Document 1, when performing 3D preview, even when a display device (display) having a large dynamic range is used, gloss reproduction is performed while maintaining the color reproducibility of an object. The specular color is compressed so that it falls within the dynamic range of the display device, the composite ratio between the specular color and diffuse color of the object is determined, and the specular color and diffuse color are combined according to the determined composite ratio. The reflection color of the object is determined.

  Also, in Patent Document 2, when performing 3D preview, in order to represent a texture that matches the texture of the printed surface of the printed material in an image displayed on a display or the like, the texture information that represents the value of the print data and the texture of the printed surface. A texture profile indicating a correspondence relationship with data values is provided.

  Furthermore, in Patent Document 3, in order to generate a high-quality preview image based on less data in 3D preview, the relative positional relationship between the incident direction of illumination and the shooting direction is changed with respect to the recording medium. One grayscale image is selected and used from a plurality of grayscale images obtained by photographing based on the illumination condition and the observation condition.

  In the calculation of the specular reflection color in Patent Document 1 described above, in addition to the normal vector (N) indicating the normal direction of the object surface, the light source vector (L) indicating the direction of the light source, and the vector (E) of the visual line direction, A parameter (n) representing the degree of gloss divergence is used, and the specular color is determined by a predetermined calculation formula. Further, the specular reflection composite ratio (α) and the diffuse reflection composite ratio (β) are calculated from the specular reflection color (after dynamic range compression) calculated in this way by a predetermined calculation formula.

  However, in the specular reflection color calculation step described above, it is necessary to calculate the angle difference between the light source vector (L) and the reflection vector (R) of the line-of-sight vector. Since it is necessary to calculate such an angle difference at each position on the object, the calculation load increases. When the shape of the light source is a point light source or a linear light source, the amount of calculation for calculating such an angle difference is small. However, when there are multiple light sources and the light source has a complicated shape, the angle difference can be easily calculated because the light source vector, the reflection vector, and the angle difference need to be calculated at each point on the object. However, there is a problem that it cannot cope with a plurality of light sources or light sources with complicated shapes.

  In addition, a problem also occurs at the location where the combined ratio of specular reflection and diffuse reflection in Patent Document 1 described above is calculated. When calculating the synthesis ratio in Patent Document 1, it is necessary to first calculate the maximum value Cs ′ (max) of the specular reflection color (after compression). At this time, the maximum value Cs ′ (max) of the specular reflection color (after compression) is obtained by calculating the specular reflection color (after compression) Cs ′ at each point on the object for all points on the object. It has the feature of being found for the first time. For this reason, Patent Document 1 calculates the specular reflection color (after compression) Cs for all points on the object, determines the maximum value Cs ′ (max) of the specular reflection color (after compression), and then Again, for all points on the object, the combined ratio of the specular reflection and the diffuse reflection is determined from the maximum value Cs ′ (max) of the specular reflection color (after compression) and the specular reflection color (after compression) Cs ′ to reflect the reflection. Determine the color. In other words, there is a problem in that two points of data access are required for all points on the object, which increases the calculation load.

  In contrast to Patent Literature 1, the present invention proposes a paper texture reproduction method that can be applied to a plurality of light sources and light sources having a complicated shape with a small calculation load.

  In Patent Document 2 described above, texture information data can be obtained by using a texture profile. This texture information data is expressed using a parameter of a bidirectional reflectance distribution function (BRDF), and the surface roughness of an object. Is a coefficient (m) representing the surface reflectance (ρs) of the object, a coefficient (ks) for the surface reflectance (ρs) of the object, an internal diffuse reflectance (ρd) of the object, and an internal diffuse reflectance (ρd) of the object. It is represented by parameters of coefficient (kd) and refractive index (n) of the object.

  In the case of displaying a preview of a printed matter in Patent Document 2, a data value for preview display is calculated from the calculation formula described in Patent Document 2 using each of these parameters. However, since this calculation needs to be performed at each position of the printed material to be previewed, there is a problem that the calculation load is very large.

  In addition, since it is necessary to acquire the parameters of the bidirectional reflectance distribution function (BRDF) by independently changing the directions of the incident light and the reflected light, it is very time-consuming to acquire the parameters. . The acquisition of the BRDF parameter is necessary every time a print image on a new sheet is reproduced by the preview apparatus. In other words, in Patent Document 2, this parameter acquisition is a very time-consuming method, so it takes a lot of labor to reproduce a print image on a new sheet with a preview. There is a problem that it is difficult to deal with.

  Also for Patent Document 2, the present invention reduces the calculation load in the calculation of the preview display data value, and does not cause a problem that a large amount of labor is required to cope with a new sheet. Propose a reproduction method.

  Also in Patent Document 3, when preview display of a printed matter is performed, a data value for preview display is calculated using the calculation formula described in Patent Document 3. However, in the case of Patent Document 3, as in Patent Document 2, since the calculation needs to be performed at each position of the printed material to be previewed, the calculation load is very large. In addition, regarding the acquisition method of each parameter used in the calculation, it is necessary to perform imaging with the illumination unit and the imaging unit set at various angles, and it cannot be said that parameter acquisition is easy.

  Also for Patent Document 3, the present invention proposes a paper texture reproduction method in which the calculation load in calculating the preview display data value is small, and the problem that the parameter acquisition itself is difficult does not occur.

(Texture of regular reflection light on paper)
According to the inventor's examination for the purpose of improving the paper texture, in order to improve the paper texture in the preview function of the 3D display and realize the “real” paper texture in a display device such as a display, It has become clear that it is necessary to realize a so-called paper texture (slight non-uniformity of the paper, reflection characteristics finely changing on the paper surface) in a display such as a preview function.

  In Patent Document 1, the specular reflection color (regular reflection color) of the paper is calculated from the light source color (ld), the parameter (Kd) representing the color of the object, the light source vector (L), the line-of-sight vector (E), and the like. Such a characteristic that the specular reflection color is finely changed on the surface of the paper (texture perceived in the specular reflection on the paper surface) is not taken into consideration. As described above, in Patent Document 1, since the texture of the regular reflection light of the paper is not reflected in the display of the preview function or the like, the preview that sufficiently reflects the texture of the paper cannot be performed.

  Also in Patent Document 2, the texture parameters used for texture reflection are the coefficient (m) representing the surface roughness of the object, the surface reflectance (ρs) of the object, the coefficient (ks) for the surface reflectance (ρs) of the object, The internal diffuse reflectance (ρd) of the object, the coefficient (kd) with respect to the internal diffuse reflectance (ρd) of the object, and the refractive index (n) of the object. Equivalent to. This is not reflected in Japanese Patent Application Laid-Open No. 2005-228688 (characteristic perceived by regular reflection on the paper surface) in which the regular reflection characteristic changes finely on the paper surface (printed material surface).

  As described above, in Patent Document 2, the texture in the regular reflection light of the paper is not reflected in the display of the preview function or the like, so that the preview that sufficiently reflects the texture of the paper cannot be performed.

(Texture in diffuse reflection of paper)
In the same way as described above, in order to realize a “real” paper texture in a display device such as a display, it has become clear that a so-called paper texture needs to be realized in a display such as a preview function. . When reflecting the texture of the paper in the display of the preview function etc., reflecting the texture of the diffuse reflection light in addition to the texture in the regular reflection light described above, the “real” paper texture is further improved. It was clarified by the inventor's study that this can be reproduced.

  In Patent Document 1, since the diffuse reflection color of the paper is merely an XYZ value, the characteristic that the diffuse reflection color is finely changed on the surface of the paper (texture perceived in the diffuse reflection on the paper surface) is not considered. . As described above, in Patent Document 1, the texture in the diffuse reflection color of the paper is not reflected in the display of the preview function or the like, and therefore, the preview that sufficiently reflects the paper texture (reflects the texture of the paper diffuse reflection light) can be performed. Absent.

  In Patent Document 2, the diffuse reflection component of the paper corresponds to a value that can be easily obtained by the product of the internal diffuse reflectance (ρd) of the object and the coefficient (kd) with respect to the internal diffuse reflectance (ρd) of the object. As described above, Patent Document 2 does not consider the characteristic that the diffuse reflection component changes finely on the surface of the paper (texture perceived in the diffuse reflection on the paper surface). For this reason, in Patent Document 2, the texture of the diffuse reflection component of the paper is not reflected in the display of the preview function or the like, so that the preview that sufficiently reflects the paper texture (reflects the texture of the paper diffuse reflection component) cannot be performed. .

The present invention has been made in view of the above problems,
An object of the present invention is to provide an image processing apparatus, an image processing method, an image display method, and a program that display (reproduce) a paper texture by improving the texture of a printed paper with respect to a display such as a preview function of a three-dimensional display. It is in.

  The present invention relates to an image processing apparatus for displaying a printed matter, in which the mixing ratio of the diffuse reflection characteristic data of the printed matter sheet and the regular reflection characteristic data of the printed matter sheet varies depending on the coordinate position in the virtual three-dimensional space. Ratio data is arranged at a predetermined position in the virtual three-dimensional space, original data of the printed matter is arranged so as to have a predetermined arrangement relationship with the mixing ratio data, and from a predetermined viewpoint position in the virtual three-dimensional space. Determining means for determining a reference position on the mixing ratio data indicated by a reflection vector of a vector directed to a target position of the document data; and a diffuse reflection characteristic of the paper according to the mixing ratio of the reference position on the mixing ratio data A calculation unit that calculates data obtained by mixing the data and the specular reflection characteristic data of the paper as display data at the target position of the document data; It is referred to as the most important feature.

  According to the present invention, a three-dimensional display reflecting the texture of printed paper can be realized.

The processing flowchart of the image processing method of this invention is shown. 1 shows a configuration of an image processing apparatus according to an embodiment of the present invention. Image data showing only the mixing ratio data of each sheet and the position of the maximum value is shown. An arrangement of document data and mixing ratio data in a virtual three-dimensional space is shown. The relationship between the viewpoint position, the line-of-sight vector, the arrangement position of each position of the document data, the normal vector, and the reflection vector is shown. The positional relationship among the viewpoint position, each position of the document data, and the mixture ratio data value used for the preview data is shown. The state where the paper is bent is shown. The example of the cross key displayed on a display apparatus is shown. An example of mixing ratio data corresponding to a complicated illumination shape is shown. Characteristic data and attenuation parameters of the paper type are shown. Attenuation characteristics and visual evaluation results are shown.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  The first embodiment is an embodiment according to an image processing apparatus that can execute a preview of a printed matter in 3D (three-dimensional) display and display of the printed matter on a display device such as a display. FIG. 2 shows the configuration of the image processing apparatus according to the first embodiment of the present invention. The display device 102 displays a UI (user interface) in addition to the print preview image and the print image. The display device 102 according to the first embodiment is a liquid crystal display, but other CRTs may be used. The input device 101 inputs an instruction from a user and a necessary data value via the input device 101. The input device 101 according to the first embodiment is a keyboard and a mouse, but other input devices may be connected. A CPU 105 and a RAM 106 constituting the processing device 104 control the entire image processing device. The storage device 103 stores a program executed by the CPU 105 and data used by the CPU 105.

  In the first embodiment, the processing device 104 processes the data stored in the storage device 103 by a program stored in the storage device 103 in accordance with the content instructed by the user via the input device 101. By displaying the processing result on the display device 102, the paper texture of the printed material can be displayed (reproduced) on the display. That is, the printed material preview (or printed material display) can be performed on the display by 3D display.

  In the first embodiment, the contents instructed by the user via the input device 101 are specifically as follows. (1) Document data of a printed material to be printed, (2) Paper type used at the time of printing. Items other than these may be targeted, but items other than these are not the main points of the present invention. Therefore, the contents instructed through the input device 101 are limited to these items and will be described below. Here, the printed material includes paper and original data.

  In the first embodiment, the document data is a BMP format data file, but other file formats may be used. Instead of a raster image such as BMP, a vector image such as PDF may be used. In the first embodiment, the type of paper can be selected from three types (cast coated paper, gloss coated paper, and mat coated paper). These three types of paper are typical papers that characterize the texture of the printing paper. If the texture of these three types of paper can be displayed (reproduced) in a 3D-displayed printed material preview, various papers other than these three types are available. It is expected that it is relatively easy to reproduce the texture of a simple paper. In the first embodiment, the output is limited to three types of selectable paper output, but there is no problem even if paper selection other than these three types (selection from more paper types) is possible.

  In the first embodiment, the data stored in the storage device 103 is the following data. (1) sheet diffuse reflection characteristic data holding the sheet diffuse reflection characteristic, (2) sheet regular reflection characteristic data holding the sheet regular reflection characteristic, and (3) sheet diffuse reflection characteristic data and sheet regular reflection characteristic data. There are three types of mixing ratio data holding the mixing ratio. In the first embodiment, the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data are each a set of RGB values (a set of three values corresponding to the three components of RGB).

  In the first embodiment, as described above, for each of the three types of paper, two RGB values that differ depending on the paper type are stored in the storage device 103 as paper diffuse reflection characteristic data and paper regular reflection characteristic data. ing. Specific numerical values of the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data in Example 1 are as shown in FIG. Here, RGB values take values of 0 to 255 (8 bits), with 0 being black and 255 being white.

  The values of the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data may be values other than those described in FIG. However, for paper with high image clarity such as cast-coated paper (paper with clear illumination), the difference between the paper diffuse reflection characteristic data and the paper regular reflection characteristic data is set to be large, and mat coat For paper with low image clarity (paper that hardly shows the reflection of lighting), the paper texture is better reproduced when displaying previews when the difference between the two is set to be small. be able to.

  In the first embodiment, as described above, the storage device 103 stores the mixing ratio data that holds the mixing ratio of the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data. The mixing ratio data is data created so that the mixing ratio varies depending on the coordinate position in the virtual three-dimensional space.

  In the first embodiment, the mixing ratio data is a BMP format data file. In the first embodiment, the mixing ratio data is also stored in the storage device 103 in accordance with the above-described three types of paper.

  The outline of the mixing ratio data of Example 1 is shown in FIGS. 3A to 3C, the shading corresponds to the data value of the mixing ratio, the black portion is the ratio of the sheet diffuse reflection characteristic data is 1.0 (the ratio of the sheet regular reflection characteristic data is 0.0), and the white portion. Corresponds to a sheet diffuse reflection characteristic data ratio of 0.0 (paper regular reflection characteristic data ratio of 1.0).

  In the first embodiment, the mixing ratio data is created as follows. First, image data describing only the position of the maximum value is created with the same image size as the above-described mixing ratio data. FIG. 3D shows an outline of the image data in which only the position of the maximum value is described. The thin white part at the center corresponds to the position (x0, y0) indicating the maximum value of the mixture ratio data.

  Next, with respect to the image data (FIG. 3 (d)) in which only the maximum value is described, the distance (r) to the nearest maximum value position for each pixel (each coordinate position (x, y)) in the black portion. ) Is calculated. Using this r, the mixing ratio data value of the target pixel is calculated from the equation (1).

  Expression (1) indicates that the mixing ratio decreases as a function of the square of the distance from the maximum value as the mixing ratio data is moved away from the position where the maximum is obtained. The position where the mixing ratio becomes maximum is a position corresponding to the center of illumination in the actual reflection of illumination on the paper. For this reason, by using the mixture ratio data having the characteristic represented by the expression (1), the aspect of attenuation from the illumination center to the peripheral portion in the reflection of the illumination on the actual paper is appropriately reflected. Mixing ratio data can be generated.

  Depending on the size of the parameter b in the formula (1), when the value of the parameter b is small, the characteristic of abruptly attenuating for cast coated paper (FIG. 3A) is used, and conversely, when the value of the parameter b is large. The mixing ratio data can have a characteristic of gently decaying for mat-coated paper (FIG. 3C).

  Here, the parameters a, b, and c are parameters that are set as appropriate, but the values of the parameters a, b, and c actually used when calculating the data shown in FIGS. Is shown in FIG. The parameter b depends on the image size of the mixture ratio data. For this reason, when creating mixing ratio data having an image size different from that of the first embodiment, it is necessary to adjust the value while maintaining the relative relationship. The value of the parameter b in FIG. 10B is a value when the length of one side of the image size of the mixing ratio data is 1.0.

  In Example 1, the texture of the printed paper can be improved. That is, a “real” texture can be reproduced at a place where toner or ink is not placed in printing (a place where the surface of the paper is exposed as it is). On the other hand, even when the method of the present invention is applied to a portion on which toner or ink is placed in printing, the texture of the surface of the toner or ink cannot be reproduced. For this reason, in the first embodiment, the method of the present invention is applied only to a region where toner or the like is not placed, that is, a region (paper portion) where the data value of document data is 255 (white).

  In the first embodiment, the storage device 103 stores a program describing a procedure for processing each data described above. FIG. 1 shows a processing flowchart of an image processing method (image display method) of the present invention.

  In step S1, (1) document data and (2) paper type are specified via the input device 101.

  In step S2, the CPU 105 determines the paper type specified in step S1 from (1) paper diffuse reflection characteristic data, (2) paper regular reflection characteristic data, and (3) mixing ratio data stored in the storage device 103. Are read into the RAM 106 respectively.

  In step S3, the CPU 105 determines an arrangement position S (x, y, z) of each coordinate position of the document data (this corresponds to arranging the printed matter in the virtual three-dimensional space). In the first embodiment, the document data is arranged so that the center point of the document data coincides with the origin O of the virtual three-dimensional space. Further, each coordinate position of the document data is arranged so that the document data becomes a simple plane. At this time, the plane normal vectors are arranged so as to face the Z-axis direction (in the first embodiment, the normal vectors n (x, y, z) are (0, 0) at all the coordinate positions of the document data. , 1.0)).

  In step S4, the CPU 105 determines the arrangement position R (x, y, z) of the above-described mixing ratio data (corresponding to determining the illumination position in the virtual three-dimensional space). In Example 1, it arrange | positions so that the center of mixing ratio data may correspond to the coordinate position (x, y, z) = (0,0,1.0) of virtual three-dimensional space.

  FIG. 4 shows the arrangement of the original data 201 on the paper and the mixing ratio data 202 in the virtual three-dimensional space. In FIG. 4, the center point of the document data 201 is arranged at the origin O of the virtual three-dimensional space, and the mixture ratio data 202 is arranged at a position of Z = 1.0. Further, the document data 201 and the mixture ratio data 202 are arranged in parallel.

  In step S5, the CPU 105 determines a viewpoint position E (= (x, y, z)) (corresponding to determining a visual (viewing) position in the virtual three-dimensional space). In the first embodiment, the coordinate position (0, 0, 1.0) is set as the viewpoint position.

  In step S6, the CPU 105 calculates a reflection vector r (x, y, z). The reflection vector includes a viewpoint position E, an arrangement position S (x, y, z) of each coordinate position of the document data, and a normal vector n (x, y, z) = (0, 0) at each coordinate position of the document data. , 1) from the equation of FIG. This reflection vector is a vector representing the direction of regular reflection on the surface defined by the normal vector with respect to the vector from the viewpoint position E to the target position of the document data for each coordinate position of the document data. It is.

  FIG. 5 shows a viewpoint position E, a line-of-sight vector in the viewpoint direction, an arrangement position S (x, y, z) of each coordinate position of document data, a normal vector n (x, y, z), and a reflection vector r (x, The relationship of y, z) is shown.

  In step S <b> 7, the CPU 105 determines a mixing ratio between the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data. The value of the mixing ratio is the value of the mixing ratio data described above in the direction indicated by the reflection vector r (x, y, z) calculated at each coordinate position of the document data. That is, the value of the mixing ratio at the position (reference position) where the direction indicated by the reflection vector at each coordinate position of the document data of interest intersects with the mixing ratio data arranged in the virtual three-dimensional space is the document. This is the value of the mixing ratio at the target position of the data.

  In the first embodiment, when the reflection vector and the mixing ratio data do not intersect, the mixing ratio is set so that the sheet diffuse reflection is 1.0 (sheet regular reflection is 0.0). . Further, instead of each coordinate position of the document data, the document data may be divided into n × n areas, and the above-described mixing ratio calculation process may be executed for each area.

  FIG. 6 shows the positional relationship between the viewpoint position, the position of the document data of interest, and the mixing ratio data value used for the preview data. Here, a state is shown in which the document data is virtually overlapped on the paper.

  The CPU 105 reads the data value R of the reference position 206 that refers to the mixture ratio data in which the reflection vector 205 reflected at the position (attention position) 204 of the document data of interest 204 is arranged at Z = 1.0. The data value R is used for calculation of preview data (or display data).

  In step S8, the CPU 105 calculates a data value for preview. According to the mixing ratio value R, the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data are mixed, and a preview data value at the target position 204 of the document data is calculated. More specifically, when the mixing ratio value is α, the preview data value P is calculated by the following equation using the sheet diffuse reflection characteristic data value Diff and the sheet regular reflection characteristic data value Spec. In this way, the calculation is performed for each coordinate position of the document data.

  In the first embodiment, the data value for preview calculated in this way is rendered on the display which is the display device 102. Thus, the regular reflection and diffuse reflection of the paper in the printed material can be reproduced, and the “real” paper texture can be reproduced on the display. In the first embodiment, the “real” paper texture can be reproduced on the display by a method having a smaller calculation load than the prior art.

  In the first embodiment, the texture of the printed paper can be improved. That is, a “real” texture can be reproduced at a place where toner or ink is not placed in printing (a place where the surface of the paper is exposed as it is). Since the texture of the surface of the toner or ink cannot be reproduced even if the above-described method is applied to the portion where the toner or ink is placed in printing, in the first embodiment, the above-described method is limited to a region where the toner or the like is not placed. Has been applied.

  In the first embodiment, another process is performed for the area on which the toner or the like is placed, and the area where the toner or the like whose paper texture is improved by the above-described method and the area where the toner or the like is placed are aligned with each other without a sense of incongruity. doing. In the area where the toner is placed, the value of the original data may be used as it is in the calculation of the preview data. However, in this case, the area where the toner is placed slightly and the portion of the sheet as it is where the toner is not placed. There is a risk that gradation inversion will occur.

  For this reason, in the first embodiment, the value of the sheet diffuse reflection data (the value of 235 described in FIG. 10A) is integrated with the value of the original data so as to be the preview data value. . Specifically, the preview data value P is calculated by the following equation using the document data value Si, the sheet diffuse reflection characteristic data value Diff, and the sheet data value Sp (usually 255) of the document data. .

  In the first embodiment, the sheet diffuse reflection characteristic data value D is D = 235 as described in FIG. 10A, and the data value of the sheet portion of the document data corresponds to the white portion of the document, so Sp = 255. (Equation (3) is calculated for each component of RGB values).

  Although the configuration of the first embodiment has been described, the present invention is not limited to the above-described embodiment. For example, the values of the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data illustrated in FIG. Values other than those described in 10 (a) may be used. Also, a method for creating the mixing ratio data and a method for pasting into the virtual three-dimensional space may be used other than those described in the embodiments.

  In addition to this, when the printed matter is displayed by a preview or the like, the color temperature of the illumination is often reflected. The first embodiment may have such a function. In that case, an image obtained by color-converting the original data, paper diffuse reflection characteristic data, paper regular reflection characteristic data, etc. according to the illumination color temperature to be reflected is calculated, and this color-converted data is used for 3D display. The value of the preview image is calculated by the method described above. Thereby, it is possible to perform a print preview reflecting the color temperature of the assertion.

  In addition, it goes without saying that the object of the present invention can be achieved by mounting the above-described data calculation method for print preview in a program using a three-dimensional graphics API such as OpenGL or DirectX.

Comparative Experiment In Example 1, the mixing ratio data reflected the following characteristics (the value b is different for each sheet, but the relationship of Formula (1) is satisfied for all sheets). In other words, the mixing ratio data R (x, y) is a mixing ratio that has the attenuation characteristic represented by the expression (1) when the position indicating the maximum value of the mixing ratio data is (x0, y0). It was data.

  The present inventors also tried other attenuation characteristics and examined the attenuation characteristics that can be more visually recognized as an illumination shape that moves to the paper when a printed material preview is performed. Explain the results of the study.

  In this examination, based on the configuration of Example 1, only the mixture ratio data was changed and a printed matter preview was performed. The evaluation method is a visual evaluation of a printed material preview image on a display, and is evaluated from the viewpoint of whether or not the image looks more like a reflection of a real illumination shape.

Example 1 is the attenuation characteristic of the formula (1) (the details of the calculation formula are described in FIG. 11A). Comparative Example 1 is an attenuation characteristic in which the multiplier of the r term in Formula (1) is 2 → 1 (details are shown in FIG. 11A).
Comparative Example 2 is an attenuation characteristic in which the multiplier of the r term in Formula (1) is 2 → 3 (details are shown in FIG. 11A).
Comparative Example 3 has a so-called Gaussian distribution attenuation characteristic (details are shown in FIG. 11A).

  The result of visual evaluation is shown in FIG. As shown in FIG. 11B, when the mixing ratio data is created using the attenuation characteristic used in Example 1, the attenuation characteristic is appropriate, and it looks like a real reflection. As a result. On the other hand, in Comparative Examples 1 to 3, the result of visual evaluation was that the attenuation was too slow or steep and did not look like a real reflection. In addition, the item of the order of FIG.11 (b) is the result of ranking from a viewpoint that a reflection looks more authentic.

  From the result of the comparison experiment by the present inventor, according to the attenuation characteristic used in Example 1, in the printed matter preview of 3D display, the “real” paper in the aspect of attenuation from the illumination center to the peripheral portion in the reflection of the illumination It will be possible to reproduce the texture.

  The second embodiment is an embodiment in which the data value of the regular reflection characteristic data of the sheet differs depending on the coordinate position (the target position of the document data). The configuration of the second embodiment is almost the same as the configuration of the first embodiment. The difference from the first embodiment is that the regular reflection characteristic data of the sheet is not a fixed RGB value (FIG. 10A of the first embodiment) as in the first embodiment, but has a configuration in which the value varies depending on the coordinate position. There is in point.

  First, the paper regular reflection characteristic data in the second embodiment will be described. The paper regular reflection characteristic data of Example 2 is that the actual cast coated paper (mirror coated platinum paper, Oji Paper Co., Ltd.) is placed on the paper, the lighting device, and the photographing so that a regular reflection image from the paper surface can be photographed. It was collected by determining the position of the device (digital camera) and shooting.

  More specifically, photographing was performed with the incident light angle from the illumination device to the paper being 20 degrees and the photographing apparatus position being 20 degrees. At the time of digital camera shooting, the shooting conditions are adjusted so that the resolution is 400 dpi with respect to the actual paper size. Since the photographed image is a dark image, the brightness is adjusted so that the average value becomes 253 (8-bit value). Furthermore, since the photographed image is smaller than the size of the printed material to be previewed (size of the original data), the images are connected and enlarged to the same size as the printed material. In the second embodiment, the image data generated in this way is used as paper regular reflection characteristic data.

  By taking a specular reflection image of the real paper with a digital camera, the characteristic that the specular reflection on the paper surface changes finely at each coordinate position on the paper surface (texture perceived in specular reflection on the paper surface) This can be reflected in the paper regular reflection characteristic data. In other words, the paper regular reflection characteristic data generated in this way has a data value that changes at each coordinate position (each pixel), and such a change in the data value shows a characteristic that the regular reflection on the paper surface changes finely. It has been reflected.

  In the second embodiment, in addition to cast coated paper, gloss coated paper and mat coated paper are also collected and generated by the same method, and paper regular reflection data corresponding to three types of paper are stored in the storage device 103. . In the second embodiment, similarly to the first embodiment, according to the paper selected by the input device 101, a corresponding one of the regular reflection data stored in the storage device 103 is selected and read out. It has become.

  Also in the second embodiment, as in the first embodiment, the storage device 103 stores a program describing a procedure for processing each data. Also in the second embodiment, this program is called to perform processing for obtaining preview data (or display data).

  Also in the second embodiment, steps S1 to S7 in the image processing method according to the first embodiment are performed (steps S1 to S7 are the same as those in the first embodiment). In the second embodiment, a process corresponding to the step S8 of the first embodiment is performed as follows.

  In step S8 of the second embodiment, a preview data value is calculated. By the processing up to step S7, the value of the mixing ratio for each coordinate position of the document data is determined. In the first embodiment, the value of the regular reflection characteristic data of the sheet is a fixed value (the same value everywhere), whereas in the second embodiment, as described above, the image data having the same size as the printed matter is transferred to the sheet. It is used as regular reflection characteristic data (the value of paper regular reflection data reflects the regular reflection texture, and thus has a different value at each coordinate position).

  In the second embodiment, when calculating the preview data value at each coordinate position of the document data, the sheet regular reflection characteristic data value at the printed matter position (paper position) corresponding to each coordinate position of the document data is used. It is composed. That is, in FIG. 6, it is assumed that the paper regular reflection characteristic data is virtually arranged at the same position as the document data, and the sheet regular reflection characteristic data value at the coordinate position corresponding to the target position 204 of the document data is used.

  Regarding the sheet diffuse reflection characteristic data, the second embodiment also has a fixed value that is the same value at any location, as in the first embodiment. More specifically, when the value of the mixing ratio is α, the preview data value P is the sheet diffuse reflection characteristic data value Diff and the sheet regular reflection characteristic data value Spec (x, x, extended in a virtual three-dimensional space. Using y, z), the following equation is used.

  Note that Spec (x, y, z) is a sheet regular reflection characteristic data value at a printed material position corresponding to the coordinate position (attention position) of the document data of interest. In FIG. 6, paper regular reflection characteristic data is virtually superimposed on the position of the document data, and the sheet regular reflection characteristic data value at the position corresponding to the position S (x, y, z) of the document data of interest is represented by Spec (x , Y, z).

  Generally, the size of document data is smaller than the size of printed matter (paper size). In order to give a paper texture to the printed material position corresponding to the outside of the document data size, the preview data value is calculated by the above formula even outside the document data size.

  The third embodiment is an embodiment in which the sheet diffuse reflection data value differs depending on the coordinate position (the target position of the document data). The configuration of the third embodiment is almost the same as that of the first embodiment. The difference from the first embodiment is that the sheet diffuse reflection characteristic data is not a fixed RGB value (described in FIG. 10A of the first embodiment) as in the first embodiment, and the value is different depending on the coordinate position. It is in taking point.

  First, the sheet diffuse reflection characteristic data in Example 3 will be described. The sheet diffuse reflection characteristic data of Example 3 is that the actual cast coated paper (mirror coated platinum paper, Oji Paper Co., Ltd.) is arranged so that the diffuse reflection image from the paper surface can be photographed, the arrangement of the illumination device, and the photographing. It was collected by determining the position of the device (digital camera) and shooting.

  More specifically, photographing was performed with the incident light angle from the illumination device to the sheet being 45 degrees and the photographing apparatus position being 0 degrees. Also, the shooting conditions are adjusted so that the resolution is 400 dpi with respect to the actual paper size. Further, the brightness of the captured image was adjusted so that the average value was 235 (8-bit value). Furthermore, since the photographed image is smaller than the size of the printed material to be previewed (size of the original data), the images are connected and enlarged to the same size as the printed material. In the third embodiment, the image data generated in this way is used as paper diffuse reflection characteristic data.

  In the third embodiment, a diffuse reflection image of a real sheet is taken with a digital camera, and the diffuse reflection on the sheet surface is finely changed at each position on the sheet surface (perceived in the diffuse reflection on the sheet surface). Texture) can be reflected in the paper diffuse reflection characteristic data. In other words, the paper diffuse reflection data generated in this way changes the data value at each coordinate position (each pixel), and the change in the data value reflects the characteristic that the diffuse reflection on the paper surface changes finely. It has become.

  In the third embodiment, in addition to cast coated paper, gloss coated paper and mat coated paper are also collected and generated by the same method, and paper diffuse reflection data corresponding to three types of paper is stored in the storage device 103. . In the third embodiment, as in the first embodiment, corresponding data is selected and read out from the sheet diffuse reflection characteristic data stored in the storage device 103 according to the sheet selected by the input device 101. ing.

  Also in the third embodiment, as in the first embodiment, the storage device 103 stores a program describing a procedure for processing each data. Also in the third embodiment, this program is called to perform processing for obtaining preview data.

  Also in the third embodiment, steps S1 to S7 in the image processing method according to the first embodiment are performed (steps S1 to S7 are the same as those in the first embodiment). In the third embodiment, the process corresponding to the step S8 of the first embodiment is performed as follows.

  In step S8 of the third embodiment, a preview data value is calculated. By the processing up to step S7, the value of the mixing ratio for each coordinate position of the document data is determined. In the first embodiment, the value of the paper diffuse reflection characteristic data is a fixed value (the same value at any location), whereas in the third embodiment, the paper diffuse reflection characteristic data has the same size as the printed matter as described above. The image diffused image data is used as the sheet diffuse reflection characteristic data (the value of the sheet diffuse reflection characteristic data reflects the diffuse reflection texture, and is different at each coordinate position).

  In the third embodiment, when calculating the preview data value at each coordinate position of the document data, the sheet diffuse reflection characteristic data value at the printed matter position (paper position) corresponding to each coordinate position of the document data is used. It is composed. That is, in FIG. 6, the paper diffuse reflection characteristic data is virtually arranged at the same position as the original data, and the paper diffuse reflection characteristic data value at the coordinate position corresponding to the target position 204 of the original data is used.

  The sheet regular reflection characteristic data in Example 3 is the same fixed value everywhere as in Example 1. More specifically, when the mixing ratio value is α, the preview data value P is a sheet diffuse reflection data value Diff (x, y, z) stretched in a virtual three-dimensional space and a sheet regular reflection characteristic. The data value Spec is used to calculate according to the following formula.

Diff (x, y, z) is a sheet diffuse reflection characteristic data value at a printed material position (paper position) corresponding to the coordinate position (attention position) of the document data of interest. That is, in FIG. 6, the sheet diffuse reflection characteristic data is virtually superimposed on the position of the document data, and the sheet diffuse reflection characteristic data value at the position corresponding to the position S (x, y, z) of the document data of interest is expressed as Diff. (X, y, z).

  The third embodiment is also the same as the second embodiment, and generally the size of the document data is smaller than the printed material size (paper size). In order to give a paper texture to the printed material position corresponding to the outside of the document data size, the preview data value is calculated by the above formula even outside the document data size.

  Note that it is possible to configure the data so that both the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data, which can be considered as a combination of the second and third embodiments, have different values depending on the coordinate position. In this case, it is possible to preview the printed matter in which both the diffuse reflection texture and regular reflection texture of the paper are reflected.

  In the fourth embodiment, the normal vector changes depending on the surface position of the printed material. The configuration of the fourth embodiment is almost the same as the configuration of the first embodiment. The difference from the first embodiment is that, in the step of determining the arrangement position of the printed material (step S3 of the first embodiment), the printed material is not arranged so that the normal vector is constant as in the first embodiment. The normal vector at the surface position of the printed material is arranged so as to differ depending on each position of the printed material.

In the first embodiment, the normal vector at each position of the printed material is set to a constant value in the step S3. n (x, y, z) = (0, 0, 1)
On the other hand, in Example 4, the normal vector at each position of the printed material was set to be the value of the following equation.

  Here, x is a coordinate in a virtual three-dimensional space that represents an arrangement position of the printed material. Although the parameter a depends on how the value of x is set, in the fourth embodiment, the x coordinate is set so that the original data is arranged exactly at −1.0 <x <1.0. In this case, a = 0.1.

  The normal vector set according to the fourth embodiment is the normal vector of the original surface when the original data arrangement position S (x, y, z) is arranged as follows.

  When the document data is arranged at the arrangement position defined by Expression (7), the document surface is arranged in a shape that is deformed downward with respect to the z direction (at this time, in the x direction) The z coordinate value of the original surface changes, but the z coordinate value does not change in the y direction).

  In the fourth embodiment, the normal vector at each position of the printed matter determined as described above is used to perform the subsequent processing. The processing performed in the fourth embodiment is the same as that in the first embodiment except that the arrangement position of each coordinate position of the document data is different from the normal vector.

  In the fourth embodiment, as in the first embodiment, a preview data value is calculated, and the calculated preview data value is rendered on a display as a display device. As a result, in the same manner as in the first embodiment, the regular reflection and diffuse reflection of the paper in the printed material can be reproduced, and the “real” paper texture can be reproduced on the display. In the fourth embodiment, in addition to this, since the normal vector at each position of the printed material is set to change depending on the position of the printed material, the paper diffuse reflection area and the paper reflected on the paper surface in the preview of the 3D display The regular reflection area is displayed as a complicated shape (if the normal vector is the same at each position on the printed paper, the diffuse reflection area and the regular reflection area are monotonous or monotonous. Will change).

  As a result, in the fourth embodiment, in the preview of 3D display, it is possible to reproduce a more “real” paper texture from the viewpoint of the complexity of the illumination shape reflected on the paper surface.

  The fifth embodiment is an embodiment in which a print image is bent and displayed at the time of preview display. FIG. 7 is an example showing a state where the sheet is bent. The ruled lines in FIG. 7 are given to clearly indicate the state of bending of the paper, and are not displayed during actual preview.

  When the preview image is displayed, the print image is bent and displayed as shown in FIG. 7, so that the direction of the normal vector at each position of the printed material changes according to the position of the printed material in the normal method (normal line). Vector orientation is not uniform).

  According to the method of bending the printed image as in the fifth embodiment (FIG. 7), the sheet diffuse reflection area and the sheet regular reflection area reflected on the sheet surface are displayed as complex shapes in the 3D display preview. From the viewpoint of the complexity of the illumination shape reflected on the paper surface, it is possible to reproduce a more “real” paper texture.

  Example 6 is an example having a viewpoint position input device. The configuration of the sixth embodiment is mostly the same as the configuration of the first embodiment. The difference from the first embodiment is that, in addition to the configuration of the first embodiment, a configuration having a visual position input device that can change the visual (viewpoint) position is adopted.

  In the sixth embodiment, a cross key as shown in FIG. 8 is displayed on the display that is the display device 102, and the viewpoint is moved left and right and up and down by clicking the cross key with the mouse that is the input device 101. Can do. In the sixth embodiment, the viewpoint can be moved back and forth by scrolling the mouse (the cross key operation on the mouse is converted into the x coordinate and the y coordinate of the viewpoint position in the virtual three-dimensional space, and the scroll operation is performed. The viewpoint position is determined in terms of the z coordinate in the virtual three-dimensional space).

  Then, the preview data is calculated for the viewpoint newly set in this way. Accordingly, the user can check the preview image while changing the viewpoint position for observing the printed matter in the 3D display preview.

  Example 7 is an example having a printed material position input device. The configuration of the seventh embodiment is mostly the same as that of the first embodiment. The difference from the first embodiment is that, in addition to the configuration of the first embodiment, a configuration having a printed material position input device that can change the arrangement position of the printed material is adopted.

  In the seventh embodiment, the printed matter in the virtual three-dimensional space is set so that the paper rotates in the left-right direction (rotation with the y axis as the rotation center) in response to moving the mouse cursor left and right. Similarly, the printed matter in the virtual three-dimensional space is set so that the paper rotates in the vertical direction (rotation about the x axis as the rotation center) in response to the movement of the mouse cursor in the vertical direction.

  In this way, after changing and determining the position of the printed material corresponding to the mouse cursor, the calculation of the preview data is calculated for the newly set position of the printed material. As a result, the user can check the preview image while changing the position of the printed material in the 3D display preview.

  The eighth embodiment is an embodiment in which the arrangement position of the printed material is determined by reflecting the bending operation. The configuration of the eighth embodiment is mostly the same as the configuration of the first embodiment. The difference from the first embodiment is that, in addition to the configuration of the first embodiment, there is a configuration having a printed material position determining means for determining a printed material position reflecting a predetermined bending operation.

  In the eighth embodiment, a configuration having a mechanism for determining a printed material position reflecting a predetermined bending operation is adopted. In the eighth embodiment, the arrangement position S (x) in which the position of the printed material is determined by Equation (7) described above. , Y, z).

  In the eighth embodiment, the arrangement position of the printed material is determined, the preview data value is calculated, and the preview is displayed on the display while the value of the constant a in Expression (7) is changed. That is, it is configured to display an animation in which the placement position of the printed material changes in the virtual three-dimensional space. In the eighth embodiment, the constant a is set in a range of −0.1 to 0.1 so as to perform reciprocating motion in 0.005 steps. This corresponds to a state in which the printed material is repeatedly deformed “convex upward” and “convex downward” in the virtual three-dimensional space.

  In the eighth embodiment, by adopting the configuration having the printed material position determining means for determining the printed material position reflecting the predetermined folding operation as described above, various folded states of the printed material in the preview of the three-dimensional display. Will be displayed. Displaying such a folded state of the printed material is very important in expressing the “genuineness” of the printed material. This is thought to be caused by the fact that the printed material is made of thin paper and is often observed in one of the folded states under normal observation conditions (when observing the printed material) , It is not only the case of locating and observing in a completely flat place).

Further, in the eighth embodiment, the folded state operates instead of being stationary (displayed as a moving image in which the folded state of the paper changes), thereby realizing the expression of the paper texture that further improves the “genuineness”. ing.
The present invention is not limited to the above-described configuration, and for example, a printed matter arrangement determination method other than Expression (7) may be applied. Any method for determining the position of the printed material may be used as long as the position of the printed material is presented as a folded state other than a plane, and the folded state can be displayed in an operating state rather than a stationary state. Absent.

  Example 9 is an example corresponding to a complicated illumination shape. FIG. 9 shows mixing ratio data (mixing ratio data of paper diffuse reflection characteristic data and paper regular reflection characteristic data) of Example 9.

  By using a complicated shape as shown in FIG. 9 as the mixing ratio data, the illumination shape reflected on the paper surface in a display such as a 3D display preview can be made more complicated. Since the illumination shape reflected on the actual printed material surface is a complex shape reflecting the actual illumination conditions, by using the mixture ratio data as shown in FIG. “Real” paper texture can be reproduced.

  As described above, the image processing apparatus according to the present invention is an image processing apparatus that displays a printed matter, and reproduces the so-called “genuineness” that is the texture of the paper of the printed matter as a 3D-displayed printed matter preview at a high level. doing.

  As described in the prior art, in the prior art, there is a problem that the calculation load until the preview data value is calculated is large, and it is not possible to deal with a plurality of light sources or light sources with complicated shapes.

  1. The image processing apparatus according to the present invention uses the virtual ratio of mixing ratio data of the sheet of printed matter and the specular reflection characteristic data of the sheet of printed matter depending on the coordinate position in the virtual three-dimensional space as the virtual ratio data. An original position of the original data is arranged from a predetermined viewpoint position in the virtual three-dimensional space, arranged at a predetermined position in the three-dimensional space, arranged so that the original data of the printed matter has a predetermined arrangement relationship with the mixing ratio data. Determining means for determining a reference position on the mixing ratio data indicated by the reflection vector of the vector directed to the head, and the diffuse reflection characteristic data of the paper and the correctness of the paper according to the mixing ratio of the reference position on the mixing ratio data There is a calculation means for calculating data obtained by mixing the reflection characteristic data as display data at the target position of the document data.

  The image processing apparatus of the present invention determines the reference position of the mixing ratio data with the above-described configuration, and only mixes the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data in accordance with the mixing ratio data value at the reference position. Data is being generated. For this reason, the image processing apparatus of the present invention is an image processing apparatus that has a smaller calculation load than the prior art. Specifically, in the present invention, by simply calculating a vector corresponding to the reflection vector (R) of the line-of-sight vector in the prior art (corresponding to the mixing ratio data reference position of the present invention), the mixing ratio data is referred to. Mixing ratio can be determined.

  On the other hand, in the prior art, the angle difference between the reflection vector and the light source vector is further calculated from the reflection vector (R) of the line-of-sight vector, and the specular reflection color is calculated by a predetermined calculation formula using the angle difference. Even after the calculated specular reflection color is calculated, the composite ratio of the specular reflection color and the diffuse reflection color is determined through compression of the specular reflection color and calculation of the maximum value of the specular reflection color. That is, the image processing apparatus according to the present invention can realize a mixing ratio calculation method that requires less calculation load to determine the mixing ratio between the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data, as compared with the prior art. It becomes like this.

  In the image processing apparatus of the present invention, the mixing ratio data describing the mixing ratio of the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data is simply configured so that the mixing ratio changes depending on the position. Therefore, it is possible to pre-calculate and prepare before the preview (even if it is calculated and created at the time of the preview, the calculation / creation only needs to be performed once).

  Therefore, even when multiple light sources or light sources with complex shapes are reflected on the surface of the paper and are regularly reflected, the mixing ratio data is calculated and created only once. . Therefore, the calculation load does not increase even when previewing 3D display.

  On the other hand, in the prior art, as described above, the calculation load is originally large, and in the case of dealing with a plurality of light sources, the step of calculating the angle difference between the reflection vector and the light source vector depends on the number of light sources. Therefore, the calculation load further increases. In addition, since there is no corresponding method for light sources with complex shapes, light sources with complex shapes cannot be reflected in the printed material preview of 3D display. In an illumination environment (for example, an illumination environment in an office) when a printed image (genuine) is actually visually recognized, since the illumination is not a simple configuration such as one, the conventional technique is far from the actual room illumination environment. It can only reflect lighting conditions.

  On the other hand, in the present invention, it is possible to realize a 3D display preview reflecting the texture of the paper by reflecting a plurality of light sources or light sources having a complicated shape.

  As compared with other prior arts, the present invention has a remarkable effect. In the present invention, it is possible to realize a calculation method with a small calculation load when determining the mixing ratio between the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data. For this reason, it is possible to perform a preview in which the texture of the paper is well reproduced in the printed matter preview of 3D display with a small calculation load. Further, according to the present invention, the mixing ratio data can be calculated and prepared in advance before the preview, so that even in the case of a plurality of light sources or light sources having a complicated shape, it is reflected in the 3D display preview. can do. As a result, a state close to an illumination environment for visually recognizing a real printed matter can be reproduced in a 3D display preview.

  2. The image processing apparatus of the present invention has preview data calculation means for calculating a preview data value from the sheet diffuse reflection characteristic data and the sheet regular reflection characteristic data according to the mixing ratio data at the reference position.

  In the present invention, the sheet regular reflection characteristic data is data whose data value varies depending on the coordinate position, and the sheet regular reflection characteristic data value used at the time of mixing is a data value corresponding to the target position of the document data. .

  As described in the related art, the conventional configuration does not take into consideration the characteristic that the specularly reflected light is finely changed on the surface of the paper (texture perceived in the specular reflection on the paper surface). For this reason. In the prior art, since the texture in the regular reflection light of the paper is not reflected in the preview function, the preview does not sufficiently reflect the texture of the paper.

  According to the study of the present inventor, in order to achieve a “real” paper texture in a display device such as a display by improving a paper texture by a printed material preview of 3D display, a regular reflection texture (paper) Slight irregularity of the image, and the specular reflection characteristics are finely changed on the paper surface) must be reproduced in the preview function.

  In the image processing apparatus of the present invention, as one of the features, the sheet regular reflection characteristic data is data whose data value varies depending on the coordinate position. By doing so, it becomes possible to reflect the paper texture (slight non-uniformity of the paper, the reflection characteristics finely changing on the paper surface) that the inventor has focused on in the preview.

  However, the paper texture does not simply mean that the specular reflection light on the paper surface should be non-uniform, and according to the study of the present inventors, the paper texture is fixed at the position of the paper surface. Needed (paper texture should not move relative to paper position).

  In the preview function of 3D display, the position of regular reflection changes according to the shape of the paper (bend, warp, etc.). At this time, it is necessary to reproduce the texture of the paper so that it is fixed at the surface position of the paper. There is. In the present invention, the sheet regular reflection characteristic data value used at the time of mixing is a data value at the reference position determined from the arrangement position of each position of the printed matter. The texture of the regular reflection light of the paper can be reproduced as if it was fixed on the paper surface. In the present invention, since the texture of the regular reflection light of the paper is expressed by being fixed to the paper surface in this way, it contributes to the realization of a printed matter preview of 3D display excellent in paper texture.

  As compared with other prior arts, the present invention has a remarkable effect. In the present invention, the paper texture in the specular reflection light is reflected in the preview, and the paper texture in the specular reflection light is reproduced at a fixed position on the surface of the paper, so that a more “real” paper texture can be reproduced. A printed material preview of 3D display can be realized. In the prior art, a preview that sufficiently reflects the paper texture cannot be realized.

  3. In the present invention, the paper diffuse reflection characteristic data is data having different data values depending on the coordinate position, and the paper diffuse reflection characteristic data value used at the time of mixing is a data value corresponding to the target position of the document data. ing. Further, in the above-described 2., the sheet regular reflection characteristic data whose data value varies depending on the position, whereas in the present invention, the data value of the sheet diffuse reflection characteristic data varies depending on the coordinate position.

  As described in the prior art, the conventional configuration does not take into account the characteristic that diffuse reflected light changes finely on the surface of the paper (texture perceived by diffuse reflection on the paper surface). The texture is not reflected in the preview function and is not a preview that sufficiently reflects the paper texture.

  According to the inventor's study, in order to improve the paper texture in the preview function of the 3D display and realize the “real” paper texture in a display device such as a display, It is necessary to reproduce the non-uniformity and the reflection characteristics on the paper surface finely in the preview function (the paper texture here is the difference between the regular reflection texture in specular reflection light and the diffuse reflection texture in diffuse reflection light). Including both).

  In the image processing apparatus according to the present invention, as one of the features, the paper diffuse reflection characteristic data is data whose data value varies depending on the coordinate position. By doing so, it is possible to reflect in the preview the texture of the paper on which the present inventor is paying attention (slight non-uniformity of the paper, the reflection characteristics being finely changed on the paper surface).

  Also, as in 2 above, even in the case of a diffuse reflection texture, it is not necessary to make the diffuse reflection light on the paper surface non-uniform, and the paper texture is fixed at a position on the paper surface. Need to be. In the preview function of 3D display, the position of the diffuse reflection area and the regular reflection area changes on the surface of the paper according to the shape of the paper (bend, warp, etc.). At this time, the paper texture (diffuse reflection texture, Both regular reflection textures) need to be reproduced to be fixed at the paper surface position.

  For this reason, the present invention is characterized in that the sheet diffuse reflection characteristic data value used at the time of mixing is a data value at the reference position determined from the arrangement position of each position of the printed matter. Thus, it is possible to reproduce the texture of the diffuse reflection light of the paper as if it was fixed to the paper surface.

  In the present invention, the texture of the diffuse reflection light of the paper is expressed by being fixed to the surface of the paper, which contributes to the realization of a printed matter preview of 3D display excellent in paper texture.

  As compared with other prior arts, the present invention has a remarkable effect. In the present invention, the paper texture in the diffuse reflected light is reflected in the preview, and the paper texture in the diffuse reflected light is reproduced at a fixed position on the surface of the paper, so that a more “real” paper texture can be reproduced. A printed material preview of 3D display can be realized. In the prior art, a preview that sufficiently reflects the paper texture cannot be realized.

  4). In the present invention, the mixing ratio data is mixing ratio data created so that the mixing ratio varies depending on the coordinate position, and the mixing ratio data is configured to satisfy the formula (1). In the configuration of 1 described above, the paper texture is reflected in the preview by a method different from that of the prior art. In 1. above, because of this unique method, the regular reflection area and the diffuse reflection area appearing on the paper surface are controlled in the 3D display preview according to the method of setting the mixing ratio of the mixing ratio data, and the paper texture is reproduced. .

  According to the study by the present inventor (comparison experiment of Example 1), by creating the mixing ratio data so as to satisfy the expression (1), the specular reflection region and the diffuse reflection appearing on the paper surface in the preview of 3D display. It has been found that the mode of switching to the area looks like lighting reflected on the paper surface, which contributes to the reproduction of a more “real” paper texture. In this study, an attempt was made to apply a relational expression (such as a Gaussian function) having a similar shape in addition to the expression (1). The relational expressions of these similar shapes are not bad at all, but they cannot be reproduced as “real” to the extent of the expression (1).

  Formula (1) shows that the mixing ratio (here, the mixing ratio of specular reflection data) decreases as a function of the square of the distance from the maximum value as the mixing ratio data is moved away from the position where the maximum is obtained. The position where the mixing ratio becomes maximum is a position corresponding to the center of illumination in the actual reflection of illumination on the paper. For this reason, by using the mixture ratio data having the characteristic represented by the expression (1), the aspect of attenuation from the illumination center to the peripheral portion in the reflection of the illumination on the actual paper is appropriately reflected. Mixing ratio data can be generated.

  As a result, according to the present invention, in the printed material preview of 3D display, the “real” paper texture can be reproduced from the viewpoint of the attenuation from the illumination center to the peripheral portion in the illumination reflection.

  5. In the present invention, the above-described 1. In addition, the print position normal vector determining means is provided for determining the normal vector at the print surface position so that the normal vector at the print surface position changes according to the print surface position. ing.

  According to the inventor's study, by setting the normal vector at each position on the surface of the printed material to be different depending on the position of the printed material, the regular reflection region and the diffuse reflection region become a complicated shape on the paper surface. Appears. In the case of an actual printed matter, since the printed matter itself is not so rigid, if the printed matter is held by hand and placed in a non-planar place, the printed matter is not completely flat. Rather, there are many cases where the printed matter is observed in a state where it is not flat. When the printed material is observed in a non-planar state, the illumination on the surface of the printed material is reflected in a complicated shape. In addition, there is a surface where the preview of the printed material feels more natural when the reflection of the illumination on the surface of the printed material has a complicated shape.

  In the present invention, since the normal vector at the surface position of the printed material is set to change depending on the surface position of the printed material, the sheet diffuse reflection area and the sheet regular reflection area reflected on the sheet surface in the 3D display preview are complicated. (If the normal vector is the same at each position on the printed paper, the diffuse reflection area and the paper regular reflection area will be monotonous or monotonous.) Will be a big change).

  Thus, according to the present invention, in the preview of 3D display, it is possible to reproduce the “real” paper texture from the viewpoint of the complexity of the illumination shape reflected on the paper surface and the complicated change.

  6). In the present invention, the above-described 1. And a visual position input device that enables a visual (visual) position to be changed.

  Since the present invention has a visual position input device that enables the visual position to be changed, it is possible to reproduce a state in which the printed material is observed from the visual position desired by the user and display it in a 3D display preview. This allows the user to check the paper texture of the printed material from various viewing positions, and is therefore useful for confirming the three-dimensional texture that is the original texture of the printed material (for example, Even when the same specularly reflected light is used, the amount of specularly reflected light is greater when the viewing position is lower than the printing surface compared to when it is higher).

  In the present invention, in the preview of 3D display, the texture of the printed material from the viewing position desired by the user can be confirmed, and thereby the three-dimensional texture of the printed material can be reproduced and confirmed in the preview. .

  7). In the present invention, the above-described 1. In addition to this, it is configured to have a printed matter position input device capable of changing the printed matter position.

  Since the present invention has a printed material position input device that allows the printed material position to be changed, it is possible to reproduce a state in which the printed material is arranged at a position desired by the user and display it in a 3D display preview. This is useful for confirming the three-dimensional texture that is the original texture of the printed material since the user can confirm the reflected light from the printed material at various positions.

  In the present invention, in the preview of the 3D display, the texture of the printed material can be confirmed by reproducing the state in which the printed material is arranged at the position desired by the user, thereby previewing the three-dimensional texture of the printed material. Can be reproduced and confirmed.

  8). In the present invention, the above-described 1. In addition to this, it is configured to include a printed material position determining unit that determines a printed material position by reflecting a bending operation in which a printed material position is determined in advance.

  According to the study by the present inventor, in addition to the diffuse reflection characteristics and regular reflection characteristics of the paper described in the present invention, the state of folding of the paper is also important for the expression of “genuineness” of the printed paper. By combining the regular reflection / diffuse reflection of the paper and the folded state of the paper instead of a flat surface, the “genuineness” of the paper is improved in the preview of the 3D display. Furthermore, by changing and operating the folded state instead of being stationary (displaying as a moving image in which the folded state of the paper changes), it is possible to express the texture of the paper with a further improvement in “genuineness”.

  The present invention includes a printed material position determining unit that determines a printed material position by reflecting a predetermined folding operation, and can display a moving image in which the folded state of the paper changes in a 3D display preview. As a result, it is possible to express the texture of the paper with a further improvement in “genuineness”.

201 Document data 202 Mixing ratio data 203 View point position 204 Document data position 205 Reflection vector 206 Reference position

JP 2010-246049 A JP 2010-152533 A JP 2009-130461 A

Claims (12)

  In the image processing apparatus for displaying the printed matter, the mixing ratio data in which the mixing ratio between the diffuse reflection characteristic data of the printed matter sheet and the regular reflection characteristic data of the printed matter sheet differs according to the coordinate position in the virtual three-dimensional space, It is arranged at a predetermined position in the virtual three-dimensional space, the original data of the printed matter is arranged so as to have a predetermined arrangement relationship with the mixing ratio data, and the original data of the original data from a predetermined viewpoint position in the virtual three-dimensional space. Deciding means for deciding a reference position on the mixing ratio data indicated by a reflection vector of a vector directed to the target position, diffuse reflection characteristic data of the paper according to the mixing ratio of the reference position on the mixing ratio data, and the paper Characterized in that it comprises calculation means for calculating data obtained by mixing the specular reflection characteristic data as display data at the target position of the document data. That image processing apparatus. The mixing ratio data R (x, y) at the coordinate position (x, y) in the virtual three-dimensional space is expressed by Equation 1 when the position indicating the maximum value of the mixing ratio data is (x0, y0). The image processing apparatus according to claim 1, wherein the image processing apparatus has an attenuation characteristic.
Parameters a, b, and c are predetermined constants   The image processing apparatus according to claim 1, wherein the value of the regular reflection characteristic data of the sheet differs according to a target position of the document data.   The image processing apparatus according to claim 1, wherein the value of the diffuse reflection characteristic data of the sheet differs according to a target position of the document data.   The image processing apparatus according to claim 1, wherein the regular reflection characteristic data of the paper, the diffuse reflection characteristic data of the paper, and the mixing ratio data differ depending on the type of the paper.   The image processing apparatus according to claim 1, wherein a normal vector at a surface position of the printed material changes according to a surface position of the printed material.   The image processing apparatus according to claim 1, further comprising an input unit that changes the viewpoint position.   The image processing apparatus according to claim 1, further comprising an input unit that changes an arrangement position of the printed matter.   The image processing apparatus according to claim 1, further comprising: a printed material arrangement position determining unit that determines an arrangement position of the printed material by reflecting a predetermined bending operation.   In the image processing method for displaying a printed matter, the mixing ratio data in which the mixing ratio between the diffuse reflection characteristic data of the printed matter sheet and the regular reflection characteristic data of the printed matter sheet differs according to the coordinate position in the virtual three-dimensional space, It is arranged at a predetermined position in the virtual three-dimensional space, the original data of the printed matter is arranged so as to have a predetermined arrangement relationship with the mixing ratio data, and the original data of the original data from a predetermined viewpoint position in the virtual three-dimensional space. A determination step of determining a reference position on the mixing ratio data indicated by a reflection vector of a vector directed to a target position; and the diffuse reflection characteristic data of the paper and the paper according to the mixing ratio of the reference position on the mixing ratio data And a calculation step of calculating data obtained by mixing the specular reflection characteristic data as display data at a target position of the document data. Image processing how.   In the image display method for displaying the texture of the printed paper, the mixing ratio of the diffuse reflection characteristic data of the printed paper and the regular reflection characteristic data of the printed paper varies according to the coordinate position in the virtual three-dimensional space. Ratio data is arranged at a predetermined position in the virtual three-dimensional space, original data of the printed matter is arranged so as to have a predetermined arrangement relationship with the mixing ratio data, and from a predetermined viewpoint position in the virtual three-dimensional space. A determination step of determining a reference position on the mixing ratio data indicated by a reflection vector of a vector directed to a target position of the document data; and a diffuse reflection characteristic of the paper according to the mixing ratio of the reference position on the mixing ratio data Data obtained by mixing data and regular reflection characteristic data of the paper is calculated as display data for displaying the texture of the paper at the target position of the original data. The image display method characterized by comprising a calculation step that.   The program for making a computer implement | achieve the image processing method of Claim 10, or the image display method of Claim 11.