JP4777162B2 - Image special effect device and image special effect method - Google Patents

Description

  The present invention relates to an image special effect device and an image special effect method used for video production and the like, and in particular, performs illumination processing in consideration of the relationship between a light source and a viewpoint, expresses a realistic special effect in real time, and a variety of special effects. It is intended to simplify and miniaturize an apparatus that can deal with effect images.

Conventionally, in order to give a lighting effect according to the type of special effect image, various shapes can be obtained by mixing table values stored with a plurality of illumination patterns corresponding to a plurality of predetermined effect surface shapes. A video effect device capable of obtaining a lighting effect on the effect surface is described. (For example, see Patent Document 1)
JP-A-5-143746

  However, the above-described special effect device described in Patent Document 1 has a situation in which various illumination patterns must be determined in advance and an optimal combination of illumination patterns according to the effect surface must be determined. Furthermore, when a special effect function is newly added, there is a situation in which an optimal combination cannot be found with a mounted illumination pattern.

  In general, a calculation method for realizing a specular reflection illumination effect so as not to be affected by the shape of the effect surface includes a light source vector (L) and an effect surface normal vector (N). Assuming that the reflection vector is R and the viewpoint vector is V, the reflection direction vector R is calculated by, for example, Equation 1.

  Reflection direction vector R = (2 (L · N) N−L) Equation 1

  By calculating the inner product of the viewpoint vector V in Equation 1, the reflectance in the viewpoint direction can be calculated. Although the calculation circuit of Formula 1 can be easily mounted on an FPGA device having abundant multipliers, the lighting effect obtained by combining a plane and a curved surface is continuous and smooth. When an effect surface such as a book having a plurality of pages is assumed in combination with the above, if the page turning operation is fast, there is a situation that the visibility of the lighting effect is lacking and a special effect image without sharpness is obtained.

  The present invention has been made in view of the above circumstances, and various image special effects can be obtained even when the illumination effect pattern is not predetermined and the shape of the effect surface changes quickly. It is an object to provide an image special effect device and an image special effect method capable of realizing a lighting effect corresponding to the above.

  In order to achieve the above object, in the first image special effect device of the present invention, the image information related to the input image has a lighting effect by light from a light source when viewed from an arbitrary viewpoint on a curved surface. An image special effect device, which is added and outputs a video signal obtained by mapping the image information on the surface, and includes orthogonal coordinate data indicating the position of the horizontal coordinate and the vertical coordinate of the surface, and the shape of the surface A normal vector generating unit that generates a normal vector indicating a normal vector in the position of the surface, a light source direction unit vector indicating the normal vector, a unit vector of the light source direction, and the viewpoint By calculating a viewpoint vector V indicating a vector in the direction of A and an expression (A (2 (L · N) N−2L) · V) using an arbitrary value A, the view direction V A lighting effect generator for generating a reflectance of, based on the image and the reflectance has a configuration having an image information creation unit that creates the image information.

  With this configuration, even if the illumination effect pattern is not predetermined and the shape of the effect surface changes quickly, illumination effects corresponding to various image special effects can be realized.

  In addition, the second image special effect device of the present invention is configured to include an arbitrary value changing unit capable of changing the arbitrary value A.

  With this configuration, it is possible to adjust the lighting effect according to the lighting and shading processing for a specific part of the page turning, and realize a lighting effect with good visibility without adding a large-scale new calculation circuit The image special effect device can be downsized.

  Further, in the third image special effect device of the present invention, the lighting effect generation unit has a plurality of candidates for the reflectance to be generated, and generates one reflectance from the plurality of candidates. Yes.

  With this configuration, it is possible to switch between multiple types of lighting effect data calculation formulas, and in addition to the page turning effect, lighting effects can be calculated for other image special effects such as the ball effect. Can be miniaturized.

The first image special effect method of the present invention uses an image special effect device to illuminate the input image information with light from a light source when viewed from an arbitrary viewpoint on a curved surface. adding effects, an the image information by mapping image special effect how to output a video signal obtained on the surface normal vector generation unit, wherein the image special effect apparatus provided in the horizontal direction of the face A normal vector generation step for generating a normal vector N indicating a vector in a normal direction at the position of the surface based on the orthogonal coordinate data indicating the coordinates and the position of the vertical coordinate and the shape of the surface; lighting effect generator which effect device included in the normal vector N, the light source direction unit vector L indicating the unit vector in the direction of the light source, indicate the direction of the vector of the viewpoint Viewpoint vector V, and the calculation of any is an expression using a value A A (2 (L · N ) N-2L) · V, lighting effects generating step of generating a reflectance of the light to the viewpoint direction And an image information creating unit provided in the image special effect device includes an image information creating step of creating the image information based on the image and the reflectance.

  By this method, it is possible to realize lighting effects corresponding to various image special effects even when the pattern of the lighting effect is not predetermined and the shape of the effect surface changes quickly.

  The present invention provides an image special effect device that can realize lighting effects corresponding to various image special effects even when the pattern of the lighting effect is not predetermined and the shape of the effect surface changes quickly. And to provide an image special effect method.

  In addition, in the lighting effect added to the page turning image special effect that turns the page, the lighting effect on the top and bottom planes can be canceled according to the page turning shape, and the lighting effect with good visibility only on the curved surface Can be added and the apparatus can be miniaturized.

  Also, by changing the arbitrary constant A in the lighting effect data depending on the page turning surface, it is possible to obtain the optimal lighting effect for each of the shading and lighting effects.

  In addition, an expression for calculating lighting effect data, for example, “A (2 (L · N) N−2L) · V” is switched to “2 (L · N) N−L) · V”, Lighting effect data can be calculated, and can be widely applied to lighting effects of various image special effects.

Hereinafter, an image special effect device according to an embodiment of the present invention will be described with reference to the drawings.
(First embodiment)
First, the image special effect device according to the first embodiment of the present invention will be described.

  FIG. 1 is a diagram showing a configuration of an image special effect device 100 according to the first embodiment of the present invention. The image special effect device 100 includes a normal vector generation unit 110 and a lighting effect data calculation unit 111.

  The normal vector generation unit 110 will be described with reference to FIG. Sequential display screen horizontal direction (x-axis) 12 using as input the orthogonal coordinate 1 indicating the position of the horizontal coordinate and the vertical coordinate of the input image, and the effect radius r2 that determines the effect size of the page turning portion. Alternatively, the normal vector N3 of each page turning surface corresponding to the position of the horizontal coordinate x12 is obtained from the display screen vertical direction (y-axis) 13.

  As shown in FIG. 3, the normal vector N3 of the upper surface plane portion 20 is the normal vector N30 of the upper surface plane N30 = (0,0,1), and the upper surface curved surface portion 21 (in FIG. 2). The normal vector N3 of the dot display portion) is the normal vector N31 of the upper curved surface, the normal vector N3 of the lower flat surface portion 22 is the normal vector N32 of the lower flat surface = (0,0,1), and the lower curved surface portion 23 A normal vector N3 (indicated by a hatched line in FIG. 2) is generated as a normal vector N33 of the lower curved surface.

  In FIG. 1, Xeffect 10 generates various video effects such as a page turning effect and a ball effect, which are calculated by the normal vector generation unit 110 from the data in the horizontal direction X12 of the sequential display screen of Cartesian coordinates 1. Display screen horizontal direction data.

  Yeffect 11 is display screen vertical direction data for generating various video effects such as a page turning effect and a ball effect, which are calculated by the normal vector generation unit 110 from sequential display screen vertical direction Y13 data of orthogonal coordinates 1. It is.

  In this way, the image special effect is obtained by reading the input image data sequentially written in the frame memory with sequential write addresses from the frame memory with read addresses based on Xeffect10 and Effect11 calculated by the normal vector 110. Various video effects such as a page turning effect and a ball effect can be added to the input image.

  The illumination effect data calculation unit 111 is a reflection direction vector based on the normal vector N3 generated by the normal vector generation unit 110, the light source direction unit vector L4, the viewpoint vector V5, and an arbitrary constant A6 input from a microcomputer or the like. R7 is generated.

  After generating the reflection direction vector R7, the lighting effect data calculation unit 111 uses the lighting effect data calculation formula 111 to calculate the lighting effect data I9 using the following formula 2. The processing content for calculating the lighting effect data I9 will be described below. Here, the viewpoint vector V5 is V, the light source direction unit vector L4 is L, the reflection direction vector R7 is R, the normal vector N3 is N, and the arbitrary constant A6 is A.

  Illumination effect data I9 = (R · V) × A = ((2 (N · L) N−2L) · V) A ··· Equation 2

When Expression 1 is used, even if the normal vector of the plane is (0, 0, 1), the illumination effect data I remains, so that the illumination effect is applied to the front plane portion 20 and the top plane portion 21 in FIG. Has been added, resulting in a lighting effect that does not appear sharp.

  Therefore, in order to make the illumination effect data I at the time of plane zero, Expression 2 that can be realized by inserting a coefficient “2” immediately before L in Expression 1 is derived. Thereby, the illumination effect of a plane part is canceled. Since the lighting effect data I of the curved surface portion is weakened, the amplification factor of the lighting effect data I can be adjusted by adding an arbitrary localization A.

  Regarding Equation 2, first, the viewpoint vector V5 is the viewpoint vector V5 for the human eye 35 in FIG. 3 as (0,0,1), the normal vector N3 as (Nx, Ny, Nz), and the light source direction unit vector L4. When (Lx, Ly, Lz) and the arbitrary constant A6 are set to 1, the lighting effect data I9 is obtained as follows. The z-axis direction components such as Nz and Lz are components in the viewpoint direction (z-axis) 14.

  First, when “2 (N · L)” in Expression 2 is expanded, “2NxLx + 2NyLy + 2NzLz” is obtained, which is designated as “Q”. At this time, if Q is substituted into Equation 2, the reflection vector R = (QN−2L). When the inner product of the reflection direction vector R and the viewpoint vector V5 (0,0,1) is obtained as the illumination effect data I9, the illumination effect data I9 is expressed by the following Equation 3.

  Illumination effect data I9 = R ・ V = R ・ (0,0,1) = Q ・ Nz-2Lz ・ ・ ・ ・ Formula 3

  As described above, the lighting effect data I9 for each shape of the page turning effect will be described with reference to FIGS.

  In the case of the upper plane portion 20 and the lower plane portion 22, the normal vector N3 indicating the plane is (0, 0, 1) by the normal vector N30 of the upper plane and the normal vector N32 of the lower plane. The Q of 3 is 2 · Lz, and the Nz is 1, so that the lighting effect data I9 is “0”. As shown in the illumination effect data I40 for the upper plane portion in FIG. 4 and the illumination effect data I50 for the lower plane portion in FIG. 5, the illumination effect data I9 is 0, so the illumination effect is cancelled.

  In the case of the upper curved surface portion 21, the illumination effect data I9 becomes a value as shown in the illumination effect data I41 of the upper curved surface portion in FIG. 4 by the normal vector N31 in FIG. Since the illumination effect data I9 is larger than 0, an illumination effect called lighting is added to the upper surface aspect portion 21. By multiplying the lighting effect data I41 of the upper surface by an arbitrary constant A6, the lighting effect data I9 as shown in the lighting effect amplification data IA42 in FIG. 4 is generated, and the lighting effect called lighting can be further deepened.

  In the case of the lower curved surface portion 23, the illumination effect data I9 is obtained from the lower surface curved surface portion shown in FIG. 5 by the normal vector N33 of FIG. Since the illumination effect data I9 is smaller than 0, an illumination effect called shading is added to the lower curved surface portion 23. Furthermore, the lighting effect called shading can be further deepened by the arbitrary constant A6.

  In addition, when it is not desired to add the lighting effect to each of the page turning upper surface plane portion 20, upper surface curved surface portion 21, lower surface flat surface portion 22, and lower surface curved surface portion 23, the arbitrary constant A6 may be set to “0 (zero)”. .

  As a result, according to the page turning shape of FIG. 2, the lighting effect of lighting is added to the upper curved surface portion 21 without adding the lighting effect to the upper flat surface portion 20 and the lower flat surface portion 22, and the lower curved surface portion. The lighting effect of shading can be added to the 23.

  As described above, in this image special effect device 100, a large-scale image can be obtained by just reexamining a part of the lighting effect data calculation formula so that the lighting effect on the plane of the page turning effect can be canceled and the lighting effect can be added only to the curved surface. A lighting effect with good visibility can be realized without adding a new calculation circuit, and the apparatus can be miniaturized.

  In this embodiment, the effect of turning pages from right to left has been described as a theme. However, a page turning effect in any direction may be used, and a special effect combining a plane and a curved surface other than the page turning effect may be used.

  In the present embodiment, the viewpoint vector V5 has been described as (0, 0, 1), but other directions may be used.

  According to such an image special effect device 100 according to the first embodiment of the present invention, the image information related to the input image includes the illumination effect by the light from the light source when viewed from an arbitrary viewpoint on the curved surface. Is an image special effect device 100 that outputs a video signal obtained by mapping image information on a surface, and is based on orthogonal coordinate data indicating the position of the horizontal coordinate and vertical coordinate of the surface and the shape of the surface A normal vector generating unit 110 for generating a normal vector indicating a normal vector at the surface position, a normal vector, a light source direction unit vector indicating a light source direction unit vector, and a viewpoint direction vector. The reflectance of light toward the viewpoint is generated by calculating A (2 (L · N) N−2L) · V, which is an expression using the viewpoint vector V and the arbitrary value A The illumination effect data calculation unit 111 and the image information creation unit that creates image information based on the image and the reflectance. Even when the shape of the image changes rapidly, it is possible to realize lighting effects corresponding to various image special effects. Also, for example, in the lighting effect added to the page turning image special effect such as turning the page, the lighting effect on the top and bottom planes can be canceled according to the page turning shape, and only the curved surface has good visibility An effect can be added and the apparatus can be miniaturized.

(Second Embodiment)
Next, an image special effect device according to the second embodiment of the present invention will be described.

  FIG. 6 is a diagram showing a configuration of an image special effect device 600 according to the second embodiment of the present invention. The image special effect device 600 includes a normal vector generation unit 110, a lighting effect data calculation unit 111, and an arbitrary constant switching control unit 601. The arbitrary constant switching control unit 601 switches the value of the arbitrary constant A6 according to the shape of the page turning surface according to the position of the horizontal coordinate x12 of FIG. Note that the normal vector generation unit 110 and the illumination effect data calculation unit 111 are the same in configuration and function as described in the first embodiment, and thus the same reference numerals are given and description thereof is omitted.

  For example, when the orthogonal coordinate 1 corresponds to the upper curved surface portion 21 in FIG. 2, if the arbitrary constant switching control unit 601 sets the value of the arbitrary constant A6 to a coefficient such that the lighting effect data I9 is multiplied several times, the lighting effect is obtained. The data calculation unit 111 can generate the lighting effect data I9 by arbitrarily adjusting the lighting effect called lighting.

  On the contrary, when the orthogonal coordinate 1 corresponds to the lower curved surface portion 23 in FIG. 2, the arbitrary constant switching control unit 601 sets the value of the arbitrary constant A6 and the coefficient that makes the illumination effect data I9 less than 0. The lighting effect data calculation unit 111 can generate the proof effect data I9 by arbitrarily adjusting the lighting effect called shading.

  According to the image special effect device 600 according to the second embodiment of the present invention as described above, the specific part of page turning is provided by the configuration having the arbitrary constant switching control unit 601 that can change the arbitrary constant A. It is possible to adjust the lighting effect according to the lighting and shading process, and it is possible to realize a lighting effect with good visibility without adding a large-scale new calculation circuit. It can be downsized.

(Third embodiment)
Next, an image special effect device according to the third embodiment of the present invention will be described.

  In the image special effect device 700 according to the third embodiment of the present invention, the configuration block diagram of the entire device is not shown, but the configuration other than the lighting effect data calculation unit 111 is the same as in the second embodiment of the present invention. The configuration is the same as that of the image special effect device 100 or 600 in the first embodiment of the present invention. In the present embodiment, the image special effect device 700 includes a lighting effect data calculation unit 111B instead of the lighting effect data calculation unit 111. The lighting effect data calculation unit 111B receives a mode selection signal for selecting an expression for performing an operation from a plurality of lighting effect data I calculation expressions from a control unit (not shown), and selects one lighting effect data calculation expression I To do. FIG. 7 is a diagram illustrating a configuration of the lighting effect data calculation formula 111B of the special effect device according to the third embodiment of the present invention.

  The lighting effect data calculation unit 111B includes a first multiplier 701, a first 1-bit left shifter 702, a second 1-bit left shifter 703, a selector 704, a second multiplier 705, a subtractor 706, and a third multiplier 707. , A fourth multiplier 708.

  The first multiplier 701 receives the light source direction unit vector L4 and the normal vector N3, and outputs the calculation result to the first 1-bit left shifter 702. The first 1-bit left shifter 702 receives the calculation result of the first multiplier 701 and outputs the calculation result to the second multiplier 705. The second 1-bit left shifter 703 receives the light source direction unit vector L4 and outputs the calculation result to the selector 704.

  The selector 704 receives the mode selection signal 8, the light source direction unit vector L 4, and the calculation result of the second 1-bit left shifter 703, and outputs the result to the subtractor 706 based on the mode selection signal 8.

  The second multiplier 705 inputs the calculation result of the first 1-bit left shifter 702 and outputs the calculation result to the subtractor 706. The subtractor 706 receives the calculation result of the selector 704 and the calculation result of the second multiplier 705 and outputs the result to the third multiplier 707. The third multiplier 707 receives the calculation result of the subtractor 706 and the viewpoint vector V5 and outputs the calculation result to the fourth multiplier 708. The fourth multiplier 708 receives the calculation result of the third multiplier 707 and the arbitrary constant A6, and outputs the lighting effect data I9.

  In FIG. 7, two types of lighting effect data I calculation formulas can be considered depending on whether or not the light source direction unit vector L4 passes through the second 1-bit left shifter 703. The same as the case of the arbitrary constant A6 = 1, and the case of not using it is the same as that shown in Formula 2 described in the first embodiment of the present invention.

  In other words, the second 1-bit left shifter 703 and the selector 704 are added to the configuration for realizing the lighting effect data I calculation formula shown in the conventional formula 1, and the conventional lighting effect data I shown in the formula 1 is added. The calculation formula and the lighting effect data I calculation formula of the image special effect device 100 described in the first embodiment shown in Formula 2 are switched by the selector 704 by the mode selection signal 8.

  In this embodiment, the configuration for switching between two lighting effect data I arithmetic expressions is introduced using FIG. 7, but the arithmetic expression is not limited to two, and two or more arithmetic expressions can be realized. It may have such a configuration.

  According to such an image special effect device 700 in the third embodiment of the present invention, the illumination effect data calculation unit 111B has a plurality of generated reflectance candidates, and one reflection is selected from the plurality of candidates. By adopting a configuration for generating a rate, a plurality of types of lighting effect data can be obtained by simply adding a combination circuit of a second 1-bit left shifter 703 and a selector 704 without adding a large-scale new calculation circuit. It is possible to switch the I calculation formula, and in addition to the page turning effect, it is possible to universally calculate the lighting effect of other image special effects such as a ball effect, and the image special effect device can be miniaturized.

  INDUSTRIAL APPLICABILITY The present invention is widely useful in various fields where, for example, video / image production / editing is performed as an image special effect device or the like that can process illumination effects of various image special effects in real time with a downsized configuration.

1 is a functional block diagram showing the configuration of an image special effect device according to a first embodiment of the present invention. Explanatory drawing of the name of the page turning surface of the image special effect apparatus in the 1st Embodiment of this invention Detailed description of normal vectors in a normal vector generator of the image special effect device according to the first embodiment of the present invention The figure which shows the characteristic of the illumination effect data by the illumination effect data calculation formula of the image special effect apparatus in the 1st Embodiment of this invention The figure which shows the characteristic of the illumination effect data by the illumination effect data calculation formula of the image special effect apparatus in the 1st Embodiment of this invention The functional block diagram which shows the structure of the image special effect apparatus in the 2nd Embodiment of this invention. The functional block diagram which shows the structure of the illumination effect data calculation part of the image special effect apparatus in the 3rd Embodiment of this invention.

Explanation of symbols

100 Image special effect device 1 Cartesian coordinate 3 Normal vector N
4 Light source direction unit vector L
5 Viewpoint vector V
6 Arbitrary constant A
8 Mode selection signal 9 Lighting effect data I
10 Xeffect
11 Yeffect
12 Display screen horizontal direction (x-axis)
13 Display screen vertical direction (y-axis)
14 View direction (z axis)
20 Upper Plane Part 21 Upper Curved Part 22 Lower Plane Part 23 Lower Curved Part 30 Normal Vector N of the Upper Plane
31 Normal vector N of the upper surface
32 Normal vector N of the lower plane
33 Normal vector N of the lower surface
40 Illumination effect data I for the upper plane part
41 Illumination effect data I for the upper curved surface I
42 Lighting effect amplification data IA
50 Illumination effect data of the lower plane part I
51 Illumination effect data I for the bottom curved surface I
110 Normal vector generator 111 Illumination effect data calculator 600 Arbitrary constant A switching controller 701 First multiplier 702 First 2 bit left shift 703 Second 2 bit left shift 704 Selector 705 Second multiplier 706 Subtractor 707 3 multiplier 708 4th multiplier

Claims (4)

Illumination effect by light from a light source when viewed from an arbitrary viewpoint on a surface having a curved surface is added to the image information regarding the input image, and a video signal obtained by mapping the image information on the surface is output. Image special effect device,
A normal vector generation unit that generates a normal vector N indicating a vector in the normal direction at the position of the surface, based on orthogonal coordinate data indicating the position of the horizontal coordinate and the vertical coordinate of the surface and the shape of the surface When,
The normal vector N 1 , the light source direction unit vector L indicating the light source direction unit vector, the viewpoint vector V indicating the viewpoint direction vector, and an arbitrary value A are used as A (2 (L · N) N-2L) · A lighting effect generation unit that generates the reflectance of the light toward the viewpoint by the calculation of V;
An image information creation unit that creates the image information based on the image and the reflectance;
An image special effect device. The image special effect device according to claim 1,
An image special effect device having an arbitrary value changing unit capable of changing the arbitrary value A. The image special effect device according to any one of claims 1 and 2,
The said lighting effect production | generation part is an image special effect apparatus which has a plurality of the said candidates for the said produced | generated reflectance, and produces | generates one reflectance from these several candidates. Using an image special effect device, the image information related to the input image is added with an illumination effect by light from a light source when viewed from an arbitrary viewpoint on a curved surface, and the image information is mapped to the surface. an image special effect how to output a video signal obtained Te,
The normal vector generation unit included in the image special effect device includes a normal vector at the position of the surface based on orthogonal coordinate data indicating the position of the horizontal coordinate and the vertical coordinate of the surface and the shape of the surface. A normal vector generation step for generating a normal vector N indicating
The lighting effect generator included in the image special effect device includes the normal vector N , a light source direction unit vector L indicating a unit vector of the light source direction, a viewpoint vector V indicating a vector of the viewpoint direction, and an arbitrary value by calculation of an expression using a a (2 (L · N ) N-2L) · V, and lighting effects generating step of generating a reflectance of the light to the viewpoint direction,
An image information creation unit provided in the image special effect device creates an image information based on the image and the reflectance, and creates an image information.
An image special effect method.

Images