JP4662238B2 - Method for manufacturing stereoscopic printed matter, stereoscopic printed matter, image generation method, and program - Google Patents

Description

  The present invention relates to a method for manufacturing a stereoscopic print, a stereoscopic print, an image generation method, and a program.

Conventionally, a left-eye image taken with a camera corresponding to the left eye and a right-eye image taken with a camera equivalent to the right eye are prepared, and these images are synthesized by anaglyph processing, etc. Techniques for realizing vision are known. A technique is also known that realizes a real stereoscopic vision that could not be realized by conventional methods by performing processing for eliminating the perspective on the left-eye image and the right-eye image taken by the camera.
JP 2000-56411 A JP 2004-178579 A

  However, in the conventional stereoscopic vision system, the stereoscopic effect of the object is accurate, but the stereoscopic vision in which the object image appears to be deformed while maintaining a realistic stereoscopic effect cannot be realized.

  For example, it is assumed that the subject of the camera is a human who sits with his hands on the floor and his legs facing the camera while raising his / her upper body. In this case, when a stereoscopic image is generated by the conventional stereoscopic method, a stereoscopic image that has a short foot and a large head as compared to a human being who is an actual subject is generated. In this case, if the stereoscopic image is viewed with the stereoscopic glasses, the length of the foot and the size of the head appear to be the same as the actual length of the foot and the size of the head of the human subject.

  However, since the viewer's brain has an image before wearing the glasses for stereoscopic viewing, the viewer has an unnatural stereoscopic vision that somehow has short legs and a large head. For this reason, there is a problem that the pose that the subject can take is limited, for example, it is necessary to take the subject with the head instead of the foot facing the camera.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a method for producing a stereoscopic printed material that enables deformation of an object image while maintaining a realistic stereoscopic effect, It is to provide a printed matter for viewing, an image generation method, and a program.

  The present invention is a method for manufacturing a printed matter for stereoscopic viewing, wherein a first left eye for stereoscopic viewing is arranged by placing an object on a reference plane that is oblique to the line-of-sight direction or below or above the reference plane. A first right-eye image for stereoscopic viewing and a first image for stereoscopic viewing, and the first to fourth on the first left-eye image corresponding to the first to fourth vertices forming a quadrangle on the reference plane The first left-eye image is deformed so that the point moves to the first to fourth vertices of the left-eye deformation processing rectangle that is not the same as or similar to the rectangle on the reference plane. First to fourth points on the first right-eye image corresponding to first to fourth vertices that form a second left-eye image and form a quadrangle on the reference surface are reference surfaces. The right-eye deformation processing quadrangle that is not the same as or similar to the quadrangle and has the same shape as the left-eye deformation processing quadrangle The first right-eye image is transformed so as to move to the first to fourth vertices to create a second right-eye image, and the second left-eye image and the second right-eye image are generated. The present invention relates to a method for manufacturing a stereoscopic printed material that creates a stereoscopic printed material in which an object image appears to be deformed based on the image for use.

  The present invention also provides a first left-eye image for stereoscopic viewing and a stereoscopic view generated by arranging an object on a reference plane that is oblique to the line-of-sight direction or below or above the reference plane. An image generation method for generating a stereoscopic image using the first right-eye image, wherein the first left-eye image corresponds to first to fourth vertices forming a quadrangle on a reference plane. For the first left eye so that the first to fourth points above move to the first to fourth vertices of the left eye deformation processing rectangle that is not the same as or similar to the rectangle on the reference plane. The first left-eye image on the first right-eye image corresponding to the first to fourth vertices that form the second left-eye image by performing image deformation processing and form a quadrangle on the reference plane The point is not the same or similar to the quadrangle on the reference plane, and the same shape as the left-eye deformation processing quadrangle The first right-eye image is deformed so as to move to the first to fourth vertices of the right-eye deformation processing rectangle to generate a second right-eye image, and the second left-eye image is generated. The present invention relates to an image generation method for generating a stereoscopic image in which an object image appears to be deformed based on an image and the second right-eye image. The present invention also relates to a program for causing a computer to execute the above procedure.

  According to the present invention, the first left-eye image of the first left-eye image is moved such that the first to fourth points on the first left-eye image move to the first to fourth vertices of the left-eye deformation processing rectangle. A deformation process is performed. Further, the first right-eye image is deformed so that the first to fourth points on the first right-eye image move to the first to fourth vertices of the right-eye deformation processing rectangle. .

  At this time, in the present invention, the left-eye deformation processing rectangle and the right-eye deformation processing rectangle are not the same as or similar to the rectangle on the reference plane. This makes it possible to create (generate) a stereoscopic image in which the object image appears to be deformed. In the present invention, the left-eye deformation processing rectangle and the right-eye deformation processing rectangle have the same shape. As a result, it is possible to realize realistic stereoscopic vision that looks as if the object is actually present on the reference plane (or below or above the reference plane). Thus, according to the present invention, it is possible to realize a stereoscopic view that enables deformation of an object image while maintaining a realistic stereoscopic effect.

  In the present invention, the left-eye deformation processing rectangle and the right-eye deformation processing rectangle may be trapezoids in which the length of the lower base closer to the viewpoint is longer than the length of the upper base farther from the viewpoint.

  In this way, it is possible to realize deformation processing such as reducing the part far from the viewpoint among the parts of the object and lengthening the part near the viewpoint. However, the shapes of the left-eye deformation processing rectangle and the right-eye deformation processing rectangle are not limited to such shapes. For example, the trapezoidal shape in which the length of the lower base is shorter than the length of the upper base may be used, or a square in which the lower base and the upper base are not parallel may be used.

  In the present invention, ruled lines, characters, symbols, or figures are drawn on the stereoscopic image obtained by the second left-eye image and the second right-eye image, and the ruled lines, characters, symbols, or figures are drawn. You may make it produce the printed material for stereoscopic vision in which the said object looks stereoscopically below.

  In this way, it is possible to realize a stereoscopic expression that looks as if a three-dimensional object (at least a part of the object) exists under the ruled lines, characters, symbols, or figures.

  In the present invention, a ruled line whose line direction changes irregularly with respect to the reference straight line may be drawn on the stereoscopic image. In this way, the viewer can easily recognize the parallax and easily understand the height at which the ruled line is drawn by extracting the singular point due to the change in the line direction of the ruled line. .

  In the present invention, a ruled line, a character, a symbol, or a figure whose color shading changes irregularly depending on the location may be drawn on the stereoscopic image. In this way, the viewer can easily recognize the parallax and easily understand the height of the ruled line and the like by extracting the singular point due to the change in the shade of the color of the ruled line and the like. It becomes like this.

  In the present invention, a ruled line, a character, a symbol, or a graphic image may be translucently combined with the stereoscopic image based on the translucency whose value irregularly changes depending on the place. In this way, it is possible to prevent a situation such as the shading of colors such as ruled lines becoming too bright.

  The present invention also relates to a stereoscopic print produced by any one of the manufacturing methods described above.

  The present invention also relates to a stereoscopic printed matter created by duplicating a stereoscopic printed matter created by any one of the manufacturing methods described above.

  Hereinafter, the present embodiment will be described with reference to the drawings. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. Moreover, not all of the configurations described in the present embodiment are essential constituent requirements of the present invention.

1. Stereoscopic Viewing Method The stereoscopic viewing method of the present embodiment will be described with reference to the flowchart of FIG. First, as shown in FIG. 2A, an object OB (subject, object) is placed on the reference plane BS (step S1). Here, the reference plane BS is a plane that is oblique with respect to the line-of-sight direction SL (the direction connecting the viewpoint position and the gazing point), and is a plane that is not orthogonal to the line-of-sight direction SL. That is, the reference plane BS is a plane different from the perspective projection screen that is always orthogonal to the line-of-sight direction SL. This reference surface BS corresponds to the surface on which the stereoscopic printed material is placed during stereoscopic viewing.

  As shown in FIGS. 3A and 3B, the object OB may be disposed below the reference plane BS. Specifically, the object OB is arranged on the arrangement surface DS set below the reference surface BS. The arrangement surface DS is a surface set below the reference surface BS when viewed from the viewpoint (VPL, VPR). Specifically, in FIG. 3A, the case 10 is provided with a recess (convex recess), the bottom surface of this recess is the arrangement surface DS, and the upper surface of the case 10 (the upper surface of the frame) is the reference. It is a surface BS. The reference surface BS is a surface that forms an overhead angle θ (θ <90 degrees) with respect to the line-of-sight direction SL. The arrangement surface DS is a surface that is a predetermined distance below the reference surface BS, and is a surface parallel to the reference surface BS. However, the reference surface BS and the arrangement surface DS may be non-parallel.

  Further, the object OB may be arranged so that a part of the object OB protrudes above the reference plane BS. Alternatively, the object OB may be arranged at a position away from the reference plane BS. Further, the number of reference surfaces is not limited to two, and three or more reference surfaces (a plurality of connected reference surfaces) may be used.

  Next, a first left-eye image IL1 and a first right-eye image IR1 for stereoscopic viewing are created (generated) (steps S2 and S3 in FIG. 1). Specifically, a left-eye image IL1 that can be seen from the left-eye viewpoint position VPL and a right-eye image IR1 that can be seen from the right-eye viewpoint position VPR are created.

  Here, the left-eye and right-eye viewpoint positions VPL and VPR are positions assumed as positions of the left and right eyes of the viewer as shown in FIG. For example, when the left-eye and right-eye images IL1 and IR1 are created by shooting with a camera (digital camera or the like), the cameras are arranged at these VPL and VPR positions (positions on the extension lines of the VPL and VPR line of sight). Then, the left-eye and right-eye images IL1 and IR1 are photographed. In this case, two cameras may be arranged in the VPL and VPR and photographed at the same time, or the position of one camera may be changed and photographed.

  On the other hand, when the left-eye and right-eye images IL1 and IR1 are generated by a system that generates a CG (Computer Graphics) image and a game image (real-time moving image), the positions of these VPL and VPR (line of sight of VPL and VPR) A virtual camera (camera in a broad sense) is arranged at a position on the extension line of the left eye and the right eye images IL1 and IR1. That is, an image that can be seen from the VPL and VPR in the object space is generated.

  4 and 5 show examples of the left-eye image IL1 and the right-eye image IR1. The left-eye image IL1 in FIG. 4 is obtained by placing the camera at the left-eye viewpoint position VPL and taking the camera's line of sight (direction) toward the object (gaze point, representative point of the object). Further, the right-eye image IR1 in FIG. 5 is obtained by placing the camera at the right-eye viewpoint position VPR and taking the camera's line of sight toward the object. As shown in FIGS. 4 and 5, these left-eye and right-eye images IL1 and IR1 have different line-of-sight angles (looks), and stereoscopic viewing is possible using binocular parallax due to this line-of-sight angle shift. Realized. In the case of CG or a game, an object (modeled graphic object) is arranged on a reference plane set in the object space, and a virtual camera is arranged in VPL and VPR. Then, by generating an image that can be seen from the virtual camera with the line of sight (direction) of the virtual camera directed toward the object (gaze point, representative point of the object), it is possible to generate images similar to those in FIGS.

  4 and 5, the object OB that is the subject of the camera is a human who sits with the hand on the floor and the legs facing the camera while raising the upper body.

  Also, the first to fourth points PL1 to PL4 on the left-eye image IL1 in FIG. 4 form first to first squares BQ (a rectangle including a square in a narrow sense) on the reference plane BS in FIG. The points correspond to the fourth vertices V1 to V4. Similarly, the first to fourth points PR1 to PR4 on the right-eye image IR1 in FIG. 5 are points corresponding to the first to fourth vertices V1 to V4 of the quadrangle BQ on the reference plane BS. For example, when viewing the reference plane BS with a line of sight in the direction AD from the upper side to the lower side in FIG. 2A, the reference plane BS is as shown in FIG. 2B. When viewed in this direction AD, V1 to V4 are squares on the reference plane BS. It constitutes the apex of BQ (rectangle).

  More specifically, when the left-eye image IL1 and the right-eye image IR1 are created in FIG. 2A, the first to fourth marks are written at positions V1 to V4 on the reference plane BS. Then, the first to fourth marks are photographed as points PL1 to PL4 in FIG. 4 and displayed on the left-eye image IL1. In FIG. 5, the images are photographed as points PR1 to PR4 and displayed on the right-eye image IR1.

  In the present embodiment, the case where the vertices V1 to V4, the points PL1 to PL4, and the points PR1 to PR4 are each four points will be described as an example. However, the present invention is not limited to this and is five points or more. May be.

  Next, as shown in FIG. 6, points PL1 to PL4 on the left eye image IL1 corresponding to the vertices V1 to V4 constituting the rectangle BQ (rectangle) with the reference plane BS are the left eye deformation processing rectangle LQ (trapezoid). The left-eye image IL1 is deformed so as to move to the vertices VL1 to VL4 (step S4 in FIG. 1). As a result, a left-eye image IL2 as shown in FIG. 8 is created (generated). Also, as shown in FIG. 7, the right eye so that the points PR1 to PR4 on the right-eye image IR1 corresponding to the vertices V1 to V4 move to the vertices VR1 to VR4 of the right-eye deformation processing square RQ (trapezoid). Deformation processing of the image IR1 is performed (step S5). As a result, a right-eye image IR2 as shown in FIG. 9 is created (generated).

  Next, a stereoscopic image (pre-completion image) is created (generated) based on the left-eye image IL2 in FIG. 8 and the right-eye image IR2 in FIG. 9 (step S6). Specifically, a stereoscopic image is created by performing anaglyph processing or the like based on IL2 and IR2.

  FIG. 10 shows an example of a stereoscopic image obtained by performing anaglyph processing based on the left-eye and right-eye images IL2 and IR2 in FIGS. In the stereoscopic image of FIG. 10, the left-eye image IL2 and the right-eye image IR2 are synthesized. The left-eye image IL2 and the right-eye image IR2 each include an image of the object OB and an image of the reference plane BS. Among the object images of the left-eye image IL2 and the right-eye image IR2, the positions (printing position, display position) of the images on the reference plane (reference plane image, object image, etc.) match (however, not necessarily). Don't have to match exactly). Further, as the distance from the reference plane BS increases, the shift (print position, display position shift) between the image (object image or the like) of the left-eye image IL2 and the image (object image or the like) of the right-eye image IR2 increases.

  Then, the stereoscopic finished image (actual image or CG image) created in step S6 in FIG. 1 is printed on a print medium using a color printer (printer in a broad sense) such as an ink jet method or a laser printer method. By doing so, the printed material for stereoscopic vision can be manufactured. In addition, you may manufacture the printed material for stereoscopic vision by duplicating the printed material for stereoscopic vision used as the original disc printed by the color printer (printing machine). In this way, there is an advantage that a large amount of stereoscopic printed material can be manufactured in a short period of time.

  Then, the stereoscopic print produced in this way is, for example, stereoscopic glasses provided with a red filter (may be a filter other than red) on the left eye and a blue filter (may be a filter other than blue) on the right eye. By viewing with, stereoscopic viewing can be realized. Note that stereoscopic viewing may be realized by providing a lenticular lens on the printed material or using a lenticular lens as a print medium.

  Further, if the completed stereoscopic image is displayed on the display unit of the image generation system, a game image (moving image) can be generated in real time. In this case, the completed stereoscopic image obtained by anaglyph processing or the like is directly displayed on the display unit, and this is displayed using glasses (equipment in a broad sense) provided with color filters (red and blue). You may make it look. Alternatively, the left-eye and right-eye images IL2 and IR2 may be alternately displayed on the display unit in different frames, for example, and viewed using glasses provided with a liquid crystal shutter or the like. Alternatively, a stereoscopic view may be realized by providing a lenticular lens in the display unit of the image generation system.

  In stereoscopic viewing so far, as shown in FIG. 11A, the stereoscopic printed matter PM (or the display screen of the display unit; the same applies to other explanations) is set so that the plane is parallel to the vertical plane. It was assumed that the viewer would view the stereoscopic printed matter PM facing the viewer.

  On the other hand, in this embodiment, as shown in FIG. 11B, the viewer places the stereoscopic printed matter PM on a placement surface (a surface corresponding to the reference surface BS) such as a desk from an oblique direction. It is assumed that you will see. That is, such an arrangement is the default arrangement of the present embodiment. If arranged in this way, the focal lengths of the points on the surface of the stereoscopic printed matter PM are not the same but different. For this reason, the focus adjustment is similar to that in the real world. Therefore, the shift in the relationship between the focus adjustment and the binocular parallax and the convergence is reduced, and a more natural and realistic stereoscopic vision can be realized.

2. Deformation Processing A feature of the stereoscopic viewing method of the present embodiment is that the left-eye image IL2 and the right-eye image IR2 are generated by performing deformation processing of the left-eye image IL1 and the right-eye image IR1 as shown in FIGS. It is in.

  Specifically, in FIG. 6, the points PL1 to PL4 corresponding to the vertices V1 to V4 of the quadrangle BQ (rectangle) on the reference plane BS shown in FIG. 2B are for deformation processing that is not the same as or similar to the quadrangle BQ. The left-eye image IL1 in FIG. 8 is generated by performing deformation processing (correction processing) of the left-eye image IL1 so as to move to the vertices VL1 to VL4 of the quadrangle LQ (trapezoid).

  In FIG. 7, points PR1 to PR4 corresponding to the vertices V1 to V4 of the quadrangle BQ are not the same as or similar to the quadrangle BQ, and the vertices VR1 to VR4 of the deformation processing quadrangle RQ (trapezoid) having the same shape as the quadrangle LQ. The right eye image IR2 in FIG. 9 is generated by performing deformation processing (correction processing) of the right eye image IR1 so as to move to FIG. Then, the left-eye image IL2 in FIG. 8 and the right-eye image IR2 in FIG. 9 are combined to generate the stereoscopic image in FIG.

  In this way, it is possible to realize a stereoscopic view that enables deformation (correction processing) of the object image while maintaining a realistic stereoscopic effect.

  For example, FIGS. 12 to 16 show a stereoscopic viewing system as a comparative example of the present embodiment. In this comparative example, as shown in FIG. 12, the left-eye image IL2 in FIG. 14 is generated by performing processing for completely eliminating the perspective on the reference plane BS of the left-eye image IL1. More specifically, points PL1 to PL4 corresponding to the vertices V1 to V4 of the quadrangle BQ on the reference plane BS are the same as or similar to the quadrangle BQ on the reference plane BS, and the vertex VL1 of the quadrangle LQ ′ (rectangle). The left-eye image IL2 of FIG. 14 is generated by performing the correction process of the left-eye image IL1 so as to move to “˜VL4”.

  In the method of the comparative example, as shown in FIG. 13, the right-eye image IR2 in FIG. 15 is generated by performing processing for completely eliminating the perspective on the reference plane BS of the right-eye image IR1. More specifically, the points PR1 to PR4 move to the vertices VR1 ′ to VR4 ′ of the quadrangle RQ ′ (rectangle) that is the same as or similar to the quadrangle BQ on the reference plane BS, so that the right-eye image IR1 is moved. By performing the correction process, the right-eye image IR2 in FIG. 15 is generated. Then, the stereoscopic image shown in FIG. 16 is generated based on the left-eye image IL2 shown in FIG. 14 and the right-eye image IR2 shown in FIG.

  In the method of the present embodiment, as shown in FIGS. 6 and 7, the deformation processing rectangles LQ and RQ are neither the same shape nor the similar shape as the rectangle BQ (FIG. 2B) on the reference plane BS. . On the other hand, in the method of the comparative example, as shown in FIGS. 12 and 13, the quadrilaterals LQ ′ and RQ ′ have the same shape as the quadrangle BQ on the reference plane BS (a shape with the same side length) or similar. It has a shape (a shape with the same side ratio).

  In the method of this comparative example, the quadrilaterals LQ ′ and RQ ′ have the same shape as or similar to the quadrangular BQ, and thus the perspective on the reference plane BS is completely eliminated, and the stereoscopic view is correct.

  However, when the subject of the camera is a human who is sitting on the floor with his hands raised on the floor and his legs facing the camera, the stereoscopic image is generated by the method of the comparative example, as shown in FIG. As described above, a stereoscopic image is generated in which a foot looks shorter and a head looks larger than a human being who is an actual subject.

  In this case, if the stereoscopic image shown in FIG. 16 is viewed by wearing stereoscopic glasses, the length of the foot and the size of the head seem to be the same as the actual length of the foot and the size of the head of the human being who is the subject. become. However, since the image of FIG. 16 before wearing the glasses for stereoscopic vision remains in the viewer's brain, somehow unnatural stereoscopic vision that the legs are short and the head looks large. For this reason, there is a problem that the pose that the subject can take is limited, for example, it is necessary to take the subject with the head instead of the foot facing the camera.

  On the other hand, according to the method of the present embodiment, as shown in the stereoscopic image of FIG. 10, a deformation process in which the legs become longer and the head becomes smaller than the stereoscopic image of the method of the comparative example of FIG. Is applied to the object image. Therefore, even if the image of FIG. 10 before wearing the glasses for stereoscopic vision remains in the viewer's brain, the above-mentioned situation of unnatural stereoscopic vision in which the legs are short and the head looks large can be prevented. In addition, the realistic stereoscopic effect that the object OB appears to actually exist on the reference plane is maintained without being lost.

  The reason why this is possible by the method of the present embodiment is that the new concepts of the deformation processing squares LQ and RQ shown in FIGS. 6 and 7 are introduced. The deformation processing rectangles LQ and RQ are not the same as or similar to the rectangle BQ (FIG. 2B) on the reference plane BS. Specifically, in FIGS. 6 and 7, the deformation processing rectangles LQ and RQ have a trapezoidal shape in which the length of the lower base closer to the viewpoint (camera) is longer than the length of the upper base farther from the viewpoint (camera). It has become.

  When the deformation processing rectangles LQ and RQ are formed in such a shape, the perspective of the left-eye image IL1 and the right-eye image IR1 is not completely eliminated, but the subject's foot is lengthened and the head is shortened as shown in FIG. It is possible to realize an object image deformation process such as

  In addition, in the present embodiment, as shown in FIGS. 6 and 7, the left-eye deformation processing rectangle LQ and the right-eye deformation processing rectangle RQ have the same shape. Therefore, as shown in the stereoscopic image of FIG. 10, the relationship that the image for left eye IL2 and the image for right eye IR2 coincide on the reference plane BS, and the two images move away from the reference plane is maintained. . Therefore, it is possible to maintain a realistic three-dimensional appearance that looks as if a real object exists on the reference plane BS. As described above, according to the present embodiment, it is possible to achieve both the deformation processing of the object image and the maintenance of a realistic stereoscopic effect, and the stereoscopic expression that cannot be realized by the conventional method becomes possible.

3. Drawing of Ruled Lines In the present embodiment, the stereoscopic image (pre-completion image) in FIG. 10 has ruled lines, characters, symbols, or figures (hereinafter referred to as ruled lines, etc.) as shown in FIGS. 17A, 17B, and 17C. 3D) may be drawn to create a stereoscopic viewing completed image, and the stereoscopic viewing printed matter PM may be completed. If such ruled lines and the like are drawn, it will appear as if ruled lines and the like are drawn on the reference plane when the viewer sees the stereoscopic printed matter PM. Then, it is possible to create a stereoscopic print that looks as if a three-dimensional object (object) exists under a ruled line or the like on the reference plane. That is, it is as if a three-dimensional object is arranged in a recess (see FIGS. 3A and 3B) provided on the reference plane, and glass is provided at a position corresponding to the reference plane above the object. Stereoscopic expression that appears as if ruled lines are drawn on the surface, and stereoscopic expression that appears as if ruled lines etc. are drawn on the glass surface on the upper side of the showcase when a three-dimensional object is placed in the showcase Thus, it is possible to realize stereoscopic expression that did not exist in the past.

  In particular, according to this method, a ruled line or the like is drawn, so that the viewer can easily recognize the height and position of the reference plane. And the viewer can recognize the height and position of the object based on the height and position of the reference plane on which the ruled lines are drawn, so that the stereoscopic and realism of the object is increased, realizing real and natural stereoscopic vision. it can.

  Next, details of drawing methods such as ruled lines will be described. In the following description, the case of drawing ruled lines will be mainly described as an example. However, the drawing method of the present embodiment can be applied not only to ruled lines but also to drawing of characters, symbols, and figures.

  In the present embodiment, when drawing ruled lines and the like as shown in FIGS. 17A, 17B, and 17C, the ruled lines whose line direction changes irregularly (randomly) with respect to the reference straight line are displayed as stereoscopic images. I try to draw it on top. Specifically, in FIG. 18A, the line direction of the ruled line KL (the tangent vector direction at each point on the line) with respect to the straight reference line RS (the line used as a reference when drawing the ruled line KL) is A ruled line KL is drawn so as to change depending on the location (as if it fluctuates irregularly). That is, the ruled lines KL are intentionally drawn so that singular points (feature points) are generated in various places as if they are irregularly fluctuated for each place in a handwritten style (freehand style) without drawing a straight line. In addition, as indicated by C1 in FIG. 18A, a place where the ruled line KL is interrupted and discontinuous is intentionally provided.

  That is, stereoscopic vision is realized by the human brain recognizing binocular parallax and convergence. However, if a strictly straight ruled line KL is drawn as shown in FIG. 18B, the brain cannot recognize binocular parallax. That is, the human brain extracts a singular point and recognizes the parallax by looking at the singular point with the left eye and the right eye to feel a three-dimensional feeling. However, there is no singular point on the strict straight ruled line KL as shown in FIG. Therefore, since the human brain cannot extract a singular point, the parallax between the left eye L and the right eye R cannot be recognized, and a stereoscopic effect cannot be felt.

  On the other hand, in this embodiment, as shown in FIGS. 18A and 18C, the ruled line KL is intentionally given irregular fluctuations. As a result, the human brain can extract the singular point PP. Then, by viewing the extracted singular point PP with the left eye L and the right eye R, the parallax can be recognized and a stereoscopic effect can be felt.

  If the viewer can recognize the parallax at each singular point such as a ruled line as described above, the viewer can easily recognize the height of the reference plane on which the ruled line is drawn in the stereoscopic finished image. That is, it is possible to easily recognize that a ruled line or the like is drawn on the object or the reference plane above the object arrangement plane. Therefore, a stereoscopic view appears as if a three-dimensional object is placed in a recess provided below the reference plane, glass is provided above the object, and ruled lines are drawn on the glass surface. It is possible to realize an expression and a stereoscopic expression in which a three-dimensional object is arranged in the showcase and a ruled line or the like is drawn on the upper glass surface of the showcase.

  Note that the method of setting a singular point on a ruled line or the like is not limited to the method shown in FIGS. For example, in FIG. 19A, a method of drawing a ruled line KL or the like whose color shade changes irregularly (randomly) on the stereoscopic image is adopted. Here, the color shading is at least one of brightness (lightness, brightness) shading, hue shading, and saturation shading. For example, in the ruled line KL of a single color (black, green, red, etc.), the brightness level may be changed irregularly.

  As shown in FIG. 19A, if a ruled line KL whose color shading fluctuates depending on the location and changes irregularly, a singular point can be generated at each location of the ruled line KL. The viewer's brain can extract these singularities and recognize the parallax by looking at the extracted singularities with the left eye and the right eye to feel a three-dimensional effect.

  In order to realize more realistic and natural stereoscopic vision, it is desirable that the image of the arrangement surface of the stereoscopic image serving as the background is an image in which the color density changes irregularly. For example, when taking a left-eye image and a right-eye image in FIGS. 3A and 3B, sand or the like is placed on the placement surface DS, and an object OB such as a shell is placed on the sand.

  In this way, the color density of the image on the arrangement plane of the stereoscopic image serving as the background also changes irregularly. Thus, the viewer's brain can recognize the parallax by extracting the singular points at each location on the arrangement surface and viewing the extracted singular points with the left eye and the right eye. As a result, the viewer can easily recognize not only the height of the reference surface on which the ruled lines and the like are drawn, but also the height of the arrangement surface, thereby realizing a real and natural stereoscopic view.

  Note that various methods are conceivable as a method for realizing a process of irregularly changing the color density of a ruled line or the like. For example, in FIG. 19B, based on the translucency α (synonymous with transparency) whose value changes irregularly depending on the location, an image such as the ruled line KL is semitransparently combined (α blending) with the stereoscopic image. The technique to do is adopted.

  That is, if the color of the ruled line is simply changed, a brighter part than the background stereoscopic image (object image, arrangement plane image) is generated on the ruled line, resulting in an unnatural situation.

  On the other hand, as shown in FIG. 19B, if the ruled line image and the stereoscopic image are semi-transparently synthesized while irregularly changing the translucency, the finally generated image is the ruled line image and the three-dimensional image. A visual image is synthesized. Therefore, it is possible to prevent a situation in which a brighter portion than the stereoscopic image serving as the background is generated on the ruled line.

  The process of translucent synthesis by changing the translucency of ruled lines or the like can be realized by various methods. For example, when using software for an image processing tool, after drawing a normal ruled line, a ruled line is selected in the selection range of the editing tool, and a gray noise filter is applied to the selected range. Thereby, a ruled line whose brightness changes for each pixel is formed. Then, the selection range in which the brightness information of the ruled lines is switched to translucency (transparency) is displayed, and another layer is created to paint the desired range in the selection range. Thereby, it is possible to obtain a ruled line whose translucency changes stepwise.

  Note that the stereoscopic printed material created by the method of the present embodiment can be applied to various printed materials such as notebooks, stationery, books, and writing paper.

  For example, in a notebook or a stationery, by drawing a ruled line as shown in FIGS. 17A and 17B, it is possible to provide a notebook and a stationery that can be viewed stereoscopically, which did not exist in the past. For example, if a stationery with ruled lines drawn by the method of this embodiment and stereoscopic glasses (red and blue spectacles) are enclosed in a letter set and sold, the commercial value of the letter set can be dramatically increased. In particular, if a character product or the like is adopted as an object (object) to be placed on the placement surface, the product value can be further increased. Furthermore, in the case of notebooks and stationery, the number of singular points on the paper increases as the viewer writes handwritten characters on the notebook and stationery. Thereby, the height of the reference surface can be recognized more easily, and the stereoscopic effect can be improved.

  Also, for books such as CD album lyrics cards, by drawing characters, symbols, figures, etc. as shown in FIG. 17C, books such as lyrics cards that can be viewed stereoscopically, which did not exist before, are provided. it can. For example, if a lyric card in which characters, symbols, and figures are drawn and stereoscopic glasses are enclosed in a CD album and sold by the method of this embodiment, the product value of the CD album can be dramatically increased.

  In addition, for example, ruled lines, characters, symbols, and figures are not drawn in the past by drawing in advance on the application form such as a cash card or a writing form such as an application form (documents, standard documents) by the method of this embodiment. In addition, it is possible to provide writing paper with a high appeal effect.

4). Image Generation System FIG. 20 shows a configuration example of an image generation system that can realize the technique of this embodiment. Note that the image generation system does not have to include all the components (each unit) shown in FIG.

  The image generation system in FIG. 20 can be used as a system for generating a game image (real-time moving image). Moreover, it can also be used as an image generation system (CG tool) for creating a stereoscopic image from a CG image (still image) and creating a stereoscopic print. Further, it can be used as an image generation system for taking a real image taken by a camera, creating a stereoscopic image from the real image, and creating a stereoscopic print.

  The operation unit 160 is for a player (operator) to input operation data, and the function can be realized by hardware such as a lever, a button, a microphone, or a touch panel.

  The storage unit 170 serves as a work area for the processing unit 100, the printing unit 193, the communication unit 196, and the like, and its function can be realized by hardware such as a RAM.

  The information storage medium 180 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), magneto-optical disk (MO), hard disk, or memory (ROM). It can be realized by hardware such as. The processing unit 100 performs various processes of this embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores (records and stores) a program for causing the computer to function as each unit of the present embodiment (a program for causing the computer to execute the processing procedure of each unit).

  The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by hardware such as a CRT, LCD, touch panel, or HMD (head mounted display).

  The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by hardware such as a speaker or headphones.

  The printing unit 193 prints a stereoscopic image on a print medium (paper, lens, film, or the like), and functions thereof by a color printer (printer in a broad sense) such as an ink jet method or a laser printer method. realizable.

  The portable information storage device 194 stores player personal data, game save data, and the like. Examples of the portable information storage device 194 include a memory card and a portable game device.

  The communication unit 196 performs various controls for communicating with the outside (for example, a host device or other image generation system). As an interface realized by the communication unit 196, a USB (USB2. 0, USB 1.1), IEEE 1394, Ethernet (registered trademark) (LAN), and the like. The functions of the communication unit 196 can be realized by hardware such as various processors or communication ASICs, programs, and the like. Using the communication unit 196, it is possible to capture a real image captured by the camera from the outside (network such as the Internet) into the image generation system, or to output the created stereoscopic image to the outside.

  Note that a program (data) for causing a computer to function as each unit of this embodiment is distributed from the information storage medium of the host device (server) to the information storage medium 180 (storage unit 170) via the network and the communication unit 196. You may do it. Use of such an information storage medium of the host device (server) is also included in the scope of the present invention.

  The processing unit 100 (processor) performs various processes such as a game process, an image generation process, and a sound generation process based on operation data from the operation unit 160, a program, and the like. In this case, the processing unit 100 performs various processes using the storage unit 170 as a work area. The function of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.) or ASIC (gate array, etc.) and a program (game program).

  The processing unit 100 includes a game processing unit 110, a first image generation unit 120, a second image generation unit 122, a stereoscopic image generation unit 126, and a sound generation unit 130. A part of these (for example, the game processing unit 110 and the sound generation unit 130) may be omitted.

  The game processing unit 110 performs various game processes for generating a game image based on operation data from the operation unit 160 (game controller). This game process includes a process for starting a game based on game start conditions, a process for advancing the game, a process for placing an object (display object) appearing in the game, object movement information (position, speed, acceleration), There are a process for obtaining motion information (motion information), a process for displaying an object, a process for calculating a game result, a process for ending a game when a game end condition is satisfied, and the like.

  The first image generation unit 120 arranges an object (object) on a reference plane that is oblique to the line-of-sight direction, or below or above the reference plane, and a first left-eye image for stereoscopic viewing Processing for generating a first right-eye image for stereoscopic viewing is performed. Here, the first left-eye image and the first right-eye image are images for stereoscopic viewing, for example, images with binocular parallax. Specifically, a virtual camera is arranged at the left-eye viewpoint position in the object space, and the first left-eye image is generated with the visual line direction of the virtual camera directed toward the object (gaze point). A virtual camera is arranged at the right eye viewpoint position in the object space, and a first right eye image is generated with the visual line direction of the virtual camera directed toward the object (gaze point).

  Note that an image seen from a virtual camera can be generated as follows. That is, first, geometric processing such as coordinate transformation, clipping processing, perspective transformation or light source processing is performed, and based on the processing result, drawing data (primitive surface vertex position coordinates, texture coordinates, color data, normal vector or α value etc.). Then, based on the drawing data (primitive surface data), the object (one or a plurality of primitive surfaces) after the perspective transformation (after the geometry processing) is converted into image information in units of pixels such as a drawing buffer 172 (frame buffer, work buffer, etc.). Draw in a buffer that can be stored. As a result, an image that can be seen from the virtual camera in the object space is generated.

  The second image generation unit 122 includes first to fourth points on the first left-eye image corresponding to the first to fourth vertices of the reference plane quadrangle (a quadrangle viewed from above the reference plane). The first left-eye image is subjected to deformation processing so that the first left-eye image is moved to the first to fourth vertices of the left-eye deformation processing quadrangle that is not the same as or similar to the reference surface quadrangle. A work image is generated (see FIG. 6). In addition, the first to fourth points on the first right-eye image corresponding to the first to fourth vertices of the quadrangle of the reference plane are for the right-eye deformation process having the same shape as the left-eye deformation process square. The first right-eye image is transformed so as to move to the first to fourth vertices of the quadrangle to generate a second right-eye image (see FIG. 7).

  The second image generation unit 122 reads the texture from the texture storage unit 174 based on the obtained texture coordinates and the texture coordinate calculation unit 123 that calculates the coordinates (U, V) of the texture stored in the texture storage unit 174. And a texture mapping unit 124 for mapping to the object. The first left-eye image deformation process and the first right-eye image deformation process can be realized using the texture mapping process or the like.

  When the first left-eye image and the first right-eye image are captured by the camera, the captured first left-eye image and first right-eye image are stored in the portable information storage device 194 or the communication. The data is taken in via a part 196 (in a broad sense, a taking part). Then, the second image generation unit 122 performs the above-described deformation process on the captured first left-eye image to generate a second left-eye image. In addition, the second image generation unit 122 performs the above-described deformation process on the captured first right-eye image to generate a second right-eye image.

  The stereoscopic image generation unit 126 performs processing for generating a stereoscopic image based on the second left-eye image (left-eye image) and the second right-eye image (right-eye image). For example, the second left-eye image (left-eye image) and the second right-eye image (right-eye image) are combined by anaglyph processing to generate a stereoscopic image. The stereoscopic image generation unit 126 also performs a process of drawing ruled lines, characters, symbols, figures, or the like on the stereoscopic image (pre-completion image). This makes it possible to provide an image in which an object (object) looks three-dimensional under a ruled line on the reference plane. In this case, the stereoscopic image generation unit 126 performs processing for drawing a ruled line whose line direction changes irregularly with respect to the reference straight line, processing for drawing a ruled line whose color shading changes irregularly depending on the location, Based on the translucency whose value changes irregularly depending on the location, a process of translucently combining the ruled line image with the stereoscopic image is performed.

  The stereoscopic image generation unit 126 outputs the generated stereoscopic image (completed image) to the printing unit 193. Then, the printing unit 193 creates and outputs a stereoscopic print by printing the stereoscopic image on a print medium.

  Alternatively, the stereoscopic image generation unit 126 outputs the stereoscopic image (completed image) to the display unit 190. In this case, for example, the player plays the game wearing glasses with red and blue color filters provided on the left and right eyes. Alternatively, the stereoscopic image generation unit 126 may perform a process of outputting the second left-eye image and the second right-eye image to the display unit 190 in different frames to realize stereoscopic viewing. In this case, the player plays the game wearing glasses with shutters that open and close in synchronization with the frame.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates game sounds such as BGM, sound effects, or sounds, and outputs the game sounds to the sound output unit 192.

  Note that the image generation system of the present embodiment may be a system dedicated to the single player mode in which only one player can play, or not only the single player mode but also a multiplayer mode in which a plurality of players can play. The system may also be provided. Further, when a plurality of players play, game images and game sounds to be provided to the plurality of players may be generated using one terminal, or connected via a network (transmission line, communication line) or the like. Alternatively, it may be generated using a plurality of terminals (game machine, mobile phone).

  The present invention is not limited to that described in the above embodiment, and various modifications can be made. For example, terms (virtual cameras, objects / subjects, etc.) cited as broad or synonymous terms (cameras, objects, etc.) in the description in the specification or drawings are broadly defined in other descriptions in the specification or drawings. Can be replaced with synonymous terms.

  Also, the method for creating the left-eye image, the right-eye image, and the stereoscopic image is not limited to that described in the present embodiment, and various modifications can be made. It is also possible to use the stereoscopic image created by the method of the present invention for uses other than the stereoscopic printed material and the game image. In addition, a case where a stereoscopic image is generated by a method equivalent to the stereoscopic method described in the present embodiment is also included in the scope of the present invention. Further, the present invention can be applied to various games (such as fighting games, competitive games, shooting games, robot battle games, sports games, role playing games, etc.). The present invention is also applicable to various image generation systems (game systems) such as a business game system, a home game system, a large attraction system in which a large number of players participate, a simulator, a multimedia terminal, and a system board for generating game images. Applicable.

The flowchart of the stereoscopic vision system of this embodiment. 2A and 2B are explanatory diagrams of the stereoscopic viewing method of the present embodiment. 3A and 3A are explanatory diagrams of the stereoscopic viewing method of the present embodiment. The example of image IL1 for left eyes produced by this embodiment. An example of a right-eye image IR1 created according to the present embodiment. Explanatory drawing of the deformation | transformation process of this embodiment. Explanatory drawing of the deformation | transformation process of this embodiment. The example of image IL2 for left eyes produced by this embodiment. An example of a right-eye image IR2 created according to the present embodiment. The example of the image for stereoscopic vision produced | generated by this embodiment. FIGS. 11A and 11B are explanatory diagrams of the stereoscopic viewing method of the present embodiment. Explanatory drawing of the correction process of a comparative example. Explanatory drawing of the correction process of a comparative example. An example of a left-eye image IL2 created by a comparative example. An example of a right-eye image IR2 created by a comparative example. The example of the image for stereoscopic vision produced | generated by the comparative example. 17A, 17B, and 17C are explanatory diagrams of a method for drawing ruled lines and the like. 18A, 18B, and 18C are explanatory diagrams of a drawing method such as ruled lines. 19A and 19B are explanatory diagrams of drawing methods such as ruled lines. The structural example of an image generation system.

Explanation of symbols

VPL left eye viewpoint position, VPR right eye viewpoint position,
OB object (object, subject), BS reference plane,
BQ quadrangle on reference plane, V1 to V4 BQ first to fourth vertices,
PL1 to PL4 1st to 4th point, LQ quadrangle for deformation processing for left eye,
VL1 to VL4 LQ first to fourth vertices,
PR1 to PR4 1st to 4th point, RQ Right-eye deformation processing rectangle,
First to fourth vertices of VR1 to VR4 RQ,
First left-eye image, IR1 first right-eye image,
IL2 second left eye image, IR2 second right eye image,
10 cases, 100 processing units, 110 game processing units, 120 first image generation units,
122 second image generation unit, 123 texture coordinate calculation unit,
124 texture mapping unit, 126 stereoscopic image generation unit,
130 sound generation unit, 160 operation unit, 170 storage unit, 172 drawing buffer,
174 Texture storage unit, 180 information storage medium, 190 display unit 192 sound output unit, 194 portable information storage device, 196 communication unit

Claims (8)

A method for producing a stereoscopic print,
An object is arranged on a reference plane that is oblique to the line-of-sight direction or below or above the reference plane, and a first left-eye image for stereoscopic viewing and a first right-eye image for stereoscopic viewing are displayed. make,
Corresponding to the first to fourth vertex of the rectangle in a reference plane, the first of the first to fourth point on the left eye image, in the square of the same or similar shape of the reference plane rather than In addition , the first left eye moves so that the length of the lower base closer to the viewpoint moves to the first to fourth vertices of the left-eye deformation processing rectangle which is a trapezoid longer than the length of the upper base far from the viewpoint. A second image for the left eye by performing a deformation process on the image for
The first to fourth points on the first right-eye image corresponding to the first to fourth vertices constituting the quadrangle on the reference plane are not the same as or similar to the quadrangle on the reference plane, and The first right-eye image is deformed so as to move to the first to fourth vertices of the right-eye deformation processing rectangle having the same shape as the left-eye deformation processing rectangle, and the second right-eye deformation processing is performed. Create an image,
Manufacturing method of the stereoscopic prints, characterized in that to create a printed material standing a visual based and the second left-eye image to the second right-eye image. In claim 1 ,
A ruled line, a character, a symbol, or a figure is drawn on the stereoscopic image obtained by the second left-eye image and the second right-eye image, and the object is placed under the ruled line, the character, the symbol, or the figure. A method for producing a stereoscopic printed matter, characterized in that a stereoscopic printed matter that appears stereoscopically is created. A stereoscopic printed material produced by the manufacturing method according to claim 1 or 2 . A stereoscopic printed matter created by duplicating a stereoscopic printed matter created by the manufacturing method according to claim 1 or 2 . A first left-eye image for stereoscopic viewing and a first right eye for stereoscopic viewing generated by placing an object on or below or above the reference plane that is oblique to the line-of-sight direction An image generation method for generating a stereoscopic image using a business image,
Corresponding to the first to fourth vertex of the rectangle in a reference plane, the first of the first to fourth point on the left eye image, in the square of the same or similar shape of the reference plane rather than In addition , the first left eye moves so that the length of the lower base closer to the viewpoint moves to the first to fourth vertices of the left-eye deformation processing rectangle which is a trapezoid longer than the length of the upper base far from the viewpoint. A second image for the left eye is generated by performing a deformation process on the image for use,
The first to fourth points on the first right-eye image corresponding to the first to fourth vertices constituting the quadrangle on the reference plane are not the same as or similar to the quadrangle on the reference plane, and The first right-eye image is deformed so as to move to the first to fourth vertices of the right-eye deformation processing rectangle having the same shape as the left-eye deformation processing rectangle, and the second right-eye deformation processing is performed. Generate an image,
Image generation method characterized by generating an image for standing a visual based on said second image for the left eye second right-eye image. In claim 5 ,
A ruled line, a character, a symbol, or a figure is drawn on the stereoscopic image obtained by the second left-eye image and the second right-eye image, and the object is placed under the ruled line, the character, the symbol, or the figure. An image generation method characterized by generating an image that looks stereoscopically. A first left-eye image for stereoscopic viewing and a first right eye for stereoscopic viewing generated by placing an object on or below or above the reference plane that is oblique to the line-of-sight direction A program for generating a stereoscopic image using the image,
Corresponding to the first to fourth vertex of the rectangle in a reference plane, the first of the first to fourth point on the left eye image, in the square of the same or similar shape of the reference plane rather than In addition , the first left eye moves so that the length of the lower base closer to the viewpoint moves to the first to fourth vertices of the left-eye deformation processing rectangle which is a trapezoid longer than the length of the upper base far from the viewpoint. A procedure of performing a deformation process of the image for generating a second left-eye image;
The first to fourth points on the first right-eye image corresponding to the first to fourth vertices constituting the quadrangle on the reference plane are not the same as or similar to the quadrangle on the reference plane, and The first right-eye image is deformed so as to move to the first to fourth vertices of the right-eye deformation processing rectangle having the same shape as the left-eye deformation processing rectangle, and the second right-eye deformation processing is performed. A procedure to generate an image;
A step of generating an image for standing a visual based on said second image for the left eye second right-eye image,
A program characterized by being executed by a computer. In claim 7 ,
A ruled line, a character, a symbol, or a figure is drawn on the stereoscopic image obtained by the second left-eye image and the second right-eye image, and the object is placed under the ruled line, the character, the symbol, or the figure. A program for causing a computer to execute a procedure for generating a stereoscopically visible image.