JP3908255B2 - Image projection system - Google Patents

Description

  The present invention relates to an image projection system that realizes projection of a high-definition image by combining images of a plurality of projectors on a screen.

  Conventionally, overhead projectors (OHP) and slides have been used in presentations for large groups. On the other hand, with the recent spread of personal computers and enhancement of application software, presentation systems combining personal computers and projection displays (hereinafter referred to as projectors) have come to be adopted. The feature of this system is that it saves the trouble of printing images and originals created on a personal computer on an OHP sheet or shooting them on a slide film. In particular, in the case of natural images, the colors seen at the creation stage can be obtained as they are. It is to be done. In such a projector, a projector using a liquid crystal panel that is lighter and less complicated to install than a conventional CRT display (Cathode Ray Tube dislay monitor) is mainly used.

  Here, FIG. 23 shows an example of a presentation system in which a personal computer and a liquid crystal projector are combined. In the figure, image / document data created on the personal computer 201 is branched from the monitor output and output to the processing control unit 206 of the liquid crystal projector 202. The processing control unit 206 of the liquid crystal projector 202 processes the input data and outputs it to the liquid crystal panel (LCP) 204. On the liquid crystal panel 204, an image corresponding to the input image data is displayed. The light from the light source 203 is projected on the screen 208 via the projection lens 207 after the amount of transmission is determined by the gradation of the image displayed on the liquid crystal panel 204.

  However, the resolution of the image projected by the liquid crystal projector is determined by the number of pixels of the liquid crystal panel. Currently, there are projectors that can input an image signal exceeding the resolution of the liquid crystal panel, but the original image data is thinned out to match the number of pixels of the liquid crystal panel, so the resolution of the original image is not utilized.

  Furthermore, although there is a projector that displays a part of an original image and projects the whole by scrolling, there is a disadvantage that the whole cannot be seen at a time. In order to solve such a problem, the number of pixels of the liquid crystal panel must be increased when obtaining a higher-definition projection image, but such a high-definition liquid crystal projector becomes very expensive. It is not suitable for general use.

  In addition, when a high-resolution liquid crystal panel is used, the load on the processing control unit also increases. Furthermore, there is a drawback that the area of the control part on the panel is widened, and as a result, the utilization efficiency of the light source light is reduced and the projected image becomes dark.

In addition, in order to project an accurate image, it is necessary to install the projector body horizontally and to face the screen. The image may be rotated or a phenomenon such as “aori”, which is generally called, has occurred.
Japanese Patent Laid-Open No. 2-306782 discloses a technique for inserting an image (inset image) prepared in advance into a part of a set photographed by a TV camera. In this technique, a tilt corresponding to the camera direction is artificially generated in the inset image (this conversion is referred to as primary perspective conversion) and inserted into the TV camera image. In this technique, the primary perspective transformation is expressed by the following expression (1), where the coordinates on the inset image are (x, y) and the coordinates in the image of the TV camera are (X, Y).

X = m · (d · x + e · y + f) / (a · x + b · y + c)
Y = m · (g · x + h · y + i) / (a · x + b · y + c) (1)
However, when this technique is applied to the projection image of the projector, a means for detecting the projection direction of the projector is required, which does not consider the rotation of the image with respect to the conversion of the above formula (1). Problems arise.

    The present invention has been made in view of the above problems, and an object of the present invention is to provide an image projection system for displaying a single original image on a screen by arranging projected images from a plurality of projectors while overlapping each other. In this case, it is possible to take a projection image of a plurality of projectors with a digital camera and automatically calculate parameters for correcting distortion etc. from the imaging data, so that a projection image faithful to the original image can be obtained and a plurality of projectors can be used. It is an object of the present invention to provide an image projection system capable of setting an existing high-definition projector very easily.

  In order to achieve the above object, according to a first aspect of the present invention, in an image projection system in which projected images from a plurality of projectors are arranged side by side with overlapping each other and one original image is displayed on a screen, coordinates are set in advance. Reference image generation means for generating reference image data having four or more feature points whose positions are known, and reference image data generated by the reference image generation means are sequentially or simultaneously input to the plurality of projectors. A digital camera that captures a reference image projected above to acquire reference image imaging data, and a position of the feature point in the reference image imaging data acquired by the digital camera, and each detected projector Based on the positions of the four or more feature points, the plurality of programs are projected on the screen so as to be a projection image faithful to the original image. Parameter calculating means for calculating parameters for correcting the shift amount of the projected image between the projectors and the difference in the distortion of the projected image caused by the difference in the projection angle between the projectors with respect to the screen, and the calculated parameter Parameter storage means for storing, and an image divided for each projector from the original image is input, and the projection images of adjacent projection images based on the parameters stored by the parameter storage means for the input original image And an image processing unit that corrects the difference between the shift amount and the distortion and outputs the corrected image to each projector.

  In a second aspect of the present invention, in the first aspect, the parameter calculation means includes an image memory means for storing image data acquired by the digital camera, and image data stored in the image memory means. A distortion amount calculating unit that compares the reference image data and determines the distortion parameter; a distortion correction unit that corrects an image acquired by the digital camera based on the distortion parameter into an image in which distortion is corrected; There is provided an image projection system comprising shift amount calculation means for calculating a shift amount between projection images of each projector from an image whose distortion has been corrected.

  According to a third aspect of the present invention, in the first or second aspect, the image processing means includes reference image imaging data display means for displaying the reference image imaging data acquired by the digital camera on a computer. Further, an image projection system is provided, further comprising a user interface for designating a feature point in the reference image captured data displayed by the reference image captured data display means.

  In a fourth aspect of the present invention, in the first to third aspects, the digital camera images a high-brightness point formed on the screen by a stick or a laser pointer, and the parameter calculation means An image projection system is provided, wherein a parameter relating to a position or distortion of a projected image of each projector on the screen is calculated using the high brightness point acquired by the digital camera as a feature point.

  According to a fifth aspect of the present invention, in the first to fourth aspects, the digital camera includes a whole reference image projected on the screen by the plurality of projectors and a reference image projected on the screen by the plurality of projectors. The parameter calculation means is for correcting the difference in the shift amount or distortion of the projected image of each projector based on the reference image imaging data obtained by imaging the entire reference image. A rough parameter is calculated, and an accurate parameter for correcting the shift amount and distortion difference of the projected images of the projectors is calculated based on the rough parameter and the partial enlarged imaging data of the reference image. An image projection system is provided.

  According to a sixth aspect of the present invention, there is provided the image projection system according to any one of the first to fifth aspects, wherein the projector blurs pixels by focusing the projected images of the plurality of projectors. Is done.

  According to a seventh aspect of the present invention, there is provided the image projection system according to any one of the first to sixth aspects, wherein the original image has a resolution higher than a resolution of a projection image of each projector.

  According to the present invention, in an image projection system in which projected images from a plurality of projectors are arranged side by side with overlapping each other and one original image is displayed on a screen, the projected images of the plurality of projectors are captured by a digital camera, From the obtained captured image data, it is possible to automatically calculate parameters for correcting the positional relationship between the projectors and the distortion (tilt) of the projected image. Therefore, a projection image faithful to the original image can be obtained, and a high-definition projector using a plurality of projectors can be set very easily.

  Embodiments of the present invention will be described below with reference to the drawings. First, an image projection system according to a first embodiment of the present invention will be described. FIG. 1 is a diagram showing a configuration of an image projection system according to the first embodiment.

  As shown in the figure, the image projection system according to the present embodiment is roughly divided into a personal computer (hereinafter abbreviated as a personal computer) 1 that creates an image / original and outputs high-definition image data 2. The high-definition image data 2 from the personal computer 1 is processed / divided to output a high-definition projector / controller unit 3 and a plurality of projectors 7a to 7d.

  The high-definition projector / controller unit 3 further includes an image processing / dividing unit 4, a projector arrangement storage unit 5, and a D / A conversion unit 6. Furthermore, although not shown here, a control unit for controlling each function is also included.

  In such a configuration, the high-definition image data 2 created and output by the personal computer 1 is output to the image processing / dividing unit 4 of the controller unit 3. The image processing / dividing unit 4 determines which portion of the high-definition image data 2 is output to each projector based on parameters stored in the projector arrangement storage unit 5 in advance, and performs predetermined processing. Details of the parameters stored in the projector arrangement storage unit 5 and the function or operation of each component such as the image processing / dividing unit 4 will be described later.

  The signals of the image processing / dividing unit 4 are output to a plurality of D / A converting units 6, converted into analog signals by the D / A converting unit 6, and then images are displayed on the screen 8 by the projectors 7 a to 7 d. Projected on top. The projected image projected on the screen 8 in this way becomes a high-definition image in which each image is accurately aligned.

  Here, with reference to FIG. 2, a method for making the entire projected image accurate without distortion when the liquid crystal projector 7 and the screen 8 are not directly facing each other will be described. When the projector 7 and the screen 8 do not face each other, the magnification is different in each part of the projected image, resulting in an image with “tilt” as shown in FIG. How the image is projected on the screen 8 depends on the distance d between the projector 7 and the screen 8 along the optical axis of the projector 7, the rotation angle ω of the projector 7 when the optical axis is the rotation axis, The angle (the direction in which the tilt occurs) θ formed by the perpendicular line CS drawn from the reference point C to the screen 8 and the optical axis of the projector and the ZX plane (the direction in which the tilt occurs), the angle formed by the perpendicular line CS and the optical axis of the projector (Tilting angle) is determined by φ.

Now, on the image input to the projector 7, the coordinates with the image center as the origin o are (x, y), and the point where the screen and the optical axis of the projector intersect as shown in FIG. When the coordinates of the X axis, the Y axis in the vertical direction, and the Z axis in the normal direction of the screen are (X, Y, 0), the relationship between (x, y) and (X, Y) is as follows: 2), (3), and (4).

  In the above equation, T on the right side of the matrix indicates transposition, and m is a scaling factor determined by the distance d from the screen. R is a matrix representing rotation by θ, φ, and ω, and the coordinate C is the position of the reference point of the projector in the XYZ coordinate system.

  By calculating backward from these d, θ, φ, and ω, and generating and outputting an image in which the tilt is corrected in advance as shown in FIG. 2 (b), the entire projected image is accurate at the same magnification. Become. This will be described later. Although the description has been given here assuming that the projection state is determined from d, θ, φ, and ω, other parameter sets may be used as long as the projection state can be accurately described and corrected.

  FIG. 3 is a diagram showing the relationship between the original image and the output image to each projector. FIG. 3A shows a high-definition original image compared to the resolution of the projector, and this image is output to two projectors that project on the screen in a positional relationship as shown in FIG. 3B. In this case, as shown in FIG. 3C, when an image of a portion shifted downward from the image of the left projector is output to the right projector, the entire original image is displayed on the screen as shown in FIG. An image that is substantially the same as the image is projected.

  Further, the overlapping portion is aligned by adopting an image laminating technique disclosed in, for example, Japanese Patent Application Laid-Open No. 6-141246. By applying the processing technology for overlapping portions of a plurality of images and multiplying the value of the original image by a coefficient as shown in FIG. 3E and outputting it to the projector, the joint portions can be smoothly connected. .

  An example of joining in this manner is shown in FIG. In FIG. 3F, one line of two images (for example, a line connecting AB in FIG. 3) is indicated by a broken line. The solid line is the value of the projected image when each data value is multiplied by the coefficient shown in FIG. In FIG. 3B, it has been described that the projectors have the same magnification. However, if the magnifications are different, it can be dealt with by changing the size of the portion selected in FIG.

  The above method is also applicable to the case where two or more projectors are used. Furthermore, because the pixels of the liquid crystal panel are relatively coarse, the liquid crystal pixels are clearly projected on the projected image, resulting in an image that is difficult to see. These phenomena can be prevented by, for example, slightly defocusing the projected image and blurring the pixels. In FIG. 3, the coefficient multiplied by the overlap portion is linearly changed. However, if it can be smoothly joined, it may be changed nonlinearly, for example, as a sin function.

  FIG. 4 shows and describes a tilt correction image generation method. 4A shows a projected image, and FIG. 4B shows image data input to the projector. An area Sq surrounded by q0, q1, q2, and q3 in FIG. 4B indicates the maximum image that can be input to the projector, and the projected image is an area surrounded by Q0, Q1, Q2, and Q3 in FIG. Corresponds to SQ.

  A region SP surrounded by P0, P1, P2, and P3 shaded in FIG. 4A is a region used for actual projection. In the projector input image, a region SP surrounded by P0, P1, P2, and P3. Corresponding to The reference point of SP is the point P0 where the angle between the two sides is the maximum, P1 and P3 are points where the horizontal and vertical straight lines intersect with each side of SQ, and P2 is a rectangle with the other three points. It is a point to make. Also, a region Sp surrounded by P0, P1, P2, and P3 in FIG. 4B is a portion corresponding to Sp in the image input to the projector.

  The pixel position (i, j) counted from the image center of the projector input image is converted into (Xi, Yj) by the above equation (2). Therefore, as the value of the pixel position (i, j), the value of the pixel corresponding to (Xi, Yj) in the original image selected for each projector is used as shown in FIG. At this time, if (Xi, Yj) is not an integer, a value is obtained by a known interpolation method such as linear interpolation or bicubic interpolation. If (Xi, Yj) goes out of SP after conversion, the pixel value is set to zero. Here, Sp is determined as described above, but Sp can be set at an arbitrary position and size within SQ.

  FIG. 5 shows and describes the detailed configuration of the image processing / dividing unit 4 that realizes the above conversion. In the figure, the image processing / dividing unit 4 further includes a display image selection unit 9, an interpolation unit 10, and a coefficient setting unit 11. As described with reference to FIG. 3, the display image selection unit 9 refers to the parameter storage unit 12 for determining a portion that can be projected by the present system in the original image, determines a portion to be projected by each projector, and determines a plurality of portions. The image for the projector is output.

  The interpolation unit 10 reads the rotation, shift, and tilt parameters of each projector from the parameter storage unit 12 and outputs the output images of the display image selection unit 9 by transforming and interpolating so that accurate projection images are connected on the screen. To do. Further, the coefficient setting unit 11 reads the overlap parameters of the projection images of the projectors from the parameter storage unit 12 and sets the coefficients shown in FIG. This coefficient is multiplied by the output image of the interpolation unit 10 and is output to each projector through the D / A conversion unit 6 as a final image.

  FIG. 6 shows a process of determining a projected image by the image dividing / processing unit 4 when the left and right projectors have a tilt in addition to FIG. In this example, the right image has a horizontal sway, and the left image has a sway upward and diagonally to the right. When the same image as FIG. 3C is projected in this state, an image in which both projections are shifted due to distortion is observed unlike the original image as shown in FIG. 6A. Therefore, in order to solve such a problem, conversion is performed by the tilt parameter stored in the parameter storage unit 12, and an image as shown in FIG. 6B is projected. Thereby, a high-definition image faithful to the original image is obtained on the screen as shown in FIG.

  In this embodiment, it is described that data is sent to the projector as an analog signal. However, if the projector has an input terminal for a digital signal, it can be output as digital data. Of course, it is unnecessary.

  Next, an image projection system according to a second embodiment of the present invention will be described. In the second embodiment, a part for calculating a parameter for determining the arrangement of the projectors is further added to the first embodiment.

  FIG. 7 is a diagram showing a configuration of an image projection system according to the second embodiment. As shown in the figure, the present embodiment mainly includes a controller unit 21, a projector 28, and a digital camera 29. The digital camera 29 is arranged near the position of a person who actually views a presentation or the like, and can capture a projection image 30. At the time of setting, the image switching unit 26 is switched to project the reference image generated by the reference image generating unit 25.

  The projected reference image is taken by the digital camera 29, and the image is input to the projector arrangement parameter calculation unit 24 of the controller unit 21, and then parameters (d, θ, φ, ω) for determining the arrangement of the projector are used. Calculated.

  The parameters thus calculated are stored in the projector arrangement storage unit 23 and read out to the image processing / division unit 22 when necessary. The image processing / dividing unit 22 creates an image to be output to the projector 28 through the D / A conversion unit 27 using the read parameters. Here, although the reference image is generated at the time of setting, it is needless to say that the reference image generation unit 25 may be configured as a reference image storage unit.

  FIG. 8 shows a detailed configuration of the parameter calculation unit 24 and will be described. In the figure, the parameter calculation unit 24 includes a tilt amount calculation unit 30, an overlap / rotation amount calculation unit 31, a tilt correction unit 32, and an image memory unit 33.

  In such a configuration, an image photographed by the digital camera 29 is temporarily stored in the image memory unit 33, read out when necessary, and compared with the reference image by the tilt amount calculation unit 30, and the tilt parameter. Is determined. The tilt parameter is output to the parameter storage unit and also input to the tilt correction unit 32.

  The tilt correction unit 32 corrects an image captured by the digital camera 29 based on the tilt parameter to an image obtained by capturing a projected image with corrected tilt. The overlap / rotation amount calculation unit 31 calculates the rotation / overlap between the projection images of the projectors from this image, and outputs them to the parameter storage unit 23.

  The projected image 30 projected when shooting with the digital camera 29 in order to calculate the parameters is, for example, a bright image or a cross arranged at regular intervals, or a known image such as a lattice pattern in which the above parameters are accurately obtained. If so, the form is not limited.

  At this time, a method of projecting reference images in order by a plurality of projectors 28 and determining parameters for each projector, or an image captured by changing the color of the projected image for each projector and captured by the digital camera 29 The parameters of each projector can also be determined by designating the color.

  Hereinafter, with reference to FIG. 9, a method of calculating parameters by displaying a straight line with a different angle divided into a plurality of times in the second embodiment will be described. When a line segment passing through the center of the image and having a length L is displayed as m = 0, 1, 2,... By changing the angle αm from the horizontal (see FIG. 9A), the line on the photographed image is displayed. Assume that a minute is observed at a length L'm and an angle α'm. Here, α′m is an angle from the horizontal in the captured image, and L′ m is divided into distances L1m and L2m from the center to the end points (L′ m = L1m + L2m). At this time, the rotation angle ω of the image is expressed by the following equation (5).

ω = α'm -αm (5)
Here, if the line segment 2 is the maximum of L′ m, the direction θ in which the tilt occurs is expressed by the following equation.

θ = α2 (6)
Further, assuming that the direction orthogonal to the line segment 2 is k, L1m and L2m are normalized by (L / L′ k).

11m = L1m ^* (L / L'k)
12m = L1m ^* (L / L'k) (7)
From these, the parameters φ and d are obtained by the following equation (8).

  Next, with reference to FIG. 10, a case of a lattice point will be described as an example of the projection image 30 projected when calculating the parameters. In the drawing, a region surrounded by a dotted line indicates a projected image of the projector, and a portion surrounded by a solid line indicates a photographing range of the digital camera 29. Further, the left and right projected images partially overlap, and the left image has a vertical tilt.

  First, the positions corresponding to the left and right grid points are calculated from the image 101 taken by the digital camera by a method such as binarization and pattern matching. Further, within one projection image (left projection image in FIG. 10), the ratio of the position on the digital camera image to the distances d1, d2,... And the grid point position on the image data actually input to the projector. From the interval w [pixel], each parameter of the above equation (2) can be obtained to correct the tilt.

  Since the position of the grid point when it is input to the projector is known, the positional relationship between the two projected images on the screen can be calculated from the shift amount s on the image 101 of the digital camera.

  In FIG. 10, it is described that the vicinity of the overlap of both projectors is photographed with a digital camera. However, if the resolution is sufficient, the whole may be photographed. It is also possible to incorporate a camera control unit, perform rough calculations on the first image of the entire image, and then accurately determine the parameters based on the image of the next enlarged image. Further, it is possible to use a sequential method (for example, steepest descent method) in which an image to be projected is gradually changed and feedback is performed so that an image obtained by capturing the projected image approaches an ideal captured image.

  Further, when the tilt becomes large, the influence of defocusing becomes large, but in that case, it can be avoided by incorporating an optical system called a tilt correction lens in the projection lens.

  Next, FIG. 11 shows another configuration of the parameter calculation unit 24 and will be described. This is a new addition of a distortion correction unit 35 for correcting distortion of an image of a digital camera. Other configurations are the same as those in FIG.

  In general, a camera lens often has a space variant distortion. However, in the system of the present invention, since the parameter is determined from an image obtained by photographing the projection image, it is not desirable that the distortion exists. Therefore, the parameters can be accurately calculated by correcting the distortion of the image before being used for parameter calculation. Distortion correction can be easily realized if the digital camera has a format that records the focal position of the lens.

  In the second embodiment, image data obtained by capturing a projection image is directly input from the digital camera 29 to the projector arrangement parameter calculation unit 24. However, a medium such as a floppy (registered trademark) disk or a PC card is used. It is also possible to input to the projector arrangement parameter calculation unit 24 offline.

  Further, the digital camera is used to capture the projected image. However, the system of the present invention can be realized by providing an image input board and an A / D converter even with a general CCD camera, video camera, or the like.

  Next, an image projection system according to a third embodiment will be described. FIG. 12 illustrates an example in which a characteristic point of a projected image on the screen, such as a vertex and a lattice point, is pointed and imaged with a bar provided with a high brightness LED at the tip.

  In this example, since the point pointed compared with the projected image can be made very bright, the feature point can be easily extracted from the photographed image of the digital camera. Moreover, you may point with a laser pointer instead of high-intensity LED.

  FIG. 13 illustrates an example in which a pointing device is provided in the projector. As shown in the figure, the image is displayed on the LCP 43, and the light from the light source 42 is projected onto the screen 50 through the LCP 43, the optical system 44, and the projection lens 45. A laser beam (indicated by a dotted line in the figure) emitted from a semiconductor laser (LD) 46 is reflected by mirrors 48 and 49 and projected onto a screen.

  The mirror 49 is tiltable. When pointing to determine the projection state, the mirror 49 is placed on the optical axis as shown in the figure, and when projecting an image, it is tilted and removed from the optical axis. The processing control unit 47 controls the LCP 43 for image display, adjusts the angle of the mirror 48, and projects the bright spot of the laser at the feature point position.

  By placing the pointing device in the projector, the feature points can be specified accurately and automatically. Further, the use efficiency of light from the light source 42 and the LD 46 can be increased by making the mirror 49 tiltable.

  Here, the laser beam is described as being projected onto the screen through the LCP 43, but it is needless to say that the mirror 49 may be provided on the screen side from the LCP 43. Furthermore, it is possible to instruct the image data of the digital camera 29 using a mouse or the like while displaying it on a personal computer, and any feature point extraction method can be used as long as it can be specified accurately.

  FIG. 14 shows an example in which the projection state is determined by arranging a large number of minute optical sensors on the screen. In the figure, such a sensor of the projected image is indicated by a black circle, and a sensor that does not apply is indicated by a white circle. In this way, the projection state on the screen can be known by detecting the sensor irradiated with light. What is important is that the parameters are calculated so that the parameters can be accurately calculated. Of course, the system of the present invention can be configured by methods other than those described above.

  Next, an image projection system according to a fourth embodiment will be described. The fourth embodiment is a high-intensity, multi-gradation projector using a plurality of projectors. Hereinafter, this embodiment will be described with reference to FIG.

  In the figure, a projected image 52 is projected by accurately overlapping the images of a plurality of projectors 51. At this time, if exactly the same image is output from both projectors, it is observed on the screen at twice the brightness as projected by one projector, so the system of the present invention functions as a projector with high brightness.

  In general, image data is expressed with 256 gradations of 0 to 255 for each color. In the system of the present invention, an image of 255 × N + 1 gradations can be expressed using N projectors. For example, when two projectors are used, if the data of the value 114 is input to the projectors 57 and 57 and the data value 317 is 159 and 158, the maximum of 510 gradations (both projectors). Can be considered.

  As described in the second embodiment, the present invention automatically aligns the projected image from the viewpoint of the viewer and outputs the corrected image to the projector. Easy to realize.

  A stereoscopic image can also be displayed by adding parallax to the output image of each projector. Since all the resolutions of the projector can be utilized in the system of the present invention, it is possible to display a stereoscopic image with a higher resolution than in the past.

  Next, an image projection system according to a fifth embodiment will be described. In each of the above embodiments, a flat screen is assumed. However, the present invention is effective even when a spherical screen shown in FIG. 16 is used as in this embodiment.

  That is, FIG. 16A shows a projection system for a large number of people. Since such a system can display an image in a wide range of field of view, a high presence can be obtained. Utilizing the present invention, such a projection system can be set up very easily.

  Further, as shown in FIG. 16B, application to a personal projection apparatus is also conceivable. For personal use, there is an example of realizing a highly realistic display by wearing a device called HMD (Head Mounted Display), but this example does not need to be equipped with a special device unlike HMD, so there is a feeling of pressure, etc. There is no, you can see easily. Furthermore, there is an effect that it is not necessary to look at the display at a close distance, the burden on the eyes is small, and an image having a higher resolution than that of the HMD can be obtained.

  The projector may be installed from below the audience as shown in FIGS. 16C and 16D, or from above and below. Further, a rear projection type display as shown in FIG.

  The image projection system according to the fifth embodiment is characterized in that since the projection state can be corrected from the viewpoint of the viewer, projection onto a screen other than a planar shape can be easily set.

  Next, an image projection system according to a sixth embodiment will be described. FIG. 17 shows an example in which storage media for storing output images to the projectors are combined. As shown in the figure, the controller unit 61 is configured by adding an output image storage unit 66 to an image processing / dividing unit 62, a projector arrangement storage unit 63, a projector arrangement parameter calculation unit 64, and a D / A conversion unit 65. .

  In such a configuration, the output image to each projector created by the image processing / dividing unit 62 is temporarily stored in the output image storage unit 66. When outputting to the projector, the output image storage unit 66 sequentially reads.

  The output image storage unit 66 may be provided outside the controller unit 61. These storage media can be composed of HDD (Hard Disk Drive), CD-ROM, DVD (Digital Video Disc) or the like. The image projection system according to the sixth embodiment is effective when the same image is used many times.

  Next, an image projection system according to a seventh embodiment will be described. It is also possible to process with software as shown in FIG. In the figure, a CPU 75 reads image processing / division software 72 and projector arrangement parameters 73 stored in a storage medium such as a hard disk, corrects and divides image / original data 71, and creates projection data 77a, 77b,. .

  The projection data 77 created in this way is output to the projectors 79a, 79b... Through the image input / output board 76. Further, the projector arrangement parameter calculation software 74 is read by reading the projector arrangement determination image data 78 obtained by photographing the projection image with the video camera 80, and the projector arrangement parameter is calculated and stored in the storage medium. The image projection system according to the seventh embodiment can be realized at a lower cost than in the case of hardware, and is effective when a moving image is not required or when an image can be prepared in advance.

  Next, an image projection system according to an eighth embodiment will be described. In the fifth embodiment, an example of a rear projection type display has been described above. However, this embodiment realizes a high-definition and thin display by arranging a large number of small projectors (microprojectors).

  FIG. 19 is a diagram for explaining an embodiment in which the present system is applied to a thin display. Of the configuration shown in FIG. 1, the image segmentation / processing unit 91, the parameter storage unit 92, the parameter calculation unit 93, the reference image generation unit 94, and the image switching unit 95 are the same as those in the above embodiment. In addition, an image obtained by capturing a projected image near the viewpoint by the audience is input to the parameter calculation unit 93. In this example, a rear projection type display that projects onto the screen 97 from behind is assumed.

  A feature of the eighth embodiment is that a micro projector 96 that is much smaller than the projector used in the above embodiment is used, and a large display is configured by arranging a large number of projectors although the projection range of each projector is limited. is there.

  Moreover, since the display main body is small, each light source does not require a very high output. Therefore, although the depth is small, since a large number of displays are arranged, a very high-definition image can be seen as compared with the conventional case.

  FIG. 20 shows an example in which the micro projector 96 is configured by lasers of three primary colors of red, green, and blue. The driver 105 adjusts the angles of the mirrors 104a to 104c and the output intensities of the lasers 101 to 103 according to the image in the memory 106, and scans a desired direction. The angle of the mirror can be changed by an electromagnet from two directions while fixing the central portion of the mirror to a flexible column.

  In FIG. 20, one color is handled by one mirror, but scanning in the x and y directions can also be controlled by two mirrors of each color. Recently, green and blue semiconductor lasers are also being put into practical use following red, so if a very small scanning projector using these semiconductor lasers is used as an output device, it will be smaller than the screen size. A display with a short depth can be realized.

  In addition, the microprojector can also be configured using an element called an LED array or a digital micromirror device (DMD). Next, an image projection system according to a ninth embodiment will be described.

  For image correction, an optical system for adjustment can be used in front of the projector. Hereinafter, the ninth embodiment will be described with reference to FIG. In the figure, a controller unit 121 includes an image division / processing unit 122, a parameter storage unit 123, a parameter calculation unit 124, an image switching unit 126, and a D / A conversion unit 127, and takes a projected image with the digital camera 125. The parameters necessary for accurate projection are calculated from the obtained images in the same manner as in the above embodiments.

  In the ninth embodiment, an adjustment optical system 128 and an adjustment optical system control unit 129 are newly added in addition to the above. The adjustment optical system control unit 129 drives the adjustment optical system newly provided on the lens front surface of the projector based on the parameters stored in the parameter storage unit so as to form an accurate projection image on the screen. The adjustment optical system 128 is composed of a lens group having a positive refractive power and a lens group having a negative refractive power. If there is a shift / tilt mechanism, the shift, tilt, and out-of-focus necessary for this system can be adjusted. is there.

  Here, FIG. 21 shows an example of image shift adjustment as an example. If there is a lens at the first shaded position and the LCD surface is on the optical axis, a projected image is formed at the position 113 on the screen. If the lens is shifted upward from this state, a projected image is formed at a position 114 on the screen. Although not shown in the figure, tilting and defocusing can be corrected by adjusting the tilt or the distance between the two lens groups.

  In the ninth embodiment, the correction has been described using only the optical system, but it is also possible to combine the correction processing with the image division / processing unit. Although not described in the above description of the embodiment, the present invention can be applied to a projector using a CRT instead of the LCD.

  The embodiment described above has the following effects. That is, firstly, in this system, by dividing and projecting high-definition image data to a plurality of projectors, it is possible to display a document / image having a higher resolution than a liquid crystal panel used in the projector. Second, dividing and projecting high-definition image data into a plurality of projectors creates an output image to each projector based on a pre-stored projection state, so that the adjusted projection can be performed automatically. it can. Third, since an image in which tilt and the like are corrected is output as an image projected by each projector, a projection image faithful to the original image can be obtained.

  Fourth, the projection images of a plurality of projectors are photographed by an imaging device placed near the viewpoint position of the audience, and parameters for automatically correcting the positional relationship between the projectors and deformation of the projection images are calculated from the obtained image data. be able to. Therefore, a high-definition projector using a plurality of projectors can be set very easily. Fifth, it is easy to calculate the projector arrangement parameters by capturing an image instructing the feature points of the projected image with a pointing device having a brightness sufficiently higher than that of the image data, such as a high brightness LED and a laser pointer.

  Sixth, by providing a pointing device in the projector, it is possible to accurately and automatically specify feature points on the projected image. Seventh, since it is possible to easily superimpose projection images of a plurality of projectors, it can be used as a high-intensity projector or a multi-tone projector. Eighth, since the system of the present invention can evaluate a projected image from the viewpoint of a viewer, it can be easily set to project onto a screen having a shape other than a plane. Ninth, by using a scanning projector having a transmission screen and using a semiconductor laser as a projection device, a very thin display can be realized with a very simple setting.

  Tenth, by providing an output image storage unit that stores an output image to each projector once created, when used multiple times, there is no need to recalculate each time. Eleventh, by incorporating the adjustment optical system into the image projection means, it becomes possible to accurately synthesize the projected images from the projectors including the out of focus of the projected images on the screen.

  The summary of the present invention is summarized as follows.

  (1) Image generation means for generating high-definition image data, image projection means including a plurality of projectors that project at least a part of the high-definition image data, and at least one of the high-definition image data to the plurality of projectors An image projection system comprising: image processing means for selecting, processing and outputting a part.

  This aspect corresponds to the first embodiment. According to this system, in the system of the present invention, high-definition image data can be divided and projected onto a plurality of projectors, thereby displaying a document / image having a higher resolution than the liquid crystal panel CRT used in the projector. it can. Furthermore, dividing and projecting high-definition image data into a plurality of projectors creates an output image to each projector based on a pre-stored projection state, so that the adjusted projection can be performed automatically. .

  (2) The image processing means includes parameter storage means for storing parameters necessary for processing for projecting an image without distortion by the plurality of projectors, and divides and processes the image data based on the parameters. The image projecting system according to (1), further comprising: an image dividing / processing unit that outputs to a plurality of projectors.

  This aspect corresponds to the first embodiment. According to this system, in the system of the present invention, high-definition image data can be divided and projected onto a plurality of projectors, thereby displaying a document / image having a higher resolution than the liquid crystal panel CRT used in the projector. it can. Furthermore, dividing and projecting high-definition image data into a plurality of projectors creates an output image to each projector based on a pre-stored projection state, so that the adjusted projection can be performed automatically. .

  (3) An imaging unit that captures a projected image on the screen projected by the image projecting unit in the vicinity of a viewer's viewpoint, and arrangement information on the screen of the projector from image data obtained by capturing the projected image by the imaging unit. The image projection system according to (1) or (2), further comprising parameter calculation means for calculating an arrangement parameter.

  This aspect corresponds to the second embodiment. According to this system, an image in which tilt and the like are corrected is output as an image projected by each projector, so that a projection image faithful to the original image can be obtained. Furthermore, the projection images of a plurality of projectors are captured by an imaging device placed near the viewpoint position of the audience, and parameters for automatically correcting the positional relationship between the projectors and the deformation of the projection images are calculated from the obtained image data. Can do. Therefore, a high-definition projector using a plurality of projectors can be set very easily.

  (4) In the above (3), the projector arrangement parameter is calculated from image data obtained by photographing a known pattern projected from one or more of the plurality of projectors with the imaging device. The image projection system described.

  This aspect corresponds to the second embodiment. According to this system, an image in which tilt and the like are corrected is output as an image projected by each projector, so that a projection image faithful to the original image can be obtained. Furthermore, the projection images of a plurality of projectors are captured by an imaging device placed near the viewpoint position of the audience, and parameters for automatically correcting the positional relationship between the projectors and the deformation of the projection images are calculated from the obtained image data. Can do. Therefore, a high-definition projector using a plurality of projectors can be set very easily.

  (5) The image projection system according to (3), wherein the projector arrangement parameter is calculated from image data obtained by photographing an image with a feature point pointed on a screen by the imaging device.

  This aspect corresponds to the third embodiment. According to this system, it is possible to easily calculate the projector arrangement parameter by capturing an image instructing the feature point of the projection image with a pointing device having a luminance sufficiently higher than that of image data such as a high luminance LED and a laser pointer. Furthermore, by providing a pointing device in the projector, it is possible to accurately and automatically specify feature points on the projection image.

  (6) The image projection system according to (3), wherein the projector arrangement parameter is calculated by an optical sensor arranged on a screen.

  This aspect corresponds to the third embodiment. According to this system, the feature point on the projected image can be specified accurately and automatically by sensing the projected image with the optical sensor on the screen.

  (7) The image according to (2) or (3), wherein the projected images of the plurality of projectors project a spatially identical portion in the image data onto the same location on the screen. Projection system. This aspect corresponds to the fourth embodiment.

  Since this system can easily superimpose the projection images of a plurality of projectors, it can be used as a high-intensity projector or a multi-tone projector.

  (8) The image projection system according to (2) or (3), wherein the projection images of the plurality of projectors are projected onto a screen having a shape other than a plane. This aspect corresponds to the eighth embodiment.

  Since this system can evaluate the projected image from the viewpoint of the viewer, it can be easily set to project onto a screen with a shape other than a plane.

  (9) The image projection system according to (2) or (3), wherein the projection images of the plurality of projectors are projected onto a transmissive screen.

  This aspect corresponds to the fifth embodiment. Since this system can evaluate the projected image from the viewpoint of the viewer, it can be easily set to project onto a screen with a shape other than the reflective type.

  (10) The image projection system according to (2) or (3), further comprising an output image storage unit that stores output images to the plurality of projectors created by the image processing / dividing unit.

  This aspect corresponds to the sixth embodiment. According to this system, by providing the output image storage unit that stores the output image to each projector once created, there is no need to recalculate each time when it is used multiple times.

  (11) The image projecting unit adjusts the projection state of the plurality of projectors and accurately synthesizes the projection images of the projectors on the screen, and the adjustment optical system that controls the adjustment optical system The image projection system according to (2) or (3), further including a control unit.

  This aspect corresponds to the ninth embodiment. According to this system, by incorporating the adjustment optical system into the image projection means, it becomes possible to accurately synthesize the projected images from the projectors including the out-of-focus of the projected images on the screen.

  Further, the present invention includes the following contents.

  That is, an image generating means for generating high-definition image data, an image projecting means having a plurality of projectors for projecting at least a part of the high-definition image data, and at least a part of the high-definition image data are selected. And an image processing unit for processing and outputting the processed image to the plurality of projectors. The image processing means stores parameter necessary for processing for projecting an accurate image by the plurality of projectors, and divides and processes the image data based on the parameters to the plurality of projectors. Image division / processing means for outputting may be further included. The image processing apparatus further includes imaging means for capturing a projection image arranged near the viewpoint of the audience, and parameter calculation means for calculating the projector placement parameter from image data obtained by capturing the projection image by the imaging means. It is good.

  That is, one of the objects of the present invention is to combine a personal computer, a plurality of projectors, and a controller unit that divides a high-definition input image and outputs an image signal to each projector, and uses a high-definition that takes advantage of the resolution of the input data. It is to obtain a projection image. Therefore, according to the present invention, a personal computer, a plurality of projectors, and a controller unit that divides a high-definition input image and outputs an image signal to each projector are combined, and a high-definition projection image utilizing the resolution of the input data is obtained. An image projection system can be provided.

It is a figure which shows the structure of the image projection system which concerns on 1st Embodiment. It is a figure for demonstrating the method of making the whole projection image accurate at equal magnification, when the liquid crystal projector 7 and the screen 8 are not facing directly. It is a figure which shows the relationship between an original image and the output image to each projector. It is a figure which shows the method of tilt correction image generation. 3 is a diagram showing a detailed configuration of an image processing / dividing unit 4. FIG. FIG. 6 is a diagram illustrating a process of determining a projection image by the image dividing / processing unit 4 when there is a tilt in the images of the left and right projectors. It is a figure which shows the structure of the image projection system which concerns on 2nd Embodiment. 3 is a diagram illustrating a detailed configuration of a parameter calculation unit 24. FIG. In a 2nd embodiment, it is a figure for explaining a method of calculating a parameter by displaying a straight line which changed an angle divided into a plurality of times. It is a figure for demonstrating the case of a lattice point as an example of the projection image 30 projected when calculating a parameter. 6 is a diagram illustrating another configuration of the parameter calculation unit 24. FIG. In 3rd Embodiment, it is a figure which shows the example which points and image | photographs the feature points of the projection image on a screen, such as a vertex and a lattice point, with the insertion rod which provided high-intensity LED at the front-end | tip. FIG. 10 is a diagram showing an example in which a pointing device is provided in a projector in the third embodiment. In the third embodiment, the projection state is determined by arranging a large number of minute optical sensors on the screen. It is a figure for demonstrating the image projection system which concerns on 4th Embodiment. It is a figure for demonstrating the image projection system which concerns on 5th Embodiment. FIG. 25 is a diagram illustrating an example in which storage media for storing output images to the projectors are combined in the sixth embodiment. It is a figure for demonstrating the image projection system which concerns on 7th Embodiment. It is a figure explaining embodiment which applied the system concerning 8th Embodiment to the thin display. It is a figure which shows the example which comprised the micro projector 96 with the laser of three primary colors of red, green, and blue. It is a figure for demonstrating the image shift adjustment example by 9th Embodiment. It is a figure which shows the structure of the image projection system which concerns on 9th Embodiment. It is a figure which shows the structure of the image projection system which concerns on a prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Personal computer, 2 ... High-definition image data, 3 ... Projector controller, 4 ... Image processing division | segmentation part, 5 ... Projector arrangement | positioning memory | storage part, 6 ... D / A conversion part, 7 ... Liquid crystal projector, 8 ... Screen.

Claims (7)

In an image projection system in which projected images from a plurality of projectors are arranged side by side with an overlap, and one original image is displayed on a screen,
Reference image generation means for generating reference image data having four or more feature points whose coordinate positions are known in advance;
A digital camera that inputs the reference image data generated by the reference image generation means sequentially or simultaneously to the plurality of projectors, images the reference image projected on the screen, and acquires the reference image imaging data;
The position of the feature point in the reference image captured data acquired by the digital camera is detected, and a projected image faithful to the original image on the screen based on the detected position of four or more feature points of each projector. Parameter calculation means for calculating a parameter for correcting the shift amount of the projection image between the plurality of projectors and the difference in distortion of the projection image caused by the difference in projection angle between the projectors with respect to the screen;
Parameter storage means for storing the calculated parameters;
An image divided for each projector is input from the original image, and the shift amount of the projection image between adjacent projection images based on the parameters stored by the parameter storage unit with respect to the input original image, and distortion Image processing means for correcting the difference and outputting to each projector;
An image projection system comprising: The parameter calculation means is
Image memory means for storing image data obtained by the digital camera, distortion amount calculating means for comparing the image data stored in the image memory means with the reference image data, and determining the distortion parameter; and Distortion correction means for correcting the image acquired by the digital camera based on the distortion parameter into an image corrected for distortion, and shift amount calculation for calculating the shift amount between the projected images of each projector from the image corrected for distortion The image projection system according to claim 1, further comprising: means. The image processing means includes
Reference image imaging data display means for displaying the reference image imaging data acquired by the digital camera on a computer,
3. The image projection system according to claim 1, further comprising a user interface for designating a feature point in the reference image captured data displayed by the reference image captured data display means. The above digital camera
The high-intensity point formed on the screen is imaged with a bar or a laser pointer,
The parameter calculation means is
4. The parameter relating to the position or distortion of a projected image of each projector with respect to the screen is calculated using the high-luminance point acquired by the digital camera as a feature point. The image projection system described. The above digital camera
An image obtained by enlarging an overlap portion of the entire reference image projected on the screen by the plurality of projectors and the reference image projected on the screen by the plurality of projectors,
The parameter calculation means is
Based on the reference image imaging data obtained by imaging the entire reference image, a rough parameter for correcting the shift amount or the difference in distortion of the projection image of each projector is calculated,
5. An accurate parameter for correcting a difference in shift amount and distortion of a projection image of each projector based on the rough parameter and partial enlarged image data of the reference image is calculated. The image projection system according to any one of the above. The projector
6. The image projection system according to claim 1, wherein pixels are blurred by focusing a projection image of the plurality of projectors. The original image is
The image projection system according to claim 1, wherein the image projection system has a resolution higher than a resolution of a projection image of each projector.

Images