JP6418265B2 - Correction control apparatus, correction method, and projector - Google Patents

Description

  The present invention relates to a correction control device, a correction method, and a projector that are used to correct the projection position of a projector.

  Conventionally, when projection is performed using a plurality of projectors, it is necessary to align images projected from the projectors with high accuracy. Therefore, a projection apparatus is known that projects a position adjustment pattern from each projector onto a screen, captures a projected image with a camera, calculates correction data from the captured image, and adjusts the projection position of the projector with high accuracy. (For example, refer to Patent Document 1).

JP 2005-102277 A

However, the display result of the position adjustment pattern displayed on the screen greatly depends on the influence of the screen installation environment (environment light or illumination), the influence of the reflection amount of the screen, or the like. In addition, since the influence of the installation environment and the amount of reflection is not uniform over the entire screen, it is difficult to obtain information necessary for adjusting the projection position of the projector with high accuracy from the captured image of the position adjustment pattern. There is a case.
The present invention has been made in view of the above-described circumstances, and an object thereof is to reliably acquire information for aligning the projection position of each projector from a captured image when projecting by a plurality of projectors. .

In order to achieve the above object, the present invention comprises: a photographing control means for photographing a guide projected on a projection surface by a projector by a photographing means; and an image analyzing means for detecting the guide from a photographed image of the photographing means. The photographing control means is characterized in that when the guide cannot be detected from the photographed image by the image analyzing means, the setting relating to the photographing condition is changed and the photographing means executes the photographing again.
According to the present invention, when the guide cannot be detected from the captured image, the exposure is changed and the image is captured a plurality of times. Thereby, it is possible to obtain a good shot image by changing the shooting conditions in response to the influence of the installation environment such as ambient light and illumination on the projection surface. Therefore, it is possible to reliably acquire information for aligning the projection position of the projector from the captured image.

Further, the present invention is the correction control apparatus described above, further comprising a correction control unit that acquires information for correcting the projection position of the projector based on the guide detected by the image analysis unit. It is characterized by.
According to the present invention, a guide can be detected from a captured image by the image analysis unit, and information for aligning the projection position of the projector can be acquired based on the detected guide. Thereby, the information for aligning the projection position of a projector can be acquired at high speed.

Further, the present invention is the correction control apparatus described above, wherein a position where the guide is to be detected in the captured image is designated in advance with respect to the image analysis means, and the image analysis means In the above, the guide is detected.
According to the present invention, since the image analysis unit determines whether or not the guide can be detected at the designated position, the image analysis unit can quickly determine whether or not the guide can be detected from the captured image. Therefore, the analysis processing of the image analysis means can be simplified, and information for aligning the projection position of the projector can be acquired at high speed.

Further, the present invention is the correction control apparatus described above, wherein the image analysis unit detects the guide at a plurality of positions of the captured image.
ADVANTAGE OF THE INVENTION According to this invention, even when the influence of an installation environment is not uniform with respect to the projection surface which a projector projects an image, a guide can be detected from a picked-up image. Therefore, information for aligning the projection position of the projector can be reliably acquired from the captured image.

Further, the present invention is the correction control apparatus described above, wherein the imaging control unit detects the guide at any position of the captured image by the image analysis unit, and then detects the guide at another position. If it is not detected, the setting relating to the shooting condition is changed, and shooting is performed again by the shooting unit.
According to the present invention, it is possible to shoot by changing the exposure for each position where the guide is detected, and even when the influence of the installation environment on the projection surface is not uniform, a plurality of photographic images with different exposures can be used. Each of the guides in position can be reliably detected. Therefore, it is possible to reliably acquire information for aligning the projection position of the projector by eliminating the influence of the installation environment.

In order to achieve the above object, the present invention provides a case where a guide projected on a projection surface by a projector is photographed by photographing means, the guide is detected from a photographed image, and the guide cannot be detected from the photographed image. The setting relating to the shooting condition is changed, and the shooting is performed again by the shooting unit.
According to the present invention, when the guide cannot be detected from the photographed image due to the influence of the installation environment on the projection surface, the guide is photographed again by changing the exposure. Accordingly, the guide can be reliably detected from the captured image, and information for aligning the projection position of the projector can be reliably acquired from the captured image.

In order to achieve the above object, the present invention provides a projection unit that projects an image on a projection surface, a photographing unit that photographs the projection surface, and the photographing unit in a state where the guide is projected on the projection surface. A photographing control unit that executes photographing by the image capturing unit, and an image analyzing unit that detects the guide from a photographed image of the photographing unit, and the photographing control unit cannot detect the guide from the photographed image by the image analyzing unit. In this case, the setting relating to the shooting condition is changed, and the shooting is performed again by the shooting unit.
According to the present invention, when the guide cannot be detected from the photographed image due to the influence of the installation environment on the projection surface, the guide is photographed again by changing the exposure. Accordingly, the guide can be reliably detected from the captured image, and information for aligning the projection position of the projector can be reliably acquired from the captured image.

Further, the present invention is the above projector, wherein the photographing control unit is configured to project the guide onto the projection surface by the projection unit and another guide from another projector. Imaging is performed by an imaging unit, the image analysis unit detects the guide projected by the projection unit and the guide projected by the other projector, and the imaging control unit is configured to detect the image analysis unit. If any of the guide projected by the projecting unit and the guide projected by the other projector cannot be detected from the captured image, the setting relating to the imaging condition is changed and the image capturing unit captures the image again. It is characterized by performing.
According to the present invention, a guide projected from a projector and a guide projected from another projector can be reliably detected from a captured image. Therefore, information for aligning the projection positions of the projection images projected from the two projectors can be reliably acquired based on the two guides detected from the captured image.

  According to the present invention, it is possible to reliably acquire information for aligning the projection position of a projector from a captured image.

It is a figure which shows schematic structure of the projection system which concerns on embodiment. It is a figure which shows the functional structure of a projection system. It is a figure which shows the projection state of a guide, (A) is a figure which shows a 1st guide, (B) is a figure which shows a 2nd guide, (C) is the 1st guide and 2nd guide overlapping. It is a figure which shows the state currently displayed. It is a flowchart which shows operation | movement of a control part. It is a flowchart which shows operation | movement of the correction control apparatus at the time of calculating a correction amount.

Embodiments to which the present invention is applied will be described below with reference to the drawings.
FIG. 1 is a diagram illustrating a schematic configuration of a projection system 1 that adjusts a projection position using a control unit (correction control device) 131 according to an embodiment of the present invention.
The projection system 1 is a projection system that performs projection by a plurality of projectors including a first projector 2A and a second projector 2B. In the present embodiment, the first projector 2A and the second projector 2B are installed side by side, and the projection images 101 and 102 by these two projectors 2A and 2B are superimposed on the screen (projection surface) SC. Display the stack as you do. In FIG. 1, a configuration in which the projectors 2A and 2B are installed side by side is taken as an example, but the projectors 2A and 2B may be installed side by side. The projectors 2A and 2B may be installed on the floor in front of the screen SC, or may be installed on the ceiling suspended from the ceiling. In addition, in the case of floor-standing installation, the projectors 2A and 2B may be placed on a table placed on the floor.

Each of the projectors 2A and 2B is connected to the image output device 7 via the image transmission cable 41, and projects an image based on the image data input from the image output device 7 onto the screen SC. Image data relating to the same image is supplied from the image output device 7 to the projectors 2A and 2B.
The projection system 1 projects the same image from each of the projectors 2 </ b> A and 2 </ b> B toward the screen SC, and these projection images 101 and 102 are superimposed on each other to form a single projection image 100 on the screen SC. That is, the projection image 100 is an image in which the projection lights of the projectors 2A and 2B are projected in an overlapping manner. The projection system 1 has an advantage that the amount of light of the projected image 100 can be significantly increased by performing the stack display in this way. In addition, the projection system 1 projects a left-eye image from one of the projectors 2A and 2B, and projects a right-eye image from the other, so that a projected image that becomes a 3D image when viewed through polarized glasses. It is also possible to project 100.

Here, if the image projected by the first projector 2 </ b> A and the image projected by the second projector 2 </ b> B are shifted, the projected image 100 is blurred. Therefore, it is necessary to adjust the projection positions of the projectors 2A and 2B, that is, the positions where the projection images 101 and 102 are projected and the sizes of the projection images 101 and 02 with high accuracy.
In the projection system 1 of the present embodiment, each of the projectors 2A and 2B has a function of projecting an adjustment guide (guide) 3 for adjusting the projection position. The adjustment guide 3 is formed by displaying a first guide 3A projected by the first projector 2A and a second guide 3B projected by the second projector 2B on the screen SC. Moreover, although mentioned later for details, the projection system 1 is provided with the imaging | photography part 143 which image | photographs the guides 3A and 3B projected from projector 2A, 2B. The photographing unit 143 is controlled by the control unit 131. The control unit 131 controls the imaging unit 143, corrects the projection positions of the projectors 2A and 2B from the captured images of the imaging unit 143, and acquires information for highly accurate alignment.

FIG. 2 is a diagram illustrating a functional configuration and a hardware configuration of the projectors 2A and 2B.
The first projector 2A includes a projection unit 110 that projects an image, a control unit 131 that performs image processing and controls each unit of the projector 2A, an image reception unit 132, an image processing unit 133, an image correction unit 134, and a light modulation device. The main body 120 includes a drive unit 135, a light source drive unit 136, a communication control unit 137, an input operation unit 138, a remote control reception unit (operation detection unit) 139, a storage unit 142, and a photographing unit 143. Although not shown, the main body 120 is provided with an LED that informs the user of the operating state of the projector 2A by blinking or lighting.
The projection unit 110 includes a light source 122, a mirror 123, a light modulation device 124, and a projection optical system 125. The light source 122 includes a reflector 122A. The mirror 123 separates the light emitted from the light source 122 into R, G, and B component color lights. The light modulation device 124 modulates the R, G, and B component color lights separated by the mirror 123. The projection optical system 125 projects the light modulated by the light modulation device 124 toward the screen SC.

As the light source 122, for example, a xenon lamp, an ultrahigh pressure mercury lamp, an LED, a laser light source, or the like can be used. The light source 122 may include a lens group (not shown), a polarizing plate, an auxiliary reflector (not shown), and the like for enhancing the optical characteristics of the projection light, in addition to the reflector 122A.
The mirror 123 reflects the R component light included in the light emitted from the light source 122 and transmits the G component and the B component, and the G transmissive mirror reflects the G component light and transmits the B component. It is provided with a dichroic mirror for use. Further, the mirror 123 may be provided with a relay lens group that absorbs the difference in optical path length for each of the R component, G component, and B component.

  The light modulation device 124 corresponds to modulation means for displaying an image on the screen SC, and is a light modulation device that modulates R component light, a light modulation device that modulates G component light, and light that modulates B component light. Includes a modulation device. More specifically, the light modulation device 124 is configured by a method using three transmissive or reflective liquid crystal light valves corresponding to each color of RGB, a method using three digital mirror devices, and the like. The R component, G component, and B component light separated by the mirror 123 is modulated.

The mirror 123 may be configured to guide the light emitted from the light source 122 to the light modulation device 124 as white light without separating the light into color light. In this case, the light modulation device 124 is configured by a DMD system in which a color wheel that transmits RGB light among light included in white light emitted from a light source is combined with one digital mirror device (DMD). . In the system in which the color wheel and one digital mirror device are combined, one digital mirror device corresponds to the modulation means.
In the present embodiment, the light modulation device 124 is configured to use a liquid crystal light valve. The light modulation device 124 includes a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix. The light modulation device 124 functions as a modulation unit that forms an image with the plurality of pixels and modulates the light emitted from the light source 122 with the formed image. .
The light modulation device 124 is driven by a light modulation device driving unit 135, which will be described later, and forms an image by changing the light transmittance of each pixel arranged in a matrix.

The projection optical system 125 includes a prism 126 that synthesizes RGB three-color modulated light modulated by the light modulator 124 and a projection lens 127 that forms an image of the projection image 100 synthesized by the prism 126 on the screen SC. The prism 126 is configured by combining one or a plurality of optical prisms and mirrors in accordance with the configuration of the light modulation device 124.
Since the light modulation device 124 of the present embodiment is configured to include three transmissive liquid crystal panels, the prism 126 is configured to synthesize light modulated by these three liquid crystal panels by the prism 126. . The projection lens 127 is composed of, for example, a plurality of lens groups, and is driven by a drive mechanism (not shown) that adjusts zoom and focus. The light projected by the projection optical system 125 is projected from the projection window 120A onto the screen SC, and the projection image 100 is displayed on the screen SC. Here, the light source 122, the light modulation device 124, and the projection optical system 125 function as a projection unit of the first projector 2A.

The control unit 131 includes a CPU (not shown), a ROM that stores programs and data executed by the CPU in a nonvolatile manner, a RAM that temporarily stores programs executed by the CPU and data to be processed, and the like. Centrally control each part of the projector 2A.
The control unit 131 includes an imaging control unit 151, an image analysis unit 152, a correction control unit 153, and a projection position correction unit 154, and functions as a correction control device that controls correction of the projection positions of the projectors 2A and 2B.
An image transmission cable 41 is connected to the image receiving unit 132. The image receiving unit 132 receives various types of image data or image signals from the external image output device 7 via the image transmission cable 41. The image data received by the image receiving unit 132 may be either an analog image signal or digital image data, and the signal format, data format, and the like are arbitrary. The specific specifications of the connection terminal to which the image transmission cable 41 is connected in the image receiving unit 132, the image transmission cable 41, and the image output device 7 are also arbitrary. The image receiving unit 132 outputs the image data received from the image output device 7 to the image processing unit 133.

The image processing unit 133 analyzes the image data input from the image receiving unit 132 under the control of the control unit 131, and performs analog / digital conversion processing and resolution conversion that are set in advance according to the data format of the image data. Processing, aspect ratio change processing, frame rate conversion processing, color reduction processing, color increase processing, image correction processing, and the like are performed, and projection image data having a resolution corresponding to the number of display pixels of the light modulation device 124 is generated.
The image correction unit 134 executes a trapezoidal distortion correction process for correcting the trapezoidal distortion that occurs due to the tilt angle of the projector 2A with respect to the screen SC. Under the control of the control unit 131, the image correction unit 134 performs a correction process in which the projection image data output from the image processing unit 133 is shaped to compensate for trapezoidal distortion, and the corrected projection image data is driven by the light modulation device. To the unit 135.
The light modulation device driving unit 135 drives the light modulation device 124 according to the image data input from the image correction unit 134. As a result, the projected image 100 is projected into the image forming area having the shape set by the user.
The light source driving unit 136 performs lighting control of the light source 122 based on an instruction from the control unit 131.

  The communication control unit 137 transmits and receives control information to and from the second projector 2B. In the projection system 1, the first projector 2 </ b> A is configured as a commander that receives commands for controlling each unit of the projection system 1. The first projector 2A is configured to be able to control the second projector 2B by transmitting a necessary command to the second projector 2B as a receiver by the communication control unit 137.

  The input operation unit 138 includes a plurality of operation keys (not shown) and the like for the user to give various instructions to the first projector 2A. As the operation keys provided in the input operation unit 138, for example, a power key for switching the power ON / OFF, a menu key for displaying a menu image for performing various settings, an item selected by the menu image, etc. are confirmed. A determination key to be moved, a position adjustment key for instructing projection of a position adjustment pattern, four direction keys corresponding to up, down, left and right, a keystone distortion correction key used for keystone distortion correction, and the like. The control unit 131 detects the operation content of the user in the input operation unit 138 and controls the first projector 2A based on the detected operation.

The remote control receiving unit 139 receives various instructions for the first projector 2A performed by the user with respect to a remote control (remote controller) 50A capable of remote operation. As with the input operation unit 138, the remote controller 50A displays, for example, a power key for switching the power ON / OFF, a menu key for displaying a menu image for performing various settings, an item selected by the menu image, and the like. A plurality of operation keys such as a determination key to be confirmed, a position adjustment key for instructing projection of a position adjustment pattern, four direction keys corresponding to up, down, left and right, a trapezoidal distortion correction key used for trapezoidal distortion correction are provided.
The remote control receiver 139 and the remote controller 50A are each configured to be able to set a reception / transmission channel. By setting the channel of the remote control receiving unit 139 and the channel of the remote control 50A to the same channel, the remote control receiving unit 139 can receive user operations performed on the remote control 50A. Also, the second projector 2B is installed in the vicinity of the first projector 2A, and the channel of the remote controller (remote controller) 50B for operating the second projector 2B is set to a channel different from the channel of the remote control receiver 139. Thus, the first projector 2A can be prevented from being operated by the remote controller 50B.

The storage unit 142 includes a non-volatile storage device such as a mask ROM, flash memory, or FeRAM (Ferroelectric RAM). The storage unit 142 stores in advance a plurality of guides 3A and 3B used when adjusting the projection positions projected from the projectors 2A and 2B.
As shown in FIG. 1, the plurality of projectors 2A and 2B constituting the projection system 1 project different guides 3A and 3B when adjusting the projection region and / or the projection position. The plurality of guides 3A and 3B may be configured to be stored in the projectors 2A and 2B, respectively, or may be configured to be stored in one projector, for example, the first projector 2A.

  When the projectors 2A and 2B respectively store a plurality of guides 3A and 3B, for example, the first projector 2A projects the different guides 3A and 3B from the projectors 2A and 2B, respectively. It may be configured to control the above. Further, for example, the second projector 2B may identify the first guide 3A projected from the first projector 2A and project the second guide 3B different from the first projector 2A. good. Further, the first projector 2A stores a plurality of guides 3A and 3B, and transmits and projects a second guide 3B different from the first guide 3A projected from the first projector 2A to the second projector 2B. The structure to be made may be sufficient.

  The imaging unit 143 is a digital camera that captures an area in which the first projector 2A projects the projection image 101 on the screen SC under the control of the imaging control unit 151. The imaging unit 143 is not limited to the configuration provided in the main body 120 of the first projector 2A, and is provided separately from the first projector 2A, and various wired or wireless devices are provided to the first projector 2A. The configuration may be a camera connected using a communication line.

  The second projector 2B includes an image projection unit 210 that projects an image, a control unit (determination unit, control unit) 231 that performs image processing and controls each unit of the second projector 2B, an image reception unit 232, and image processing. The unit 233, the image correction unit 234, the light modulation device driving unit 235, the light source driving unit 236, the communication control unit 237, the input operation unit 238, the remote control reception unit (operation detection unit) 239, and the storage unit 242 In preparation. Moreover, although illustration is abbreviate | omitted, the structure provided with the imaging | photography part which image | photographs the range which can cover the projection range of the 2nd projector 2B may be sufficient as the 2nd projector 2B. The configuration of each unit of the second projector 2B is the same as the configuration of each unit of the first projector 2A, and the description thereof is omitted. That is, the image projection unit 210 is configured in the same manner as the projection unit 110, the image reception unit 232 is configured in the same manner as the image reception unit 132, the image processing unit 233 is configured in the same manner as the image processing unit 133, and the image correction unit 234. Is configured in the same manner as the image correction unit 134, the light modulation device driving unit 235 is configured in the same manner as the light modulation device driving unit 135, the light source driving unit 236 is configured in the same manner as the light source driving unit 136, and the communication control unit 237 The input operation unit 238 is configured in the same manner as the input operation unit 138, the remote control reception unit 239 is configured in the same manner as the remote control reception unit 139, and the storage unit 242 is configured in the same manner as the storage unit 142. Composed.

  The second projector 2B operates as a receiver that receives a control command from the first projector 2A by the communication control unit 237. When the second projector 2B performs projection alone, the second projector 2B executes various functions according to the operation detected by the input operation unit 238 and the operation by the remote control 50B received via the remote control reception unit 239. Further, when the second projector 2B operates as a receiver of the first projector 2A that is a commander, the second projector 2B operates in the sub operation mode. In this sub operation mode, no response is made to the user operation detected by the input operation unit 238 and the user operation detected by the remote control receiving unit 239. That is, the second projector 2B in the sub operation mode operates according to a command output from the first projector 2A in response to a user operation performed on the first projector 2A.

  When the two projectors 2A and 2B are arranged close to each other, interference that both the two projectors 2A and 2B receive infrared signals transmitted by the remote controllers 50A and 50B may occur. In order to prevent this interference, for example, different channels are allocated to the two projectors 2A and 2B and the two remote controllers 50A and 50B, respectively, and one projector detects only an infrared signal emitted from one remote controller. It can be configured. For example, if channel 1 is assigned to the remote controller 50A and the first projector 2A, and channel 2 is assigned to the remote controller 50B and the second projector 2B, the first projector 2A reacts only to the operation of the remote controller 50A, and the second projector 2B. Reacts only to the operation of the remote controller 50B. In this configuration, when the second projector 2B operates in the sub operation mode, the second projector 2B does not respond to the operation of the remote controller 50B.

  FIG. 3A is a view showing the first guide 3A projected from the first projector 2A onto the screen SC. The first projector 2 </ b> A forms a first guide 3 </ b> A on the liquid crystal panel of the light modulation device 124 and projects it on the screen SC under the control of the control unit 131. In the first guide 3A exemplified in the present embodiment, the background 4A over the entire projection area is formed in black, and four white first dots 5 are provided at each of the four corners of the background 4A. Placed one by one. The four dots arranged at each corner are arranged at respective vertex positions of a substantially rectangular shape with a predetermined interval therebetween.

  FIG. 3B is a diagram showing the second guide 3B projected from the second projector 2B onto the screen SC. The second projector 2B exemplified in the present embodiment forms the second guide 3B on the liquid crystal panel of the light modulation device 224 and projects it on the screen SC under the control of the control unit 231. In the second guide 3B, the background 4B over the entire projection area is formed in black, and one white second dot 8 is arranged at each of the four corners of the background 4B. In addition, four white lines 9 are arranged along the outer edge of the projection area in the second guide 3B. The line 9 is arranged for detecting the second dot 8.

  As shown in FIGS. 3A and 3B, the guides 3A and 3B projected from the projectors 2A and 2B respectively have a plurality of portions in the projection area of the projectors 2A and 2B. In addition, dots 5 and 8 serving as reference points for acquiring information for aligning the projection positions of the projectors 2A and 2B are provided. The plurality of portions where these reference points are arranged are portions for detecting the guides 3A and 3B in order to obtain information for aligning the projection positions of the projectors 2A and 2B.

  The first guide 3A projected from the first projector 2A onto the screen SC and the second guide 3B projected from the second projector 2B onto the screen SC are displayed so as to overlap the screen SC. As a result, an adjustment guide (guide) 3 is formed on the screen SC as shown in FIG. In the adjustment guide 3, white first dots 5, second dots 8, and lines 9 are displayed on a black background 4. In the projectors 2A and 2B, the projection area, the projection position, and the projection angle are adjusted by a user operation so that each second dot 8 is within the area surrounded by the four first dots 5. .

As described above, the control unit 131 of the projector 2A obtains information for aligning the projection positions of the projectors 2A and 2B with high accuracy, and serves as a correction control device that corrects the projection positions of the projectors 2A and 2B. Fulfills the function.
The operation of the control unit 131 when the control unit 131 functions as a correction control device will be described below with reference to the flowcharts of FIGS.
FIG. 4 is a flowchart showing the operation of the control unit 131 when aligning the projection positions of the projectors 2A and 2B. First, when an operation for performing stack projection by the projectors 2A and 2B is performed by the user via the input operation unit 138 or the remote controller 50A, the control unit 131 starts from the first projector 2A, which is a commander projector, to the first guide 3A. The second guide 3B is projected from the second projector 2B, which is a receiver projector, onto the screen SC (step S1). More specifically, the control unit 131 projects the first guide 3A stored in the storage unit 142 onto the screen SC, and causes the second projector 2B to project the second guide 3B via the communication control unit 137. Send a command. The second projector 2B projects the second guide 3B onto the screen SC under the control of the control unit 231. The second guide 3B may be configured to be stored in the storage unit 142 of the first projector 2A and transmitted to the second projector 2B via the communication control units 137 and 237, or the second guide 3B. The configuration may be stored in the storage unit 242 of the projector 2B.

Subsequently, the control unit 131 calculates the correction amount of the projection position of the projectors 2A and 2B in the first portion L1 based on the adjustment guide 3 projected on the screen SC (step S2). The process for calculating the correction amount is a predetermined process defined in advance, and the operation of the control unit 131 when calculating the correction amount will be described in detail later.
As described above, the first dot 5 and the second dot 8 are arranged at each corner of the adjustment guide 3. The control unit 131 calculates the correction amount of the projection position of the projectors 2A and 2B based on the positional relationship between the first dot 5 and the second dot 8 for each corner. In the present embodiment, the first portion L1 is the upper left portion of the adjustment guide 3, the second portion L2 is the upper right portion of the adjustment guide 3, the third portion L3 is the lower left portion of the adjustment guide 3, 4 portion L4 is the lower right portion of the adjustment guide. The correction amounts of the projection positions of the projectors 2A and 2B are calculated in order from the first portion L1 to the fourth portion L4. In addition, the order which calculates the corrected amount of a projection position can be changed suitably in the parts L1-L4. In addition, the arrangement positions of the first dots 5 and the second dots 8 and the number of arrangement positions can be appropriately changed according to the projection conditions such as the size and shape of the projection screen.

  As described above, in the guides 3A and 3B exemplified in the present embodiment, the dots 5 and 8 which are the reference points for calculating the correction amounts of the projection positions of the projectors 2A and 2B are provided as one second dot 8. They are arranged so as to fit within the area surrounded by the four first dots 5. Thereby, the correction amount can be calculated for each of the portions L1 to L4 for detecting the adjustment guide 3 based on the positional relationship between the second dot 8 and each of the first dots 5, and the projection position. Can be acquired based on the positional relationship between the dots 5 and 8. Further, since the dots 5 and 8 are arranged in a plurality of portions in the projection area, the correction amount of the projection position of the projectors 2A and 2B can be calculated for each of the plurality of portions, and the projectors 2A and 2B. Can be acquired based on the guides 3A and 3B.

  Next, the control unit 131 determines whether or not the calculation processing of the correction amount of the projection position of the projectors 2A and 2B has been completed for the first portion L1 (step S3). Note that if the calculated correction amount is output as a result of step S2, the control unit 131 determines that the correction amount calculation processing has been completed (step S3: Yes). On the other hand, if a correction amount calculation error is output as a result of step S2, the control unit 131 determines that the correction amount calculation processing has not been completed (step S3: No). If it is determined that the correction amount calculation processing has not been completed (step S3: No), the control unit 131 outputs an image adjustment failure notification (step S12), and adjusts the projection position of the projectors 2A and 2B. The correction process to be performed is terminated. The control unit 131 may be configured to notify the user that the image adjustment has failed by blinking or lighting an LED provided in the main body 120 to indicate that the image adjustment has failed.

When it is determined that the correction amount calculation process has been completed for the first portion L1 (step S3: Yes), the control unit 131 subsequently corrects the correction amounts of the projection positions of the projectors 2A and 2B in the second portion L2. Is calculated (step S4). Although details will be described later, the same processing is also performed in steps S6 and S8.
Next, the control unit 131 determines whether or not the calculation processing of the correction amount of the projection position of the projectors 2A and 2B has been completed for the second portion L2 (step S5). When it is determined that the correction amount calculation process is not completed for the second portion L2 (step S5: No), the control unit 131 outputs an image adjustment failure (step S12).
When it is determined that the correction amount calculation process has been completed for the second portion L2 (step S5: Yes), the control unit 131 subsequently corrects the correction amounts of the projection positions of the projectors 2A and 2B in the third portion L3. Is calculated (step S6). Next, the control unit 131 determines whether or not the calculation processing of the correction amount of the projection position of the projectors 2A and 2B has been completed for the third portion L3 (step S7). When it is determined that the correction amount calculation process has not been completed for the third portion L3 (step S7: No), the control unit 131 outputs that the image adjustment has failed (step S12).

When it is determined that the correction amount calculation process has been completed for the third portion L3 (step S7: Yes), the control unit 131 subsequently corrects the correction amounts of the projection positions of the projectors 2A and 2B in the fourth portion L4. Is calculated (step S8). Next, the control unit 131 determines whether or not the calculation processing of the correction amount of the projection position of the projectors 2A and 2B has been completed for the fourth portion L4 (step S9). When it is determined that the correction amount calculation process has not been completed for the fourth portion L4 (step S9: No), the control unit 131 outputs that the image adjustment has failed (step S12).
When it is determined that the correction amount calculation processing has been completed for the fourth portion L4 (step S9: Yes), the control unit 131 performs the first calculation based on the calculated correction amounts in the portions L1 to L4. The image of the projector 2A is corrected. The control unit 131 aligns the projection positions of the projectors 2A and 2B with high accuracy by correcting the projection position so that the projection image 101 of the first projector 2A matches the projection image 102 of the second projector 2B. . The control unit 131 optically or electronically corrects the projection image of the first projector 2A and aligns the projection positions of the projectors 2A and 2B (step S10).
When the control unit 131 completes the alignment of the projection positions of the projectors 2A and 2B based on the correction amounts calculated for the portions L1 to L4, the control unit 131 outputs an image adjustment completion message (step S11), and the projections of the projectors 2A and 2B. The correction process for adjusting the position is ended. The control unit 131 may be configured to notify the user that the correction processing for adjusting the position of the projection positions of the projectors 2A and 2B has been completed by blinking or lighting the LED provided in the main body 120. .

Next, the operation of the control unit 131 when calculating the correction amounts of the portions L1 to L4, which are processes corresponding to the above-described steps S2, S4, S6, and S8, will be described using the flowchart of FIG.
When calculating the correction amount of the projection position of the projectors 2A and 2B for each of the portions L1 to L4 based on the adjustment guide 3 projected on the screen SC, the control unit 131 first uses the function of the photographing control unit 151 to perform the photographing unit. 143 is controlled and the guides 3A and 3B displayed so as to overlap the screen SC are photographed (step S21). As shown in FIG. 3C, the entire adjustment guide 3 is photographed in the photographed image 50 of the photographing unit 143. Subsequently, the control unit 131 determines whether or not the adjustment guide 3 can be detected for a specific region of the captured image 50 by the function of the image analysis unit 152 (step S22). The specific region is one of the first portion L1, the second portion L2, the third portion L3, and the fourth portion L4. In the present embodiment, the correction amount is calculated based on the captured image 50 of the imaging unit 143 in order from the first portion L1.

  By the way, the amount of reflection of the screen SC due to the influence of the installation environment such as ambient light and illumination on the screen SC or the influence of the installation environment is not uniform on the screen SC. Therefore, a part of the captured image 50 may be overexposed or underexposed. When the overexposed or blackened portion of the captured image 50 occurs in the portions L1 to L4 that detect the adjustment guide 3, the portions L1 to L4 and the like cannot detect the adjustment guide 3. If there is a portion in the photographed image 50 where the adjustment guide 3 cannot be detected, it is impossible to calculate a correction amount for accurately aligning the projection positions of the projectors 2A and 2B from the photographed image 50 of the photographing unit 143. End up. The present embodiment provides a method for preventing the adjustment guide 3 from being undetectable from the photographed image 50 due to the installation environment of the projection system 1 and the amount of reflection of the screen SC. A good photographed image 50 is acquired by photographing a plurality of times.

  When it is determined that the adjustment guide 3 cannot be detected for the first portion L1 of the captured image 50 of the imaging unit 143 (step S22: No), the control unit 131 determines whether the number of detection determinations is within a specified number. (Step S25). The number of detection determinations for determining whether or not the adjustment guide 3 can be detected for each of the portions L1 to L4 is determined in advance. If the number of detection determinations exceeds the specified number (step S25: Yes), control is performed. The unit 131 outputs a correction amount calculation error and ends the correction amount calculation process. When the number of detection determinations of the adjustment guide 3 is within the specified number for a specific portion of the captured image 50 (step S25: No), the control unit 131 uses the function of the shooting control unit 151 to set the shooting conditions of the shooting unit 143. Is changed (step S27), and the adjustment guide 3 projected again on the screen SC is imaged by the imaging unit 143. In the present embodiment, when the adjustment guide 3 cannot be detected, the imaging control unit 151 captures the captured image 50 while changing the exposure as the imaging condition. The imaging control unit 151 can change the exposure of the imaging unit 143 in a plurality of stages, and changes the exposure to capture the adjustment guide 3 multiple times, thereby affecting the captured image 50 due to the installation environment of the screen SC. Can be removed. Note that the shooting control unit 151 changes the exposure by adjusting one or each of the shutter speed, ISO sensitivity, and lens aperture of the shooting unit 143.

When the adjustment guide 3 can be detected for the first portion L1 of the photographed image 50 of the photographing unit 143 (step S22: Yes), the control unit 131 detects from the photographed image 50 by the function of the correction control unit 153. Based on the positional relationship between the dots 5 and 8 of the adjustment guide 3 thus adjusted, a correction amount for correcting the projection positions of the projectors 2A and 2B is calculated (step S23). That is, the control unit 131 acquires information for accurately aligning the projection positions of the projectors 2A and 2B from the captured image 50 of the imaging unit 143. The control unit 131 outputs the calculated correction amount (step S24), and ends the process of calculating the correction amount in the first portion L1.
Similarly, the control unit 131 performs the processing of steps S21 to S27 for the second portion L2, the third portion L3, and the fourth portion L4, and calculates the correction amount for each of the portions L2 to L4. It should be noted that when an image for calculating the correction amount of each of the portions L1 to L4 is captured, the exposure that has been successfully detected by the adjustment guide 3 in the previous shooting is first applied to the subsequent shooting. May be. That is, after calculating the correction amount for the first portion L1, when calculating the correction amount for the second portion L2, the exposure that has been successfully detected by the adjustment guide 3 for the first portion L1 The configuration may be applied when the image for calculating the correction amount for the portion L2 is first taken.
According to these configurations, when the guide projected on the screen SC is photographed, the exposure is adjusted according to the influence of ambient light or illumination or the change in the situation such as the amount of reflection of each part of the screen SC due to the influence. Change and shoot multiple times. This makes it possible to reliably detect the adjustment guide 3 from the captured image 50 in response to changes in ambient light over time and differences in the amount of reflection at each part of the screen with respect to illumination. In addition, a sequence of photographing the adjustment guide 3 projected on the screen SC and a sequence of calculating a correction amount based on the adjustment guide 3 in the photographed image and correcting the projection positions of the projectors 2A and 2B. The flow can be integrated, and the projection position correction process can be speeded up.

  Further, according to the configuration of the present embodiment, the photographing unit 143 is accommodated in the main body 120 of the first projector 2A as described above. According to this configuration, since the first projector 2A and the photographing unit 143 are integrated, even if the adjustment guide 3 projected on the screen SC is photographed a plurality of times while changing the exposure, the photographing by the photographing unit 143 is performed. There is no misalignment between the images 50. Thereby, the correction amount of each part L1-L4 can be calculated using a separate image, and the adjustment guide 3 for the parts L1-L4 can be calculated from a plurality of photographed images 50 photographed a plurality of times with different exposures. Can be detected respectively.

  As described above, according to the control unit (correction control device) 131 according to the embodiment to which the present invention is applied, the photographing unit 143 photographs the adjustment guide 3 projected on the screen SC by the projectors 2A and 2B. A control unit 151, and an image analysis unit 152 that detects the adjustment guide 3 from the captured image 50 of the imaging unit 143, and the imaging control unit 151 detects the adjustment guide 3 from the captured image 50 by the image analysis unit 152. If it is not possible, the exposure setting is changed and the image capturing unit 143 performs image capturing again. That is, when the adjustment guide 3 cannot be detected from the captured image 50, the control unit 131 changes the exposure and captures images a plurality of times. As a result, it is possible to obtain a good photographic image by changing the photographic conditions in accordance with the installation environment such as ambient light and illumination with respect to the screen SC. Therefore, in the portion where the adjustment guide 3 of the photographic image 50 is detected. There is no possibility that the adjustment guide 3 cannot be detected due to whiteout or blackout. Therefore, the control unit 131 can reliably acquire information for aligning the projection positions of the projectors 2A and 2B with high accuracy from the captured image 50.

  Further, a correction control unit 153 that acquires information for correcting the projection positions of the projectors 2A and 2B based on the adjustment guide 3 detected by the image analysis unit 152 is provided. Thus, the adjustment guide 3 is detected by the image analysis unit 152 from the captured image 50 of the imaging unit 143, and information for aligning the projection positions of the projectors 2A and 2B based on the detected adjustment guide 3 is obtained. It can be acquired with certainty.

  Further, the position where the adjustment guide 3 is to be detected in the captured image 50 is designated in advance for the image analysis unit 152, and the image analysis unit 152 detects the adjustment guide 3 at the designated position. As a result, the image analysis unit 152 only needs to determine whether or not the adjustment guide 3 can be detected at the designated position, and promptly determines whether or not the adjustment guide 3 can be detected from the captured image 50 of the imaging unit 143. Can be determined. Accordingly, the analysis process of the image analysis unit 152 can be speeded up, and the image analysis process of the control unit 131 can be performed instantaneously. Therefore, information for aligning the projection positions of the projectors 2A and 2B can be quickly obtained. Can be acquired.

  Further, since the image analysis unit 152 detects the adjustment guide 3 at a plurality of positions of the captured image 50, even if the display result of the adjustment guide 3 is greatly influenced by the installation environment of the screen SC and the reflection amount. The adjustment guide 3 can be reliably detected from the captured image 50. Accordingly, the influence of the installation environment of the projection system 1 is not uniform on the projection surface of the screen SC on which the projectors 2A and 2B project images, and the photographing result by the photographing unit 143 of the adjustment guide 3 is not uniform. However, the adjustment guide 3 can be detected from the captured image 50. Therefore, information for aligning the projection positions of the projectors 2A and 2B can be reliably acquired from the captured image 50.

  In addition, after the adjustment guide 3 is detected at any position of the captured image 50 by the image analysis unit 152, the shooting control unit 151 sets the exposure setting when the adjustment guide 3 is not detected at another position. And the image capturing unit 143 performs image capturing again. Thus, since the exposure is changed for each position where the guide is detected, the influence of the installation environment such as ambient light and illumination on the screen SC, or the reflection amount of the screen SC due to the influence of the installation environment on the screen SC. Even when it is not uniform, each of the adjustment guides 3 at a plurality of positions can be reliably detected from a plurality of captured images 50 having different exposures. Therefore, the influence of the installation environment of the projection system 1 can be eliminated, and information for aligning the projection positions of the projectors 2A and 2B can be reliably acquired.

  Further, according to the correction method according to the embodiment to which the present invention is applied, the adjustment guide 3 projected on the screen SC by the projectors 2A and 2B is photographed by the photographing unit, and the adjustment guide 3 is detected from the photographed image 50. When the adjustment guide 3 cannot be detected from the photographed image 50, the exposure setting is changed and the photographing unit 143 performs photographing again. As a result, when the captured image 50 is overexposed or darkened due to the influence of the environment such as ambient light or illumination on the screen SC, the exposure guide is changed and the adjustment guide 3 is captured again. Thus, the adjustment guide 3 cannot be detected. Therefore, information for aligning the projection positions of the projectors 2A and 2B can be reliably acquired from the captured image 50.

  Further, according to the first projector 2A according to the embodiment to which the present invention is applied, the projection unit 110 that projects an image on the screen SC, the photographing unit 143 that photographs the screen SC, and the adjustment guide 3 on the screen SC. The image capturing control unit 151 that causes the image capturing unit 143 to perform image capturing in the projected state and the image analysis unit 152 that detects the adjustment guide 3 from the captured image 50 of the image capturing unit 143 include the image capturing control unit 151. When the adjustment guide 3 cannot be detected from the photographed image 50 by the analysis unit 152, the setting relating to exposure is changed and the photographing unit 143 executes the photographing again. As a result, when the captured image 50 is overexposed or darkened due to the influence of the environment such as ambient light or illumination on the screen SC, the exposure guide is changed and the adjustment guide 3 is captured again. Thus, the adjustment guide 3 cannot be detected. Therefore, information for aligning the projection positions of the projectors 2A and 2B can be reliably acquired from the captured image 50.

  In addition, the imaging control unit 151 is configured to capture the imaging unit in a state where the first guide 3A is projected on the screen SC by the projection unit 110 and another second guide 3B is projected by the other second projector 2B. The image analysis unit 152 detects the first guide 3A projected by the projection unit 110 and the second guide 3B projected by the other second projector 2B, and performs the imaging control. When the image analysis unit 152 cannot detect either the first guide 3A projected by the projection unit 110 or the second guide and 3B projected by the other second projector 2B from the captured image 50 by the image analysis unit 152. Then, the setting relating to exposure is changed, and the photographing unit 143 performs photographing again. Accordingly, the first guide 3A and the second guide 3B can be reliably detected from the captured image 50. Therefore, based on the first guide 3A and the second guide 3B detected from the captured image 50, information for aligning the projection positions of the projectors 2A and 2B can be reliably acquired.

The above embodiment is merely an example of a specific mode to which the present invention is applied, and does not limit the present invention. The present invention can also be applied as a mode different from the above embodiment. For example, in the above-described embodiment, the projectors 2A and 2B and the image output device 7 are described by way of example as being wiredly connected via the image transmission cable 41. The connection form with the image output device 7 is arbitrary, for example, wireless communication using a wireless LAN, Bluetooth (registered trademark), etc., or wired communication using a general-purpose data communication cable such as USB, a wired LAN, or the like. May be connected to each other to transmit and receive image data. In addition, the projectors 2A and 2B are connected to each other by wireless communication using a wireless LAN, Bluetooth (registered trademark) or the like, or by wired communication using a general-purpose data communication cable such as a USB or a wired LAN. A specific connection form is arbitrary as long as information can be transmitted and received.
Moreover, each functional unit of the projectors 2A and 2B shown in FIG. 2 includes a functional configuration realized by cooperation of hardware and software, and the specific mounting form is not particularly limited. In addition, the specific detailed configuration of each part of the projection system 1 including the projectors 2A and 2B and the image output device 7 can be arbitrarily changed without departing from the gist of the present invention.

In the above embodiment, the control unit 131 of the first projector 2A functions as a correction control device. However, the present invention is not limited to this, and the correction control device is provided separately from the projectors 2A and 2B. It may be a configuration.
Moreover, in said embodiment, it was set as the structure which obtains the favorable picked-up image 50 corresponding to the influence of an installation environment by changing exposure in the imaging | photography conditions of the imaging | photography part 143, and image | photographing several times with different exposure. However, the present invention is not limited to this, and a configuration in which shooting conditions such as white balance and focus of the shooting unit 143 are changed may be used. Then, when the adjustment guide 3 cannot be detected due to the influence of the reflection amount of the screen SC, the exposure is changed. When the adjustment guide 3 cannot be detected due to the influence of ambient light or illumination, the white balance is changed, and the captured image is changed. When the adjustment guide 3 cannot be detected because the 50 is out of focus, the photographing condition is changed according to the reason that the adjustment guide 3 is not detected, such as changing the focus. Also good.
Further, in the above-described embodiment, when the projected images 101 and 102 by the two projectors 2A and 2B are displayed on the screen SC so as to be superimposed, information for accurately aligning the projected positions of the images is acquired. Was described as an example. However, according to the present invention, when a plurality of projectors are arranged side by side and projected images from the plurality of projectors are combined to project one large screen image by tiling display, exposure is performed for each of the overlapping portions of the images. It is also possible to employ a configuration in which information for aligning the tiling boundary with high accuracy is reliably acquired from the captured image by changing the image.

DESCRIPTION OF SYMBOLS 1 ... Projection system, 2A ... 1st projector, 2B ... 2nd projector, 3 ... Adjustment guide (guide), 3A ... 1st guide, 3B ... 2nd guide, 50 ...
Captured images 122, 222 ... light source 124, 224 ... light modulator 131 ... control unit (correction control device) 142 ... storage unit 143 ... shooting unit (shooting unit) 151 ... shooting control unit (shooting control unit) , 152 ... Image analysis unit (image analysis unit), 153 ... Correction control unit (correction control unit), 154 ... Projection position correction unit (projection position correction unit), SC ... Screen (projection surface).

Claims (7)

Photographing control means for photographing the guide projected on the projection surface by the projector by the photographing means;
Image analysis means for detecting the guide from a photographed image of the photographing means,
The image analysis means detects the guide at a plurality of positions of the captured image;
The photographing control unit changes the exposure of the photographing unit and causes the photographing unit to photograph the guide again when the image analyzing unit determines that the guide cannot be detected from the photographed image. Until the number of times of detection detection of the guide is exceeded, or until it is determined that the guide has been detected, the exposure of the imaging unit is changed to a plurality of stages, and the guide is imaged multiple times by the imaging unit ,
After the guide is detected at any position of the photographed image by the image analysis means, when the guide is not detected at another position, the exposure of the photographing means is changed and photographing is performed again by the photographing means. A correction control apparatus characterized by being executed . The correction control device according to claim 1,
A correction control apparatus comprising correction control means for acquiring information for correcting the projection position of the projector based on the guide detected by the image analysis means. The correction control device according to claim 1, wherein:
A correction control apparatus, wherein a position where the guide is to be detected in the captured image is designated in advance for the image analysis means, and the image analysis means detects the guide at the designated position. First guide and projected on the projection surface by a first projector, a photographing control unit that a plurality of guides, is photographed by the photographing means including a second guide projected on the projection surface by a second projector,
Image analysis means for detecting a plurality of the guides from a photographed image of the photographing means,
The photographing control unit changes the exposure of the photographing unit and causes the photographing unit to photograph the guide again when the image analyzing unit determines that the guide cannot be detected from the photographed image. Until the number of times of detection detection of the guide is exceeded, or until it is determined that the guide has been detected, the exposure of the imaging unit is changed to a plurality of stages, and the guide is imaged multiple times by the imaging unit ,
The imaging control unit causes the imaging unit to perform imaging again when the image analysis unit cannot detect either the first guide or the second guide from the captured image;
A correction control device characterized by the above. The guide projected on the projection surface by the projector is photographed by the photographing means,
Detecting the guide at a plurality of positions in the captured image,
When it is determined that the guide cannot be detected from the photographed image, the exposure of the photographing unit is changed, the guide is photographed again by the photographing unit, and a predetermined number of times of detection detection of the guide is exceeded. Or, until it is determined that the guide can be detected, the exposure of the photographing unit is changed to a plurality of stages and the guide is photographed a plurality of times by the photographing unit ,
After the guide is detected at any position of the captured image, when the guide is not detected at another position, the exposure of the imaging unit is changed and the imaging unit executes imaging again.
The correction method characterized by this. Projection means for projecting an image on the projection surface;
Photographing means for photographing the projection surface;
Photographing control means for performing photographing by the photographing means in a state where a guide is projected on the projection surface;
Image analysis means for detecting the guide from a photographed image of the photographing means,
The image analysis means detects the guide at a plurality of positions of the captured image;
The photographing control unit changes the exposure of the photographing unit and causes the photographing unit to photograph the guide again when the image analyzing unit determines that the guide cannot be detected from the photographed image. Until the number of times of detection detection of the guide is exceeded, or until it is determined that the guide has been detected, the exposure of the imaging unit is changed to a plurality of stages, and the guide is imaged multiple times by the imaging unit ,
After the guide is detected at any position of the photographed image by the image analysis means, when the guide is not detected at another position, the exposure of the photographing means is changed and photographing is performed again by the photographing means. A projector characterized by being executed . Projection means for projecting an image on the projection surface;
Photographing means for photographing the projection surface;
Photographing control means for performing photographing by the photographing means in a state where a guide is projected on the projection surface;
Image analysis means for detecting the guide from a photographed image of the photographing means,
The photographing control unit changes the exposure of the photographing unit and causes the photographing unit to photograph the guide again when the image analyzing unit determines that the guide cannot be detected from the photographed image. Until the number of times of detection detection of the guide is exceeded, or until it is determined that the guide has been detected, the exposure of the imaging unit is changed to a plurality of stages, and the guide is imaged multiple times by the imaging unit,
The imaging control unit causes the imaging unit to perform imaging in a state where the guide is projected by the projection unit and another guide is projected by another projector on the projection surface,
The image analysis means detects the guide projected by the projection means and the guide projected by the other projector,
When the image analysis unit cannot detect either the guide projected by the projection unit or the guide projected by the other projector from the captured image, the imaging control unit again performs the imaging control unit. To execute the shooting,
Projector.

Images