JP6354567B2 - Control device, program, and projection system - Google Patents

Description

  The present invention relates to a technical field of a projection system that projects an image on projection surfaces in a plurality of directions.

  2. Description of the Related Art Conventionally, as disclosed in, for example, Patent Document 1, a system is known in which one camera is arranged to face a projector between one projector and a screen. In such a system, when the projection light of the projector is reflected on the camera, the reflected light is generated in the video image taken by the camera, so that the video image is difficult to see. In order to improve this phenomenon, in the technique disclosed in Patent Document 1, a dark region is set on an image projected by a projector, and a luminance histogram in a captured image of one camera is automatically used by using this setting. It is configured to optimize.

JP 2010-114769 A

  By the way, not only for one screen but also for projecting an image on projection surfaces in a plurality of directions in a room, a plurality of projectors are necessary. When determining the reflection of light from a plurality of projectors in one camera, it is complicated and not easy to specify the projector that is the light source of the reflected light, even when using a luminance histogram. .

  The present invention has been made in view of the above points, and in the case of projecting an image on a projection surface using a plurality of projectors, a projection device such as a projector serving as a light emission source of light reflected on the camera is simply processed. A control device, a program, and a projection system that can be specified and dimmed are provided.

  In order to solve the above-described problem, the invention described in claim 1 includes a plurality of projection devices that project images onto projection surfaces in a plurality of directions, and at least one imaging device, and the imaging device includes: A control device used in a projection system arranged between at least one of the projection devices and at least one of the projection planes to project, wherein the first control emits light from at least one of the plurality of projection devices. And an acquisition means for acquiring an imaging result captured by at least one imaging device arranged between at least one of the plurality of projection devices and at least one projection plane. And whether or not the light of the projection device emitted by the first control unit is included in a field of view of the imaging device from the imaging result acquired by the acquisition unit, or more than a predetermined reference. Determining means for determining, and second control means for performing dimming processing of the projection apparatus determined by the determination means that the light is included in a predetermined reference or more among the plurality of projection apparatuses. Features.

  According to a second aspect of the present invention, in the control device according to the first aspect, the first control unit sequentially selects and emits light for each of the projection devices, and the acquisition unit performs the first control. The imaging result is acquired for each of the projection devices selected by the means, and the determination unit includes whether the light of each projection device includes a predetermined reference or more in each of the imaging results acquired by the acquisition unit. The second control means determines that the light is included in a plurality of projection devices sequentially selected by the first control means and that the light is included in a predetermined reference or more by the determination means. Further, the light reduction processing of the projection device is performed.

  According to a third aspect of the present invention, in the control device according to the first or second aspect of the present invention, the control device further includes a setting unit that sets a moving image mode in which an imaging result captured by the imaging device is recorded as a moving image. And means for performing recording processing of the moving image when the moving image mode is set by the setting device, and dimming processing of the projection device determined by the determining device to include the light above a predetermined reference. It is characterized by performing.

  According to a fourth aspect of the present invention, in the control device according to the third aspect, the setting means is either the moving image mode or a determination mode for determining whether or not the light is included in a predetermined reference or more. Can be set, and further includes second acquisition means for acquiring information indicating the start of music playback by the music playback device, and when the information indicating the start of music playback is acquired by the second acquisition means, the setting means Is switched from the determination mode to the moving image mode, and when the setting unit is switched from the determination mode to the moving image mode, the second control unit is configured to record the moving image and the light is output from the determination unit. A dimming process of the projection apparatus determined to be included within a predetermined standard is performed.

  According to a fifth aspect of the present invention, in the control device according to the third aspect, when the determination unit determines that the light includes a predetermined reference or more, the imaging result acquired by the acquisition unit is captured. A storage unit that associates and stores the imaging device that has been determined that the light is included in a predetermined reference or more, and detects a user's singing state from an imaging result captured by the imaging device Detecting means, and when the moving picture mode is set by the setting means and a user's singing state is detected by the detecting means, The light reduction process of the said projection apparatus matched with the said imaging device which imaged the said imaging result in which the user's singing state was detected by the detection means is performed, It is characterized by the above-mentioned.

  The invention described in claim 6 includes a plurality of projection devices that project images onto projection planes in a plurality of directions, and at least one imaging device, and the imaging device is at least one of the projection devices. A first control step for causing a computer used in a projection system arranged between at least one projection plane to project to emit light, and causing at least one of the plurality of projection apparatuses to emit light; An acquisition step of acquiring an imaging result imaged by at least one of the imaging devices arranged between at least one of the projection devices and at least one of the projection planes; and the acquisition step From the imaging result obtained by the above, the projection device light emitted by the first control step is included within the angle of view of the imaging device above a predetermined reference And a second control step of performing a dimming process for the projection apparatus that has been determined by the determination step to include the light above a predetermined reference among the plurality of projection apparatuses. Are executed by a computer.

  The invention according to claim 7 includes a plurality of projection devices that project images onto projection planes in a plurality of directions, and at least one imaging device, and the imaging device is at least one of the projection devices. Is a projection system disposed between at least one projection plane on which the projection is performed, and a control device used in the projection system is a first control unit that sequentially selects and emits light for each of the projection devices. And, in the first control, an imaging result captured by at least one imaging device arranged between at least one projection device and at least one projection plane among the plurality of projection devices. The first control unit emits light within an angle of view of the imaging device from the acquisition unit acquired for each of the projection devices selected by the unit and each imaging result acquired by the acquisition unit. Determining means for determining whether or not the light of each projection apparatus is greater than or equal to a predetermined reference; and among the plurality of projection apparatuses, the projection apparatus determined by the determination means to include the light greater than or equal to a predetermined reference And a second control means for performing the dimming process.

  According to the first, sixth, and seventh aspects of the invention, when an image is projected onto the projection plane using a plurality of projection devices, the projection device that is a light emission source of light reflected on the imaging device is specified by simple processing. And can be fading.

  According to the second aspect of the present invention, it is possible to accurately specify the projection device to be dimmed.

  According to the third aspect of the present invention, when the imaging result is recorded as a moving image, the system load can be reduced by dimming the projection device to be dimmed.

  According to the fourth aspect of the present invention, since the moving image recording process and the dimming process of the projection device can be automatically performed when the reproduction of the music is started, it is possible to save the operation by the user. Can be reduced.

  According to invention of Claim 5, the quality and value of a moving image recorded when a user is in a singing state can be improved.

It is a figure which shows the example of a schematic structure of the projection system S of this embodiment. It is a figure which shows the positional relationship of the apparatus arrange | positioned in the room where the projection system S is utilized. It is a figure which shows an example of a mode that the light reduction process of projector 5a, 5b is performed based on the imaging result imaged with the camera 3a. 7 is a flowchart illustrating an example of a dimming target specifying process executed by a control unit 63. It is a flowchart which shows an example of a projector light determination process. 5 is a flowchart illustrating an example of service processing executed by a control unit 63. It is a flowchart which shows an example of the light reduction process of a projector. It is a figure which shows a mode that the direction where the user U in a room turns is changing. It is a flowchart which shows an example of the dimming process comprised so that the projector to be dimmed may change dynamically.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[1. Outline of Projection System Configuration and Operation]
First, with reference to FIG.1 and FIG.2, the structure and operation | movement outline | summary of the projection system S of embodiment of this invention are demonstrated. FIG. 1 is a diagram showing a schematic configuration example of the projection system S of the present embodiment. FIG. 2 is a diagram showing the positional relationship of devices arranged in a room where the projection system S is used. As shown in FIG. 1, the projection system S includes a display / operation device 1, a music playback device 2, cameras 3a to 3c, video playback devices 4a to 4d, projectors 5a to 5d, a playback control device 6, and the like. Is done. The projection system S is used in a room in an amusement facility such as a karaoke store. The reproduction control device 6 is an example of a control device of the present invention. The reproduction control device 6 can be connected to the Internet via a LAN (wired LAN (Local Area Network) or wireless LAN), a hub (HUB), and a router (Router). Thereby, the reproduction | regeneration control apparatus 6 can access the moving image delivery site comprised by a web server etc., and can upload a moving image file. The moving image file is, for example, a file that stores moving image data recorded (recorded) by the reproduction control device 6. The moving image data stored in the uploaded moving image file is distributed by streaming to a terminal that has accessed the moving image distribution site, for example. Thereby, the user of a terminal can see the moving image imaged, for example in the room of a karaoke store.

  The display / operation device 1, the music playback device 2, and the cameras 3a to 3c are connected to the playback control device 6 via wired or wireless communication, respectively. The display / operation device 1 is a device that receives a predetermined operation from a user (user). The music playback device 2 is a device for playing back music. As an example of the music reproducing device 2, for example, a karaoke commander installed in a room of a karaoke store can be cited. The cameras 3a to 3c are an example of an imaging device that images, for example, one room in a karaoke store. The video reproduction devices 4a to 4d and the projectors 5a to 5d are connected to the reproduction control device 6 via a LAN and a hub, respectively. Furthermore, the projectors 5a to 5d are respectively connected to the video reproduction devices 4a to 4d via a wired or wireless connection. The video reproduction devices 4a to 4d are devices that reproduce video. The projectors 5a to 5d are an example of a plurality of projection devices that project the images reproduced by the image reproduction devices 4a to 4d onto projection surfaces in a plurality of directions in one room of a karaoke store, for example. In the example of FIG. 2A, the front, back, left and right wall surfaces a to d of the user U are projection surfaces. The ceiling surface and floor surface of the room may be projection surfaces. For example, as shown in FIG. 2A, the projectors 5a to 5d are arranged so as to project images on at least one wall surface a to d. Each of the cameras 3a to 3c is disposed between at least one projector 5a to 5d and at least one wall surface a to d. For example, in FIG. 2A, the camera 3a is disposed between the projectors 5a and 5b and the wall surface a. As a result, the camera 3a captures a range that falls within the angle of view of the camera 3a in the space between the projectors 5a and 5b and the wall surface a. In the room as shown in FIG. 2A, the user U sings with the microphone M while watching the display D, for example. The microphone M and the display D are connected to the music reproducing device 2 via a wired or wireless connection. The display D may be connected to the reproduction control device 6 via wired or wireless.

  In addition, although the three cameras 3a-3c are shown in the example of FIG. 1, any number may be sufficient as a camera, and 1 or more and 2 or less, or 4 or more may be sufficient as it. In the example of FIG. 1, four video playback devices 4 a to 4 d and four projectors 5 a to 5 d are shown, but the video playback devices and the projectors are one or more, three or less, or five or more, respectively. It may be. In the example of FIG. 1, the video playback device and the projector correspond one-to-one, but may correspond to one-to-N (N is a natural number of 2 or more). For example, a plurality of projectors may be connected to one video reproduction device. When there is one video playback device, the video playback device may be incorporated in the playback control device 6 as video playback means (configured by hardware or software).

  As the display / operation device 1, for example, a touch panel display including a display screen is used. The display / operation device 1 may be, for example, a remote controller of the music playback device 2. The display / operation device 1 may be incorporated in the music playback device 2 or the playback control device 6. In this case, for example, the display / operation device 1 is a display unit formed integrally with the music playback device 2 or the playback control device 6. The display / operation device 1 displays, on the display screen, video information indicating videos that are candidates for selection of videos projected by the projectors 5a to 5d and music information indicating songs that are candidates for selection of music to be played back by the music playback device 2. To do. Video information displayed as a selection candidate includes, for example, a video ID, a video name, and one image frame in the video. The music information displayed as the selection candidate includes, for example, a music ID, a music title, an artist name, and a performance time. The music ID is composed of a music number, for example. The performance time is the playback time from the start of music playback to the end of playback. Note that on the display screen of the display / operation device 1, a plurality of pieces of video information or a plurality of pieces of music information may be simultaneously displayed on one screen.

  The video information indicating the video as the selection candidate and the music information indicating the music as the selection candidate are transmitted from the playback control device 6 and stored in the storage unit of the display / operation device 1, for example. The display / operation device 1 selects a video or a song according to a selection operation by the user. The display / operation device 1 transmits video information indicating the selected video to the playback control device 6. The video information transmitted to the reproduction control device 6 is transmitted from the reproduction control device 6 to the video reproduction devices 4a to 4d, for example. In addition, the display / operation device 1 transmits music information indicating the selected music to the reproduction control device 6. The music information transmitted to the reproduction control device 6 is transmitted from the reproduction control device 6 to the music reproduction device 2. The playback control device 6 may transmit the music information transmitted from the display / operation device 1 to the music playback device 2 in response to the music information acquisition request from the music playback device 2. Alternatively, the display / operation device 1 transmits the music information indicating the selected music to the music playback device 2, and the music playback device 2 receives the music information received from the display / operation device 1 to the playback control device 6. You may send it. In this case, the music playback device 2 may transmit the music information to the playback control device 6 in response to the music information acquisition request from the playback control device 6.

  Further, the display / operation device 1 transmits mode setting information for causing the reproduction control device 6 to set various modes to the reproduction control device 6 in accordance with a setting operation by the user. Modes that can be set by the playback control device 6 include a moving image mode and a determination mode. The moving image mode is a recording mode in which the imaging result captured by the camera is recorded as a moving image. The determination mode is a determination mode for determining whether or not the light (projector light) emitted by the projector is included in the angle of view of the camera or more from a captured image captured by the camera.

  The music reproducing device 2 stores a plurality of music files in the storage unit. The music file stores music data constituting music such as karaoke music. Each music file is associated with a music ID, for example. The music ID may be included in the music file name of each music file. The music playback device 2 receives the music information transmitted from the display / operation device 1 or the playback control device 6. For example, the music reproducing device 2 reproduces music data indicated by the music ID included in the music information in the order in which the music information is received, and outputs the music signal to a speaker (not shown). Also, the music playback device 2 transmits information indicating the playback start of the music to the playback control device 6 when the playback of the music is started. Furthermore, the music playback device 2 transmits information indicating the end of music playback to the playback control device 6 when playback of the music is finished. When the music playback device 2 is a karaoke commander, the music playback device 2 has a mixing amplifier that mixes the music signal and the singing voice signal of the user U collected by the microphone M and outputs it to the speaker. Provided. In addition, the music reproducing device 2 displays on the display D, for example, lyrics telop of the music being reproduced, imaging results captured by the cameras 3a to 3c, and the like.

  For the cameras 3a to 3c, for example, RGB cameras are used. For example, in the space in one room of a karaoke store, the cameras 3a to 3c store, for example, an imaging result obtained by continuously capturing an imaging range within the angle of view of the cameras 3a to 3c in a buffer, and the imaging result stored in the buffer. Is transmitted to the reproduction control device 6. As shown in FIG. 2B, the imaging results include RGB images in the imaging range determined by the angles of view a to c of the cameras 3a to 3c. For example, RGB cameras and infrared cameras may be used as the cameras 3a to 3c. For example, RGB cameras and depth cameras may be used as the cameras 3a to 3c. The depth camera is a depth sensor such as an infrared laser. A depth image indicating the depth to each point of the imaging range in the room is acquired by the depth camera. In this case, the imaging result transmitted to the reproduction control device 6 includes an RGB image and a depth image.

  Each of the video reproduction devices 4a to 4d stores the video file in the storage unit. The video file stores, for example, video data constituting a video to be projected onto projection planes in a plurality of directions in the room. Examples of this video include a video showing outer space, a video showing a room where shelves and the like are installed, or a video showing a stage where a person sings. For example, a lyrics telop of the music being played may be displayed superimposed on these videos. These videos are, for example, still images and moving images. Note that the reproduced video may be the same or different between the video reproducing devices 4a to 4d. When the video is different between the video playback devices 4a to 4d, for example, the entire projection plane in the room where the video is projected is used as the projection range, and the projection range is played back from the video data constituting the video to be projected onto the projection range. Divided video data divided into the number of devices 4a to 4d is created. Then, the divided video data is stored in a video file and stored in each storage unit of each video playback device 4a to 4d. For example, a video ID is associated with each video file. The video ID may be included in the video file name of each video file. Each video file that stores a plurality of divided video data divided from one video data is associated with the same video ID. The video playback devices 4 a to 4 d receive the video playback command transmitted from the playback control device 6. The video playback command includes a video ID indicating the video to be played back. Each of the video reproduction devices 4a to 4d reproduces the video data (or divided video data) indicated by the video ID included in the received video reproduction command, and outputs the video signal to the projectors 5a to 5d. When the video playback devices 4a to 4d are one video playback device or playback control means incorporated in the playback control device 6, the video playback device or video playback means sends the video signal to the projectors 5a to 5d. Output to.

  Each of the projectors 5a to 5d includes a light emitting unit that emits light based on the three primary colors of red, green, and blue. Each of the projectors 5a to 5d turns on (turns on) the power when receiving the power ON command (lamp on command) transmitted from the reproduction control device 6. Thereby, projector 5a-5d each emits light from a light emission part. Each of the projectors 5a to 5d turns off the power when the power-off command (lamp-off command) transmitted from the reproduction control device 6 is received. The projectors 5a to 5d output images by emitting light corresponding to the image signals received from the image reproducing devices 4a to 4d from the light emitting units, respectively. As a result, the projectors 5a to 5d project images on the projection planes in the projection ranges determined by the projection angles a to d of the projectors 5a to 5d, as shown in FIG. For example, the projectors 5a to 5d project images on different wall surfaces (for example, front, back, left, and right wall surfaces of the user). The projectors 5a to 5d may project images on different areas of the same wall surface.

  The playback control device 6 controls playback of music by the music playback device 2, playback of video by the video playback devices 4a to 4d, and power ON / OFF of the projectors 5a to 5d. The reproduction control device 6 includes IFs 61a to 61f, a storage unit 62, and a control unit 63, as shown in FIG. The IFs 61a to 61f, the storage unit 62, and the control unit 63 are connected to the bus 64. The IF 61 a is an interface between the music playback device 2 and the playback control device 6. The IF 61 b is an interface between the display / operation device 1 and the reproduction control device 6. The IF 61c is an interface between the camera 3a and the playback control device 6. The IF 61d is an interface between the camera 3b and the playback control device 6. The IF 61e is an interface between the camera 3c and the playback control device 6. The IF 61f is an interface with the LAN.

  The storage unit 62 is configured by, for example, a hard disk drive. The storage unit 62 stores an OS (Operating System), the program of the present invention, and the like. The program of the present invention is a program for causing a CPU to execute a control process described later. In addition, the storage unit 62 stores video information indicating videos that are candidates for selection of videos projected by the projectors 5 a to 5 d and music information indicating songs that are selection candidates to be played back by the music playback device 2.

  The control unit 63 includes a CPU (Center Processing Unit) as a computer, a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The control unit 63 is an example of a first control unit, a second control unit, an acquisition unit, a second acquisition unit, a determination unit, and a setting unit of the present invention. The RAM or the storage unit 62 is an example of the storage unit of the present invention. The control unit 63 executes processing according to the program of the present invention. In this process, the control unit 63 causes at least one of the plurality of projectors 5a to 5d to emit light. For example, the control unit 63 emits light by turning on the power of the projectors 5a to 5d. Thereby, light is emitted from at least one light emitting unit of the plurality of projectors 5a to 5d. The control unit 63 acquires an imaging result in which a range that falls within the angle of view is captured by at least one of the cameras 3a to 3c in the space between the emitted projectors 5a to 5d and the projection plane. That is, the space between the emitted projectors 5a to 5d and the projection surface is, in other words, a range that can be accommodated in at least one of the angles of view of the cameras 3a to 3c. The control unit 63 determines whether or not the light emitted by the projectors 5a to 5d is included in the angle of view of the camera from the acquired imaging result above a predetermined reference. The control unit 63 performs dimming processing for a projector that is determined to include the light above a predetermined reference among the plurality of projectors 5a to 5d. The dimming process is a process for dimming light emitted from the projector. For example, in the dimming process, the control unit 63 stops the light emission by turning off the power of the projector. Alternatively, in the dimming process, the control unit 63 may reduce the illuminance (light brightness) of light emitted from the projector, or cause the projector to output a black image.

  FIG. 3 is a diagram illustrating an example of a state in which the light reduction processing of the projectors 5a and 5b is performed based on the imaging result captured by the camera 3a. In the example of FIG. 3A, all of the projectors 5a to 5d are in a light-emitting state. In this state, the light emitted from the projectors 5c and 5d does not appear in the imaging result obtained by the camera 3a, but the light emitted from the projectors 5a and 5b appears in the imaging result. That is, the projectors 5a and 5b are light emission sources for light reflected on the camera 3a. Therefore, the control unit 63 determines that the light emitted from the projectors 5a and 5b is included in the imaging result captured by the camera 3a above a predetermined reference, and performs the dimming processing of the determined projectors 5a and 5b. Do. In the example of FIG. 3B, the light emission of the projectors 5a and 5b is stopped by the dimming process.

  Further, the control unit 63 sets the determination mode or the moving image mode according to the mode setting information received from the display / operation device 1, for example. For example, when the determination mode is set, as described above, the control unit 63 determines whether or not the light emitted by the projector is included in the imaging result above a predetermined reference. Further, for example, when the moving image mode is set, the control unit 63 performs recording processing for recording the imaging result captured by the camera as a moving image, and dimming of the projector that determines that the light is included above a predetermined reference Process.

[2. Operation of Projection System S]
Next, the operation content performed by the projection system S of the present embodiment will be described.

(Light reduction target specific processing)
First, the dimming target specifying process will be described with reference to FIG. The dimming target specifying process is a process of specifying a projector to be dimmed for each camera. FIG. 4 is a flowchart illustrating an example of the dimming target specifying process executed by the control unit 63. Identification numbers “11” to “13” are assigned to the cameras 3 a to 3 c connected to the playback control device 6 via the interface IFs 61 c to 61 e, respectively. Identification numbers “01” to “04” are assigned to the projectors 5a to 5d connected to the reproduction control device 6 via the interface IF 61f, respectively. The control unit 63 can distinguish the cameras 3a to 3c and the projectors 5a to 5d based on the identification numbers. Further, it is assumed that the power sources of the projectors 5a to 5d are turned on at the start of the dimming target specifying process.

  The dimming target specifying process shown in FIG. 4 is started, for example, when the control unit 63 sets the determination mode according to the mode setting information received from the display / operation device 1 as a trigger. When the dimming target specifying process shown in FIG. 4 is started, the control unit 63 initializes all the cameras 3a to 3c (step S1). For example, the control unit 63 outputs an initialization command (start command) to each of the cameras 3a to 3c via the IF 61c to IF 61e. Thereby, each of the cameras 3a to 3c is activated according to the initialization command, and starts imaging after initializing the buffer, for example. When the imaging is started, the cameras 3a to 3c each store the imaging result in the buffer, and transmit the imaging result stored in the buffer to the reproduction control device 6 at predetermined intervals. Thereby, the control part 63 memorize | stores the imaging result received from each camera 3a-3c via IF61c-IF61e in the buffer distinguished for every camera 3a-3c. For example, in the buffer a, an image that is an imaging result received from the camera 3a is stored in time series. For example, the buffer b stores an image that is an imaging result received from the camera 3b in time series. For example, in the buffer c, an image that is an imaging result received from the camera 3c is stored in time series.

  Next, the control unit 63 initializes the dimming target lists for the number of initialized cameras 3a to 3c to be empty (step S2). Thereby, for example, a dimming target list corresponding to each of the cameras 3a to 3c is created in the RAM. The dimming target list is a list for storing a camera and a projector to be dimmed with respect to the camera in association with each other. Next, the control unit 63 turns off the power of all the projectors 5a to 5d (step S3). For example, the control unit 63 outputs a power OFF command to each of the projectors 5a to 5d via the IF 61f to turn off the power of the projectors 5a to 5d. For example, a command conforming to a protocol such as PJLink can be applied to the power OFF command and the power ON command.

  Next, the control unit 63 substitutes “01” for a variable N indicating the projector identification number (step S4). Accordingly, the projector 5a having the identification number “01” is selected from the projectors 5a to 5d. Note that the projector selected in this process is referred to as a projector N. Next, the projector N selected in step S4 is turned on (step S5). For example, the control unit 63 outputs a power ON command to the selected projector N to turn on the power of the projector N. Accordingly, the projector N emits, for example, white light set in advance from the light emitting unit. When the lens surface of the light emitting unit of the projector N is circular, for example, circular white light is projected. Note that the control unit 63 may transmit a video playback command for outputting a white image to the video playback device to which the projector N is connected. In this case, the video playback device outputs a white image signal to the projector N in response to the video playback command. Accordingly, the projector N emits white light corresponding to the white image signal from the light emitting unit.

  Next, the control unit 63 assigns “11” to the variable M indicating the camera identification number (step S6). As a result, the camera 3a with the identification number “11” is selected from the cameras 3a to 3c. The camera selected in this process is referred to as camera M. Next, the imaging result captured by the camera M selected in step S6 is acquired from the camera M (step S7). Next, the control unit 63 performs projector light determination processing based on the imaging result acquired in step S7 (step S8). The projector light determination process is a process of determining whether or not the light emitted by the projector N is included within the angle of view of the camera M from the imaging result acquired in step S7.

  FIG. 5 is a flowchart illustrating an example of the projector light determination process. In the projector light determination process shown in FIG. 5, the control unit 63 detects an edge in the image frame by applying an edge detection filter to the image frame included in the imaging result acquired in step S <b> 7 (step S <b> 81). As the edge detection filter, for example, a known edge detection filter such as Canny's edge detection filter can be used. Next, the control unit 63 performs binarization processing on the image frame in which the edge is detected in step S81 (step S82). For the binarization process, a known binarization process such as Otsu's method can be used. For example, in the binarization process, the control unit 63 compares the pixel value with the threshold value for each pixel constituting the image frame, sets the pixel value that is smaller than the threshold value to 0, and the pixel value is equal to or greater than the threshold value. A pixel is determined to be 1.

  Next, the control unit 63 performs circle detection processing on the image frame binarized in step S82 (step S83). For the circle detection process, a known circle detection process such as a Hough transform can be used. In this example, it is assumed that the lens surface of the light emitting unit of the projector N is circular. For this reason, when the light emitted from the projector N is reflected in the imaging result, the shape of the light is circular or elliptical. For example, in the circle detection process, an area having a circular shape or an elliptical shape is searched from the pixel area determined to be 1, for example, in the binarization process.

  Next, the control unit 63 determines whether or not a circle is detected from the image frame binarized in step S82 (step S84). For example, when an area having a circular shape or an elliptical shape is found, it is determined that a circle is detected from the image frame. It should be noted that the object to be detected here may include a partial omission such as a semicircle. When it is determined that a circle has been detected from the image frame (step S84: YES), the control unit 63 sets the return value to TRUE (step S85), and returns to the process illustrated in FIG. TRUE indicates that the light emitted by the projector N is included above a predetermined reference. That is, the projector N is specified as a dimming target. On the other hand, when it is determined that the circle is not detected from the image frame (step S84: NO), the control unit 63 sets the return value to FALSE (step S86) and returns to the process shown in FIG. FALSE indicates that the light emitted by the projector N is not included above a predetermined reference.

  Returning to the processing illustrated in FIG. 4, in step S <b> 9, the control unit 63 determines whether or not the return value of the projector light determination processing is TRUE. When it is determined that the return value is TRUE (step S9: YES), the control unit 63 registers the identification number N of the projector N specified as the dimming target in the dimming target list corresponding to the camera M ( The process proceeds to step S10) and step S11. The dimming target list corresponding to the camera M is referred to as a dimming target list M. For example, the dimming target list 11 corresponds to the camera 11 (camera 3a). As a result of the processing in step S10, the camera M that has captured the imaging result and the projector N that has been determined that the imaging result includes light above a predetermined reference are associated and stored. On the other hand, when it determines with the return value not being TRUE (it is FALSE) (step S9: NO), the control part 63 progresses to step S11.

  In step S11, the control unit 63 determines whether there is an unselected camera among the cameras 3a to 3c. When it is determined that there is an unselected camera (step S11: YES), the control unit 63 proceeds to step S12. On the other hand, when it is determined that there is no unselected camera (step S11: NO), the control unit 63 proceeds to step S13. In step S12, the control unit 63 adds “1” to the variable M indicating the camera identification number, and returns to step S7. For example, “1” is added to the identification number “11” of the camera 3a, and M = 12. As a result, the camera 3b with the identification number “12” is selected, and the processing after step S7 is performed in the same manner as described above. Similarly, for the camera 3c, the process after step S7 is performed with M = 13 indicating the identification number.

  In step S <b> 13, the control unit 63 turns off the power of the projector N. Next, the control unit 63 determines whether or not there is an unselected projector among the projectors 5a to 5d (step S14). When it is determined that there is an unselected projector (step S14: YES), the control unit 63 proceeds to step S15. On the other hand, when it is determined that there is no unselected projector (step S14: NO), the control unit 63 ends the dimming target specifying process illustrated in FIG. In step S15, the control unit 63 adds “1” to the variable N indicating the projector identification number, and returns to step S5. For example, “1 (= 01)” is added to the identification number “01” of the projector 5a, and N = 02. As a result, the projector 5b with the identification number “02” is selected, and the processing after step S5 is performed in the same manner as described above. Similarly, the processes in and after step S5 are repeatedly performed on the projectors 5c and 5d with N = 03 and N = 04 indicating the identification numbers, respectively. That is, in the example of FIG. 4, the control unit 63 sequentially selects and emits light for each projector in a time difference, acquires the imaging result for each selected projector, and within the angle of view of the camera from each acquired imaging result. It is determined whether or not the light emitted by each projector is included above a predetermined reference. Thereby, it is possible to accurately specify the projector to be dimmed among the plurality of projectors 5a to 5d.

(Service processing)
First, service processing will be described with reference to FIG. A service process is a process performed when a user uses the room of a karaoke store, for example, after a process for specifying a dimming target. FIG. 6 is a flowchart illustrating an example of service processing executed by the control unit 63.

  The service process illustrated in FIG. 6 is started after the end of the dimming target specifying process illustrated in FIG. 4, for example, when a user who enters the room operates the display / operation device 1. Note that at the start of the service process, as described above, it is assumed that the determination mode that is a trigger for starting the dimming target specifying process is continuously set. When the dimming target specifying process shown in FIG. 4 is started, the control unit 63 turns on all the projectors 5a to 5d (step S21). Next, the control unit 63 transmits a video playback command to the video playback devices 4a to 4d via the IF 61f (step S22). Each of the video playback devices 4a to 4d plays back video according to the received video playback command, and outputs the video signal to the projectors 5a to 5d. The projectors 5a to 5d output images by emitting light corresponding to the image signals received from the image reproducing devices 4a to 4d from the light emitting units, respectively.

  Next, the control unit 63 determines whether information is received from the display / operation device 1 (step S23). When it is determined that information has been received from the display / operation device 1 (step S23: YES), the control unit 63 executes processing according to the received information (step S24). For example, the control unit 63 sets the moving image mode when receiving mode setting information for setting the moving image mode from the display / operation device 1 according to the setting operation by the user. That is, the determination mode is switched to the moving image mode. Further, for example, when the music information is received from the display / operation device 1 in response to the selection operation by the user, the control unit 63 transmits the received music information to the music playback device 2. On the other hand, when it is determined that the information is not received from the display / operation device 1 (step S23: NO), the control unit 63 proceeds to step S25. In step S25, the control unit 63 determines whether or not the reproduction of the music has started. For example, when receiving information indicating the start of music playback from the playback control device 6, the control unit 63 determines that the music playback has started (step S25: YES), and proceeds to step S26. On the other hand, when it determines with the reproduction | regeneration of a music not starting (step S25: NO), it returns to step S23.

  In step S26, the control unit 63 determines whether or not the moving image mode is set. When it is determined that the moving image mode is set (step S26: YES), the control unit 63 proceeds to step S27. That is, when the moving image mode is set, the control unit 63 performs a projector dimming process in step S27 and a moving image recording process (recording process) in step S28 and subsequent steps. Thereby, the system load can be reduced. On the other hand, when it determines with the moving image mode not being set (step S26: NO), the control part 63 progresses to step S29. Note that the control unit 63 may be configured to switch the setting from the determination mode to the moving image mode instead of the process of step S26. That is, the control unit 63 switches from the determination mode to the moving image mode when information indicating the reproduction of music is acquired in step S25. In this case, when the control unit 63 is switched from the determination mode to the moving image mode, the dimming process of the projector is performed in step S27 and the moving image recording process is performed in step S28 and subsequent steps. Accordingly, since the moving image recording process and the projector dimming process can be automatically performed when the reproduction of the music is started, it is possible to reduce the time and effort of the operation by the user.

  FIG. 7 is a flowchart illustrating an example of the light reduction process of the projector. In the projector dimming process shown in FIG. 7, the control unit 63 substitutes “11” for the variable M indicating the camera identification number (step S271). As a result, the camera 3a with the identification number “11” is selected from the cameras 3a to 3c. Next, the control unit 63 acquires the imaging result captured by the camera M selected in step S271 from the camera M (step S272). The control part 63 detects a user's singing state by the process of the following steps S273-S276 from the acquired imaging result. Here, the user's singing state refers to a state in which the user is singing or a state in which the user is singing. The purpose of detecting the user's singing state is to dimming the projector to be dimmed when recording a moving image when the user is in the singing state. Thereby, the reflected light from the projector enters the moving image when the user is in a singing state (for example, a dazzling circular light is reflected), the gain control of the camera is affected, the user's face becomes dark, and halation occurs. It is possible to prevent the occurrence and the like from affecting the image quality.

  Next, the control unit 63 performs face detection processing on the image frame included in the imaging result acquired in step S272 (step S273). For the face detection process, a known face recognition algorithm such as Viola Jones algorithm can be used. Next, the control unit 63 determines whether or not a face is detected from the image frame subjected to the face detection process in step S273 (step S274). When it is determined that the face is detected from the image frame (step S274: YES), the control unit 63 proceeds to step S275. On the other hand, when it is determined that the face is not detected from the image frame (step S274: NO), the control unit 63 proceeds to step S278.

  In step S275, the control unit 63 performs microphone detection processing in the image frame included in the imaging result acquired in step S272. The microphone detection process is, for example, a process of detecting a microphone by image pattern matching using a microphone image on an image frame included in the imaging result. The microphone image is preset. In addition, when an infrared image is contained in an imaging result, you may comprise so that the metal part of a microphone and an infrared-type audio | voice transmission part may be detected from an infrared image. Next, the control unit 63 determines whether or not a microphone is detected from the image frame subjected to the microphone detection process in step S275 (step S276). When it is determined that the microphone is detected from the image frame (step S276: YES), that is, when the user's singing state is detected, the control unit 63 proceeds to step S277. On the other hand, when it is determined that the microphone is not detected from the image frame (step S276: NO), the control unit 63 proceeds to step S278.

  In addition, in the process of step S273-S276, it comprised so that a face detection and a microphone detection might be performed as an example of a user's singing state detection. By detecting the microphone in addition to the face detection, the projector associated with the camera M capturing the front of the user can be dimmed. As another example, when it is determined in step S274 that a face has been detected, it may be configured that the user's singing state is detected and the process proceeds to step S277. Alternatively, when a depth image is included in the acquired imaging result, the control unit 63 performs a process of detecting a skeleton constituting a human skeleton or contour from the depth image instead of the processes of steps S273 to S276. You may comprise. In this case, when the preset skeleton is detected from the depth image, the control unit 63 determines that the user's singing state is detected, and proceeds to step S277.

  In step S277, the control unit 63 turns off the power of the projector registered in the dimming target list M corresponding to the camera M selected in step S271. For example, as described above, the control unit 63 outputs a power OFF command to the projector via the IF 61f to turn off the power of the projector. That is, when the moving image mode is set and the user's singing state is detected, the control unit 63 performs the light reduction processing of the projector associated with the camera M that has captured the imaging result in which the user's singing state is detected. I do. For example, the light reduction processing of the projectors 5a and 5b associated with the camera 3a is performed. At this time, the control unit 63 registers, in the dimming target list M, information indicating that the light is being reduced in association with the identification number of the projector that has been dimmed when the power is turned off.

  In step S278, the control unit 63 determines whether there is an unselected camera among the cameras 3a to 3c. When it is determined that there is an unselected camera (step S278: YES), the control unit 63 proceeds to step S279. On the other hand, when it is determined that there is no unselected camera (step S278: NO), the control unit 63 returns to the process illustrated in FIG. In step S279, the control unit 63 adds “1” to the variable M indicating the camera identification number, and returns to step S272. For example, “1” is added to the identification number “11” of the camera 3a, and M = 12. As a result, the camera 3b with the identification number “12” is selected, and the processing from step S272 onward is performed in the same manner as described above. Similarly, the process after step S272 is performed on the camera 3c with M = 13 indicating an identification number.

  Returning to the processing illustrated in FIG. 6, the control unit 63 starts the moving image recording processing (step S <b> 28). In the moving image recording process, the control unit 63 acquires imaging results (for example, RGB images) continuously captured by the respective cameras 3a to 3c via the IF 61c to IF 61e, and the acquired imaging results are converted into moving images. Record. Depending on the setting, the imaging result captured by any one of the cameras 3a to 3c may be recorded as a moving image.

  In step S29, the control unit 63 determines whether or not the reproduction of the music has ended. For example, if the control unit 63 receives information indicating the end of music playback from the playback control device 6, it determines that the music playback has ended (step S29: YES), and proceeds to step S30. On the other hand, if it is determined that the reproduction of the music has not ended (step S29: NO), the process returns to step S29. In step S30, the control unit 63 determines whether or not the moving image mode is set. When it is determined that the moving image mode is set (step S30: YES), the control unit 63 proceeds to step S31. On the other hand, when it determines with the moving image mode not being set (step S30: NO), the control part 63 progresses to step S33.

  In step S31, the control unit 63 stops the moving image recording process. The moving image data recorded by the recording process is stored in a moving image file of a predetermined file format and stored in the storage unit 62. The moving image file stored in the storage unit 62 is uploaded to a URL of a moving image distribution site designated in advance by a user who uses a room of a karaoke store, for example. The moving image stored in such a moving image file is a moving image in which there is no reflected light from the projector by the above-described dimming process. For this reason, according to the said process, the quality and value of the uploaded moving image can be improved.

  Next, the control unit 63 stops (cancels) the dimming performed in the dimming process in step S27 (step S32). For example, the control unit 63 stops the light emission by turning on the power of a projector that is turned off. A projector whose power is OFF is a projector in which information indicating that light is being reduced in the light reduction target list M is associated with an identification number. The control unit 63 deletes information indicating that the light is being dimmed from the dimming target list M and associated with the identification number of the projector that has stopped dimming. In step S <b> 33, the control unit 63 determines whether or not the reproduction control device 6 has been instructed to turn off the power. When the control unit 63 determines that there is no power-off instruction of the reproduction control device 6 (step S33: NO), the control unit 63 returns to step S23. On the other hand, when it is determined that the playback control device 6 has been instructed to turn off the power (step S33: YES), the control unit 63 ends the service process illustrated in FIG.

  In the light reduction processing of the projector, it is assumed that the user U is facing the camera 3a, but the user U may be facing another direction. FIG. 8 is a diagram illustrating how the direction in which the user U faces in the room changes. In FIG. 8A, the user U faces the direction of the camera 3a. In this case, since the microphone M is hidden by the user U when viewed from the camera 3b or the camera 3c, the image is captured by the camera 3b or the camera 3c. The microphone M is not detected from the captured image. For this reason, according to the projector light determination process shown in FIG. 7, the light reduction process of the projector associated with the camera 3b or the camera 3c is not performed. On the other hand, in FIG. 8B, the user U faces the direction of the camera 3b. In this case, the microphone M is hidden from the user U when viewed from the camera 3a or the camera 3c. The microphone M is not detected from the captured image captured by the above. For this reason, according to the projector light determination process shown in FIG. 7, the dimming process of the projector associated with the camera 3a or the camera 3c is not performed. On the other hand, in FIG. 8C, the user U faces the direction of the camera 3c. In this case, the microphone M is hidden from the user U when viewed from the camera 3a or the camera 3b, and thus the camera 3a or the camera 3b. The microphone M is not detected from the captured image captured by the above. For this reason, according to the projector light determination process shown in FIG. 7, the light reduction process of the projector associated with the camera 3a or the camera 3b is not performed.

  Note that the projector dimming process shown in FIG. 7 is configured to specify a projector to be dimmed by sequentially selecting a plurality of projectors in a time-sequential manner and emitting white light. As another example, the reproduction control device 6 may be configured to specify a projector to be dimmed by causing a plurality of projectors to simultaneously emit light of different colors. In this case, the playback control device 6 transmits an image playback command for playing back images of different colors to the video playback devices 4a to 4d. Thereby, each of the video playback devices 4a to 4d that has received the image playback command plays, for example, a prestored image (for example, a red image, a blue image, a green image, or a yellow image) and outputs the image signal to the projector. Output to. As a result, the projectors 5a to 5d simultaneously emit light of different colors. At this time, the reproduction control device 6 acquires the imaging result captured by the camera, and specifies the projector to be dimmed based on the color of the image detected from the acquired imaging result. According to such a configuration, it is possible to quickly identify the projector to be dimmed.

  As described above, according to the above-described embodiment, among the plurality of projectors, a projector in which light emitted by the projector is included within the angle of view of the camera from the imaging result captured by the camera is greater than or equal to a predetermined reference. It was specified and configured to perform dimming processing for the specified projector. For this reason, when projecting an image on a projection surface using a plurality of projectors, it is possible to identify and dimming a projector as a light emission source of light reflected on the camera by a simple process.

  In addition, in the said embodiment, since the case where the moving image when a user exists in a song state was assumed, it comprised so that a user's song state might be detected by the process of step S273 to S276. However, even when the user is not in a singing state, the video projected on the projection plane by the projector may be recorded as a moving image. In this case, the control unit 63 may be configured to perform the process of step S277 without performing the processes of steps S272 to S276 after the process of step S271 illustrated in FIG.

  Moreover, the case where the direction where the user U in a singing state turns to frequently changes from the reproduction | regeneration start of reproduction | regeneration of music is assumed. In this case, it is desirable that the projector that is dimmed by the dimming process dynamically changes in accordance with the change in the direction in which the user U faces. FIG. 9 is a flowchart illustrating an example of a dimming process configured to dynamically change the projector to be dimmed. The process shown in FIG. 9 is executed when it is determined in step S29 that the reproduction of music has not ended in addition to being executed in step S27 shown in FIG. 8, and then the process returns to step S29. The processes in steps S281 to S286 shown in FIG. 9 are the same as the processes in steps S271 to S276 shown in FIG. Further, the processes in steps S291 and S292 shown in FIG. 9 are the same as the processes in steps S278 to S279 shown in FIG.

  If it is determined in step S286 shown in FIG. 9 that the microphone has been detected from the image frame (step S286: YES), the control unit 63 registers the projector registered in the dimming target list M corresponding to the camera M selected in step S281. Is determined to be dimmed (the dimming target is dimmed) (step S287). For example, when information indicating that the light is being reduced is registered in association with the identification number of the projector registered in the dimming target list M, it is determined that the projector is being dimmed. When it is determined that the projector registered in the dimming target list M is dimming (step S287: YES), the control unit 63 proceeds to step S291. On the other hand, when it is determined that the projector registered in the dimming target list M is not dimming (step S287: NO), the control unit 63 dims the projector registered in the dimming target list M ( Step S288), the process proceeds to Step S291. For example, the control unit 63 transmits a black image playback command to the video playback device to which the dimming target projector is connected. The black image reproduction command is a command for reproducing a black image. Upon receiving the black image playback command, the video playback device plays back a previously stored black image and outputs the image signal to the projector. The projector emits light corresponding to the image signal received from the video reproduction device (that is, dimmed light) from the light emitting unit. The control unit 63 may transmit a command for reducing the illuminance of light to the projectors registered in the dimming target list M. In this case, the projector that has received the command reduces the illuminance by adjusting the illuminance setting. As described above, according to the configuration in which the light is reduced without turning off the power of the projector, the light can be stopped more quickly than the power is turned on in the process of step S290 described later. This configuration is particularly effective when applying a projector that starts slowly from power ON (for example, starts in minutes). Note that when applying a projector that starts up quickly after turning on the power, the control unit 63 may turn off the power of the projector as in step S277.

  On the other hand, if it is determined in step S284 that no face is detected (step S284: NO), or if it is determined in step S286 that no microphone is detected (step S286: NO), the process proceeds to step S289. In step S289, the control unit 63 determines whether the projector registered in the dimming target list M corresponding to the camera M selected in step S281 is dimming. When it is determined that the projector registered in the dimming target list M is dimming (step S289: YES), the control unit 63 proceeds to step S290. On the other hand, when the control unit 63 determines that the projector registered in the dimming target list M is not dimming (step S289: NO), the control unit 63 proceeds to step S291. In step S290, the control unit 63 stops the dimming of the projector registered in the dimming target list M, and proceeds to step S291. For example, the control unit 63 transmits the video playback command transmitted in step S22 again to the video playback device to which the projector registered in the dimming target list M is connected. The video playback device plays back the video according to the received video playback command and outputs the video signal to the projector. The projector emits light corresponding to the video signal received from the video playback device from the light emitting unit. This stops the dimming. Note that the control unit 63 may transmit a command for returning the illuminance of light to the projectors registered in the dimming target list M. In this case, the projector that has received the command restores the illuminance by adjusting the illuminance setting. When the power supply of the projector is turned off, the control unit 63 turns on the power supply of the projector.

  As described above, according to the process shown in FIG. 9, even when the direction in which the user U is frequently turned is changed from the start to the end of the music, the change in the direction in which the user U is turned. It is possible to dynamically change the projector that is dimmed to match. For this reason, the quality and value of the uploaded moving image can be further improved.

  In the above-described embodiment, the playback control device 6 is configured to record the imaging result captured by the camera as a moving image. However, for example, the music playback device 2 is configured to record a moving image according to a command from the playback control device 6. You may comprise so that it may record. In this case, at least one of the cameras 3a to 3c is connected to the music reproducing device 2 via a wired or wireless connection. The music reproducing device 2 acquires an imaging result continuously captured by the camera, and records the acquired imaging result as a moving image. In this case, the imaging result captured by the camera is transmitted from the music playback device 2 to the playback control device 6.

DESCRIPTION OF SYMBOLS 1 Display and operation device 2 Music reproduction apparatus 3a-3d Camera 4a-4d Video reproduction apparatus 5a-5d Projector 6 Playback control apparatus S Projection system

Claims (7)

A plurality of projection devices that project images onto projection surfaces in a plurality of directions; and at least one imaging device; and the imaging device projects at least one projection surface projected by at least one of the projection devices. A control device used in a projection system arranged between
First control means for emitting light from at least one of the plurality of projection devices;
An obtaining means for obtaining an imaging result captured by at least one imaging device disposed between at least one projection device and at least one projection plane among the plurality of projection devices;
A determination unit that determines whether or not the light of the projection device emitted by the first control unit is included in an angle of view of the imaging device based on the imaging result acquired by the acquisition unit; ,
Second control means for performing dimming processing of the projection apparatus determined by the determination means to include the light above a predetermined reference among the plurality of projection apparatuses;
A control device comprising: The first control means sequentially selects and emits light for each of the projection devices in a time difference,
The acquisition unit acquires the imaging result for each of the projection devices selected by the first control unit,
The determination means determines whether or not the light of each projection device is included in a predetermined reference or more in each imaging result acquired by the acquisition means,
The second control unit is configured to reduce the number of the projection devices that are determined by the determination unit to include the light above a predetermined reference among the plurality of projection devices that are sequentially selected and emitted by the first control unit. The control apparatus according to claim 1, wherein optical processing is performed. Further comprising setting means for setting a moving image mode for recording an imaging result captured by the imaging device as a moving image;
When the moving image mode is set by the setting unit, the second control unit reduces the projection device in which the moving image recording process and the determination unit determine that the light is included in a predetermined reference or more. The control device according to claim 1, wherein optical control is performed. The setting means can set either the moving image mode or a determination mode for determining whether or not the light is included above a predetermined reference.
A second acquisition means for acquiring information indicating the start of music reproduction by the music reproduction device;
When information indicating the start of music playback is acquired by the second acquisition unit, the setting unit switches from the determination mode to the video mode,
The second control unit is configured to record the moving image when the setting unit switches from the determination mode to the moving image mode, and the projection that the determination unit determines that the light includes a predetermined reference or more. The control device according to claim 3, wherein the control device performs dimming processing of the device. When it is determined by the determination means that the light is included above a predetermined reference, the image pickup apparatus that images the imaging result acquired by the acquisition means and the light is determined to be included above a predetermined reference Storage means for storing the projection apparatus in association with each other;
Detecting means for detecting the singing state of the user from the imaging result captured by the imaging device;
In the second control unit, when the moving image mode is set by the setting unit and the user's singing state is detected by the detecting unit, the singing state of the user is detected by the detecting unit in the storage unit. The control apparatus according to claim 3, wherein a light reduction process is performed on the projection apparatus associated with the imaging apparatus that captured the detected imaging result. A plurality of projection devices that project images onto projection surfaces in a plurality of directions; and at least one imaging device; and the imaging device projects at least one projection surface projected by at least one of the projection devices. A program to be executed by a computer used in a projection system arranged between
A first control step of causing at least one of the plurality of projection devices to emit light;
An obtaining step of acquiring an imaging result captured by at least one imaging device arranged between at least one of the plurality of projection devices and at least one of the projection planes;
A determination step of determining from the imaging result acquired in the acquisition step whether or not the light of the projection device emitted by the first control step is included in a field angle of the imaging device above a predetermined reference; ,
A second control step of performing a dimming process of the projection device determined by the determination step to include the light above a predetermined reference among the plurality of projection devices;
A program that causes a computer to execute. A plurality of projection devices that project images onto projection surfaces in a plurality of directions; and at least one imaging device; and the imaging device projects at least one projection surface projected by at least one of the projection devices. A projection system arranged between and
The control device used in the projection system is:
First control means for sequentially selecting and emitting light sequentially for each of the projection devices;
Of the plurality of projection devices, the first control means captures an imaging result captured by at least one imaging device arranged between at least one projection device and at least one projection plane. Obtaining means for obtaining each selected projection device;
Determination means for determining whether or not the light of each projection device emitted by the first control means is included in a field of view of the imaging apparatus from the respective imaging results acquired by the acquisition means above a predetermined reference When,
Second control means for performing dimming processing of the projection apparatus determined by the determination means to include the light above a predetermined reference among the plurality of projection apparatuses;
A projection system comprising: