JP5124425B2 - Imaging system, imaging apparatus, and imaging control program - Google Patents

Description

  The present invention relates to a photographing system, a photographing device, and a photographing control program.

In the shooting of movies, TV programs, etc., moving images are shot using a lighting device. FIG. 22 is a conceptual diagram showing a conventional photographing system. This figure shows that the person P1 and the person P2 are talking in the television program. In this figure, the photographing system includes photographing devices X1 to X3 and illumination devices Y1 to Y7.
Here, the illuminating devices Y1, Y4, and Y5 are illuminating devices used for photographing the photographing devices X1, X2, and X3, respectively. The illumination devices Y2 and Y3 are illumination devices that illuminate the faces of the people P1 and P2, respectively. The illumination devices Y6 and Y7 are illuminations that are permanently installed in a studio (room) that captures the television program. The lighting devices Y1 to Y7 are lighting devices that always emit light after power is input.

In such a conventional photographing system, due to the relationship between the photographing device and the illuminating device, the illumination light of the other illuminating device unnecessary for photographing or the reflected light is reflected in the image photographed by the photographing device, and the photographing is performed. There was a problem that the video was not intended by the user.
For example, in FIG. 22, the image of the photographing device X1 has a problem that the light of the illumination devices Y2 and Y4 that are backlit is reflected and the image becomes unclear. In FIG. 22, the person P2 of the image of the photographing device X1 is illuminated by the light of the illumination device Y5 used for photographing of the photographing device X3, and becomes an image unintended by the photographer who photographs using the photographing device X1. There was a problem.

In order to solve such a problem, Patent Document 1 discloses an illumination control device that recognizes the position of an irradiation target and controls the irradiation direction of the lighting fixture to automatically track the movement of the irradiation target. A lighting control apparatus is described in which a moving range is divided into a plurality of recognition areas, and the lighting apparatus is controlled according to the recognition area including the irradiation target recognized from the position of the irradiation target.
The technique of this patent document 1 automatically sets the light level of the illuminating device to be irradiated for each recognition area when the movement path of the irradiation target is determined to some extent, so that the light of the device is not backlit. It is a technology that tries to control easily.

  In recent years, in the field of video technology used for movies and the like, motion capture technology, which is a technology for digitally recording the movement of an actual person or object, has been used.

Japanese Patent Laid-Open No. 2004-228561 uses a plurality of LED light emitters that cyclically repeat blinking one by one at a predetermined timing as a target, receives light from each LED light emitter, and measures its position in real time. A motion capture system comprising a position measurement device using a semiconductor position detection element (PSD) and means for processing data synchronized with the blinking timing of a plurality of LED light emitters from the position measurement device input to the processing device Is described.
The technique of this patent document 2 uses a PSD that measures a blinking LED illuminant to input the position of a target as position data, not as image data, into the processing device, thereby greatly simplifying data processing. Technology.

Patent Document 3 discloses a timing signal transmitting means for transmitting a timing signal by light or radio, a timing signal receiving means for receiving the timing signal transmitted by the timing signal transmitting means, Light emitting means for emitting light at a timing corresponding to the timing signal received by the timing signal receiving means, a light diffusing means for diffusing and emitting light emitted by the light emitting means in a specific shape, and the light diffusing means There is described an input device having imaging means for imaging the light emitted from the light emitting means diffused through a light source while removing other external light. Patent Document 3 discloses a light emission target device for emitting light in response to a timing signal from an image acquisition device, and a timing signal receiving unit for receiving the timing signal from the image acquisition device; A light emitting means for emitting light at a timing corresponding to the timing signal received by the timing signal receiving means, and a light diffusing means for causing the light emitted by the light emitting means to diffuse and emit light in a specific shape A target device is described.
The technique of this Patent Document 3 is a technique for reliably detecting the movement of a target object by operating with the target device mounted or held on the target object even when the object to be acquired is at a long distance. .
Japanese Patent Laid-Open No. 11-176209 Japanese Patent Laid-Open No. 10-74249 JP 2003-83716 A

However, with the technology of Patent Document 1, it is possible to prevent the lighting of the instrument from being backlit, but it is not possible to eliminate the effects of illumination of other lighting devices that are not necessary for shooting, and images that are not intended by the photographer. There was a drawback of becoming.
Further, in the techniques of Patent Document 2 and Patent Document 3, when the light emitted from the target and the light emitted from another illumination device are the same color, it is difficult to identify the light emitted from the target. There was a drawback of becoming.
As described above, in the conventional technique, the influence of the illumination from the plurality of illumination devices cannot be appropriately controlled, and there is a drawback in that an image affected by the illumination unintended by the photographer may be taken. was there.

  The present invention has been made in view of the above points, and an object thereof is to provide a photographing system, a photographing device, and a photographing control program capable of photographing an image illuminated by illumination intended by a photographer. It is in.

(1) The present invention has been made to solve the above-described problems, and the invention described in claim 1 is an imaging system including a plurality of illumination devices and an imaging device for capturing a moving image. The lighting device includes a light emission timing control unit that performs light emission control for each predetermined light emission time of the device itself, and the imaging device includes the light emission time of the at least one lighting device determined in advance. Within a light emission time of at least one of the lighting devices determined in advance among a photographing timing control unit that performs photographing control , a light receiving charging unit that generates a charge by received light, and a charge generated by the light receiving charging unit And a light emitting charge accumulating unit for accumulating only the generated charges .

(2) Further, the invention described in claim 2 is an imaging system including a plurality of illumination devices and a plurality of imaging devices for capturing a moving image, wherein the first illumination device is the predetermined illumination device. The first lighting device (for example, lighting devices B1 and B3 in each embodiment) includes a first light emission timing control unit that performs light emission every light emission time, and the second lighting device is predetermined. The second lighting device (for example, lighting devices B2 and B4 in each embodiment) includes a second light emission timing control unit that performs light emission for each light emission time, and includes the first imaging device (for example, each embodiment). The imaging device C1) according to the embodiment includes a first imaging timing control unit that performs control to perform the imaging within a predetermined light emission time of the first illumination device, and a first that generates electric charge by the received light. Receipt of A charging unit, out of the first charge receiving charging unit has generated, and a light-emitting charge storage portion for storing only the charge generated in the light emitting time of the first illuminating device, the second of the photographing The apparatus (for example, the imaging apparatus C2 in each embodiment) includes a first imaging timing control unit that performs control to perform the imaging within a predetermined light emission time of the first illumination apparatus, and received light. A second light receiving and charging unit that generates charge; and a light emitting charge storage unit that stores only the charge generated within the light emission time of the second illumination device among the charges generated by the second light receiving and charging unit ; the provided light emitting timing of the first of the lighting device and the light emission timing of the second of the lighting device is a photographing system characterized different.

(3) Further, the invention according to claim 3, of the charges the light receiving charging portion is generated, and generates a time other than the light emitting time background light time a predetermined time period of the lighting device An imaging system comprising a background light charge storage unit that stores only charges.

(4) Further, the invention described in claim 4, is an imaging system characterized by repeated and the background light time and the light emitting time alternately.

(5) In the invention described in claim 5, among the charges the light receiving charging unit has generated, and a charge discharging part for discharging the electric charge generated in the time other than the light emitting time and the background light time It is the imaging system characterized by this.

(6) Further, the invention described in claim 6, wherein the imaging system comprises a plurality of said imaging device, the light-emitting timing control unit of a plurality of lighting devices, background light time a predetermined time period The background light charge accumulating unit of each of the plurality of imaging devices accumulates the electric charge generated during the background light time out of the electric charges generated by the light receiving charging unit without performing control to emit light. System.

(7) Further, the invention described in claim 7, wherein the imaging device, the image by the charge emitting charge accumulation portion is accumulated in the image accumulation time including a plurality of light-emitting time of the at least one lighting device a predetermined An imaging system comprising a video data generation unit for generating data.

( 8 ) Further, the invention described in claim 8 is predetermined in an imaging device that captures a moving image using illumination of a plurality of illumination devices that perform control to emit light every predetermined emission time of the device itself. Among the charge generated by the imaging timing control unit that performs control to perform the imaging within the light emission time of at least one of the illumination devices, the light receiving charging unit that generates charge by received light, and the light generated by the light receiving charging unit, An imaging device comprising: a light emission charge storage unit that stores only charges generated within a light emission time of the predetermined at least one illumination device .

( 9 ) Further, the invention described in claim 9 provides a computer of a photographing apparatus for photographing a moving image by using illumination of a plurality of illumination apparatuses that perform control to emit light every predetermined light emission time of the own apparatus. Shooting timing control means for performing control for shooting within a light emission time of at least one lighting device determined, light emission of at least one predetermined lighting device among charges generated by received light This is a photographing control program that functions as a light-emitting charge accumulating unit that accumulates only the charges generated in time .

(1) According to the invention described in claim 1, in the photographing system, the light emission timing control unit of the illuminating device performs control to emit light every predetermined light emission time of the own device, and the photographing of the photographing device is performed. The timing control unit performs control to cause the photographing within a predetermined light emission time of the lighting device. Charges are generated by the light received by the light receiving and charging unit, and only the charges generated within the light emission time of at least one predetermined illumination device among the generated charges are stored by the light emitting charge storage unit .
Thereby, the imaging system can take an image using only the illumination of the illumination device that emits light during the light emission time, and can take an image illuminated by the illumination intended by the photographer. . In addition, the imaging system can accumulate only the charges generated within the light emission time without controlling the light reception by the light receiving and charging unit, and the illumination of the at least one predetermined illumination device can be performed. There is an effect that it is possible to accumulate only the charges generated from the light illuminated by.

(2) According to the invention described in claim 2, the photographing system emits light at every light emission time of the first lighting device in which the first light emission timing control unit of the first lighting device is predetermined. performs control to, intends row control to emit light for each emission time of the second light-emitting timing control unit predetermined second illuminating device of the second illumination device. The first imaging device generates a charge by the received light, accumulates only the generated charge within the light emission time of the first illumination device, and generates a charge by the received light. Of the generated charges, only the charges generated within the light emission time of the second lighting device are accumulated. The light emission timing of the first illumination device is different from the light emission timing of the second illumination device .
As a result, the imaging system can perform imaging using only the illumination of the first illumination device that emits light during the light emission time of the first illumination device. An image that is not affected by the illumination of the second illumination device that is not intended by the photographer can be captured. Further, the second photographing device can photograph using only the illumination of the second lighting device that emits light during the light emission time of the second lighting device, and the photographer of the second photographing device does not intend. There is an effect that an image that is not affected by the illumination of the first illumination device can be taken. In addition, the imaging system can accumulate only the charges generated within the light emission time without controlling the light reception by the light receiving charging unit, and from the light illuminated by the illumination of the first or second illumination device. There is an effect that only generated charges can be accumulated.

( 3 ) According to the invention described in claim 3 , the imaging system generates the background light charge accumulating unit at a background light time that is a predetermined time other than the light emission time of the illumination device. Only the generated charge is accumulated.
Accordingly, the imaging system may be configured such that the background light charge storage unit is naturally generated from an image generated from the charge generated from the light illuminated by the illumination of the at least one lighting device. An image generated from background light such as ambient light can be removed, and an image captured using only the illumination of the predetermined at least one illumination device can be provided.

( 4 ) According to the invention described in claim 4 , the photographing system repeats the light emission time and the background light time alternately.
As a result, the imaging system can accumulate charges generated from background light such as natural environment light during background light time close to the light emission time, and even when background light such as natural environment light changes over time. The image generated from the charge charged by the background light close to the background light used for the image is removed from the image generated from the charge accumulated by the light-emitting charge accumulation unit, and an accurate image can be taken. There is.

( 5 ) According to the invention described in claim 5 , in the imaging system, the charge discharging unit of the imaging apparatus has a charge other than the light emission time and the background light time out of the charges generated by the light receiving charging unit. Discharge the charge generated in time.
Thereby, the imaging system accumulates only the charges generated by the light received during the light emission time and the background light time, and is generated by the light received at a time other than the light emission time and the background light time. In this case, the storage capacity can be reduced.

( 6 ) According to the invention described in claim 6 , in the photographing system, the light emission timing control unit of the plurality of illumination devices does not perform control to emit light in the background light time which is a predetermined time, Each of the background light charge accumulating units of the plurality of imaging devices accumulates the charge generated during the background light time among the charges generated by the light receiving charging unit.
Thereby, the said imaging | photography system ensures more time used as light emission time compared with the case where the background light time which receives background light, such as natural environment light, in each of these several imaging devices is made into different time. Thus, there is an effect that photographing can be performed using a larger number of photographing devices or lighting devices.

( 7 ) According to the invention described in claim 7 , in the imaging system, the video data generation unit of the imaging device has the light emission charge during the video accumulation time including a plurality of the light emission times of the predetermined at least one illumination device. Video data is generated by the electric charge accumulated in the accumulation unit.
As a result, the imaging system can generate video data with charges that are received and charged within a plurality of the light emission times, and generate video data with charges that are received and charged within one light emission time. Compared with the case where it does, there exists an effect which can produce clearer video data.

(First embodiment)
<Overview of the shooting system>
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a conceptual diagram showing a photographing system according to the first embodiment of the present invention.
In this figure, the photographing system includes a synchronization device A1, illumination devices B1 to B7, and photographing devices C1 to C3.

Here, the illuminating devices B1, B4, and B5 are illuminating devices used for photographing by the photographing devices C1, C2, and C3, respectively. The lighting devices B2 and B3 are lighting devices that illuminate the faces of the people P1 and P2, respectively. The lighting devices B6 and B7 are illuminations that are permanently installed in a studio (room) that captures the television program.
In this figure, the illumination devices B1 to B7 and the photographing devices C1 to C3 communicate with the synchronization device A1 via a cable or wirelessly.

The synchronization device A1 generates and outputs a clock signal, and the illumination devices B1 to B6 and the imaging devices C1 to C3 perform synchronization based on the clock signal input from the synchronization device A1. In addition, the synchronization device A1 stores in advance the light emission time during which each of the lighting devices B1 to B6 emits light, and outputs it to the lighting devices B1 to B6 and the photographing devices C1 to C3.
The illumination devices B1 to B6 blink by emitting light during the light emission time of the own device input from the synchronization device A1. This blinking is preferably such that a person cannot perceive the blinking of light. The lighting device B7 is a lighting device that always emits light after power is input.

Further, the photographing devices C1 to C3 take pictures in accordance with the light emission of the lighting devices B1 to B6 that emit light used for photographing by the own device.
FIG. 1 shows a photographing system at the moment when the lighting device B1 and the lighting device B3 emit light, and the photographing device C1 is photographing at this moment.

  Hereinafter, the synchronization device A1, the lighting devices B1 to B6, and the photographing devices C1 to C3 will be described in detail. In this embodiment, the synchronization device A1 is referred to as a synchronization device a1, the illumination devices B1 to B6 are referred to as an illumination device b1, and the imaging devices C1 to C3 are referred to as an imaging device c1.

<About the configuration of the synchronization device a1>
First, the synchronization device a1 will be described. FIG. 2 is a schematic block diagram showing the configuration of the synchronization device a1 according to the present embodiment.
The synchronization device a1 includes a clock signal generation unit a11, a light emission time storage unit a12, and a light emission time transmission unit a13.

  The clock signal generation unit a11 is a transmission circuit using a crystal resonator. The clock signal generation unit a11 generates a clock signal that is a pulse with a constant period, and outputs the generated clock signal to the light emission time transmission unit a13.

The light emission time storage unit a12 stores in advance a light emission time information file (FIG. 4) in which the identification information of the illumination device b1 and the light emission time of the illumination device b1 are associated with each other.
The light emission time transmission unit a13 outputs the clock signal input from the clock signal generation unit a11 to the illumination device b1 and the imaging device c1.

Moreover, the light emission time transmission part a13 reads the light emission time information file of the light emission time memory | storage part a12, and reads the information of the light emission time matched with the identification information about each illuminating device b1. The light emission time transmission unit a13 transmits information on the read light emission time (a clock cycle number d described below, hereinafter referred to as a light emission clock cycle number d1) to each of the lighting devices b1.
In addition, the light emission time transmission unit a13 reads the light emission time information file in the light emission time storage unit a12 and transmits the information of the light emission time information file to the imaging device c1.
Details of the clock signal and the light emission time information file will be described below.

FIG. 3 is a time chart for explaining a clock signal according to the present embodiment.
In this figure, the clock signal indicates "0" or "1" depending on the voltage of the signal. This figure also shows the numbering of clock signals by period. The clock number D (D is a positive integer including 0) is a serial number from the reference time for the clock signal representing “1”. The synchronization device a1 transmits a signal indicating that it is a reference time (hereinafter referred to as a reference signal) at the time of transmission of the clock signal or at a predetermined time after transmission, and the illumination device b1 and the photographing device c1 The time when this signal is received is set as a reference time.
The clock cycle number d (d = 0 to 7) is a number F of clock signal cycles (hereinafter referred to as clock cycles) (in this embodiment, F = 8, hereinafter referred to as cycle number F). Is a serial number assigned to a clock signal representing “1” within a period n (n is a positive integer).
The clock cycle is, for example, in the range of 10 to 100 μs (microseconds).

FIG. 4 is a schematic diagram illustrating an example of a light emission time information file according to the present embodiment. The light emission time information file is managed by a relational database.
As shown in the figure, the light emission time information file is a two-dimensional tabular data composed of rows and columns, and has columns for each item of a clock cycle number d and an illumination device name (identification information of the illumination device b1). ing. Here, the name of the lighting device is a symbol of the lighting device in FIG.
For example, FIG. 4 shows that the lighting device name “B1” of the lighting device B1 and the lighting device name “B3” of the lighting device B3 are associated with the clock cycle number “1”. In this case, for example, the clock cycle number “1” for the lighting device name “B1” is the light emission clock cycle number “1”.

<About the configuration of the illumination device b1>
Next, the illumination device b1 will be described. FIG. 5 is a schematic block diagram showing the configuration of the illumination device b1 according to this embodiment.
The illumination device b1 includes a light emission timing control unit b11 and a light emission unit b12.

  The light emission timing controller b11 counts the clock number D from the time when the reference signal is received for the clock signal input from the synchronization device a1. Further, the light emission timing control unit b11 determines whether or not the remainder (that is, the clock cycle number d) obtained by dividing the clock number D by the period number F is equal to the light emission clock cycle number d1 input from the synchronization device a1. judge.

As a result of the determination, when the calculated clock cycle number d is equal to the light emission clock cycle number d1, the light emission timing control unit b11 controls the light emission unit b12 to emit light during one clock cycle (light emission time) (hereinafter referred to as light emission). Control). In other words, the light emission timing control unit b11 performs control to emit light every predetermined light emission time of the own device.
On the other hand, as a result of the determination, if the calculated clock cycle number d is not equal to the light emission clock cycle number d1, the light emission timing control unit b11 does not control the light emission unit b12.

  The light emitting unit b12 emits light only while light emission control is performed from the light emission timing control unit b11, and does not emit light during other periods. Since the clock cycle number d is equal to the light emission clock cycle number d1 every cycle (period cycle), the light emitted from the illumination device b1 blinks.

<About the configuration of the photographing apparatus c1>
Next, the imaging device c1 will be described. FIG. 6 is a schematic block diagram illustrating a configuration of the imaging device c1 according to the present embodiment.
The imaging device c1 includes an optical unit c11, an illumination device information storage unit c12, an imaging timing control unit c13, storage units c14-1 to c14-m, a video data generation unit c15, and a video data storage unit c16. .
Since the storage units c14-1 to c14-m have the same configuration and function, one of them (the storage unit c14-1) will be described as a representative.

The optical unit c11 is realized including an optical lens. The optical unit c11 forms the received light on the storage units c14-1 to c14-m corresponding to each of the m pixels of the moving image to be photographed.
The illumination device information storage unit c12 stores information on the light emission time information file received from the light emission time transmission unit a13 of the synchronization device a1.
In addition, the illumination device information storage unit c12 stores in advance the name of the illumination device of the illumination device b1 that emits light that the photographer intends to use for photographing with the photographing device c1. For example, the imaging device C1 of FIG. 1 stores the illumination device name “B1” of the illumination device B1 and the illumination device name “B3” of the illumination device B3.

  The imaging timing control unit c13 obtains the clock cycle number d corresponding to the lighting device name stored in advance in the lighting device information storage unit c12 in the light emission time information file from the lighting device information storage unit c12, that is, the light emission clock cycle number d1. read out.

Further, the imaging timing control unit c13 counts the clock number D from the time when the reference signal is received for the clock signal input from the synchronization device a1. Further, the imaging timing control unit c13 determines whether or not the remainder (that is, the clock cycle number d) obtained by dividing the clock number D by the period number F is equal to the read light emission clock cycle number d1.
As a result of the determination, if the calculated clock cycle number d is equal to the light emission clock cycle number d1, the imaging timing control unit c13 gives the charge generated by the received light for one clock cycle to the charge control unit c142 as the light emission charge. Control for accumulating in the accumulator c143 (hereinafter referred to as light emission charge accumulation control) is performed.
As a result of the determination, if the calculated clock cycle number d is not equal to the light emission clock cycle number d1, the imaging timing control unit c13 controls the charge control unit c142 to discharge the charge generated by the received light (hereinafter referred to as “light emission clock cycle number d1”). , Called discharge control).

  In addition, the imaging timing control unit c13 stores the charge control unit c142 at a predetermined timing (N is a number of accumulation periods, N, each time the predetermined period N in FIG. 3 elapses). Control for storing charges (hereinafter referred to as video storage control) is performed. N is a number in the range of 1000 to 10,000.

The storage unit c14-1 includes a light receiving and charging unit c141, a charge control unit c142, a light emission charge storage unit c143, and a charge discharge unit c144.
The light receiving charging unit c141 photoelectrically converts the light of the image formed by the optical unit c11 and outputs the charge generated by the conversion to the charge control unit c142.

When the light emission charge accumulation control is performed from the imaging timing control unit c13, the charge control unit c142 outputs the charge input from the light receiving charging unit c141 to the light emission charge accumulation unit c143. On the other hand, when the discharge control is performed from the imaging timing control unit c13, the charge control unit c142 outputs the charge input from the light receiving charging unit c141 to the charge discharging unit c144.
In addition, when the video storage control is performed from the photographing timing control unit c13, the charge control unit c142 causes the video data generation unit c15 to output the charges accumulated in the light emission charge accumulation unit c143.

The light emission charge accumulation unit c143 accumulates charges.
The charge discharging unit c144 discharges the charge.
The video data generation unit c15 generates video data based on the charges accumulated in the N number of accumulation periods (video accumulation time) input from the light emission charge accumulation unit c143. The video data generation unit c15 stores the generated video data in the video data storage unit c16 as a moving image.

Next, the hardware configuration of the storage unit c14-1 will be described.
FIG. 7A is a configuration diagram illustrating a hardware configuration of the storage unit c14-1 according to the present embodiment.
The accumulating unit c14-1 includes a light receiving and charging unit c141, a charge accumulating unit c1421, a distribution gate c1422, a drain gate c1423, a light emitting charge accumulating unit c143, a reset gate c1431, a reset electrode c1432, and a charge discharging unit c144. . Note that the charge accumulation unit c1421, the distribution gate c1422, and the drain gate c1423 correspond to the charge control unit c142.

At least one light receiving and charging unit c141 is an embedded photodiode. The light receiving charging unit c141 is connected to the light emission charge accumulating unit c143 through the sorting gate c1422, and is connected to the charge discharging unit c144 through the drain gate c1423.
The charge accumulating unit c1421 transfers charges generated by the light receiving charging unit c141. When there are two or more light receiving and charging units c141, charges are collected and transferred by the charge accumulating unit c1421.
The distribution gate c1422 is supplied with voltage when the emission timing accumulation unit c13 performs emission charge accumulation control, and outputs the charges accumulated in the charge accumulation unit c1421 to the emission charge accumulation unit c143.

A voltage is applied to the reset electrode c1432, and, as will be described later, the reset process of the light-emitting charge storage unit c143 is performed by opening the reset gate c1431.
A voltage is applied to the drain gate c1423 when discharge control is performed from the imaging timing control unit c13, and the charge accumulated in the charge accumulation unit c1421 is output to the charge discharge unit c144.

FIG. 7B is a cross-sectional view of the storage unit c14-1 according to the present embodiment. FIG. 7B is a cross-sectional view taken along the broken line AA ′ from point A to point A ′ in FIG. In this figure, c149 is a light shielding curtain.
This figure shows that an N-type region c1402 hatched by shading is embedded in the P-type power storage unit c14-1.

  Further, in this PN junction, the area from the vicinity of the sorting gate c1422 to the lower side of the light shielding curtain c149 and the vicinity of the drain gate c1423 to the lower side of the light shielding curtain c149 correspond to the charge accumulation portion c1421 in FIG. The charge accumulating portion c1421 and the light receiving charging portion c141 in the central portion are different in doping level, for example, as shown in the modification of the second embodiment (FIG. 21), the width c141 becomes narrower. Therefore, as described later, there is a potential difference between the charge accumulating unit c1421 and the light receiving charging unit c141, and the charges generated by the light receiving charging unit c141 move from the light receiving charging unit c141 to the charge accumulating unit c1421. It should be noted that the number of the light receiving / charging portions c141 may be one or more, and may be one as shown in FIG. 7 or four as shown in FIG.

Further, the light emitting charge storage part c143, the reset electrode c1432, and the charge discharging part c144 that are formed on the P-type area and hatched with diagonal lines are N ⁺ -type areas. The distribution gate c1422, the drain gate c1423, and the reset gate c1431 are gates having a MOS (Metal Oxide Semiconductor) structure.
The distribution gate c1422, the drain gate c1423, and the reset gate c1431 are each applied with a voltage, whereby a charge accumulation unit c1421, a light emission charge accumulation unit c143, a charge accumulation unit c1421, a charge discharge unit c144, and a light emission charge accumulation unit c143, respectively. The reset electrode c1432 is electrically connected to move charges.

<About operation | movement of the synchronizer a1, the illuminating device b1, and the imaging device c1>
Hereinafter, operations of the synchronization device a1, the illumination device b1, and the imaging device c1 will be described.
FIG. 8 is an example of a time chart showing operations of the synchronization device A1, the illumination device B1, and the photographing device C1 of FIG. 1 according to the present embodiment. In this figure, the horizontal axis indicates time, and broken lines d1 and d4 indicate the time points of the light emission clock cycle number “1” and the light emission clock cycle number “4”, respectively.

  FIG. 8A is a time chart showing a clock signal. This figure is the same time chart as the time chart of FIG. 3, and the clock number D is shown for the clock signal.

FIG. 8B is a time chart showing the presence or absence of light emission of the light emitting part b12 (FIG. 5) of the illumination devices B1 and B3. In the vertical axis of this figure, “1” indicates that the light emitting unit b12 emits light, and “0” indicates that the light emitting unit b12 does not emit light.
In this figure, the light-emitting unit b12 starts light emission when the light-emitting clock cycle number “1” of the lighting devices B1 and B3 (see FIG. 4), and emits light during the light-emission time during one clock cycle. It shows that.

FIG. 8 (b ′) is a time chart showing the presence or absence of light emission of the light emitting part b12 (FIG. 5) of the illumination devices B2 and B4. In the vertical axis of this figure, “1” indicates that the light emitting unit b12 emits light, and “0” indicates that the light emitting unit b12 does not emit light.
This figure shows that the light emitting unit b12 starts to emit light when the light emitting clock cycle number “4” of the lighting devices B2 and B4 is set (see FIG. 4) and emits light during one clock cycle.

FIG. 8C is a time chart showing the presence / absence of charge output for the sorting gate c1422 (FIG. 7) of the photographing apparatus C1. In the vertical axis of the figure, “1” indicates that the distribution gate c1422 outputs the charge generated by the light receiving charging unit c141 and passing through the charge accumulating unit c1421 to the light emitting charge accumulating unit c143. It shows that the distribution gate c1422 does not output charges. The charges output from the distribution gate c1422 to the light emission charge accumulation unit c143 are accumulated in the light emission charge accumulation unit c143.
This figure shows that the output of charge starts when the distribution gate c1422 is the light emission clock cycle number “1” of the lighting devices B1 and B3, and the charge is output during one clock cycle.

FIG. 8D is a time chart showing the presence or absence of charge output for the drain gate c1423 (FIG. 7) of the photographing apparatus C1. In the vertical axis of this figure, “1” indicates that the drain gate c1423 outputs the charge of the charge accumulating portion c1421 to the charge discharging portion c144, and “0” indicates that the drain gate c1423 does not output the charge. Show. The charge output from the drain gate c1423 to the charge discharging unit c144 is discharged by the charge discharging unit c144.
This figure shows that when the drain gate c1423 is the light emission clock cycle number “1” of the lighting devices B1 and B3, the output of charge is stopped and the output of charge is stopped during one clock cycle.

  As described above, when the light emission clock cycle number is “1”, the illumination devices B1 and B3 emit light (see FIG. 8B), and the imaging device C1 accumulates the generated charges (see FIG. 8C). ). Further, except when the light emission clock cycle number is “1”, the imaging device C1 releases the generated charges (see FIG. 8D). As described above, the photographing apparatus C1 does not have the light emission clock cycle number “1”, for example, when the illumination devices B2 and B4 emit light (see the light emission clock cycle number “4”, FIG. 8B ′). The generated charge is released without accumulating.

  Note that, after the period N−1 has elapsed, the light emission charge accumulation unit c143 outputs the accumulated charge to the video data generation unit c15.

  FIG. 9 is an example of a time chart showing the operations of the synchronization device A1, the illumination device B2, and the imaging device C2 of FIG. 1 according to the present embodiment. In this figure, the horizontal axis indicates time, and broken lines d1 and d4 indicate the time points of the light emission clock cycle number “1” and the light emission clock cycle number “4”, respectively.

  FIG. 9A is a time chart showing a clock signal. This figure is the same time chart as the time chart of FIG. 3, and the clock number D is shown for the clock signal.

FIG. 9B is a time chart showing the presence or absence of light emission of the light emitting part b12 (FIG. 5) of the lighting devices B2 and B4. In the vertical axis of this figure, “1” indicates that the light emitting unit b12 emits light, and “0” indicates that the light emitting unit b12 does not emit light.
This figure shows that the light emitting unit b12 starts to emit light when the light emitting clock cycle number “4” of the lighting devices B2 and B4 is set (see FIG. 4) and emits light during one clock cycle.

  FIG. 9B 'is a time chart showing the presence or absence of light emission of the light emitting unit b12 (FIG. 5) of the illumination devices B1 and B3. This figure is the same as FIG. In the vertical axis of this figure, “1” indicates that the light emitting unit b12 emits light, and “0” indicates that the light emitting unit b12 does not emit light. In this figure, the light-emitting unit b12 starts light emission when the light-emitting clock cycle number “1” of the lighting devices B1 and B3 (see FIG. 4), and emits light during the light-emission time during one clock cycle. It shows that.

FIG. 9C is a time chart showing the presence / absence of charge output for the sorting gate c1422 (FIG. 7) of the photographing apparatus C2. In the vertical axis of this figure, “1” indicates that the distribution gate c1422 outputs the charge of the charge accumulation unit c1421 to the light emission charge storage unit c143, and “0” indicates that the distribution gate c1422 does not output the charge. . The charges output from the distribution gate c1422 to the light emission charge accumulation unit c143 are accumulated in the light emission charge accumulation unit c143.
This figure shows that when the distribution gate c1422 is the light emission clock cycle number “4” of the lighting devices B2 and B4, the output of the charge is started and the charge is output during one clock cycle.

FIG. 9D is a time chart showing the presence / absence of charge output for the drain gate c1423 (FIG. 7) of the photographing apparatus C2. In the vertical axis of this figure, “1” indicates that the drain gate c1423 outputs the charge of the charge accumulating unit c1421 to the charge discharging unit c144, and “0” indicates that the drain gate c1423 does not output the charge. The charge output from the drain gate c1423 to the charge discharging unit c144 is discharged by the charge discharging unit c144.
This figure shows that when the drain gate c1423 is the light emission clock cycle number “4” of the lighting devices B2 and B4, the output of charge is stopped and the output of charge is stopped during one clock cycle.

  As described above, when the light emission clock cycle number is “4”, the illumination devices B2 and B4 emit light (see FIG. 9B), and the imaging device C2 accumulates the generated charges (see FIG. 9C). ). Also, except when the light emission clock cycle number is “4”, the imaging device C2 releases the generated charges (see FIG. 9D). As described above, the photographing apparatus C2 does not have the light emission clock cycle number “4”, for example, when the lighting devices B1 and B3 emit light (see the light emission clock cycle number “1”, FIG. 9B ′). The generated charge is released without accumulating.

  Note that, after the period N−1 has elapsed, the light emission charge accumulation unit c143 outputs the accumulated charge to the video data generation unit c15.

FIG. 10 is a diagram illustrating an example of a temporal change in the potential state of the storage unit c14-1 (FIG. 7) according to the present embodiment. This figure shows that time elapses in the order of (a) initial stage, (b) reset, (c) accumulation, (d) discard, (e) accumulation, (f) discard, Repeatedly, that is, N-1 times of accumulation in FIG. 10 as a whole, and (b) returning to reset. In this figure, the horizontal axis indicates the position along the broken line AA ′ in FIG. 7, and the vertical axis in each of FIGS. 10A to 10F indicates the potential.
FIG. 10 shows the reset electrode c1432, the reset gate c1431, the light-emitting charge storage unit c143, and the distribution in order from the point A toward the point A ′ (horizontal axis) at each time of FIGS. The potentials of the gate c1422, the charge accumulation unit c1421, the light receiving charging unit c141, the charge accumulation unit c1421, the drain gate c1423, and the charge discharge unit c144 are shown.

  FIG. 10A shows an initial potential state in which nothing is controlled by the storage unit c14-1. In FIG. 10B, the reset gate c1431, the distribution gate c1422, and the drain gate c1423 are opened with a voltage applied to the reset electrode c1432, that is, the reset gate c1431, the distribution gate c1422, and the drain gate c1423 are lowered to emit light. A state in which charges in the charge accumulation unit c143, the light receiving charging unit c141, and the charge accumulation unit c1421 are discharged (referred to as reset processing) is shown.

  FIG. 10C shows a state in which the potential of the distribution gate c1422 is lowered during the first light emission time (for example, the time of the light emission clock cycle number “1” in period 0 in FIG. 8). This figure shows that the charge generated by the light-receiving charging unit c141 hatched by shading is accumulated in the light-emission charge accumulating unit c143 via the charge accumulating unit c1421. In addition, since the charge accumulation unit c1421 has a lower potential than the light receiving charging unit c141, the charge moves from the light receiving charging unit c141 to the charge accumulation unit c1421.

  FIG. 10D shows a drain in a time other than the first light emission time (for example, the time of light emission clock cycle number “2” in period 0 to the time of light emission clock cycle number “0” in period 1 in FIG. 8). The state where the potential of the gate c1423 is lowered is shown. This figure shows that the charge generated by the light receiving and charging unit c141 moves to the charge discharging unit c144 via the charge accumulation unit c1421, and is discharged.

  FIG. 10E shows a state where the potential of the sorting gate c1422 is lowered during the second light emission time (for example, the time of the light emission clock cycle number “1” in period 1 in FIG. 8). This figure is the same state as the state of FIG. FIG. 10 (f) shows the drain in the time other than the second light emission time (for example, the time of the light emission clock cycle number “2” in period 1 to the time of the light emission clock period number “0” in period 2 in FIG. 8). The state where the potential of the gate c1423 is lowered is shown. This figure is the same state as the state of FIG.

  FIG. 11 is an example of a flowchart illustrating operations of the synchronization device a1 and the illumination device b1 according to the present embodiment.

(Step S101) The synchronization device a1 stores the light emission time. Thereafter, the process proceeds to step S102.
(Step S102) The synchronization device a1 generates a clock signal. Thereafter, the process proceeds to step S103.

(Step S103) The illuminating device b1 determines whether it is the light emission time of an own apparatus. When it determines with the illuminating device b1 being the light emission time of an own apparatus, it progresses to step S104. On the other hand, when it determines with the illuminating device b1 not being the light emission time of an own apparatus, it progresses to step S105.
(Step S104) The illumination device b1 emits light. Thereafter, the process proceeds to step S103.
(Step S105) The illumination device b1 does not emit light. Thereafter, the process proceeds to step S106.

(Step S106) The illumination device b1 determines whether or not to end the light emission process. When it is determined that the lighting device b1 ends the light emission process, this operation ends. On the other hand, when it determines with the illuminating device b1 not complete | finishing a light emission process, it progresses to step S103.

  FIG. 12 is an example of a flowchart illustrating operations of the synchronization device a1 and the imaging device c1 according to the present embodiment.

(Step S101) The synchronization device a1 stores the light emission time. Thereafter, the process proceeds to step S102.
(Step S102) The synchronization device a1 generates a clock signal. Thereafter, the process proceeds to step S103.

(Step S203) The photographing apparatus c1 determines whether or not it is the light emission time of the illumination apparatus b1 that emits light that the photographer intends to use for photographing by the photographing apparatus c1. If it is determined that it is the light emission time of the illumination device b1 that emits light intended to be used for photographing by the photographing device c1, the process proceeds to step S204. On the other hand, when it is determined that it is not the light emission time of the illumination device b1 that emits light intended to be used for photographing by the photographing device c1, the process proceeds to step S205.
(Step S204) The imaging device c1 performs imaging. Thereafter, the process proceeds to step S203.
(Step S205) The photographing apparatus c1 does not photograph. Thereafter, the process proceeds to step S206.

(Step S206) The photographing apparatus c1 determines whether or not to end the photographing process. When the photographing apparatus c1 determines to end the photographing process, this operation is finished. On the other hand, when it is determined that the photographing apparatus c1 does not end the photographing process, the process proceeds to step S203.

Hereinafter, details of the operation of the storage unit c14-1 will be described.
FIG. 13 is an example of a flowchart illustrating operations of the imaging timing control unit c13 and the accumulation unit c14-1 according to the present embodiment.

(Step S301) The imaging timing control unit c13 sets the clock number D to “−1”. Thereafter, the process proceeds to step S302.
(Step S302) The imaging timing control unit c13 counts the clock number D from the time when the reference signal is received for the clock signal. Thereafter, the process proceeds to step S303.

(Step S303) The photographing timing control unit c13 determines whether or not the clock number D is equal to the number obtained by multiplying the period number F by the accumulation period number N. When the imaging timing control unit c13 determines that the clock number D is equal to the number obtained by multiplying the period number F by the accumulation period number N, the process proceeds to step S304. On the other hand, if the imaging timing control unit c13 determines that the clock number D is not equal to the number obtained by multiplying the period number F by the accumulation period number N, the process proceeds to step S305.
(Step S304) The accumulating unit c14-1 outputs the accumulated charge and stores the video data generated by the accumulated charge. Thereafter, the process proceeds to step S312.

(Step S305) The imaging timing control unit c13 determines whether or not the clock cycle number d that is the remainder of dividing the clock number D by the period number F is equal to the light emission clock cycle number d1. When the photographing timing control unit c13 determines that the clock cycle number d is equal to the light emission clock cycle number d1, the process proceeds to step S306. On the other hand, if the photographing timing control unit c13 determines that the clock cycle number d is not equal to the light emission clock cycle number d1, the process proceeds to step S309.

(Step S306) The accumulation unit c14-1 closes the drain gate c1423 of FIG. Thereafter, the process proceeds to step S307.
(Step S307) The accumulation unit c14-1 opens the sorting gate c1422 in FIG. 7 and outputs charges to the light emission charge accumulation unit c143. Thereafter, the process proceeds to step S308.
(Step S308) The accumulation unit c14-1 accumulates the charge output to the light emission charge accumulation unit c143 via the distribution gate c1422. Thereafter, the process proceeds to step S312.

(Step S309) The accumulation unit c14-1 closes the distribution gate c1422 in FIG. Thereafter, the process proceeds to step S310.
(Step S310) The accumulation unit c14-1 opens the drain gate c1423 of FIG. 7 and outputs the charge to the charge discharging unit c144. Thereafter, the process proceeds to step S308.
(Step S311) The storage unit c14-1 discharges the charge output to the charge discharging unit c144 via the drain gate c1423. Thereafter, the process proceeds to step S312.

(Step S312) The photographing timing control unit c13 determines whether or not to end the photographing process. When the imaging timing control unit c13 determines to end the imaging process, this operation ends. On the other hand, if the shooting timing control unit c13 determines not to end the shooting process, the process proceeds to step S302.

As described above, according to the present embodiment, the photographing system controls the light emission timing control unit b11 of the illumination device b1 to emit light every predetermined light emission time of the own device, and the photographing timing control unit of the photographing device c1. In step c13, control is performed to perform the photographing within a predetermined light emission time of at least one of the illumination devices.
As a result, the photographing system can photograph the photographing device c1 using only the illumination of the lighting device b1 that emits light that the photographer intends to use for photographing by the photographing device c1. You can shoot images illuminated by lighting.

Further, according to the present embodiment, the light emission timing control unit b11 of the lighting devices B1 and B3 controls to emit light during the light emission time of the light emission clock cycle number “1” (the time of the first light emission time) that is a predetermined time. The light emission timing control unit b11 of the lighting devices B2 and B4 performs control to emit light during the light emission time (second light emission time) of the light emission clock cycle number “4”, which is a predetermined time. The photographing timing control unit c13 of the photographing apparatus C1 performs control to perform photographing within the light emission time of the light emission clock cycle number “1” of the lighting apparatuses B1 and B3, and the photographing timing control unit c13 of the photographing apparatus C2 includes the lighting apparatus B2, Control is performed to perform shooting during the light emission time of the light emission clock cycle number “4” of B4.
Thereby, the imaging system can take an image using only the illumination of the illumination devices B1 and B3 that emit light during the light emission time of the light emission clock cycle number “1” of the illumination devices B1 and B3. It is possible to shoot images that are not affected by the illumination of the illumination devices B2 and B4 that are not intended by the photographer. In addition, the photographing device C2 can shoot using only the illumination of the lighting devices B2 and B4 that emit light during the light emission time of the light emission clock cycle number “4” of the lighting devices B2 and B4. There is an effect that it is possible to shoot a video that is not affected by the illumination of the illumination devices B1 and B3.

Further, according to the present embodiment, the imaging system generates a charge by the light received by the light receiving charging unit c141, and the light emitting charge accumulating unit c142 generates at least one of the charges generated by the light receiving charging unit c141. Only charges generated within the light emission time of the two lighting devices b1 are accumulated.
Accordingly, the imaging system can accumulate only the charges generated within the light emission time without controlling the light reception by the light receiving and charging unit c141, and illuminates the illumination of at least one predetermined illumination device b1. There is an effect that only charges generated from the emitted light can be accumulated.

In addition, according to the present embodiment, the imaging system includes a video storage time (the number of storage periods is N) including N light emission times of at least one lighting device b1 that is determined in advance by the video data generation unit c15 of the imaging device c1. Video data is generated by the charges accumulated in the light emission charge accumulating unit c143 during the period.
As a result, the imaging system can generate video data with the charge received and charged within N light emission times, and generate video data with the charge received and charged within one light emission time. Compared to the case, there is an effect that clearer video data can be generated.

Further, according to the present embodiment, the photographing system arranges the illumination device B1 and the photographing device C1 adjacent to each other, the light emission direction and the photographing direction are the same direction, and the person P1 (photographing target object). The direction.
As a result, the photographing system C1 can receive with high intensity the reflected light from the photographing object of the light emitted from the lighting device B1 during the light emission time, and can capture a clear image. There is.

(Second Embodiment)
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the second embodiment, the photographing apparatus can further generate video data excluding the influence of light other than the light used by the apparatus for photographing (hereinafter referred to as background light) such as natural environment light. Will be explained.

The overall image of the video system according to this embodiment is the same as that of the first embodiment (FIG. 1). In the present embodiment, the synchronization device A1 is referred to as a synchronization device a1, the illumination devices B1 to B6 are referred to as illumination devices b1, and the imaging devices C1 to C3 are referred to as imaging devices c2.
Moreover, since the synchronizer a1 and the illuminating device b1 which concern on this embodiment are the same as 1st Embodiment (FIG. 2, FIG. 5), description is abbreviate | omitted.

FIG. 14 is a schematic diagram showing an example of a light emission time information file according to the second embodiment of the present invention. The light emission time information file is managed by a relational database.
As shown in the figure, the light emission time information file is a two-dimensional tabular data composed of rows and columns, and has columns for each item of a clock cycle number d and an illumination device name (identification information of the illumination device b1). ing. Here, the name of the lighting device is a symbol of the lighting device in FIG.
For example, FIG. 14 illustrates that the lighting device name “B1” of the lighting device B1 and the lighting device name “B3” of the lighting device B3 are associated with the clock cycle number “1”.
When the light emission time information file according to the present embodiment (FIG. 14) and the light emission time information file according to the first embodiment (FIG. 4) are compared, the clock cycle number “7” indicates the lighting devices B1 to B1 at this time. The difference is that “None” indicating that B6 does not emit light is associated.

<About the configuration of the photographing apparatus c2>
Hereinafter, the imaging device c2 will be described. FIG. 15 is a schematic block diagram illustrating a configuration of the imaging device c2 according to the present embodiment.
When the imaging device c2 (FIG. 15) according to the present embodiment is compared with the imaging device c1 (FIG. 6) according to the first embodiment, the imaging timing control unit c23, the charge control unit c242, and the background light charge accumulation unit c245. , And the differential charge extraction unit c246 is different. However, other constituent elements (the optical unit c11, the illumination device information storage unit c12, the video data generation unit c15, the video data storage unit c16, the light receiving charging unit c141, the light emission charge storage unit c143, and the charge discharge unit c144) have. Since the function is the same as that of the first embodiment, description of the same function as that of the first embodiment is omitted.

  The imaging timing control unit c23 receives the clock cycle number d corresponding to the illumination device name stored in advance in the illumination device information storage unit c12 in the light emission time information file from the illumination device information storage unit c12, that is, the light emission clock cycle number d1. A clock cycle number d (hereinafter referred to as background light clock cycle number d2; in this embodiment, clock cycle number “7”) corresponding to the illumination device name “none” is read.

The clock number D is counted from the time when the reference signal is received for the clock signal input from the imaging timing control unit c23 and the synchronization device a1. In addition, the imaging timing control unit c23 determines whether or not the remainder obtained by dividing the clock number D by the period number F (that is, the clock period number d) is equal to the read light emission clock period number d1 or the background light clock period number d2. Determine whether.
As a result of the determination, when the calculated clock cycle number d is equal to the light emission clock cycle number d1, the imaging timing control unit c23 performs light emission charge accumulation control on the charge control unit c242.
As a result of the determination, when the calculated clock cycle number d is equal to the background light clock cycle number d2, the imaging timing control unit c23 performs one clock cycle (background light time) with respect to the background light charge accumulation unit c245. Control for accumulating charges generated by the received light in the background photocharge accumulator c245 (hereinafter referred to as background photocharge accumulation control) is performed.
As a result of the determination, if the calculated clock cycle number d is not equal to either the light emission clock cycle number d1 or the background light clock cycle number d2, the imaging timing control unit c23 performs discharge control on the charge control unit c242. Do.

When the light emission charge accumulation control is performed from the imaging timing control unit c23, the charge control unit c242 outputs the charge input from the light receiving charging unit c141 to the light emission charge accumulation unit c143. Further, when the background light charge accumulation control is performed from the imaging timing control unit c23, the charge control unit c242 outputs the charge input from the light receiving charging unit c141 to the background light charge accumulation unit c245.
On the other hand, when the discharge control is performed from the photographing timing control unit c23, the charge control unit c242 outputs the charge input from the light receiving charging unit c141 to the charge discharging unit c144.
Further, when the video storage control is performed from the photographing timing control unit c23, the charge control unit c242 causes the differential charge extraction unit c246 to output the charges accumulated in the light emission charge accumulation unit c143 and the background light charge accumulation unit c245. .

  The background photocharge storage unit c245 stores charges. Here, the charge accumulated in the background light charge accumulation unit c245 is a charge generated by natural environment light or background light from the lighting device B7 that always emits light.

The differential charge extraction unit c246 performs a process of subtracting the charge input from the background light charge storage unit c245 from the charge input from the light emission charge storage unit c143. That is, the differential charge extraction unit c246 emits light by subtracting the charge generated and accumulated by the background light from the charge generated and accumulated by the background light and the light of the lighting device b1 that emitted light at the light emission clock cycle number d1. Only the electric charge generated and accumulated by the light of the illuminating device b1 emitted at the clock cycle number d1 is extracted.
The differential charge extraction unit c246 outputs the charge subjected to the subtraction process to the video data generation unit c15.

Next, the hardware configuration of the storage unit c24-1 will be described. FIG. 16A is a configuration diagram illustrating a hardware configuration of the storage unit c24-1 according to the present embodiment.
When the storage unit c24-1 (FIG. 16A) according to the present embodiment is compared with the storage unit c14-1 (FIG. 7A) according to the first embodiment, the second distribution gate c2424, The background photocharge storage portion c245, the reset gate c2451, and the reset electrode c2452 are different. However, other components (light-receiving charging unit c141, charge accumulation unit c1421, distribution gate c1422 (referred to as the first distribution gate c1422 in this embodiment), drain gate c1423, light-emitting charge storage unit c143, reset gate c1431, reset Since the functions of the electrode c1432 and the charge discharging unit c144) are the same as those of the first embodiment, description of the same functions as those of the first embodiment is omitted.
Note that the charge accumulation unit c1421, the first distribution gate c1422, the drain gate c1423, and the second distribution gate c2424 correspond to the charge control unit c242.

The second distribution gate c2424 is supplied with a voltage when the background photocharge accumulation control is performed from the imaging timing control unit c23, and outputs the charges accumulated in the charge accumulation unit c1421 to the background photocharge accumulation unit c245. .
A voltage is applied to the reset electrode c2452, and, as will be described later, by opening the reset gate c2451, the reset process of the background photocharge storage unit c245 is performed.

FIG. 16B is a cross-sectional view of the storage unit c24-1 according to the present embodiment. FIG. 16B is a cross-sectional view taken along a broken line BB ′ from point B to point B ′ in FIG. When comparing the cross-sectional view of the storage unit c24-1 according to the present embodiment (FIG. 16B) and the cross-sectional view of the storage unit c14-1 according to the first embodiment (FIG. 7B), The two sort gates c2424, the background photocharge storage portion c245, the reset gate c2451, and the reset electrode c2452 are different. However, other components (P ⁺ type region c1401 and N type region c1402 (light receiving charging unit c141 and charge accumulating unit c1421), first distribution gate c1422, drain gate c1423, light emitting charge storage unit c143, reset gate c1431, Since the functions of the reset electrode c1432 and the charge discharging unit c144) are the same as those of the first embodiment, description of the same functions as those of the first embodiment is omitted. In addition, in FIG.16 (b), about the point of broken line AA 'of FIG.7 (b), it is the same as 1st Embodiment (FIG.7 (b)).

In this figure, the background photocharge accumulator c245 and the reset electrode c2452 hatched with diagonal lines are N ⁺ -type regions. The second distribution gate c2424 and the reset gate c2451 are gates having a MOS (Metal Oxide Semiconductor) structure.
The second distribution gate c2424 and the reset gate c2451 electrically connect the charge accumulation unit c1421 and the background photocharge accumulation unit c245, and the background photocharge accumulation unit c245 and the reset electrode c2452, respectively, by applying a voltage. Move the charge.

<About operation | movement of the synchronizer a1, the illuminating device b1, and the imaging device c2>
Hereinafter, operations of the synchronization device a1, the illumination device b1, and the imaging device c2 will be described.
FIG. 17 is an example of a time chart showing operations of the synchronization device A1, the illumination device B1, and the photographing device C1 of FIG. 1 according to the present embodiment. In this figure, the horizontal axis indicates time, and broken lines d1, d4, and d7 indicate the time points of the light emission clock cycle number “1”, the light emission clock cycle number “4”, and the light emission clock cycle number “7”, respectively.
Note that FIGS. 17A to 17C are the same time charts as FIGS. 8A to 8C, respectively, and thus description thereof is omitted.

FIG. 17D is a time chart showing the presence / absence of charge output for the second sorting gate c2424 (FIG. 16) of the photographing apparatus C1. In the vertical axis of this figure, “1” indicates that the second distribution gate c2424 outputs the charge of the charge accumulation unit c1421 to the background photocharge storage unit c245, and “0” indicates that the second distribution gate c2424 has the second distribution gate c2424. Indicates that no charge is output. The charges output from the second distribution gate c2424 to the background photocharge storage unit c245 are stored in the background photocharge storage unit c245.
This figure shows that the second distribution gate c2424 starts to output charges when the background light clock cycle number is “7” and outputs charges during one clock cycle.

FIG. 17E is a time chart showing the presence or absence of charge output for the drain gate c1423 (FIG. 7) of the photographing apparatus C1. In the vertical axis of this figure, “1” indicates that the drain gate c1423 outputs the charge of the charge accumulating portion c1421 to the charge discharging portion c144, and “0” indicates that the drain gate c1423 does not output the charge. Show. The charge output from the drain gate c1423 to the charge discharging unit c144 is discharged by the charge discharging unit c144.
This figure shows that when the drain gate c1423 has the light emission clock cycle number “1” and the background light clock cycle number “7”, the charge output is stopped and the charge output is stopped during one clock cycle. Indicates.

FIG. 18 is an example of a time chart showing operations of the synchronization device A1, the illumination device B2, and the imaging device C2 of FIG. 1 according to the present embodiment. In this figure, the horizontal axis indicates time, and broken lines d1, d4, and d7 indicate the time points of the light emission clock cycle number “1”, the light emission clock cycle number “4”, and the light emission clock cycle number “7”, respectively.
Note that FIGS. 18A to 18C are the same time charts as FIGS. 9A to 9C, respectively, and thus description thereof is omitted.

FIG. 18D is a time chart showing the presence / absence of charge output for the second sorting gate c2424 (FIG. 16) of the photographing apparatus C2. In the vertical axis of this figure, “1” indicates that the second distribution gate c2424 outputs the charge of the charge accumulation unit c1421 to the background photocharge storage unit c245, and “0” indicates that the second distribution gate c2424 has the second distribution gate c2424. Indicates that no charge is output. The charges output from the second distribution gate c2424 to the background photocharge storage unit c245 are stored in the background photocharge storage unit c245.
This figure shows that the second distribution gate c2424 starts to output charges when the background light clock cycle number is “7” and outputs charges during one clock cycle.

FIG. 18E is a time chart showing the presence / absence of charge output for the drain gate c1423 (FIG. 7) of the photographing apparatus C1. In the vertical axis of this figure, “1” indicates that the drain gate c1423 outputs the charge of the charge accumulating portion c1421 to the charge discharging portion c144, and “0” indicates that the drain gate c1423 does not output the charge. Show. The charge output from the drain gate c1423 to the charge discharging unit c144 is discharged by the charge discharging unit c144.
This figure shows that when the drain gate c1423 has the light emission clock cycle number “4” and the background light clock cycle number “7”, the charge output is stopped and the charge output is stopped during one clock cycle. Indicates.

FIG. 19 is a diagram illustrating an example of a temporal change in the potential state of the storage unit c24-1 (FIG. 16) according to the present embodiment. In this figure, time elapses in the order of (a) initial stage, (b) reset, (c) luminescent charge accumulation, (d) background photocharge accumulation, (e) luminescent charge accumulation, and (f) background photocharge accumulation. After that, the light emission charge accumulation and the background light charge accumulation are repeated N-3 times, that is, the light emission charge accumulation and the background light charge accumulation are performed N-1 times in the whole of FIG. Show. In this figure, the horizontal axis indicates the position along the broken line BB ′ in FIG. 16, and the vertical axis in each of FIGS. 19A to 19F indicates the potential.
FIG. 19 shows the reset electrode c1432, the reset gate c1431, the light-emitting charge storage unit c143, the first in order from the point B to the point B ′ (horizontal axis) at the respective times shown in FIGS. 1 shows potentials of one sort gate c1422, charge accumulation unit c1421, light receiving charging unit c141, charge accumulation unit c1421, second sort gate c2424, background photocharge accumulation unit c245, reset gate c2451, and reset electrode c2452.

  FIG. 19A shows an initial potential state in which nothing is controlled by the storage unit c24-1. FIG. 19B shows that the reset gate c1431, the reset gate c2451, the first distribution gate c1422, the second distribution gate c2424, and the drain gate c1423 are opened in a state where a voltage is applied to the reset electrode c1432 and the reset electrode c2452. The reset gate c1431, the reset gate c2451, the first distribution gate c1422, the second distribution gate c2424, and the drain gate c1423 are lowered, and the light emission charge storage unit c143 and the background photocharge storage unit c245 are reset. Indicates the state.

  FIG. 19C shows a state in which the potential of the first distribution gate c1422 is lowered during the first light emission time (for example, the time of the light emission clock cycle number “1” in period 0 in FIG. 17). This figure shows that the charge generated by the light-receiving charging unit c141 hatched by shading is accumulated in the light-emission charge accumulating unit c143 via the charge accumulating unit c1421.

  FIG. 19D shows a state in which the potential of the second distribution gate c2424 is lowered during the first background light time (for example, the time of the light emission clock cycle number “7” in period 0 in FIG. 17). This figure shows that the charge generated by the light receiving and charging unit c141 hatched with diagonal lines is accumulated in the background light charge accumulation unit c245 via the charge accumulation unit c1421.

  FIG. 19E shows a state in which the potential of the first distribution gate c1422 is lowered during the second light emission time (for example, the time of the light emission clock cycle number “1” in period 1 in FIG. 17). This figure is the same state as the state of FIG. FIG. 19F shows a state in which the potential of the second distribution gate c2424 is lowered during the second background light time (for example, the time of the light emission clock cycle number “7” in period 1 in FIG. 17). This figure is the same state as the state of FIG.

  FIG. 20 is an example of a flowchart illustrating operations of the imaging timing control unit c23 and the storage unit c24-1 according to the present embodiment. Note that an example of a flowchart showing operations of the synchronization device a1 and the illumination device b1 and an example of a flowchart showing operations of the synchronization device a1 and the imaging device c2 according to the present embodiment are the same as those in FIGS. 11 and 12, respectively. Therefore, the description is omitted.

  A flowchart (FIG. 20) showing operations of the shooting timing control unit c23 and the storage unit c24-1 according to the present embodiment, and a flowchart showing operations of the shooting timing control unit c13 and the storage unit c24-1 according to the first embodiment. Compared with FIG. 13, the processes of S400 to S407 are different. However, since other processes (the processes of S301 to S309 and S312) are the same as those in the first embodiment, the description of the same processes as those in the first embodiment will be omitted.

(Step S400) The accumulation unit c24-1 performs a process of subtracting the charge accumulated in the background light charge accumulation unit c245 from the charge accumulated in the light emission charge accumulation unit c143 in FIG.

(Step S401) The imaging timing control unit c23 determines whether the clock cycle number d, which is the remainder obtained by dividing the clock number D by the period number F, is equal to the background light clock cycle number d2 corresponding to the illumination device name “none”. Determine whether or not. When the imaging timing control unit c23 determines that the clock cycle number d is equal to the background light clock cycle number d2, the process proceeds to step S402. On the other hand, if the photographing timing control unit c23 determines that the clock cycle number d is not equal to the background light clock cycle number d2, the process proceeds to step S405.

(Step S402) The accumulation unit c24-1 closes the drain gate c1423 of FIG. Thereafter, the process proceeds to step S403.
(Step S403) The accumulation unit c24-1 opens the second distribution gate c2424 in FIG. 16, and outputs charges to the background photocharge accumulation unit c245. Thereafter, the process proceeds to step S404.
(Step S404) The storage unit c24-1 stores the charge output to the background light charge storage unit c245 via the second distribution gate c2424. Thereafter, the process proceeds to step S312.

(Step S405) The accumulation unit c24-1 closes the second sorting gate c2424 in FIG. Thereafter, the process proceeds to step S406.
(Step S406) The storage unit c24-1 opens the drain gate c1423 of FIG. 16 and outputs the charge to the charge discharging unit c144. Thereafter, the process proceeds to step S407.

(Step S407) The storage unit c24-1 discharges the charge output to the charge discharging unit c144 via the drain gate c1423. Thereafter, the process proceeds to step S312.

As described above, according to the present embodiment, the imaging system generates a charge by the light received by the light receiving charging unit c141 of the imaging device c2, and the light emitting charge accumulation unit c143 out of the charges generated by the light receiving charging unit c141. Only a charge generated within a predetermined light emission time of at least one illumination device b1 is accumulated, and the background photocharge storage unit c245 is a time other than the light emission time of the illumination device b1 and a predetermined time. Only charges generated during light time are stored.
As a result, the imaging system allows the background light charge accumulation unit c245 to generate natural environment light from the image generated from the charge generated from the light illuminated by the illumination of the at least one illumination device b1 that is determined in advance. The image generated from the background light such as the above can be removed, and an image captured using only the illumination of at least one predetermined illumination device b1 can be provided.

Further, according to the present embodiment, in the photographing system, the light emission timing control unit b11 of the plurality of illumination devices B1 to B6 does not perform control to emit light during the background light time that is a predetermined time, and performs a plurality of photographing. Each of the background light charge accumulating units c245 of the devices C1 to C3 accumulates the charges generated during the background light time among the charges generated by the light receiving charging unit c141.
As a result, the photographing system ensures more time to be used as the light emission time compared to the case where the background light time for receiving the background light such as natural environment light is different in each of the plurality of photographing devices C1 to C3. Therefore, there is an effect that photographing can be performed using a larger number of photographing devices or lighting devices.

Further, according to the present embodiment, in the photographing system, the charge discharging unit c144 of the photographing device c2 discharges the charge generated at a time other than the light emission time and the background light time among the charges generated by the light receiving charging unit c141. .
As a result, the imaging system accumulates only the charges generated by the light received during the light emission time and the background light time, and discharges the charges generated by the light received during times other than the light emission time and the background light time. The storage capacity of the storage units c24-1 to c24-m can be reduced.

<Modification>
Hereinafter, modifications of the hardware configuration of the storage unit will be described. In this modification, a case will be described in which the storage unit includes four fine light receiving and charging units, and the width of the light receiving and charging unit is narrower than that of the second embodiment (FIG. 16A).

FIG. 21 is a configuration diagram illustrating a modification of the hardware configuration of the storage unit c34-1 according to the present embodiment.
When the storage unit c34-1 (FIG. 21) according to the present embodiment is compared with the storage unit c24-1 (FIG. 16A) according to the second embodiment, the light receiving charging units c341-1 to c341-4 are compared. And transfer gates c3411-1 to c3411-4 are different. However, other components (charge accumulation unit c1421, first distribution gate c1422, drain gate c1423, second distribution gate c2424, light-emitting charge storage unit c143, reset gate c1431, reset electrode c1432, charge discharge unit c144, background The functions of the photocharge storage unit c245, the reset gate c2451, and the reset electrode c2452) are the same as those of the second embodiment, and thus the description of the same functions as those of the second embodiment is omitted.

  The light receiving and charging units c341-1 to c 341-4 are embedded photodiodes. The light receiving charging units c341-1 to c 341-4 are connected to the charge accumulation unit c 1421 via transfer gates c 3411-1 to c 3411-4, respectively.

  Here, the light receiving charging sections c341-1 to c 341-4 are fine embedded photodiodes as compared with the light receiving charging section c 141 (FIG. 16A) in the second embodiment. For example, the light receiving charging units c341-1 to c 341-4 divide the light receiving charging unit c 141 into four parts, and make each of the divided parts U-shaped to increase the width of each of the light receiving charging units c 341-1 to c 341-4. Thinly processed. Note that the width of the charge accumulation unit c1421 connected to the light receiving and charging units c341-1 to c341-4 is the same as that of the second embodiment.

  The transfer gates c3411-1 to c3411-4 are opened at the same time as the first distribution gate c1422 or the second distribution gate c2424 is opened, and after the charge is output, the first distribution gate c1422 or the second distribution gate c2424 is closed. Close before.

Thus, in this modification, the width of the light receiving charging portions c341-1 to c 341-4 is reduced by providing the fine light receiving charging portions c 341-1 to c 341-4. As a result, a potential difference is generated between each of the charge accumulation unit c1421 and each of the light receiving charging units c341-1 to c341-4. To c341-4 move to the charge accumulating unit c1421. Further, in this case, compared to the second embodiment, the potential gradient becomes steep and the movement of charges can be accelerated.
In the present modification, the accumulating unit c34-1 generates charges in each of a plurality (four) of the light receiving charging units c341-1 to c341-4 and accumulates the charges. The sensitivity of the video can be improved as compared with the case of generating.

In the second embodiment, the photographing system may repeat the light emission time and the background light time alternately.
Thereby, the photographing system can accumulate charges generated from background light such as natural environment light in the background light time close to the light emission time, and even when the background light such as natural environment light changes over time, The image generated from the charge charged by the background light close to the background light used for the image is removed from the image generated from the charge accumulated by the light emitting charge storage unit c143, and an accurate image can be taken. is there.

In each of the above embodiments, the synchronization device A1 may be included in the illumination device b1 or the imaging devices c1 and c2.
Further, in each of the above embodiments, the imaging devices c1 and c2 accumulate charges in the emission charge accumulation unit c143 at the same time as the emission time of the predetermined illumination device b1, but the present invention is not limited to this. For example, the charge may be accumulated in the light emission charge accumulation unit c143 in a time shorter than one clock cycle in one light emission time.
In each of the above embodiments, the imaging devices c1 and c2 start accumulating charges in the light emission charge accumulating unit c143 simultaneously with the start of the light emission time of the predetermined illumination device b1, but the predetermined illumination device b1. After a sufficient amount of time has elapsed for the light receiving and charging unit c141 to generate charges by the illumination light of the illumination device b1, the storage of the charges in the light emitting charge storage unit c143 may be started.

  Note that some of the synchronization device a1, the illumination device b1, and the imaging devices c1 and c2 in the above-described embodiment, for example, the clock signal generation unit a11, the light emission time transmission unit a13, the light emission timing control unit b11, the imaging timing control unit c13, c23 and the video data generation unit c15 may be realized by a computer. In that case, the program for realizing the control function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by a computer system and executed. Here, the “computer system” is a computer system built in the synchronization device a1, the illumination device b1, and the photographing devices c1 and c2, and includes hardware such as an OS and peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” is a medium that dynamically holds a program for a short time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, In such a case, a volatile memory inside a computer system serving as a server or a client may be included and a program that holds a program for a certain period of time. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  As described above, the embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to the above, and various design changes and the like can be made without departing from the scope of the present invention. It is possible to

1 is a conceptual diagram illustrating a photographing system according to a first embodiment of the present invention. It is a schematic block diagram which shows the structure of the synchronizer which concerns on this embodiment. It is a time chart for demonstrating the clock signal which concerns on this embodiment. It is the schematic which shows an example of the light emission time information file which concerns on this embodiment. It is a schematic block diagram which shows the structure of the illuminating device which concerns on this embodiment. It is a schematic block diagram which shows the structure of the imaging device which concerns on this embodiment. It is a block diagram which shows the hardware constitutions of the storage part which concerns on this embodiment. It is an example of the time chart which shows operation | movement of the synchronizer which concerns on this embodiment, an illuminating device, and an imaging device. It is another example of the time chart which shows operation | movement of the synchronizer which concerns on this embodiment, an illuminating device, and an imaging device. It is a figure which shows an example of the time change of the potential state of the storage part which concerns on this embodiment. It is an example of the flowchart which shows operation | movement of the synchronizing device which concerns on this embodiment, and an illuminating device. It is an example of the flowchart which shows operation | movement of the synchronizing device which concerns on this embodiment, and an imaging device. It is an example of the flowchart which shows operation | movement of the imaging | photography timing control part and storage part which concern on this embodiment. It is the schematic which shows an example of the light emission time information file which concerns on 2nd Embodiment of this invention. It is a schematic block diagram which shows the structure of the imaging device c2 which concerns on this embodiment. It is a block diagram which shows the hardware constitutions of the storage part which concerns on this embodiment. It is an example of the time chart which shows operation | movement of the synchronizer which concerns on this embodiment, an illuminating device, and an imaging device. It is another example of the time chart which shows operation | movement of the synchronizer which concerns on this embodiment, an illuminating device, and an imaging device. It is a figure which shows an example of the time change of the potential state of the storage part which concerns on this embodiment. It is an example of the flowchart which shows operation | movement of the imaging | photography timing control part and storage part which concern on this embodiment. It is a block diagram which shows the modification of the hardware constitutions of the storage part which concerns on this embodiment. It is a conceptual diagram which shows the conventional imaging | photography system.

Explanation of symbols

A1, a1 ... synchronization device, B1-B7, b1 ... illumination device, C1-C3, c1, c2 ... photographing device a11 ... clock signal generation unit, a12 ... light emission time storage unit, a13: Light emission time transmission unit b11 ... Light emission timing control unit, b12 ... Light emission unit c11 ... Optical unit, c12 ... Lighting device information storage unit, c13, c23 ... Imaging timing control unit , C14-1 to c14-m, c24-1 to c24-m, c34-1 ... accumulation unit, c15 ... video data generation unit, c16 ... video data storage unit, c141, c341-1 c341-4... light receiving charging unit, c3411-1 to c3411-4... transfer gate, c142, c242... charge control unit, c143... light emission charge accumulating unit, c144. c245 ... Background photocharge storage unit, c246 ... differential charge extraction unit, c1421 ... charge accumulation unit, c1422 ... first distribution gate, c1423 ... drain gate, c2424 ... second distribution gate, c1431 ... reset gate, c1432 ... reset electrode, c1401 ... P ⁺ type region, c1402 ... N type region, c149 ... light shielding curtain, c2451 ... reset gate, c2452 ... reset electrode

Claims (9)

In a photographing system comprising a plurality of lighting devices and a photographing device for photographing a moving image,
The lighting device includes:
A light emission timing control unit that performs control to emit light every predetermined light emission time of the device,
The imaging device
An imaging timing control unit that performs control to perform the imaging within a predetermined light emission time of the illumination device ; and
A light-receiving charging unit that generates a charge by the received light;
Among the charges generated by the light-receiving charging unit, a light-emitting charge storage unit that stores only the charge generated within the light emission time of the at least one lighting device;
An imaging system comprising: In a photographing system comprising a plurality of lighting devices and a plurality of photographing devices for photographing moving images,
The first illumination device includes:
A first light emission timing control unit that performs control to emit light for each light emission time of the first lighting device determined in advance;
The second illumination device includes:
A second light emission timing control unit configured to perform light emission for each light emission time of the second lighting device that is determined in advance;
The first imaging device includes:
A first imaging timing control unit that performs control to perform the imaging within a predetermined light emission time of the first illumination device ;
A first light receiving and charging unit that generates a charge by the received light;
Among the charges generated by the first light receiving and charging unit, a light emitting charge storage unit that stores only the charge generated within the light emission time of the first lighting device ;
With
The second imaging device comprises:
A second imaging timing control unit that performs control to perform the imaging within a predetermined light emission time of the second illumination device ;
A second light receiving and charging unit that generates a charge by the received light;
A light-emitting charge accumulating unit that accumulates only the charge generated within the light emission time of the second illumination device among the charges generated by the second light-receiving charging unit ;
With
Imaging system and the light emission timing of the first of the lighting device and the light emission timing of the second of the lighting device are different from each other. Among the charges generated by the light receiving and charging unit, a background light charge accumulation unit that accumulates only the charge generated during the background light time that is a predetermined time other than the light emission time of the illumination device;
The imaging system according to claim 1 , further comprising: The imaging system according to claim 3 , wherein the light emission time and the background light time are alternately repeated. The imaging system according to claim 3 , further comprising a charge discharging unit that discharges a charge generated at a time other than the light emission time and the background light time among the charges generated by the light receiving charging unit. The photographing system includes a plurality of the photographing devices,
The light emission timing control unit of the plurality of lighting devices does not perform control to emit light in the background light time that is a predetermined time,
4. The photographing system according to claim 3 , wherein each of the background light charge accumulation units of the plurality of photographing devices accumulates a charge generated during the background light time among the charges generated by the light receiving charging unit. The imaging apparatus includes a video data generation unit that generates video data using charges accumulated by the light-emission charge accumulation unit during a video accumulation time including a plurality of light emission times of at least one lighting device that is determined in advance. The imaging system according to claim 1 or 2 . In an imaging device that captures a moving image using illumination of a plurality of illumination devices that perform control to emit light at each predetermined emission time of the device,
An imaging timing control unit that performs control to perform the imaging within a predetermined light emission time of the illumination device ; and
A light-receiving charging unit that generates a charge by the received light;
A light-emitting charge accumulating unit that accumulates only the charge generated within the light emission time of the predetermined at least one lighting device among the charges generated by the light-receiving charging unit;
An imaging apparatus comprising: A computer of a photographing device that shoots a moving image using illumination of a plurality of lighting devices that performs control to emit light every light emission time of the device itself,
Photographing timing control means for controlling the photographing within the light emission time of at least one of the lighting devices determined in advance ;
A light emitting charge accumulating means for accumulating only a charge generated within a light emitting time of the predetermined at least one lighting device among the charges generated by the received light;
Shooting control program to function as.

Images