JP4701709B2 - Projection system and additional information recording method used in the system - Google Patents

Description

  The present invention relates to a projection system that projects an arbitrary image on a screen such as a whiteboard, and in particular, a projection system suitable for use when storing information added to a projected image on a screen by handwriting or the like. The present invention relates to an additional information recording method used in this system.

  For example, when a presentation such as an explanation of product planning is given, the document information for presentation is transferred from a personal computer (hereinafter referred to as a PC) to a projection device (projector), and is projected on a screen. Is generally done.

  Here, when a whiteboard or the like is used as a screen, supplementary explanations and the like are often added to the image projected thereon by handwriting as necessary. When information added by handwriting (hereinafter referred to as additional information) is stored for reference, it is conceivable that the additional information is photographed with a digital camera, for example. However, in the method of simply capturing and storing additional information, when the captured image is confirmed later, it is not possible to know which document information (projected image) was written, and There is also the inconvenience that the user has to shoot with the camera each time.

Conventionally, in order to solve such a problem, a digital camera is integrated into the projector so that a screen in a document projection state and a screen in a non-projection state can be individually photographed, and two types of images obtained by the photographing, that is, It is considered that the “captured image of document information including additional information” and the “captured image of only additional information” are stored in association with each other (see, for example, Patent Document 1).
JP 2004-199299 A

  However, in the device in which the projector and the digital camera as described above are integrated, the cost is higher than the configuration of a normal projector alone, and the digital camera incorporated therein cannot be used alone, This is very inconvenient for the user.

  In addition, document information which is a projected image on the screen and additional information written therein are stored as a photographed image by the camera, which makes it very difficult to see.

The present invention has been made in view of the problems as described above, to allow shoot the added information to the projected image on the screen may have been saved in association with the captured image to the projection image It is an object to provide a projection system and an additional information recording method.

A projection system according to a first aspect of the present invention is a projection system including a projection device that projects an image according to input information onto a screen, and an imaging device connected to the projection device, in the timing, a projection control unit that the projected image displayed on the screen by the projection device and a non-display state, when a non-display state projected image on the screen by the projection control means, the screen A frame display means for displaying a frame in a range where the projection image is displayed; a detection means for detecting the frame displayed by the frame display means; and a frame detected by the detection means. and matching control means for performing processing to match the shooting range, on the screen when a non-display state projected image on the screen by the projection control means And imaging control means for controlling the photographing operation of the imaging device as the additional information Tsu by the matching control means for photographing in a state in which processing has been to match the imaging range of the imaging device, wherein the last shooting by the imaging device Projection image acquisition means for acquiring a projection image displayed on the screen; and recording means for recording the projection image obtained by the projection image acquisition means in association with the photographed image obtained by the photographing control means. It is provided and configured.

  According to a second aspect of the present invention, in the projection system according to the first aspect, the projection device and the imaging device are connected by predetermined wireless communication.

  According to a third aspect of the present invention, in the projection system according to the first aspect, the projection control unit is configured to display a projected image on the screen when a shutter key provided in the imaging device is pressed. It is characterized by being in a display state.

According to a fourth aspect of the present invention, in the projection system according to the first aspect, the match control unit performs zoom control so as to match a photographing range of the photographing apparatus with a frame detected by the detecting unit. characterized in that it is a control means.

  According to a fifth aspect of the present invention, in the projection system according to the first aspect, first identification code adding means for adding an identification code to the projection image obtained by the projection image acquiring means, and the photographing control means. And a second identification code adding means for adding an identification code to the captured image obtained by the step, wherein the recording means includes the identification code added to the projection image by the first code adding means and the second code. The projection image and the captured image are recorded in association with each other based on the identification code added to the captured image by the adding means.

According to a sixth aspect of the present invention, in the projection system according to the first aspect, a synthesizing unit for synthesizing the projection image obtained by the projection image obtaining unit and the photographed image obtained by the photographing control unit. further characterized in that obtaining Bei.
According to a seventh aspect of the present invention, in the projection system according to the sixth aspect, the image processing apparatus further includes a composite display unit that displays the image combined by the combining unit.
According to an eighth aspect of the present invention, in the projection system according to the sixth aspect, the recording unit records the synthesized image generated by the synthesizing unit.

According to a ninth aspect of the present invention, there is provided a projection system comprising: a projection device that projects an image according to input information on a screen; and an imaging device connected to the projection device. A method for recording additional information used, wherein the projection image displayed on the screen by the projection device is in a non-display state at a predetermined timing, and the projection image on the screen is in a non-display state. In addition, a step of displaying a frame in a range where the projection image on the screen has been displayed, a step of detecting the displayed frame, and a step of performing a process of adjusting the shooting range of the photographing apparatus to the detected frame If, like the process of matching the imaging range of the imaging apparatus remaining additional information on the screen when the projected image on the screen and the non-display state is Wherein in the step of controlling the imaging operation of the imaging device to capture, obtaining a projected image displayed on the screen immediately before photographing of the image pickup device, a photographing immediately before the projected image by the imaging device And a step of associating with a photographed image obtained by photographing with an imaging device and recording it in a predetermined memory.

According to the present invention, upon the addition of a pressurized information with hands to the image projected on a screen by the projection device, taken using an imaging apparatus that additional information, the captured image to the projection image It can be stored in association .

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a diagram schematically showing a configuration of a projection system according to an embodiment of the present invention. This projection system includes, for example, a projector 11 used for projection of document information for the presentation, a general-purpose personal computer (hereinafter referred to as a PC) 12, and a digital camera 13 used as an imaging device. Prepare.

  The projector 11 is connected to the PC 12 via an RGB cable 14 and a USB (Universal Serial Bus) cable 15, and projects and displays an image corresponding to the projection target data transferred from the PC 12 on the screen 16. In this case, as the screen 16, a screen that can be easily written by handwriting on the image projection surface, such as a white boat, is used.

  Further, the projector 11 and the digital camera 13 are connected to each other by a connecting means 17 so that data communication is possible. As the connection means 17, for example, wireless communication such as IEEE802.11a or IEEE802.11b standard wireless LAN or Bluetooth (registered trademark) is used. IEEE802.11a is a wireless LAN standard with a communication speed of 54 Mbps using 5 GHz band radio waves. IEEE802.11b is a wireless LAN standard using a 2.4 GHz band radio wave and having a communication speed of 11 Mbps. Bluetooth (registered trademark) is a wireless interface conforming to a short-range wireless communication standard, and realizes wireless communication of about 10 m using a radio wave of 2.4 GHz ISM (Industrial Scientific Medical) band. is there.

  2A and 2B are diagrams showing an example of the projector 11 used in the present system. FIG. 2A is a perspective view when viewed from above, and FIG. 2B is a perspective view when viewed from below.

  As shown in FIG. 2A, the projector 11 is provided with a projection lens 21, two phase difference sensors 23 a and 23 b, and an Ir receiver 24 on the front surface of a rectangular parallelepiped main body casing 21.

  The projection lens 22 is for projecting a light image formed by a spatial light modulation element such as a micromirror element. Here, the in-focus position and the zoom position (projection angle of view) can be arbitrarily changed. To do. The phase difference sensors 23a and 23b measure the distance to the subject, specifically the distance to the image projection plane, based on the principle of triangulation from the parallax with respect to the subject image. The Ir receiver 24 receives infrared light on which a key operation signal from a remote controller (not shown) is superimposed.

  A main body main key / indicator 25 having various operation keys, a speaker 26 and a cover 27 are disposed on the upper surface of the main body casing 21. The speaker 26 amplifies and outputs a sound during reproduction of a moving image. The cover 27 opens and closes when a subkey (not shown) is operated. The sub key operates various detailed operations and the like that cannot be set by the operation keys on the main body main key / indicator 25.

  Further, as shown in FIG. 2B, an input / output connector portion 28, an Ir receiving portion 29, and an AC adapter connecting portion 30 are disposed on the back surface of the main body casing 21.

  The input / output connector unit 28 includes, for example, an RGB terminal for image input, an S terminal, an RCA terminal, a stereo mini terminal for audio input, and the like in addition to a USB terminal for connection to an external device such as a personal computer. Similar to the Ir receiver 24, the Ir receiver 29 receives infrared light on which key operation signals from a remote controller (not shown) are superimposed. The AC adapter connection unit 30 connects a cable from an AC adapter (not shown) serving as a power source.

  In addition, a pair of fixed leg portions 31 a and 31 b are attached to the lower surface of the main body casing 21 on the back surface side, and an adjustment leg portion 32 capable of height adjustment is attached to the front surface side. The adjustment leg 32 manually adjusts the vertical component of the projection direction of the projection lens 22, that is, the elevation angle, by manually operating the screw rotation position.

  FIG. 3 is a block diagram showing a schematic circuit configuration of the projector 11 and the PC 12 used in this system.

  The projector 11 includes a CPU 41, a ROM 42, a RAM 43, an image input unit 44, a projection unit 45, a signal receiving unit 46, a distance measuring unit 47, a key input unit 48, and the like, and here, a wireless unit 49 is built therein. Further, the projector 11 is provided with a terminal 14 a for connecting the RGB cable 14 and a terminal 15 a for connecting the USB cable 15.

  The CPU 41 controls the projector 11 as a whole, reads a program stored in the ROM 42 or the like, and executes various processes including an image projection process. The ROM 42 stores various data including a program for starting the CPU 41. The RAM 43 is used as a work memory.

  The image input unit 44 performs predetermined input processing such as converting image data (RGB data) to be projected output from the PC 12 into a format corresponding to the projector 11. The image data input by the image input unit 44 is projected onto the screen 16 shown in FIG.

  The projection unit 45 includes a light source such as a krypton lamp, an image conversion element for converting the light from the light source into projection light, a drive circuit that drives the image conversion element in accordance with RGB signals, and FIG. The image data for projection output from the PC 12 is projected onto the screen 16 through the optical system. As the image conversion element, a liquid crystal, a micromirror array, or the like is used.

  The signal receiving unit 46 includes the Ir receiving units 24 and 29 shown in FIG. 1 and receives a key operation signal from a remote controller (not shown). The distance measuring unit 47 includes the phase difference sensors 23 a and 23 b shown in FIG. 1 and measures the distance to the screen 16. The key input unit 48 includes various keys for the user to operate the projector 11, and specifically includes the main body main key / indicator 25 illustrated in FIG. 1 and a sub key (not illustrated).

  The wireless unit 49 is for transmitting and receiving data to and from the digital camera 13, and under the control of the CPU 41, wireless communication processing corresponding to the connection means 17, specifically, IEEE802.11a and IEEE802.11b standards. Wireless communication processing corresponding to wireless LAN and Bluetooth (registered trademark).

  On the other hand, the PC 12 includes a CPU 51, a ROM 52, a RAM 53, a video adapter 54, a VRAM 55, a display unit 56, a key input unit 57, a storage unit 58, and the like. Further, the PC 12 is provided with a terminal 14b for connecting the RGB cable 14 and a terminal 15b for connecting the USB cable 15.

  The CPU 51 controls the entire PC 12, reads a program stored in the ROM 52 or the like, and executes various processes including an image transfer process. The ROM 52 stores various data including a program for starting the CPU 51. The RAM 53 is used as a work memory.

  The video adapter 55 converts the image data stored in the storage unit 58 or the like into RGB data and develops it in the VRAM 55, displays it on the display unit 56, or transfers it to the projector 11 via the RGB cable 14. . The display unit 56 includes a display device such as an LCD (Liquid Crystal Display), and displays various data including image data. The key input unit 57 includes a keyboard provided in the main body, a mouse connected to the main body, and the like, and inputs and instructs various data. The storage unit 58 includes a storage device having a relatively large capacity, such as a hard disk device, and is used for storing image data.

  FIG. 4 is a block diagram showing an electronic circuit configuration of the digital camera 13 used in the present system.

  In the digital camera 13, a lens optical system 62 including a photographing lens is provided so as to be movable within a predetermined range in the optical axis direction by driving a motor 61, and a CCD (charge) as an imaging device is provided behind the optical axis. A coupled device) 63 is provided. The CCD 63 receives light from each part of the subject input through the photographing lens and outputs an electric signal corresponding to the intensity of the light.

  In the recording mode, which is the basic mode, the CCD 63 is scanned and driven by a timing generator (TG) 64 and a driver 65, and outputs a photoelectric conversion output corresponding to a light image formed at regular intervals for one screen. The photoelectric conversion output of the CCD 63 is appropriately gain-adjusted for each primary color component of RGB in the state of an analog value signal, sampled and held by a sample hold circuit 66, and converted into digital data by an A / D converter 67. The

  Then, the color process circuit 68 performs image processing including pixel interpolation processing and γ correction processing to generate a luminance signal Y and color difference signals U and V (Cb, Cr) as digital values, and DMA (Direct Memory Access). ) Output to the controller 69.

  The DMA controller 69 once uses the luminance signal Y and the color difference signals U and V output from the color process circuit 68 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 68 once. And the DMA transfer to the DRAM 71 used as a buffer memory via the DRAM interface (I / F) 70.

  The control unit 72 controls the entire digital camera 13 and is configured by a microcomputer including a CPU, a ROM storing an operation program executed by the CPU, a RAM used as a work memory, and the like. . The controller 72 reads out the luminance and color difference signals from the DRAM 71 via the DRAM interface 70 and writes them into the VRAM 74 via the VRAM controller 73 after the DMA transfer of the luminance and color difference signals to the DRAM 71 is completed.

  The digital video encoder 75 periodically reads the luminance and color difference signals from the VRAM 74 via the VRAM controller 73, generates a video signal based on these data, and outputs the video signal to the display unit 79.

  The display unit 79 functions as a monitor display unit (electronic finder) at the time of shooting, and performs display based on the video signal from the digital video encoder 75, so that an image captured from the VRAM controller 73 at that time is displayed. An image based on the information is displayed in real time.

  In this way, when the image at that time is displayed in real time as a monitor image on the display unit 79, for example, when the shutter key 76a is pressed at a timing when it is desired to take a still image, a trigger signal is generated.

  In response to the trigger signal, the control unit 72 immediately stops the path from the CCD 63 to the DRAM 71 immediately after the DMA transfer of the luminance and color difference signals for one screen captured from the CCD 63 to the DRAM 71 is completed. , Transition to the record storage state.

  In this recording and storage state, the control unit 72 outputs the luminance and color difference signals for one frame written in the DRAM 71 to each of Y, Cb, and Cr components of 8 pixels × 8 pixels horizontally via the DRAM interface 70. The data is read out in units called basic blocks, written in a JPEG (Joint Photographic Coding Experts Group) circuit 77, and this JPEG circuit 77 uses ADCT (Adaptive Discrete Cosine Transform), which is an entropy coding system. Data compression is performed by processing such as conversion.

  The obtained code data is read out from the JPEG circuit 77 as a data file of one image and written in the memory 78 for recording. The memory 78 includes, in addition to an internal memory such as a flash memory built in the main body in advance, a memory card that is detachably mounted as a recording medium. With the compression processing of the luminance and color difference signals for one frame and the completion of writing all the compressed data to the memory 78, the control unit 72 activates the path from the CCD 63 to the DRAM 71 again.

  The control unit 72 is further connected with a USB interface (I / F) 80, a strobe driving unit 81, and a wireless unit 83.

  The USB interface 80 performs communication control when image data and other information are transmitted / received to / from another information terminal device such as a personal computer connected via a USB connector. A strobe drive unit 81 charges a strobe capacitor (not shown) at the time of photographing, and then drives the strobe light emitting unit 82 to flash based on control from the control unit 72.

  The wireless unit 83 is for realizing the connection unit 17 with the projector 11 and performs predetermined wireless communication processing with the wireless unit 49 provided on the projector 11 side.

  In addition to the shutter key 76a, the key input unit 76 includes, for example, a power key, a shooting mode key, a playback mode key, a strobe key, a menu key, a zoom key, and the like. It is sent to the control unit 72.

  When shooting a moving image instead of a still image, when the shutter key 76a is pressed, the above-described JPEG circuit 77 compresses the captured moving image using a technique such as motion-JPEG (Joint Photographic Experts Group). To the memory 78. When the shutter key 76a is operated again, the recording of the moving image data is ended.

  On the other hand, in the playback mode which is the basic mode, the control unit 72 selectively reads out the image data recorded in the memory 78, and is compressed by a procedure completely opposite to the procedure in which data is compressed in the recording mode by the JPEG circuit 77. Decompress image data. The decompressed image data is held in the DRAM 71 via the DRAM interface 70, and then the content held in the DRAM 71 is stored in the VRAM 74 via the VRAM controller 73. The image data is periodically read out from the VRAM 74. A video signal is generated and reproduced and output by the display unit 79.

  If the selected image data is not a still image but a moving image, the multiple frames of still image data that make up the moving image data are played back and displayed sequentially in chronological order, and all the still image data is played back. For example, the top still image data is displayed until the next playback instruction is given.

  Next, the operation of this system will be described.

  FIG. 5 is a flowchart showing the operation of this system, which is divided into processing on the digital camera 13 side and processing on the PC 12 side. The PC 12 and the projector 11 constituting this system are connected by a communication cable, and the projector 11 and the digital camera 13 are connected by a wireless LAN or the like (see FIG. 3). Therefore, data exchange between the PC 12 and the digital camera 13 is actually performed through the projector 11. That is, when data is transferred from the digital camera 13 to the PC 12, the data is once transferred from the digital camera 13 to the projector 11 and then sent from the projector 11 to the PC 12. The same applies when data is transferred from the PC 12 to the digital camera 13.

  It is assumed that document information (including characters, symbols, graphs, etc.) for the presentation is stored in the storage unit 58 in the PC 12 when performing a presentation. Image data corresponding to the document information is input to the projector 11 as projection data, and is projected and displayed on the screen 16 installed in front of the projector 11. In addition, since the projection process by the projector 11 is not directly related here, the detailed description is abbreviate | omitted.

  Here, as shown in FIG. 1, it is assumed that a whiteboard is used as the screen 16 and additional information is written on the image projected on the screen 16 by handwriting or the like. The additional information referred to here includes information pasted using, for example, sticky notes, in addition to information directly written on the screen 16 by handwriting or the like. In FIG. 1, S1 indicates a projected image (presentation image data), and S2 to S4 indicate additional information of the presenter.

  When the user depresses the shutter key 76a of the digital camera 13 with the digital camera 13 facing the image projection surface of the screen 16 (Yes in step A11), information indicating that the shutter key 76a has been depressed (hereinafter, referred to as “the shutter key 76a”). (Referred to as shutter pressing information) is transferred to the PC 12 (step A12). Specifically, shutter pressing information is transmitted from the digital camera 13 to the projector 11 by wireless communication, and the projector 11 that has received this information transfers it to the PC 12 via the USB cable 15.

  On the PC 12 side, when shutter pressing information is received from the digital camera 13 (step B11), first, the projection image S1 projected on the screen 16 at that time is temporarily held in the VRAM 55 (step B12), and the projection image S1. An identification code is added to the header information (step B13). This identification code consists of a unique code for several bits.

  FIG. 6 shows an example of the projection image S1. When shutter pressing information is sent from the digital camera 13, the PC 12 adds an identification code such as “00A1” to the header information of the projection image S 1 and holds it in the VRAM 55.

  Next, the PC 12 controls the projection operation of the projector 11 so that the projection image S1 on the screen 16 is not displayed (step B14). Then, the PC 12 displays a rectangular frame T as shown by the dotted line in FIG. 1 in the range where the projection image S1 on the screen 16 was displayed (step B15), and then digitally notifies the completion of the frame display. This is sent to the camera 13 (step B16). Also in this case, in detail, a frame display completion notification is sent from the PC 12 to the projector 11 via the USB cable 15, and then transferred from the projector 11 to the digital camera 13 by wireless communication.

  When the digital camera 13 receives a frame display completion notification from the PC 12 (Yes in step A13), the digital camera 13 performs a process of matching the shooting range with the frame T displayed on the screen 16 (step A14), and displays the shooting range and frame display. If they match (Yes in Step A15), the photographing process is executed (Step A16).

  Specifically, the digital camera 13 detects the range of the rectangular frame T based on the color of the frame T displayed on the screen 16 or the difference in contrast, and the rectangular shape drawn on the through screen of the display unit 79. The angle of view is adjusted by performing zoom control so that the shooting range frame and the frame T on the screen 16 coincide with each other. After the adjustment, a predetermined shooting process is executed to capture an image within the shooting range frame as a shot image.

  In this case, in the frame T on the screen 16, additional information S2 to S4 added by handwriting is displayed. Therefore, an image obtained by photographing the additional information S2 to S4 (hereinafter referred to as a photographed image S5) is obtained by the photographing process of the digital camera 13. The digital camera 13 stores the captured image S5 corresponding to the additional information S2 to S4 in the memory 78 (step A17), and adds an identification code to the header information of the captured image S5 (step A18). This identification code is also composed of a unique code of several bits, like the identification code added to the projection image.

  FIG. 7 shows an example of the captured image S5. In response to the frame display completion notification from the PC 12, the digital camera 13 captures additional information S2 to S4 existing in the frame T on the screen 16, and identifies, for example, “00B1” in the header information of the captured image S5. A code is added and stored in the memory 78.

  Next, the digital camera 13 transfers the captured image S5 to which the identification code (“00B1”) is added to the PC 12 (step A19). In this case, the captured image S <b> 5 is transmitted from the digital camera 13 to the projector 11 by wireless communication, and then transmitted to the PC 12 via the RGB cable 14.

  On the PC 12 side, when the photographed image S5 corresponding to the additional information S2 to S4 is received from the digital camera 13 (Yes in step B17), the projection image S1 projected and displayed on the screen 16 until just before photographing is read from the VRAM 55 and the identification is performed. Based on the code, the projection image S1 and the captured image S5 are associated and recorded in the storage unit 58 (step B18).

  Specifically, the projection image S1 and the photographed image S5 are recorded in the image storage area of the storage unit 58, and the identification codes “00A1” and “00B1” added thereto are associated with each other in the management table 58a in the storage unit 58. Set it. As a result, the projection image S1 and the captured image S5 are associated with each other by the identification codes “00A1” and “00B1”. When the projection image S1 and the captured image S5 are associated and recorded in this manner, the projection image S1 is displayed again on the screen 16 in accordance with an instruction from the PC 12 (step B19).

  In this way, an image (captured image S5) obtained by photographing only information added to the image projected on the screen 16 with the digital camera 13 and an image (projected image) projected and displayed on the screen 16 immediately before the photographing. S1) can be associated and recorded in the storage unit 58 in the PC 12. Therefore, when confirming the additional information later, the projected image S1 and the captured image S5 are combined on the PC 12 and displayed on the display unit 56, so that not only the content of the additional information but also which document information is attached. You can easily know what the information was.

FIG. 8 shows an example of a composite image S6 of the projection image S1 and the captured image S5. The combination of images to be combined is determined by the identification code set in the management table 58a described above. That is, in the example of FIG. 8, the projection image S1 and the captured image S5 are read out as the synthesis target based on the identification code “00A1” and the identification code “00B1” set in the management table 58a, and the image provided in the PC 12 The composite image S6 is generated by the composite function and displayed on the screen of the display unit 56 .

  In this case, the portion corresponding to the projection image S1 in the composite image S6 is not a photographed image, but is formed of image data actually projected on the screen 16. Therefore, there is an advantage that the additional information can be confirmed on the original beautiful projected image.

  Further, in this system, the image S1 projected on the screen 16 is not displayed at the timing when the user presses the shutter key 76a of the digital camera 13, so that the addition added by handwriting or the like is added thereto. Only the information S2 to S4 can be easily photographed. Therefore, a troublesome operation such as taking a picture with the digital camera 13 after the user manually erases the projection image S1 each time is unnecessary, and an image S5 obtained by taking only the additional information S2 to S4 is automatically obtained. And can be stored in association with the original projection image S1.

  In addition, the digital camera 13 used as the imaging apparatus of the present system is not integrated into the projector 11 but exists as a device independent of the projector 11. Therefore, a mechanism for incorporating the digital camera 13 into the projector 11 is not required, and the cost can be reduced correspondingly. From the user side, the digital camera 13 is always carried around, not only when the projector 11 is used. It is convenient to enjoy shooting.

  In the system configuration shown in FIG. 1, a wireless LAN or the like is used for the connection means 17 of the projector 11 and the digital camera 13, but a configuration in which a wired connection using a communication cable, for example, may be used.

  In the embodiment, the projection image S1 and the captured image S5 are associated and recorded in the storage unit 58, and a composite image S6 of the projection image S1 and the captured image S5 is generated at the time of reproduction, and this is displayed on the screen. The projected image and the photographed image are combined and recorded in the storage unit 58 from the beginning, and the combined image S6 is read from the storage unit 58 and displayed as it is during playback. Also good.

  In addition, although individual identification codes are attached to the projection image S1 and the captured image S5, the projection image S1 and the captured image S5 may be managed using the same identification code.

  Specifically, in step A12 of FIG. 5, when the shutter release information is notified from the digital camera 13 to the PC 12, the identification code (for example, “0001”) determined on the digital camera 13 side is notified to the PC 12. To do. Thereby, the identification code “0001” is attached to the projection image S1 on the PC 12 side (step B13), and the identification code “0001” notified to the PC 12 is attached to the photographed image S5 on the digital camera 13 side (step A18). ), The projected image S1 and the captured image S5 can be managed by the same identification code “0001”.

  As another method, the identification code (for example, “0001”) added to the projection image S1 on the PC 12 side when the PC 12 notifies the digital camera 13 of the completion of the frame display in step B16 in FIG. ) To the digital camera 13. Accordingly, the digital camera 13 attaches the identification code “0001” notified from the PC 12 to the captured image S5 and transfers the captured image S5, thereby making the projected image S1 and the captured image S5 have the same identification code “0001”. Can be managed.

  As described above, when the same identification code is added to the projection image S1 and the captured image S5, the management table 58a for associating the identification code assigned to each of them becomes unnecessary.

  Further, the storage location of the projection image S1 and the captured image S5 is not necessarily on the PC 12 side, and may be provided on the projector 11 side, for example. That is, as shown in FIG. 1, for example, using a memory card 11a that can be attached to and detached from the main body of the projector 11, a projection image S1 is obtained from the PC 12 and a photographed image S5 is obtained from the digital camera 13 on the projector 11 side. This is stored in the memory card 11a by the method described above. When the memory card 11a is attached to the PC 12 or the like as necessary, the stored contents can be confirmed.

  In short, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

FIG. 1 is a diagram schematically showing a configuration of a projection system according to an embodiment of the present invention. 2A and 2B are diagrams showing an example of a projector used in the present system. FIG. 2A is a perspective view when viewed from above, and FIG. 2B is a perspective view when viewed from below. FIG. 3 is a block diagram showing a schematic circuit configuration of a projector and a PC used in this system. FIG. 4 is a block diagram showing an electronic circuit configuration of a digital camera used in this system. FIG. 5 is a flowchart showing the operation of the present system, and is a flowchart showing processing on the digital camera side and processing on the PC side. FIG. 6 is a diagram illustrating an example of a projected image. FIG. 7 is a diagram illustrating an example of a captured image. FIG. 8 is a diagram illustrating an example of a composite image of a projected image and a captured image.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 11 ... Projector, 11a ... Memory card, 12 ... PC, 13 ... Digital camera, 14 ... RGB cable, 15 ... USB cable, 16 ... Screen, 17 ... Connection means, S1 ... Projection image, S2-S4 ... Additional information, S5 ... taken image, S6 ... composite image, T ... frame, 41 ... CPU, 42 ... ROM, 43 ... RAM, 45 ... projection unit, 46 ... signal receiving unit, 47 ... distance measuring unit, 48 ... key input unit, 49 ... Wireless part 51 ... CPU 52 ... ROM 53 ... RAM 54 ... Video adapter 55 ... VRAM 56 ... Display part 57 ... Key input part 61 ... Motor 62 ... Lens optical system 63 ... CCD 64 ... Timing generator (TG), 65 ... Driver, 66 ... Sample and hold circuit (S / H), 67 ... A / D converter, 68 ... Color process circuit, 69 ... DMA controller 70 ... DRAM interface (I / F), 71 ... DRAM, 72 ... Control unit, 73 ... VRAM controller, 74 ... VRAM, 75 ... Digital video encoder, 76 ... Key input unit, 76a ... Shutter key, 77 ... JPEG Circuit, 78... Memory, 79. Display section, 80... USB interface (I / F), 81. Strobe drive section, 82. Strobe light emitting section, 83.

Claims (9)

A projection system including a projection device that projects an image according to input information on a screen, and an imaging device connected to the projection device,
Projection control means for making a projection image displayed on the screen by the projection device in a non-display state at a predetermined timing;
A frame display means for displaying a frame in a range where the projection image on the screen was displayed when the projection image on the screen is in a non-display state by the projection control means;
Detection means for detecting a frame displayed by the frame display means;
Match control means for performing processing for matching the photographing range of the photographing apparatus to the frame detected by the detecting means;
The additional information remaining on the screen when the projected image on the screen is hidden by the projection control means is photographed in a state in which processing for matching the photographing range of the photographing apparatus is performed by the match control means. Shooting control means for controlling the shooting operation of the imaging device;
A projection image acquisition means for acquiring a projection image displayed on the screen immediately before shooting by the imaging device;
A projection system comprising: a recording unit that records the projection image obtained by the projection image acquisition unit and the captured image obtained by the imaging control unit in association with each other.   The projection system according to claim 1, wherein the projection apparatus and the imaging apparatus are connected by predetermined wireless communication.   The projection system according to claim 1, wherein the projection control unit puts the projection image on the screen into a non-display state when a shutter key provided in the imaging apparatus is pressed. The match control means includes
The projection system of claim 1, wherein it is a zoom control means for performing zoom control to match the imaging range of the imaging device detected frame by said detecting means. First identification code adding means for adding an identification code to the projection image obtained by the projection image acquiring means;
A second identification code adding means for adding an identification code to the photographed image obtained by the photographing control means;
The recording means includes the projection image and the photographed image based on the identification code added to the projection image by the first code addition means and the identification code added to the photographed image by the second code addition means. The projection system according to claim 1, wherein the projection system is recorded in association with each other. The projection system of claim 1, wherein the obtaining further Bei a synthesizing means for synthesizing processes the captured image obtained by the photographing control means and the resulting projected image by the projection image acquisition unit. The projection system according to claim 6, further comprising: a composite display unit that displays an image combined by the combining unit. The projection system according to claim 6, wherein the recording unit records the combined image generated by the combining unit. An additional information recording method used in a projection system including a projection device that projects an image according to input information on a screen, and an imaging device connected to the projection device,
A step of non-displaying a projection image displayed on the screen by the projection device at a predetermined timing;
Displaying a frame in a range in which the projection image on the screen was displayed when the projection image on the screen was in a non-display state;
Detecting the displayed frame;
Performing a process of adjusting the photographing range of the photographing device to the detected frame;
The imaging operation of the imaging device is controlled so that additional information remaining on the screen when the projected image on the screen is in a non-display state is imaged in a state where processing for matching the imaging range of the imaging device is performed. Steps,
Obtaining a projected image displayed on the screen immediately before shooting by the imaging device;
An additional information recording method comprising: a step of associating a projection image immediately before photographing by the imaging device and a photographed image obtained by photographing by the imaging device in association with each other and recording them in a predetermined memory.

Images