JP4595986B2 - Automatic photographing system, photographing camera device, photographing camera device control program, automatic photographing management server, and automatic photographing management server control program - Google Patents

Description

  The present invention relates to an automatic photographing system, a photographing camera device, a photographing camera device control program, an automatic photographing management server, and an automatic photographing management server control program, and in particular, automatic photographing capable of photographing according to a photographing plan set by a subject himself / herself. The present invention relates to a system, a photographing camera device, a photographing camera device control program, an automatic photographing management server, and an automatic photographing management server control program.

  Conventional automatic photographing apparatuses are described in, for example, Japanese Patent Application Laid-Open No. 2005-10244 (Patent Document 1) and Japanese Patent Application Laid-Open No. 2003-116127 (Patent Document 2). Japanese Patent Laid-Open No. 2005-10244 automatically captures a person to be photographed according to a desired number of sheets, and can automatically notify the person to be photographed when the desired number of sheets is not reached within a time limit. An imaging device is described.

Japanese Patent Application Laid-Open No. 2003-116127 discloses an automatic photographing that can take a picture when a subject carrying a wireless tag enters the photographing area and obtain the photographed image via a server. An apparatus is described.
JP 2005-10244 A JP 2003-116127 A

  However, since the automatic photographing apparatus described in each of the above publications performs photographing without the subject being aware of it, the photographed image is not necessarily what the subject has liked.

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide an automatic photographing system capable of automatically photographing an image as expected by a subject, a photographing camera device constituting such an automatic photographing system, a photographing camera device control program, and an automatic photographing management server. And an automatic photographing management server control program.

  An automatic photographing system according to the present invention includes an automatic photographing management server that is a server having a storage unit for storing photographing plans, and a photographing plan that is connected to the automatic photographing management server via a network and is held by the automatic photographing management server. And a photographing camera device for photographing the subject based on the above.

  Specifically, the shooting plan includes information for specifying a person to be shot and shooting control information for controlling execution of shooting by the shooting camera device. The automatic shooting management server includes shooting plan registration means for receiving shooting plan registration from the user, and shooting plan distribution means for distributing the shooting plan to the shooting camera device. The photographing camera device includes a photographing plan receiving means for receiving a photographing plan from the automatic photographing management server, a detecting means for detecting a person to be photographed based on information for specifying the person to be photographed, and a detecting means based on the photographing control information. And photographing means for photographing the subject detected by.

  If it is set as the said structure, the automatic imaging | photography system which can image | photograph the image of the content according to hope to a to-be-photographed person can be obtained. In addition, since the subject does not have to do anything with respect to shooting, the user can take a picture even when traveling alone, or the whole family can be taken simultaneously on a family trip. Also, it is not necessary to carry a camera when going out. Furthermore, it is possible to shoot at an angle that is difficult for personal shooting.

  In this specification, “shooting plan” indicates how to shoot a subject, and includes information for identifying at least the subject, and shooting control information for controlling execution of shooting. including. The shooting control information includes start condition information that is a condition for starting shooting, shooting execution information that holds specific shooting conditions, and post-processing information that holds the contents of image processing after shooting. ing.

  Preferably, the photographing camera device further includes an image transmission unit that transmits an image photographed by the photographing unit to the automatic photographing management server. The automatic photographing management server further includes image receiving means for receiving an image from the photographing camera device, and image storage means for storing the received image for each subject. Thereby, the person to be photographed can obtain the photographed image from the automatic photographing management server. In this specification, “image” includes not only a moving image (video) but also a still image (photo). The “moving image” may be a video only (no audio), or may be a video and audio paired.

  More preferably, the automatic photographing management server further includes image editing means for editing the image stored in the image storage means in response to a request from the user. Thereby, the user can further edit the photographed image to his / her preference.

  Preferably, the imaging control information further includes activation condition information that is a condition for starting imaging. Specifically, the activation condition information includes one of a shooting start time and a predetermined event. Events are roughly classified into events related to the subject's own operation and events related to the subject's surroundings.

  Preferably, the automatic photographing management server further includes guiding means for guiding the subject to the photographing point. Thereby, a photography plan can be advanced smoothly.

  In one embodiment, the activation condition information is a shooting start time. The photographing camera device further includes a non-photographed person arrival notification means for notifying the non-photographed person to the automatic photographing management server when the detection means cannot detect the photographed person even after the photographing start time has elapsed. Including. And a guidance means guides a to-be-photographed person to an imaging | photography spot triggered by having received the to-be-photographed person non-arrival notice.

  As another embodiment, the shooting plan includes first and second shooting control information having different shooting start times. And a guidance means guides a to-be-photographed person to the imaging | photography point of 2nd imaging | photography control information triggered by completion | finish of imaging | photography based on 1st imaging | photography control information.

  As yet another embodiment, the activation condition information is an event that defines a specific action of the subject. The photographing camera device further includes event detection means for detecting occurrence of an event. The photographing unit photographs the person to be photographed when the event detection unit detects the event.

  Preferably, the detection means is an RFID reader that detects an RFID tag (referred to as “Radio Frequency IDentification”, hereinafter the same) tag possessed by the subject. Thereby, a to-be-photographed person can be detected correctly.

  An automatic photographing system according to another aspect of the present invention includes a plurality of photographing camera devices including photographing means for photographing a subject, storage means for storing a photographing plan including movement path information of the subject, And an automatic shooting management server that is a server including a selection unit that selects a shooting camera device arranged on the movement path of the camera and a shooting control unit that causes the shooting camera device selected by the selection unit to take a shot of the subject. .

  The photographing camera device according to the present invention photographs a subject based on a photographing plan including information for specifying a subject and photographing control information for controlling execution of photographing. Specifically, a detection unit that detects whether or not the subject is within the shootable area based on information that identifies the subject, and a subject that is detected by the detection unit based on the shooting control information And photographing means for photographing.

  Preferably, the photographing camera device further includes image processing means for masking a person different from the person to be photographed from an image photographed by the photographing means. Thereby, the privacy of others can be protected appropriately.

  Preferably, the detection means is an RFID reader that detects an RFID tag possessed by the subject. Thereby, a to-be-photographed person can be detected correctly.

  The photographic camera device control program according to the present invention includes a detection device that detects a subject, a photographic device that photographs the photographic subject, information that identifies the photographic subject, and photographic control that controls the execution of photographing by the photographic device. The computer connected to the storage means for storing the photographing plan including the control information is collated with the detection signal of the detection device and the information for identifying the photographed person, and the photographed person is identified according to the coincidence of both. In response to the identification of the photographed person by the photographed person identifying means and the photographed person identifying means, the photographing apparatus control means is configured to cause the photographing apparatus to photograph the photographed person based on the photographing control information.

  The automatic photographing management server according to the present invention is a server that causes a photographing camera device to photograph a subject based on a preset photographing plan. Specifically, it includes an imaging plan registration unit that receives registration of an imaging plan from a user, and an imaging plan distribution unit that distributes the imaging plan to the imaging camera device.

  Preferably, the automatic shooting management server further includes shooting plan update means for accepting a change in a shooting plan already registered. As a result, the shooting plan further conforms to the user's wishes.

  The automatic photographing management server control program according to the present invention causes a computer to operate as the automatic photographing management server described above.

  With reference to FIGS. 1-18, the automatic imaging system 11, the imaging camera apparatus 21, and the automatic imaging management server 31 which concern on one Embodiment of this invention are demonstrated. FIG. 1 is a hardware block diagram of the automatic photographing system 11, and FIG. 2 is a schematic diagram of the photographing camera device 21.

  With reference to FIG. 1, the automatic photographing system 11 includes a photographing camera device 21 and an automatic photographing management server 31. The automatic photographing system 11 is configured such that the photographing camera device 21 automatically photographs a person to be photographed if the user acts in accordance with a photographing plan set in advance by the user.

  Referring to FIGS. 1 and 2, a photographing camera device 21 is connected to an automatic photographing management server 31 via a network 10 and photographs a subject based on a photographing plan held by the automatic photographing management server 31. It is. Specifically, a detection device 22, a photographing device 23, a control device 24, a network I / F (referred to as “InterFace”, the same applies hereinafter) 25, an operation rail 26, and a self-supporting pole stand 27 are provided. Including. For example, a plurality of the photographing camera devices 21 are installed in a sightseeing spot or the like. Then, the subject is photographed based on the photographing plan received from the automatic photographing management server 31.

  The detection device 22 detects whether or not the subject is within the shootable area of the photographic device 23. Specifically, the detection device 22 includes an RFID antenna 22a and a reader / writer 22b, and detects an RFID tag possessed by the subject.

  The photographing device 23 includes a television camera 23a for photographing an image, an illumination 23b for irradiating light to a photographable region, and a microphone 23c for collecting sound, and records a photographed person's image and sound. In addition, a to-be-photographed person, imaging | photography start time, imaging | photography angle, etc. are controlled by the control apparatus 24 based on an imaging | photography plan.

  The control device 24 includes a CPU (referred to as “Central Control Unit”) 24a and a ROM (referred to as “Read Only Memory”) 24b storing a program and the like as a temporary storage area. RAM (referred to as “Random Access Memory”; hereinafter the same) 24c and HDD (referred to as “Hard Disk Drive”) as storage means 24d, and controls the entire photographing camera device 21. . The CPU 24a operates alone or together with the network I / F 25 as a photographing plan receiving unit, an image transmitting unit, a photographing state notification unit, an image processing unit, a subject identification unit, and a photographing device control unit.

  The shooting plan receiving unit receives the shooting plan from the automatic shooting management server 31 via the network 10. The received shooting plan is stored in the HDD 24d. In normal times, it is desirable to receive at night when the load on the network 10 is low. On the other hand, when a shooting plan is registered on the day of shooting, or when a shooting plan already received is changed, it is received in real time.

  The image transmission unit transmits the image data captured by the image capturing device 23 to the automatic image capturing management server 31 via the network 10. The transmitted image data is associated with a subject ID (referred to as “IDentification”; the same applies hereinafter). Further, the image data in the HDD 24d is deleted after the transmission is completed. Note that the image data is desirably transmitted in real time in parallel with photographing. However, since the image data has a large data size, it may be transmitted at night when the load on the network 10 is low when a sufficient bandwidth cannot be secured.

  The shooting status notification means notifies the shooting status based on the received shooting plan to the automatic shooting management server 31 via the network 10. Specifically, a shooting completion notification is given when shooting is completed as planned. In addition, when the photographing start time of the photographing plan has elapsed, the photographed person has not been detected, and a photographed person non-arrival notice is issued.

  The image processing means masks a person who is different from the person to be photographed from the image photographed by the photographing device 23. Thereby, the privacy of others can be protected appropriately. In addition, image processing such as removing spots and wrinkles from the face of the subject in the captured image is performed.

  The network I / F 25 is connected to the network 10 and transmits / receives data to / from the automatic shooting management server 31. The operating rail 26 and the self-supporting pole stand 27 are used to adjust the shooting angle and height of the shooting device 23.

  The person-to-be-photographed identification means collates the detection signal from the detection device 22 with information for identifying the person to be photographed included in the photographing plan. Specify whether or not. The detection means includes a detection device 22 and a CPU 24a that operates as a subject identification means.

  The photographing device control means causes the photographing device 23 to photograph the subject based on the photographing control information included in the photographing plan. Specifically, the angle of the TV camera 23a, the brightness of the illumination 23b, the direction of the microphone 23c, and the like are adjusted. The photographing means is composed of a photographing device 23 and a CPU 24a that operates as photographing device control means.

  The automatic photographing management server 31 includes a network I / F 32, a control device 33, and a storage device 34. The automatic photographing management server 31 is a server that manages the photographing plan and causes the photographing camera device 21 to photograph the subject based on the photographing plan. Note that a plurality of photographing camera devices 21 can be controlled by one automatic photographing management server 31.

  The network I / F 32 is connected to the network 10 and transmits / receives data to / from the photographing camera device 21 and the person to be photographed (user).

  The control device 33 includes a CPU 33a, a ROM 33b in which programs and the like are stored, and a RAM 33c as a temporary storage area, and controls the entire automatic photographing management server 31. The CPU 33a alone or together with the network I / F 32, member management means, photographing plan registration means, photographing plan update means, photographing plan deletion means, photographing plan distribution means, image reception means, image editing means, image distribution means, and guidance Acts as a means.

  The member management means manages member information such as member registration processing, member information change, and withdrawal processing. The member information is stored in a member information DB (referred to as “DataBase”, the same applies hereinafter) 34 a of the storage device 34.

  The shooting plan registration means accepts a shooting plan registration from the user. The registered shooting plan is stored in the shooting plan DB 34 b of the storage device 34. The imaging plan update unit accepts a change in an already registered imaging plan. The shooting plan deletion means accepts deletion of a shooting plan already registered. The user registers and changes the shooting plan via the network 10 from a personal computer or a mobile phone.

  The shooting plan distribution unit distributes the registered shooting plan to the shooting camera device 21. Specifically, the photographing camera device 21 that performs photographing is selected based on the photographing plan (selecting means), and the photographing plan is distributed to the selected photographing camera device 21. Thereby, the to-be-photographed person can be made to image | photograph the imaging | photography camera apparatus 21 based on an imaging | photography plan (imaging control means).

  The image receiving means receives an image taken by the photographic camera device 21 via the network 10. The received image is stored in the accumulated image DB 34c of the storage device 34 for each subject.

  The image editing means edits the image stored in the accumulated image DB 34c in response to a request from the user. Specifically, a plurality of images can be combined, unnecessary portions can be deleted, and music and characters can be inserted. The edited image is stored in the processed image DB 34d of the storage device 34.

  The image stored in the stored image DB 34c is referred to as “stored image”, and the image stored in the processed image DB 34d is referred to as “processed image”. Further, the storage image DB 34c and the processed image DB 34d have a storage deadline, and data that is not used for a certain period is automatically deleted.

  The image distribution means distributes the processed image stored in the processed image DB 34d to the user via the network 10. Note that security must be taken into account when downloading the processed image.

  The guiding means guides the subject to the photographing point. Specifically, by sending an e-mail describing the shooting start time, the shooting point address, a map, route guidance, and the like to the mobile terminal of the subject, the user is prompted to move to the shooting point.

  For example, an e-mail containing information on the first shooting point is transmitted on the morning of shooting. In addition, an e-mail that prompts the user to move to the shooting location is transmitted in response to the reception of the non-photographed person notification from the shooting camera device 21. Furthermore, in the case of a shooting plan in which a plurality of shooting points are registered, an e-mail that prompts the user to move to the next shooting point is transmitted when receiving a shooting completion notification from the shooting camera device 21.

  The storage device 34 stores various data. Specifically, a member information DB 34a for storing member information, a shooting plan DB 34b as a storage means for storing a shooting plan, an accumulated image DB 34c as an image storage means for storing images received from the shooting camera device 21, and a user. A processed image DB 34d that stores processed images is included.

  A user can access the automatic photographing management server 31 via the network 10 by a personal computer or a mobile phone. In addition, if the photographed person carries an IC card with an RFID tag embedded and goes to the photographing point, photographing is automatically performed based on a pre-registered photographing plan.

  With the above-described configuration, it is possible to capture an image having content that meets the user's desire. In addition, since the subject does not have to do anything about photography, he can photograph himself even when traveling alone, or the whole family can be photographed simultaneously on a family trip. Also, it is not necessary to carry a camera when going out. Furthermore, it is possible to shoot at an angle that is difficult for personal shooting.

  In the present specification, the “user” and the “photographed person” may be the same person or different persons. For example, the subject himself / herself can create a photography plan, or a parent (user) can create a photography plan for photographing a child (subject). The subject is not limited to a human being but may be a pet or the like.

  Next, the data structure of the shooting plan DB 34b, the accumulated image DB 34c, and the processed image DB 34d will be described with reference to FIGS. 3 and 4 show the data structure of the shooting plan DB 34b, FIG. 5 shows the data structure of the accumulated image DB 34c, and FIG. 6 shows the data structure of the processed image DB 34d.

  First, referring to FIG. 3, a shooting plan record for managing basic information of a shooting plan is registered in the shooting plan DB 34b. Specifically, a shooting plan number for uniquely identifying a shooting plan, a shooting course number for identifying a shooting course, one or more subject IDs as information for specifying a subject, and one or more shooting points. The shooting point ID is registered. This record is normalized and registered in the shooting plan DB 34b.

  Further, a shooting control information record as shown in FIG. 4 is associated with a shooting plan number and a shooting point ID in the shooting plan record. There are as many shooting control information records as the number (n) of shooting point IDs registered in the shooting plan record.

  The shooting control information record includes start condition information, shooting execution information, and post-processing information. The activation condition information is a condition for starting shooting, a shooting sequence indicating the order in which shooting is performed, a shooting start date and time (including “date” and “time”) indicating the date and time when shooting is started at this point, and the like. Is applicable.

  The shooting execution information is specific information for shooting, and includes a shooting method, a shooting time, a shooting angle of the shooting device 23, a height of the shooting device 23, information on lighting, information on sound, shooting magnification, and An option for designating one of a plurality of photographing modes (automatic photographing) provided by the automatic photographing system 11 is applicable.

  If “Manual” is selected as the shooting method, no. Photographing is performed according to the conditions set in 7 to 11. On the other hand, when “Auto” is selected as the shooting method, No. No. 12 based on the shooting mode selected in No. 12. The contents of 7 to 11 are automatically set. By providing an auto photographing function, even a user without specialized knowledge can easily use it.

  The post-processing information includes the necessity of masking processing by the image processing means of the photographing camera device 21, the content of image processing performed on the image after photographing such as removal of spots and wrinkles, and the processing content after photographing such as a storage deadline. Stipulate. In the embodiment shown in FIG. 4, the field for setting post-processing information is omitted.

  Next, referring to FIG. 5, the stored image DB 34 c is a database for registering image data received from the photographing camera device 21, and is uniquely identified by a photographed person ID, a reservation number, and a sequence number. In addition to the above key items, shooting start date and time, shooting time, and image data are registered.

  Next, referring to FIG. 6, the processed image DB 34d is a record that is uniquely identified by the photographed person ID and the reservation number, and an image edited by the image editing means is registered. The contents set in the items are the same as those in the stored image DB 34c.

  Next, the operation of the automatic photographing system 11 having the above configuration will be described with reference to FIGS. FIG. 7 is a diagram showing an example of the photographing plan, and FIG. 8 is a flowchart showing the operation of the automatic photographing system 11.

  First, referring to FIG. 8, the user needs to register as a member before using the automatic photographing system 11 described above. In step S11, the user accesses the automatic photographing management server 31 to register member information. Specifically, the name, address, contact information (telephone number, mail address), etc. are registered.

  Next, in steps S12 and S13, the automatic photographing system 11 issues a member number and an RFID tag ID (corresponding to “photographed person ID”). These are registered in the member information DB 34a in association with the member information.

  Next, in step S14, an IC card in which an RFID tag is embedded is issued. In step S15, the IC card is sent to the registered address. The user can use the automatic photographing system 11 after receiving the IC card.

  Next, referring to FIG. 9, the user needs to change the registered content of the member information DB 34a when the member information is changed. In step S21, the user changes member information. The changed contents are reflected in the member information DB 34a in step S22. However, the membership number and RFID tag ID cannot be changed.

  Next, referring to FIG. 10, the user needs to cancel the membership when the automatic photographing system 11 is not used in the future. Specifically, in step S31, the user designates a membership number and performs withdrawal processing. When the withdrawal process is completed, the member information is deleted from the member information DB 34a in step S32, the member's shooting plan from the shooting plan DB 34b, the member's stored image from the stored image DB 34c, and the member's stored image from the processed image DB 34d. Each processed image is deleted.

  The member registration process, the member information change process, and the withdrawal process are controlled by the CPU 33a that operates as a member management unit.

  Next, referring to FIG. 7 and FIG. 11, the user can create a shooting plan according to his / her wish and register it in the automatic shooting management server 31. First, in step S41 shown in FIG. 11, the user selects the appearance of the shooting course. Specifically, a map showing the installation location of the photographing camera device 21 may be displayed on the screen, and the photographing points may be selected in the order of photographing. Here, at least one shooting point must be selected. In the embodiment illustrated in FIG. 7, it is assumed that shooting points are selected in the order of point A, point B, and point C.

  Next, in step S42, the user selects detailed shooting control information at each point. Specifically, the shooting start date and time, the shooting time, the shooting angle, the height, the illumination, the voice, the magnification, and the like as shown in FIG. 4 are set.

  Next, in step S43, the automatic photographing management server 31 registers the above photographing plan in the photographing plan DB 34b and issues a reservation number to the user. This reservation No. is necessary when changing or deleting the shooting plan, creating or downloading a processed image. Further, the above-described shooting plan registration process is controlled by the CPU 33a that operates as a shooting plan registration unit.

  Next, referring to FIG. 12, the automatic shooting management server 31 distributes the registered shooting plan to the shooting camera device 21. Specifically, in step S51, the automatic shooting management server 31 searches for shooting upcoming ones from the shooting plans registered in the shooting plan DB 34b. For example, it is only necessary to search for a shooting plan whose shooting start date is tomorrow.

  Next, in step S52, the automatic photographing management server 31 distributes the photographing plan to the photographing camera device 21 that performs photographing. Specifically, a shooting control information record corresponding to each shooting camera device 21 and a subject ID to be shot are distributed. The above-described shooting plan distribution process is controlled by the CPU 33a that operates as a shooting plan distribution unit.

  Next, with reference to FIG. 13, the user can change the already registered shooting plan. Specifically, in step S61, the user specifies the shooting plan to be changed based on the reservation number issued at the time of shooting plan registration (step S43 in FIG. 11).

  Next, in step S62, the user selects a change point and performs a change process. Specifically, it is possible to change the shooting order and change the shooting control information at each shooting point. It is also possible to delete a part of the shooting point.

  Next, in step S63, the automatic photographing management server 31 reflects the above change in the photographing plan DB 34b. The photographing plan update process is controlled by the CPU 33a that operates as a photographing plan update unit.

  If the shooting plan before the change has not been distributed to the shooting camera device 21 yet, the changed shooting plan is distributed by the shooting plan distribution process described in FIG. On the other hand, when the shooting plan before the change has already been distributed to the shooting camera device 21, the changed shooting plan is redistributed to the shooting camera device 21 as a target.

  Next, referring to FIG. 14, the user can delete the already registered shooting plan. Specifically, in step S71, the user specifies a shooting plan to be deleted based on a reservation number issued at the time of shooting plan registration. Next, in step S72, the automatic shooting management server 31 deletes the designated shooting plan from the shooting plan DB 34b. In addition, when the said imaging | photography plan is already delivered to the imaging | photography camera apparatus 21, it notifies that the imaging | photography plan was deleted to the imaging camera apparatus 21 used as object. Note that the above-described shooting plan deletion processing is controlled by the CPU 33a that operates as shooting plan deletion means.

  Next, with reference to FIG. 7 and FIGS. First, referring to FIG. 15, the automatic photographing management server 31 transmits a guide mail to the photographed person on the morning of the photographing date. Specifically, in S81, the automatic photographing management server 31 acquires the mail address of the person to be photographed from the member information DB 34a. If a plurality of subjects are registered in the photographing plan, only the email address of the representative may be acquired, or the email addresses of all registered subjects may be acquired. .

  Next, in step S82, the automatic photographing management server 31 creates a mail that prompts the user to move to the point A by 10:00, and transmits a guide mail to the acquired mail address. Further, dedicated map data may be downloaded to a mobile phone with a GPS function, and guidance by navigation may be performed. In addition, said guidance process is controlled by CPU33a which operate | moves as a guidance means.

  As described above, it is possible to smoothly advance the shooting plan by executing the guidance process that prompts the user to move to the shooting point in advance.

  Next, with reference to FIG. 16, a process in which the photographing camera device 21 photographs the subject based on the photographing plan will be described. If the person to be photographed carries the RFID tag and goes to point A at 10:00, photographing is automatically performed. The photographing camera device 21 constantly monitors the RFID tag in the imageable area.

  Specifically, the reader / writer 22b of the detection device 22 transmits a polling signal from the RFID antenna 22a. When a reply from the RFID tag carried by the subject is received, a detection signal is transmitted to the control unit 24. The CPU 24a that operates as the subject identification unit compares the detection signal from the detection device 22 with the subject ID registered in the photographing plan, and the subject is in the photographable region because they match. Recognize. Note that in order to reliably photograph the subject, it is necessary to set the communicable area of the RFID antenna 22a within the photographable area of the TV camera 23a.

  Next, in step S91, the control unit 24 determines whether the detected subject is already being photographed. Specifically, the control unit 24 holds a shooting list in the RAM 24c. Then, if the ID of the detected RFID tag is registered in this shooting list, it is determined that the subject is shooting.

  When it is determined that the subject is not being photographed (NO in step S91), in step S92, the control unit 24 determines whether or not the photographing plan associated with the subject is held.

  If the photographing plan associated with the subject is held and the photographing control information is satisfied (YES in step S92), in step S93, the control unit 24 loads the photographing plan from the HDD 24d to the RAM 24c.

  In step S94, the position of the person to be photographed is specified. In step S95, the photographing control information of the photographing device 23 is adjusted based on the photographing plan, and photographing is started. This process is controlled by the CPU 24a that operates as a photographing device control means.

  Further, in step S96, the control unit 24 registers the shooting course number of the shooting plan and the ID of the RFID tag in the shooting list of the RAM 24c. The captured image and sound are stored in the HDD 24d.

  Note that if there is no shooting plan associated with the subject or if the shooting control information is not satisfied (NO in step S92), the processing in steps S93 to S96 is skipped. For example, if the shooting start time has not yet been reached, it is determined that the shooting control information is not satisfied. When a plurality of photographed person IDs are registered in the photographing plan, it is determined that the photographing control information is not satisfied until all photographed person IDs are detected.

  On the other hand, when the subject is already being photographed, that is, when the ID of the RFID tag is already registered in the photographing list (YES in step S91), in step S97, the control unit 24 determines the scheduled photographing time. Determine whether or not it has passed. If the scheduled shooting time has not yet elapsed (NO in step S97), shooting is continued.

  On the other hand, if the shooting time has already passed (YES in step S97), the shooting device 23 ends shooting of the subject in step S98. In step S <b> 99, the CPU 24 a that operates as a shooting status notification unit transmits a shooting completion notification to the automatic shooting management server 31. Further, in step S100, the ID of the RFID tag is deleted from the shooting list, and in step S101, the shooting plan is deleted from the RAM 24c and HDD 24d. The captured image and sound are transmitted to the automatic photographing management server 31 by the CPU 24a that operates as an image transmission means at an arbitrary timing.

  The subject can change the shooting control information of the shooting camera device 21 during shooting in real time. Specifically, it is possible to change the shooting control information via the automatic shooting management server 31 using the shooting plan update process described with reference to FIG. As a result, the subject can appropriately change the photographing control information in accordance with the surrounding situation, and further photographing according to the desire of the subject can be performed.

  In addition, the CPU 24a operating as an image processing means performs masking processing for a person other than the person to be photographed from the photographed image. Thereby, the privacy of others can be protected appropriately. This process may be performed in real time during shooting, or may be performed after completion of shooting.

  Next, the automatic photographing management server 31 urges the subject to move to the B point when receiving the photographing completion notification from the photographing camera device 21 at the A point. Specifically, the guidance process shown in FIG. 15 is executed. Since the processing contents have already been described, a description thereof will be omitted. This eliminates the need for the subject to grasp information about all the photographing points in advance, thereby reducing the burden on the subject.

  Next, with reference to FIG. 17, a process in the case where the subject does not appear at the shooting point even after the shooting start time has elapsed will be described. The shooting camera device 21 at the point B shown in FIG. 7 periodically checks the held shooting plan. Specifically, in step S111, the control unit 24 determines whether or not the shooting plan is already being shot based on the stored contents of the shooting list. If the shooting plan is being shot (YES in step S111), the processing (S112 to S115) shown in FIG. 17 is skipped.

  On the other hand, when the shooting plan is not being shot, that is, when the shooting plan is not registered in the shooting list (NO in step S111), in step S112, the control unit 24 passes the shooting start time of the shooting plan. Judge whether or not.

  If the shooting start time has already passed (YES in step S112), in step S113, the control unit 24 determines whether or not a shooting subject non-arrival notification has already been performed. Specifically, the control unit 24 holds a notification list in the RAM 24c. Then, if the shooting course number is registered in this notification list, it is determined that the shooting subject non-arrival notification has already been made.

  When the subject non-arrival notice has not been notified yet, that is, when the photographing course number is not registered in the notification list of the RAM 24c (NO in step S113), in step S114, the photographing state notifying means (the subject unarrived) The CPU 24 a that operates as notification means transmits a notification that the subject has not arrived to the automatic photographing management server 31. In step S115, the shooting course number of the shooting plan is registered in the notification list of the RAM 24c.

  On the other hand, if the shooting start time of the shooting plan has not yet been reached (NO in step S112), or if a shooting subject non-arrival notification has already been made for the shooting plan (YES in step S113), steps S114 and The process of step S115 is skipped.

  The automatic photographing management server 31 that has received the non-photographed person arrival notification prompts the photographed person to move to the B point. Specifically, the guidance process described with reference to FIG. 15 is executed. Since the processing contents have already been described, a description thereof will be omitted.

  This has an advantageous effect when the subject has forgotten to move to the shooting point. However, the subject may change the schedule on the way. Therefore, when receiving notifications of non-photographed persons from a plurality of photographing camera devices 21, the photographing plan deletion process is performed on the assumption that photographing has been canceled.

  Next, a method for editing and acquiring a captured image will be described with reference to FIGS. First, in step S121 shown in FIG. 18, the user selects image data to be edited from the stored images stored in the stored image DB 34c. For example, if three image data shown in FIG. 5 are selected, in step S122, the automatic imaging management server 31 combines the selected image data in ascending order of sequence numbers (in order of 1, 2, 3).

Next, in step S123, the user deletes unnecessary portions from the combined image data. Here, it is also possible to extract a still image (snapshot) from the moving image.
Further, in step S124, the user inserts music and characters into the image data.

  When the editing of the image data is completed, in step S125, the automatic shooting management server 31 registers the edited image data as a processed image in the processed image DB 34d. The image editing process is controlled by the CPU 33a that operates as an image editing unit.

  Note that the user can download the processed image registered in the processed image DB 34d or view it by streaming on the condition that the membership number and the password are input. It is also possible to publish the web to a specific other person by issuing an ID and a password. This process is controlled by the CPU 33a that operates as an image distribution unit.

  In the above embodiment, an example in which an RFID tag is detected as an example of the detection unit has been described. For example, in addition to this, face authentication may be used in combination. Specifically, face data of the photographed person may be registered in advance, and the photographed person may be recognized by comparing with the photographed face.

  Further, in the above-described embodiment, an example in which the television camera 23 that shoots a moving image (video) is used as the photographic means has been described. Good.

  In the above-described embodiment, an example of the fixed photographing camera device 21 fixed to the self-supporting pole stand 27 has been described. However, the present invention is not limited thereto, and a movable photographing camera device may be used. For example, a robot that moves about the subject may be photographed.

  In the above embodiment, an example of the shooting sequence and the shooting start date and time is shown as the start condition information. However, the present invention is not limited to this, and an arbitrary start condition can be set. For example, photographing may be started when a photographing instruction from the automatic photographing management server 31 is received. Furthermore, the event-driven automatic photographing system 11 that detects and activates “an event related to the subject's own operation” or “an event related to a phenomenon around the subject” may be used.

  Specifically, the “event regarding the subject's own action” includes laughing, flying, walking, reaching a specific position, making a voice, raising a hand, and the like. On the other hand, the “event related to the phenomenon around the subject” includes other people coming near the subject, illumination of the subject, rain, and the like.

  With reference to FIGS. 1, 16, 19, and 20, processing when “detection of subject's smile” is set as activation condition information will be described. In addition, description of a common step is abbreviate | omitted and it demonstrates centering on difference.

  First, the control device 24 of the photographing camera device 21 holds a 3D face model 41 (referred to as “Dimension”, the same applies hereinafter) as shown in FIG. The 3D face model 41 defines the positions of the face outline 42, eyes 43, nose 44, mouth 45, and the like. The CPU 24a also operates as an identification unit that identifies each element of the face and a smile degree measurement unit as an event detection unit that measures the smile level of the subject.

  Referring to FIG. 16, the CPU 24 a operating as the photographing device control means in step S <b> 94 causes the photographing device 23 to photograph the face of the subject. However, the captured image at this time is not stored in the HDD 24d.

  Next, referring to FIG. 20, the CPU 24 a that operates as the specifying unit collates the 3D face model 41 with the face of the subject photographed by the photographing device 23, and opens and closes the eyes of the subject. Shape, wrinkle shape, opening / closing degree of mouth, shape of mouth corner, and the like.

  Next, the CPU 24a operating as a smile degree measuring unit measures the smile level of the subject from the shape of the face specified by the specifying unit. Specifically, when you smile, your eyes narrow, your eyes turn down, wrinkles beside your nose, your mouth opens and your corners rise. Therefore, the smile level (0% to 100%) is measured by combining the above elements.

  Next, the CPU 24a operating as the photographing device control means, in step S95, on condition that the smile level of the photographed person measured by the smile degree measuring means exceeds a predetermined threshold (for example, 60%). 23 is instructed to start photographing. Note that images taken thereafter are stored in the HDD 24d.

  According to the automatic photographing system 11 described above, it is possible to selectively photograph only the state that the photographed person is enjoying, and thus it is possible to obtain an image that meets the photographed person's desire. According to the above method, the smile of the photographed person can be detected without registering the face of the photographed person in advance. It is also possible to measure the smile levels of multiple people at the same time.

  Further, in the above embodiment, an example has been shown in which the subject person himself / herself can change the photographing control information during photographing using the photographing plan update process shown in FIG. 13, but the present invention is not limited to this. A person different from the photographer (referred to as “photographer”) can also change the photographing control information in real time.

  For example, the photographer can change the shooting control information while streaming viewing the image being shot. At this time, since the person to be photographed is automatically detected by the photographing camera device 21, the photographer does not need to be aware of the position of the person to be photographed.

  According to this, even if the photographer is not at the photographing point, the photographing camera device 21 can be controlled as if in front of the eyes. This can be applied to a service in which a parent (photographer) watches the safety of a child (photographed person) in a remote place.

  In the above-described embodiment, an example in which a shooting plan is distributed from the automatic shooting management server 31 to the shooting camera device 21 in advance has been described. You may make it inquire about a photography plan as needed. At this time, the CPU 24a also operates as an imaging plan inquiry unit that inquires of the automatic imaging management server 21 whether or not there is an imaging plan associated with the subject ID.

  Specifically, the detection means 22 constantly monitors whether an RFID tag is present in the communicable area. Then, triggered by the detection of the RFID tag, the CPU 24a that operates as a photographing plan inquiry unit inquires of the automatic photographing management server 31 about the presence or absence of the photographing plan associated with the photographed person ID written in the RFID tag.

  Upon receiving the inquiry, the automatic shooting management server 31 searches the shooting plan DB 34b for a shooting plan associated with the subject ID. When there is a shooting plan, the CPU 33 a operating as a shooting plan distribution unit distributes the shooting plan to the shooting camera device 31. Then, the photographic camera device 31 that has received the photographic plan shoots the person to be photographed in the procedure of steps S92 to S96 shown in FIG.

  In the above-described embodiment, the photographing camera device 21 and the automatic photographing management server 31 are described as examples of dedicated devices. However, the present invention is not limited thereto, and these are general-purpose computers. A similar operation may be performed by installing a program for executing the operation performed by the imaging management server. In this case, the program may be supplied on a recording medium such as a CD or DVD, or may be downloaded from a network.

  Further, the automatic photographing system 11 can be used for all purposes. For example, it can be used as a commemorative video shooting service in a bus tour. Specifically, an RFID tag is attached to a tour participant, and a shooting plan that matches the bus tour process is created. As a result, the tour participant does not need to bring a video camera by himself and can obtain a commemorative video of the tour without being conscious of being photographed.

  Further, if the above-described photographing camera device 21 is installed inside the bus, it is possible to perform tour call management of tour participants using the seat position and the RFID tag. Moreover, if RFID is given to baggage, missing baggage and wrong delivery can be prevented.

  In addition, if the tour participants' “hobby preferences” and “previous symptoms” are registered as additional information for the shooting plan, and if the tour crew can acquire additional information as required, additional value will be added to the tour participants. Service can be provided.

  Further, the automatic photographing system 11 can be used in other fields. For example, it can be installed in a golf driving range and used for form check. Alternatively, it can be installed on the school road and used for school attendance management.

  As mentioned above, although embodiment of this invention was described with reference to drawings, this invention is not limited to the thing of embodiment shown in figure. Various modifications and variations can be made to the illustrated embodiment within the same range or equivalent range as the present invention.

1 is a block diagram illustrating a configuration of an automatic photographing system according to an embodiment of the present invention. It is a schematic diagram of a photography camera device. It is a figure which shows the data structure of the photography plan record of photography plan DB. It is a figure which shows the data structure of the imaging | photography control information record of imaging | photography plan DB. It is a figure which shows the data structure of accumulation | storage image DB. It is a figure which shows the data structure of processed image DB. It is a figure which shows an example of an imaging plan. It is a flowchart which shows the flow of a member registration process. It is a flowchart which shows the flow of a member information change process. It is a flowchart which shows the flow of withdrawal processing. It is a flowchart which shows the flow of imaging plan registration processing. It is a flowchart which shows the flow of imaging | photography plan delivery processing. It is a flowchart which shows the flow of imaging | photography plan update processing. It is a flowchart which shows the flow of a photography plan deletion process. It is a flowchart which shows the flow of a guidance process. It is a flowchart which shows the flow of an imaging process. It is a flowchart which shows the flow of a to-be-photographed person non arrival notification process. It is a flowchart which shows the flow of an image editing process. It is a figure which shows a 3D face model. It is a figure which shows the example which matched 3D face model and a to-be-photographed person's face.

Explanation of symbols

  10 network, 11 automatic photographing system, 21 photographing camera device, 22 detection device, 22a RFID antenna, 22b reader / writer, 23 photographing device, 23a TV camera, 23b illumination, 23c microphone, 24, 33 control unit, 24a, 33a CPU , 24b, 33b ROM, 24c, 33c RAM, 24d HDD, 25, 32 Network I / F, 26 Movable rail, 27 Free-standing pole stand, 31 Automatic shooting management server, 34 Storage device, 34a Member management DB, 34b Shooting plan DB, 34c Accumulated image DB, 34d Processed image DB, 41 3D face model, 42 Face outline, 43 eyes, 44 nose, 45 mouths.

Claims (16)

An automatic photographing management server which is a server having a storage means for storing a photographing plan, and a subject who is connected to the automatic photographing management server via a network and based on the photographing plan held by the automatic photographing management server An automatic photographing system comprising a photographing camera device for photographing
The shooting plan includes information for specifying a subject and shooting control information for controlling execution of shooting by the shooting camera device,
The automatic photographing management server
Shooting plan registration means for receiving registration of the shooting plan from a user;
A shooting plan distribution means for distributing the shooting plan to the shooting camera device;
The photographing camera device includes:
A shooting plan receiving means for receiving the shooting plan from the automatic shooting management server;
Detecting means for detecting a subject based on information identifying the subject who has received registration from a user;
An imaging unit for imaging the subject based on the imaging control information received from the user after recognizing that the subject detected by the detection unit is in a shootable region;
Image transmitting means for transmitting an image photographed by the photographing means to the automatic photographing management server,
The automatic photographing management server
Image receiving means for receiving the image transmitted by the image transmitting means from the photographing camera device;
Image delivery means for streaming delivery of the image received by the image receiving means to a user;
An automatic photographing system including photographing plan update means for accepting a change in the photographing control information already registered during operation of the image distribution means . The automatic photographing system according to claim 1, wherein the automatic photographing management server further includes an image accumulating unit that accumulates the image received by the image receiving unit for each subject.   The automatic photographing system according to claim 2, wherein the automatic photographing management server further includes an image editing unit that edits the image stored in the image storing unit in response to a request from a user.   The automatic photographing system according to claim 1, wherein the photographing control information further includes start condition information that is a condition for starting photographing.   The automatic photographing system according to claim 4, wherein the automatic photographing management server further includes guiding means for guiding the subject to the photographing point. The activation condition information is a shooting start time,
The photographing camera device notifies the subject not to arrive at the automatic photographing management server when the detection means cannot detect the subject even after the photographing start time has elapsed. Further comprising a notification means,
6. The automatic photographing system according to claim 5, wherein the guiding means guides the photographed person to the photographing point when receiving the photographed person non-arrival notice. The shooting plan includes first and second shooting control information having different shooting start times,
The automatic photographing system according to claim 5, wherein the guiding unit guides the person to be photographed to a photographing point of the second photographing control information when photographing based on the first photographing control information is finished. The activation condition information is an event that defines a specific action of the subject,
The photographing camera device further includes event detection means for detecting the occurrence of the event,
The automatic photographing system according to claim 4, wherein the photographing unit photographs the subject when the event is detected by the event detection unit.   The automatic photographing system according to claim 1, wherein the detection unit is an RFID reader that detects an RFID tag possessed by a subject. An automatic photographing system comprising a plurality of photographing camera devices and an automatic photographing management server that controls the photographing camera device to photograph a subject.
The photographing camera device includes:
Detecting means for detecting a photographed person based on information identifying the photographed person who has received registration from the user ;
Photographing means for photographing the subject based on photographing control information for controlling execution of photographing accepted from the user after recognizing that the photographed person detected by the detecting means is in the photographing possible area ; ,
Image transmitting means for transmitting an image photographed by the photographing means to the automatic photographing management server,
The automatic photographing management server
Storage means for storing a shooting plan that includes registration information received from a user, including movement path information of the shooting person, information for specifying the shooting person, and the shooting control information ;
A selecting means for selecting the photographing camera device arranged on the movement path of the subject ;
Shooting control means for causing the shooting camera device selected by the selection means to shoot the subject ,
Image receiving means for receiving the image transmitted by the image transmitting means from the photographing camera device;
Image delivery means for streaming delivery of the image received by the image receiving means to a user;
An automatic photographing system including photographing plan update means for accepting a change in the photographing control information already registered during operation of the image distribution means . A photographing camera device that includes information for identifying a subject and photographing control information for controlling execution of photographing, and photographs a subject based on a photographing plan that has been registered from a user,
The photographing camera device includes:
It is connected to an automatic shooting management server that stores the shooting plan via a network, and the shooting plan is distributed from the automatic shooting management server, and the automatic shooting management server receives an image shot from the shooting camera device. An image receiving unit that performs streaming distribution of the image received by the image receiving unit to a user, and a shooting plan that accepts a change in the shooting control information that has already been registered during the operation of the image distributing unit. Update means, and
The photographing camera device includes:
Detecting means for detecting whether or not the photographed person is in a shootable area based on information identifying the photographed person who has received registration from the user;
After recognizing that the photographed person detected by the detecting means is in the shootable area, the photographed person is photographed based on the photographing control information received from the user, and by the photographing plan updating means. Based on the changed photographing control information, photographing means for photographing the subject ,
An imaging camera device comprising: an image transmission unit that transmits an image captured by the imaging unit to the automatic imaging management server .   The photographing camera device according to claim 11, further comprising an image processing unit that performs masking processing on a person different from the person to be photographed from an image photographed by the photographing unit.   The photographing camera device according to claim 11 or 12, wherein the detection means is an RFID reader that detects an RFID tag possessed by a subject. Connected to the server via the network,
It includes a detection device that detects a subject, a photographing device that photographs the subject, information that identifies the subject, and photographing control information that controls execution of photographing by the photographing device, and accepts registration from the user A computer connected to storage means for storing the shooting plan
Based on the information for identifying the photographed person who has received registration from the user, the detection signal of the detection device and the information for identifying the photographed person are collated, and the photographed person is determined in accordance with the match. A subject identification means for identifying;
The photographing apparatus based on the photographing control information received from the user after recognizing that the photographed person is in the photographable area when the photographed person is specified by the photographed person specifying unit. The photographed person is photographed, and the photographed image is transmitted to the server. The server accepts a change in the photographing control information while streaming the received image to the user, and the server changes the photographed control information. A photographic camera device control program that operates as a photographic device control unit that causes the photographic device to shoot a subject based on the photographic control information . A server that accepts registration from a user, detects a person to be photographed based on a preset photographing plan, recognizes that the person to be photographed is in a photographable area, and causes the photographing camera apparatus to photograph the person to be photographed Because
The shooting plan includes information for specifying a subject and shooting control information for controlling execution of shooting by the shooting camera device,
Shooting plan registration means for receiving registration of the shooting plan from a user;
A shooting plan distribution means for distributing the shooting plan to the shooting camera device;
Image receiving means for receiving an image taken from the photographing camera device;
Image delivery means for streaming delivery of the image received by the image receiving means to a user;
An automatic photographing management server including photographing plan update means for accepting a change in the photographing control information already registered during operation of the image distribution means . An automatic photographing management server control program for operating a computer as the automatic photographing management server according to claim 15 .

Images