JP5304751B2 - Image creating apparatus and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve creation of photographic stickers and users' satisfaction with created photographic stickers. <P>SOLUTION: A display control part 235 regulates a photographed image in which a plurality of users are photographed as subjects so that the photographed image is displayed as a moving image on a display part in real-time, and a composition processing part 231 combines a compositing image with each subject in the moving image displayed on the display part and combines an overall compositing image, which is different from any of the compositing images combined with each subject, with the whole subjects in the moving image when each subject in the moving image has a prescribed positional relation. Then a photographed image with the overall compositing image combined is output as a static image. The invention is applied to a photographic sticker creating apparatus, for example. <P>COPYRIGHT: (C)2012,JPO&amp;INPIT

Description

  The present invention relates to an image creating apparatus and method, and a program, and more particularly to an image creating apparatus and method capable of improving the work of creating a photo sticker and user satisfaction with the created photo sticker, and Regarding the program.

  Conventionally, a user (subject) is photographed, and a graffiti editing process is performed in which a prepared image is combined with the obtained photographed image or a character or a line drawing is superimposed, printed on sticker paper, and a photo sticker There is a photographic seal machine provided to users.

  This photo sticker is installed, for example, in an entertainment (game) facility such as a game center, and provides services mainly to high school girls and female junior high school students for a fee. Users can not only enjoy creating photo stickers as a game, but also cut out photo stickers with edited images printed in various sizes and paste them on their belongings. doing.

  The game for creating a photo sticker is performed by shooting a subject, editing a graffiti on the shot image, and outputting the edited image to a photo sticker. The user plays this series of processes within the time limit, and receives a photo sticker created as a product. Therefore, in order to improve user satisfaction, it is important to improve the fun of the photo sticker creation work as well as to improve the quality of the photo sticker.

  In a photo sticker that provides such a photo sticker creation game, an image of a subject that is a user is displayed in real time as a moving image (live view image) at the time of shooting. Then, shooting can be performed while checking the live view image.

  By the way, there is a photo sticker that displays a live view image in which a frame area at a selected position is corrected by a user selecting a frame display position for a portion to be corrected in a live view image (Patent Document 1). reference).

  There is also an imaging device that detects the face of a subject in a captured image and displays a face position marker corresponding to the detected facial expression superimposed on the captured image (see Patent Document 2).

  Furthermore, in order to create a photo sticker with a surprise and enjoyment for the user, the photo sticker machine displays an image that has a different design from the composite image that was edited and input for the shot image to be edited. A technique has been proposed in which a photo sticker paper is combined and printed (see Patent Document 3).

JP 2005-277772 A Japanese Patent No. 4264663 JP 2005-195857 A

  By the way, in the photo sticker of Patent Document 1, the frame displayed in the live view image is for representing the area to be corrected, and is displayed superimposed on the captured image in the imaging device of Patent Document 2. The face position marker is merely for indicating the position of the face of the subject. In other words, these frames and face position markers do not give the user who is the subject an interest in shooting.

  In addition, in the photo sticker of Patent Document 3, the image synthesized on the photo sticker that is finally printed is unknown to the user, and an image that satisfies the user is not always synthesized, The editing input operation itself was not interesting.

  The present invention has been made in view of such a situation, and makes it possible to improve the work of creating a photo sticker and the satisfaction of a user with respect to the created photo sticker.

  An image creation apparatus according to one aspect of the present invention is an image creation apparatus that captures a user as a subject and outputs the obtained image, and an imaging unit that captures a plurality of users as subjects and obtains captured images. Display control means for controlling the photographed image photographed by the photographing means to be displayed as a moving image on the display unit in real time, and compositing images for each subject in the moving image displayed on the display unit The synthesizing means, and the synthesizing means is the synthesis image synthesized with each of the subjects in the entire moving image when each of the subjects in the moving image has a predetermined positional relationship. One different overall synthesis image is synthesized, and the photographing means outputs the photographed image as a still image in which the whole synthesis image is synthesized.

  In this image creating apparatus, the photographing unit is configured by, for example, a photographing processing unit, the display control unit is configured by, for example, a display control unit, and the combining unit is configured by, for example, a combining processing unit.

  In the image creating apparatus of the present invention, a plurality of users are photographed as subjects to obtain a photographed image, and the photographed photographed image is controlled and displayed so as to be displayed on the display unit in real time as a moving image. When a compositing image is synthesized with each subject in the image and each subject in the moving image has a predetermined positional relationship, the entire subject in the moving image is different from the compositing image synthesized with each subject. The synthesized image is synthesized, and a captured image is output as a still image in which the entire synthesized image is synthesized.

  Thereby, for example, the user can make a frame image combined with each face portion of the subject in the live view image into one completed frame image by bringing the faces close to each other. Can be done while having fun. Moreover, since the completed frame image is reflected in the photographed image (image to be edited) and the edited image, it can be reflected in the photo sticker that is finally output. Therefore, it is possible to improve the photo sticker creation work and the user satisfaction with the photo sticker created.

  The overall synthesis image may be a combined synthesis image obtained by combining the synthesis images synthesized with each of the subjects.

  The combination composition image may form a predetermined figure, and the composition image may form a part of the predetermined figure.

  The image creating apparatus further includes a recognition unit for recognizing a subject's face in the moving image, and the synthesizing unit synthesizes the composition image with each of the subject's faces in the moving image. The combination composition image can be combined with the entire face of the subject in the moving image in which each of the faces has a predetermined positional relationship.

  The recognition means of this image creating apparatus is constituted by a face recognition unit, for example.

  The synthesizing unit can synthesize the combination synthesis image with the entire face of the subject in the moving image when the positions of the faces of the subject in the moving image fall within a predetermined distance range.

  The synthesizing means may be configured such that when the positions of the faces of the subject in the moving image are within a predetermined distance range and the size of each of the faces of the subject is larger than a predetermined size, The combination image can be combined with the entire face of the subject.

  The display control unit causes the display unit to display the moving image in which the subject is photographed and a model image that is an image of another subject registered in advance, and the combining unit displays the display When the subject image and the model image in the moving image displayed on the screen are combined with each other and the subject image and the model image in the moving image have a predetermined positional relationship, The whole subject image and the whole model image can be combined with one whole synthesis image different from the synthesis image synthesized with the subject and the model image.

  An image creation method according to an aspect of the present invention is an image creation method of an image creation apparatus that captures a user as a subject and outputs the obtained image, and images a plurality of the users as subjects. A capturing step, a display control step for controlling the captured image to be displayed on the display unit in real time as a moving image, and a compositing image for each subject in the moving image displayed on the display unit The composition step includes: a compositing step, wherein the compositing step processing includes composing the compositing image synthesized with each of the subjects in the moving image when the subjects in the moving image have a predetermined positional relationship. Is combined with one image for overall synthesis, and the process of the photographing step is performed as a still image obtained by combining the image for overall synthesis. And it outputs the captured image.

  In the image creating method of the present invention, a plurality of users are photographed as subjects to obtain a photographed image, and the photographed photographed image is controlled and displayed so as to be displayed on the display unit in real time as a moving image. When a compositing image is synthesized with each subject in the image and each subject in the moving image has a predetermined positional relationship, the entire subject in the moving image is different from the compositing image synthesized with each subject. The synthesized image is synthesized, and a captured image is output as a still image in which the entire synthesized image is synthesized.

  A program according to an aspect of the present invention is a program that causes a computer to perform processing for capturing a user as a subject and outputting an obtained image, and controls capturing of the plurality of users as subjects. A shooting control step for obtaining the image, a display control step for controlling the shot image to be displayed on the display unit in real time as a moving image, and a composition for each subject in the moving image displayed on the display unit And a compositing control step for controlling the compositing of the image. The processing of the compositing control step is performed when the subjects in the moving image are in a predetermined positional relationship. To control the synthesis of one overall synthesis image different from the synthesis image synthesized for each of the subjects. Processing of the imaging control step, the whole composite image is synthesized, and controls the output of the captured image as a still image.

  This program is recorded on a predetermined recording medium, read by a drive, for example, and installed in the photo sticker creating apparatus. Recording media include magnetic disks made of floppy (registered trademark) disks, optical disks made of CD-ROM (Compact Disc Read Only Memory), DVD-ROM (Digital Versatile Disc), MD (Mini Disc) (registered trademark), etc. And a removable medium such as a semiconductor memory.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to improve the user's satisfaction with the creation work of a photo sticker and the created photo sticker.

It is a perspective view which shows the example of one Embodiment of the photograph sticker production apparatus to which this invention is applied. It is a perspective view from the other angle of the photograph sticker production apparatus of FIG. It is a perspective view which shows the example of installation of the photograph sticker production apparatus of FIG. It is a figure explaining a user's space movement. It is a figure which shows the structural example of the front of a front unit. It is a figure which shows the structural example of the side surface of an edit unit. It is a figure which shows the structural example of the other side of an edit unit. It is a block diagram which shows the example of an internal structure of a photograph sticker production apparatus. It is a functional block diagram which shows the detailed structural example of a control part. It is a functional block diagram which shows the detailed structural example of an imaging | photography process part. It is a functional block diagram which shows the detailed structural example of a live view display control part. It is a flowchart explaining the example of the flow of photograph sticker creation game processing. It is a flowchart explaining the example of the flow of an imaging | photography process. It is a flowchart explaining the example of the flow of an imaging | photography process. It is a flowchart explaining the example of the flow of a live view display process. It is a figure which shows the example of a display of a touchscreen monitor. It is a figure explaining the synthesis | combination of a completed frame image. It is a figure which shows the other example of a display of a touchscreen monitor.

  FIG. 1 is a diagram showing an example of an embodiment of a photo sticker creating apparatus to which the present invention is applied.

  The photo sticker creating apparatus 1 in FIG. 1 enhances the amusement of work such as shooting and editing, and allows the user to perform such work as a game (play service), and uses the shot image or edited image as a photo sticker or data. It is a game device (play service providing device) that receives money from the user instead of providing it to the user.

  In the photo sticker creating game executed by the photo sticker creating apparatus 1, the user inputs the price of the game, takes a picture of himself / herself using the camera provided in the photo sticker creating apparatus 1, and displays the photographed image. On the other hand, the background image is synthesized, and editing (doodle editing) such as adding an image for synthesis by an editing function such as pen input or stamp input is performed, and the photographed image is designed to be rich. After the game ends, the user receives a photo sticker or the like on which the edited image is printed as a product.

  Such a photo sticker creating apparatus 1 is normally installed in a game center, a store in a sightseeing spot, or the like. That is, the photo sticker creating apparatus 1 is sold to managers of those stores from, for example, manufacturers and sales companies. The manager who has purchased the photo sticker creating apparatus 1 installs the photo sticker creating apparatus 1 in a store (for example, a game center) to manage and operate the photo sticker creating apparatus 1 for general users represented by female high school students and female junior high school students. Play the created game for a fee, and make a profit by paying for it.

  Therefore, the high profit rate of the photo sticker creating apparatus 1 is important for the store manager. That is, it is desirable that the photo sticker creating apparatus 1 has a high rate of return per unit time. Moreover, in the case of a normal store, the installation place of the photograph sticker production apparatus 1 is limited by restrictions, such as a floor area and a structure. Therefore, it is desirable that the photo sticker creating apparatus 1 has a high profit rate per unit floor area. Furthermore, since the size and shape of each store are usually not the same, and other game machines and the like installed together with the photo sticker creating apparatus 1 are also different, it is desirable that the degree of freedom of installation is higher.

  As a method of improving the profit rate, for example, there is a method of improving the rotation rate of the photo sticker creation game. That is, it is a method of increasing the rate of return per unit time by increasing the number of games played within a predetermined time. However, if there is no user who plays the photo sticker creation game, the profit rate is not improved. Therefore, it is also important to improve the user's expectation and satisfaction with respect to the photo sticker creating game of the photo sticker creating apparatus 1.

  For example, the photo sticker creating apparatus 1 can increase the number of users by providing a function with high expectation that a user who has never played a game wants to play. In addition, by providing a function with a high degree of satisfaction that a user who has played once thinks that “it was fun and would like to play again”, the photo sticker creating apparatus 1 increases the number of users by increasing so-called repeaters. be able to. As a result, the profit of the photo sticker creating apparatus 1 is improved.

  For the user, the photo sticker creating apparatus 1 is roughly divided into playing a photo sticker making game (photo sticker making work) and obtaining a photo sticker image and a photo sticker as a result (finished photo). There are two types of entertainment: the seal itself.

  Examples of the former method for improving the amusement of photo sticker creation work include, for example, a multi-functionality of shooting functions and editing functions such as graffiti editing, improved operability, or adjustment of play time and waiting time. . The latter method of improving the amusement of the completed photo sticker itself is, for example, improvement of hardware such as improvement of the quality of sticker paper, high image quality printing, special color printing, etc. Improve the satisfaction level of the elderly.

  In addition, high school girls and junior high school students who are the main users not only stick the obtained photo sticker to their property, but also exchange the photo sticker or talk about the photo sticker as a topic. To do. Therefore, for example, when the image content of a photo sticker is flashy, interesting, scarce or novel, the user may like the photo sticker, but not only that, It is also possible that the conversation will be excited about the photo sticker.

  In this way, by improving the enjoyment of the photo sticker, not only will the user's satisfaction be improved, but the expectation of others will also be improved, attracting customers due to the spread of reputation, that is, by so-called word-of-mouth You can also expect to increase new users. Therefore, by using such a photo sticker, the photo sticker itself can also serve as an advertisement for the photo sticker creating apparatus 1.

  In other words, in the photo sticker creation game, by providing a function that can create images that users will like, not only the user's satisfaction with the photo sticker creation game but also the satisfaction with the photo sticker is improved. Furthermore, the topicality of the photo sticker and the advertising effect can be improved at the same time.

  Although the photo sticker creating apparatus 1 has such a feature, the casing 10 includes four units, that is, a photographing unit 12, an editing unit 13, a ceiling strobe unit 14, and a background curtain unit 15, as shown in FIG. It is roughly divided into

  The photographing unit 12 has a function of photographing a user or the like as a subject, and the subject is photographed in an internal photographing space described later. The photographing unit 12 is roughly divided into two units, a front unit 12A and a rear unit 12B.

  The front unit 12A is a unit on the front side of the shooting space, and performs processing related to shooting of the user in the shooting space and accepts operations related to the user's photo sticker creation game. The rear unit 12B is a unit on the side that is the rear side of the shooting space, and is a unit that plays the role of the user when the front unit 12A takes a picture. The interior of the rear unit 12B is a cavity (space), and is configured as a part of a shooting space used when a user performs shooting. A stage or the like used for the user to pose may be provided in the rear unit 12B. An external monitor 16, a speaker 17, and a touch button 18 are provided on the side surface of the front unit 12A. Details thereof will be described later.

  The editing unit 13 is provided with a configuration (for example, a monitor, a touch panel, and a touch pen) for the user to perform graffiti editing or the like on the captured image. As will be described later, the editing unit 13 consisting of one frame is provided with a configuration for performing graffiti editing and the like on each of the two surfaces so that two sets of users can perform editing work simultaneously. Yes. As will be described later, the photo sticker creating apparatus 1 can execute a plurality of photo sticker creating games in parallel. In other words, a plurality of sets of users can play the photo sticker creation game in the photo sticker creation device 1 at the same time. The editing unit 13 has a configuration for performing two graffiti editing and the like so that a plurality of sets of users can simultaneously perform graffiti editing in order to improve the rotation rate of the photo sticker creation game. Is provided.

  The ceiling strobe unit 14 provided above the photographing space incorporates a strobe that emits flash light toward the photographing space in accordance with the photographing timing. The ceiling strobe unit 14 is further provided with a fluorescent lamp, and functions as illumination that constantly illuminates the shooting space (the user in the shooting space). The photographing space is simply configured as a closed space as will be described later. Therefore, it is difficult for light to enter from the outside, and the user's operability may be deteriorated because it tends to be dark. Therefore, the ceiling strobe unit 14 can illuminate the shooting space with the illumination to avoid such a fear and improve operability. Such illumination is also provided in the front unit 12A. A configuration example of the front unit 12A will be described later with reference to FIG.

  Moreover, the background curtain unit 15 provided with the movable curtain (background curtain) utilized for a background is provided in the upper part of the back unit 12B, for example. In the background curtain unit 15, for example, a plurality of winding curtains having different colors or patterns are suspended. For example, there are colors and patterns that are popular among young women who are the main users, such as bright single colors, stylish and cute patterns like foreign picture books, and colorful pop patterns (for the masses). Multiple items are aligned.

  The background curtain unit 15 operates in conjunction with a photographing function such as a camera or a strobe provided in the front unit 12A. At the time of photographing, for example, a curtain of a color selected by the user is lowered and other curtains are wound. take. By operating in this manner, the background curtain unit 15 can easily provide a background of a design desired by the user, a design according to the shooting mode, and the like. Thereby, the photograph sticker creation apparatus 1 can improve the user's satisfaction with respect to an image (photo sticker).

  The number of curtains (background curtains) provided in the background curtain unit 15 is arbitrary. For example, only one background curtain may be suspended from the background curtain unit 15. In this case, the photo sticker creating apparatus 1 may prepare a plurality of types of background images for composition, and may synthesize the background image selected by the user from the photographed images. By doing in this way, even if there is only one physical background curtain provided in the photo sticker creating apparatus 1, the photo sticker creating apparatus 1 can cope with various user preferences.

  When the user is shooting in the shooting space in the shooting unit 12, the external monitor 16 is located next to the user who is waiting to use the shooting space next time or the photo sticker creating apparatus 1. Content (demonstration) and photos that output (display) a video showing the progress of the user's game during shooting, and guide (explain) the flow and play of the photo sticker creation game An advertisement or the like of a store or a region where the sticker creating apparatus 1 is installed is output. If an error has occurred in the photo sticker creating apparatus 1, the content of the error is output.

  The speaker 17 outputs sound that matches the video, content, advertisement, etc. output from the external monitor 16.

  The touch button 18 is configured not to have a mechanically operating mechanism, and is operated (touched) by a predetermined user, thereby sensing pressure or static electricity caused by the touch and accepting the user's operation. When the touch button 18 receives a user operation, the contents of the video, content, advertisement, and the like output from the external monitor 16 are switched as appropriate. The touch button 18 may be configured to be displayed on a part of the display area of the external monitor 16 when the external monitor 16 is configured with a touch panel superimposed thereon. Alternatively, it may be configured as a push button having a mechanically operated mechanism.

  Further, the external monitor 16, the speaker 17, and the touch button 18 are provided on any one of the side surfaces of the front unit 12A. That is, the side surface of the front unit 12A (not shown in FIG. 1) is connected to the side surface of the front unit 12A in which the external monitor 16, the speaker 17, and the touch button 18 are provided in FIG. When the button 18 is not provided, the external monitor 16, the speaker 17, and the touch button 18 can be installed.

  FIG. 2 is a perspective view of the photo sticker creating apparatus 1 of FIG. 1 as viewed from the editing unit 13 side.

  As shown in FIG. 2, the editing unit 13 is installed adjacent to the surface of the front unit 12A opposite to the surface on the rear unit 12B side (that is, the surface on the imaging space side). A first editing interface 13A and a second editing interface 13B are provided on two side surfaces of the editing unit 13 that are orthogonal to the front unit 12A. That is, the editing unit 13 allows a plurality of sets of users who perform the photo sticker creation game to perform editing operations with the editing unit 13 facing each other in a direction orthogonal to the direction connecting the front unit 12A and the rear unit 12B. Two editing interfaces are provided so that this can be done.

  Also, on the surface of the editing unit 13 that faces the photographing unit 12, a photo sticker discharge unit 13C that is provided to the user by discharging the photo sticker created by playing the photo sticker making game is provided. ing.

  FIG. 3 is an external view showing an installation example of the photo sticker creating apparatus 1.

  When the photo sticker creating apparatus 1 is installed in a game center or the like, for example, as shown in FIG. 3, a side curtain 21 is provided so as to surround the photographing unit 12 and the editing unit 13. The side curtain 21 simply surrounds an imaging space in which an imaging operation is performed, an editing space in which an editing operation is performed, and the like, and improves the closeability of each space. In other words, for example, the side curtain 21 contributes to high-quality shooting and the visibility of the editing screen by stabilizing the environment in each space, or blocks the field of view from outside each space. It is possible to perform operations such as shooting and editing without being conscious of the line of sight from the outside.

  The outer surface of the side curtain 21 is usually used as a place to place an advertisement, and a flashy design image representing the model name and model image of the photo sticker creating apparatus 1 is provided so as to attract attention at the installation location. Printed.

  The photo sticker creating apparatus 1 as described above causes each set of users to play a photo sticker creating game. The photo sticker creating apparatus 1 can simultaneously execute a plurality of photo sticker creating games. That is, the photo sticker creating apparatus 1 can cause a plurality of sets to play a photo sticker creating game at the same time. At this time, each group of users can perform each work of the photo sticker creation game while moving through a plurality of spaces provided in the photo sticker creation device 1 to advance the game.

  Next, the flow of the photo sticker creation game and the accompanying movement of the space will be described with reference to FIG.

  FIG. 4 is a plan view of the photo sticker creating apparatus 1 as viewed from above during the user's game. As shown in FIG. 4, the user passes from the outside (user A or user A ′) between the front unit 12A and the rear unit 12B, and is indicated by the dotted line in the figure, the front unit 12A and the rear unit. The photograph sticker creation game is started by entering the photographing space 32 where the photographing work is performed and the price is inserted (User B). If the previous group of users is using the shooting space 32 (if shooting is in progress), the user waits outside the unit (user A or user A ′). In FIG. 4, the user (user A) outputs a video showing the progress of the user's game being photographed and the flow of the photo sticker creation game, how to play, etc., which are output from the external monitor 16 and the speaker 17. It is possible to wait while watching the content that guides the user.

  When the price is inserted and the photo sticker creation game is started, the user (user B) performs a shooting operation to photograph himself / herself using a camera or a monitor provided in front of the front unit 12A. .

  When the photographing operation is completed, the user selects one of the obtained photographed images to be saved as an image to be edited, and in accordance with the displayed movement guide, from the photographing space 32 where the photographing operation is performed, a dotted line in the figure. It moves to the edit space which performs edit work shown by.

  A first editing space 33A is provided on the left side of the editing unit 13 as viewed from the front unit 12A (in front of the first editing interface 13A), and a second editing space 33B is provided on the right side (in front of the second editing interface 13B). ing. That is, in this photo sticker creation apparatus 1, a total of two sets of users, the user (user C) of the first editing space 33A and the user (user C ') of the second editing space 33B, simultaneously edit. Work can be done. A user (user B) of the shooting space 32 is guided to a free one of the two editing spaces. When the user moves to the first editing space 33A or the second editing space 33B, the user performs a graffiti editing work. Hereinafter, when it is not necessary to distinguish the first editing space 33A and the second editing space 33B, they are referred to as an editing space 33.

  Thereafter, when the graffiti editing is completed, the user (user C or user C ′) next performs print setting work and sets the number of divisions and the like. When printing is started, the user performs image transmission, questionnaire input, mini-games, and the like during the printing. Then, when printing is completed, it moves to the printed matter receiving area 34 in front of the photo sticker discharge unit 13C (user D), receives the discharged photo sticker paper, and ends the photo sticker creation game.

  In the photo sticker creation game as described above, when the user B of the shooting space 32 moves to the editing space 33, the shooting space 32 becomes unused, so the photo sticker creation device 1 uses a new set. A person can use the photographing space 32. Further, when the user C of the first editing space 33A or the user C ′ of the second editing space 33B moves to the printed material receiving area 34, the first editing space 33A or the second editing space 33B is not used. Therefore, the photo sticker creating apparatus 1 can cause a new set of users (user B) to use the first editing space 33A or the second editing space 33B. Note that when both the first editing space 33A and the second editing space 33B are unused, the photo sticker creating apparatus 1 gives the user (user B) the first editing space 33A and the second editing space 33B. In addition to guiding the user to use one of the editing spaces 33B, when the user moves to a direction other than the guided editing space, the user can be guided to the guided editing space.

  In other words, the photo sticker creating apparatus 1 uses the shooting space 32, the first editing space 33A, the second editing space 33B, and the printed matter in order to improve the rotation rate per unit time and unit floor area of the photo sticker creating game. Using the receiving area 34, a plurality of sets of users can play a photo sticker creation game at the same time (multiple customer service can be performed).

  In addition, the structure of such a housing | casing 10 is arbitrary and may be a structure other than what was mentioned above. Similarly, the method of multiple customer service is also arbitrary.

  Next, the configuration of each unit will be described.

  FIG. 5 is a diagram illustrating a configuration example of the front unit 12A. A front surface 12A-1 in FIG. 5 is a side surface facing the imaging space 32, and is a front surface for the user who performs the imaging operation. That is, the user basically performs a photographing operation in the photographing space 32 toward the front surface 12A-1 (facing the front unit 12A).

  Near the center of the front surface 12 </ b> A- 1, a camera 51 for photographing a subject in the photographing space 32 is provided, and a touch panel monitor 52 is provided below the camera 51. The touch panel monitor 52 functions as, for example, a live view monitor that displays a composite image (moving image) obtained by combining an image such as a background or foreground with a captured image that has been photoelectrically converted by the camera 51 and captured in real time (immediately). And a function of displaying various GUI (Graphical User Interface) images and receiving a user's instruction through a touch panel superimposed on the screen. In addition, the front surface 12A-1 illuminates the inside of the photographing space 32 behind the milky white acrylic plate 53-1 to the milky white acrylic plate 53-6 formed of a curved surface or a flat surface, or matches the photographing timing by the camera 51. In addition to the installation of a lighting device that emits flash light, a fee for baggage storage areas 54-1 and 54-2 for placing user's baggage and the like during shooting, and a photo sticker creation game was introduced. A coin insertion / return port 55 is provided.

  Further, on the front surface 12A-1, on the back side of the milky white acrylic plate 53-1 to the milky white acrylic plate 53-3, near the ceiling of the shooting space 32, guidance sound in the shooting work of the photo sticker creation game, BGM (Back A speaker 124 (FIG. 8) (not shown) that outputs sound such as Ground Music) and sound effects is provided. In addition, the number and installation positions of the speakers 124 are arbitrary.

  The camera 51 is configured by an imaging device or the like using a CCD (Charge Coupled Device), and captures a moving image as a captured image by capturing a user in the photographing space 32 in the photographing work process of the photo sticker creation game. A part of the captured image captured by the camera 51 is cut out or an image such as a background is combined and displayed on the touch panel monitor 52 immediately. In addition, from the captured image captured by the camera 51 at a predetermined timing, an image of the frame at that timing is extracted and stored as a captured image (still image).

  For example, a camera using a CMOS sensor may be used as the camera 51 instead of the CCD. Of course, any camera other than these may be used as long as the user can be photographed and digital image data can be obtained. Further, the number of cameras 51 and the installation position are arbitrary.

  The touch panel monitor 52 includes, for example, a live view monitor 123 (FIG. 8) such as a CRT (Cathode Ray Tube) or an LCD (Liquid Crystal Display) and a colorless and transparent touch panel laminated thereon, and is used during photographing work. The captured image captured by the camera 51 is displayed immediately (in real time) so that the person can determine the standing position and posture while checking the photographing result. At this time, for example, the captured image displayed on the touch panel monitor 52 is synthesized with an image designated by the user, such as a background or a foreground, or a part of the captured image is trimmed (trimmed) according to the image size of the image. Or). In addition, the touch panel monitor 52 displays an image related to the shooting work such as a guide image for guiding the procedure of the shooting work, and the touch panel (for example, pressure-sensitive type or electromagnetic induction type) accepts a tap operation by a user's finger or the like, for example. It is made like that.

  Behind the milky white acrylic plate 53-1 to the milky white acrylic plate 53-6, a plurality of lighting devices capable of fluorescent light and strobe light emission are installed to brighten the shooting space 32 and ensure operability and safety. Furthermore, in order to constantly illuminate the shooting space 32 and improve the image quality of the shot image, the flash is emitted at a timing corresponding to the shooting timing, and the user who is shot is irradiated with light from various angles. Hereinafter, the milky white acrylic plate 53-1 to the milky white acrylic plate 53-6 are referred to as a milky white acrylic plate 53 when it is not necessary to distinguish between them. Further, an LED (Light Emitting Diode) (not shown) may be provided on the surface of the predetermined milk-white acrylic plate 53 in order to adjust the brightness of the photographing space 32 by flash emission.

  The luggage storage areas 54-1 and 54-2 are shelves that are used as storage areas for user baggage at the time of photographing. The luggage storage areas 54-1 and 54-2 do not interfere with shooting, that is, do not interfere with the user's shooting pose and do not interfere with the above-described illumination of the illumination device. In the position. The user can perform photographing work more comfortably by placing the baggage in the luggage storage areas 54-1 and 54-2.

  The coin insertion / return port 55 is a user interface that allows a user to insert a coin as a price for a photo sticker creation game, or to return a coin that has failed to be inserted or a coin for fishing.

  Of course, a configuration other than that described above may be provided on the front surface 12A-1 of the front unit 12A.

  Next, the configuration of the editing unit 13 will be described.

  FIG. 6 is a diagram illustrating a configuration example of the left side of the editing unit 13 as viewed from the photographing unit 12 side (configuration example on the first editing space 33A side).

  In FIG. 6, an illumination device 61 is provided above the first editing interface 13A to illuminate the first editing space 33A that becomes dark because it is partitioned by the side curtain 21 or the like. The illuminating device 61 allows the photo sticker creating apparatus 1 to suppress a reduction in the user's editing work efficiency and improve the safety of the first editing space 33A. In the example of FIG. 6, the upper portion of the editing unit 13 on the first editing interface 13 </ b> A where the lighting device 61 is provided penetrates to the second editing space 33 </ b> B side. The first editing space 33A and the second editing space 33B are shared. That is, the illumination device 61 illuminates not only the first editing space 33A but also the second editing space 33B, thereby improving safety. Note that the installation position and the number of the illumination devices 61 are arbitrary.

  The first editing interface 13A is provided with a tablet built-in monitor 62, two touch pens 63-1, a touch pen 63-2, a speaker 64, and an additional coin insertion / return port 65.

  In the tablet built-in monitor 62, a colorless and transparent tablet capable of inputting position information with the touch pen 63-1 or the touch pen 63-2 is superimposed on a display screen of a display device capable of displaying an image such as a CRT display or an LCD. It is constituted by. Accordingly, the tablet built-in monitor 62 not only displays a GUI image or the like by the display device but also accepts an input operation from the user by the tablet. On the tablet built-in monitor 62, for example, an editing screen including a GUI image for editing work for editing a shot image obtained by shooting work in a shooting space is displayed.

  The touch pen 63-1 and the touch pen 63-2 are detachably fixed to the editing unit 13 by a predetermined attachment on the left and right sides of the tablet built-in monitor 62 one by one on the left and right sides. By using each of these touch pens, it is possible to play the editing process of the photo sticker creation process at the same time. In the following description, the touch pen 63-1 and the touch pen 63-2 are simply referred to as the touch pen 63 when it is not necessary to distinguish them from each other.

  The touch pen 63 is electrically connected to a system installed inside the editing unit 13 by wire (or wireless). The touch pen 63 operates in cooperation with the tablet of the tablet built-in monitor 62. When the user operates the touch pen 63 and taps the tablet (the touch pen 63 and the display screen of the tablet built-in monitor 62 are brought into contact (or close proximity)), the tablet operates as an input unit that receives input from the user. To do. The number of touch pens 63 to be installed, the installation position, the shape, and the like are arbitrary.

  The speaker 64 outputs, for example, sound related to editing work of the photo sticker creation game, such as guidance sound, sound effects, or BGM. The speaker 64 is disposed on the right side of the tablet built-in monitor 62. Since a right-handed user performs an editing operation while holding the touch pen 63 with the right hand, even when the editing operation is performed while leaning on the editing unit 13, there is little possibility of leaning on the right side of the tablet built-in monitor 62. Therefore, by disposing the speaker 64 on the right side of the tablet built-in monitor 62, even when a right-handed user performs an editing operation while leaning on the editing unit 13, the user closes the speaker 64 and can hear sound. It can be prevented from disappearing. The number, design, shape, etc. of the speakers 64 are arbitrary.

  The additional coin insertion / return port 65 is provided to allow the user to insert additional coins or return the change when the user wants to extend the editable time or outputs a plurality of photo stickers. It has been. In addition, payment of this additional price is not limited to a coin, Naturally, it can also be made to be able to pay also with a banknote. In addition, instead of cash (coins and banknotes) that are actually distributed, payment can also be made with prepaid cards, coins, electronic money, etc. distributed at amusement facilities where the photo sticker creation device 1 is installed. May be.

  However, the extension of the editable time is performed when the shooting operation is not currently performed in the shooting space 32 (when there is no next user) or the other editing interface (in this case, the second editing interface). 13B) is possible only when it is empty, and cannot be extended when the shooting operation is performed in the shooting space 32 and the other editing interface is used.

  Note that the configuration of the editing unit 13 on the second editing space 33B side is basically the same as the configuration of the first editing space 33A side shown in FIG. In the following, the configuration example shown in FIG. 6 is also applied to the case where the configuration of the editing unit 13 on the second editing space 33B side is described.

  FIG. 7 is a diagram illustrating a configuration example of the photo sticker discharge unit 13 </ b> C of the editing unit 13.

  As shown in FIG. 7, the photo sticker discharging unit 13C has a photo sticker created by a user who has performed editing work in the first editing space 33A (that is, a photo sticker created by operating the first editing interface 13A). And a photo sticker discharge port 71 through which a photo sticker created by a user who has performed editing work in the second edit space 33B (that is, a photo sticker created by operating the second edit interface 13B) is discharged. It has been.

  A printer is installed inside the editing unit 13, and a printing image created by operating the first editing interface 13A or the second editing interface 13B is printed on sticker paper by the printer. The photo sticker output from the printer is discharged from the photo sticker discharge port 71.

  Further, a speaker (not shown) may be provided in the photo sticker discharge unit 13C. The speaker (not shown) outputs sound relating to printing and discharging of the photo sticker such as guidance sound, sound effect, or background music.

  Next, an internal configuration example of the photo sticker creating apparatus 1 will be described.

  FIG. 8 is a block diagram illustrating a functional configuration example of the photo sticker creating apparatus 1. The same parts as those described above are denoted by the same reference numerals.

  In FIG. 8, the photo sticker creating apparatus 1 includes a control unit 101 that is a processing unit that controls the entire apparatus of the photo sticker creating apparatus 1. The control unit 101 includes a storage unit 102, a communication unit 103, A drive 104, a ROM (Read Only Memory) 106, a RAM (Random Access Memory) 107, a photographing unit 112, an editing unit 113, a printer 114, an external monitor 16, a speaker 17, and a touch button 18 are respectively connected via predetermined buses. Connected.

  The storage unit 102 has a non-volatile storage medium such as a hard disk or a flash memory, and stores various setting information supplied from the control unit 101 in the storage medium or is recorded in the storage medium. The setting information is read and supplied to the control unit 101. Note that this storage medium may be anything as long as it can store information.

  The communication unit 103 is connected to another communication device (not shown) via an external network (not shown) such as the Internet or a public telephone line network, or simply via a communication cable (not shown). And is controlled by the control unit 101 to communicate with another communication device such as a mobile terminal such as a user's mobile phone, a user's personal computer, or a central management server. For example, the communication unit 103 transmits a transmission signal supplied as a communication signal from the control unit 101 to another communication device, or supplies a reception signal supplied from another communication device to the control unit 101 as a communication signal. To do.

  The drive 104 includes a removable medium such as a magnetic disk (including a flexible disk), an optical disk (including a CD-ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc)), a magneto-optical disk, and a semiconductor memory. The computer program and data read out from them are supplied to the control unit 101 as necessary, and stored in the storage unit 102 or installed.

  The ROM 106 stores programs and data executed by the control unit 101 in advance, and the ROM 106 supplies the programs and data to the control unit 101 based on instructions from the control unit 101. The RAM 107 temporarily holds data and programs processed by the control unit 101.

  The imaging unit 112 is a block related to the imaging unit 12 and includes a coin processing unit 121, a background curtain unit 15, an illumination control unit 122, a camera 51, a touch panel monitor 52, and a speaker 124.

  The coin processing unit 121 is activated in response to an activation signal input from the control unit 101. When a coin is inserted into the coin insertion / return port 55, a process related to payment for the photo sticker creation device 1 by the user (game participation) And the activation signal is supplied to the control unit 101. In response to the activation signal, the control unit 101 causes the touch panel monitor 52 and the speaker 124 to perform charging processing, guidance, and the like.

  Based on the background control signal supplied from the control unit 101, the background curtain unit 15 selects a background to be provided, that is, raises and lowers (expands and stores) the movable background curtain. The background may be selected manually by the user.

  Based on the illumination control signal supplied from the control unit 101, the illumination control unit 122 turns on or off the illumination device installed behind the milky acrylic plate 53.

  The camera 51 is controlled by the control unit 101 to shoot a user or the like in the shooting space 32 as a subject in the shooting process of the photo sticker creation game. For example, the camera 51 captures a moving image under the control of the control unit 101 and supplies the captured moving image data to the control unit 101. In addition, the camera 51 acquires a captured image (still image) by operating a mechanical shutter based on a shutter control signal supplied from the control unit 101, and stores the acquired still image data in the storage unit 102. Let

  The touch panel monitor 52 includes a live view monitor 123. The live view monitor 123 of the touch panel monitor 52 is an image based on RGB signals supplied from the control unit 101 (an image captured in real time by the camera 51, a composite image created using a captured image, a GUI image, or the like). Is displayed. Further, when the user taps (touches or approaches) the touch panel monitor 52 using his / her own finger or the like, the touch panel monitor 52 supplies the position information to the control unit 101. The control unit 101 analyzes the position information, identifies and accepts information and instructions input by the user with respect to the display image.

  The speaker 124 is provided at an arbitrary position of the photographing unit 12 and outputs, for example, sound of a sound signal supplied from the control unit 101 (such as shooting work guidance sound, sound effect, or background music).

  The editing unit 113 is a block related to the editing unit 13, and includes a first editing unit 113A corresponding to the first editing interface 13A and a second editing unit 113B corresponding to the second editing interface 13B. The first editing unit 113A and the second editing unit 113B have the same configuration, and the following description is given with respect to the first editing unit 113A, but is also applicable to the second editing unit 113B.

  As described with reference to FIG. 6, the first editing unit 113 </ b> A includes a coin processing unit 130 in addition to the tablet built-in monitor 62, the touch pen 63-1 and the touch pen 63-2, and the speaker 64.

  As described above, the tablet built-in monitor 62 includes the editing monitor 141 made of a display device such as a CRT display or LCD, and the colorless and transparent tablet 142 superimposed on the display screen of the editing monitor 141. The tablet built-in monitor 62 displays on the editing monitor 141 an image relating to editing, such as an editing input GUI and a photographed image, corresponding to the RGB signal supplied from the control unit 101. When the user operates the touch pen 63-1 or the touch pen 63-2 and taps the tablet 142, the tablet built-in monitor 62 supplies a signal representing the position information to the control unit 101 as an input signal. The control unit 101 analyzes the position information represented by the input signal, specifies and accepts information and instructions input by the user with respect to the display image. That is, editing input for the captured image is performed using these configurations.

  The speaker 64 outputs the sound of the sound signal supplied from the control unit 101 (editing work guide sound, sound effect, or sound related to the editing work process of the photo sticker creation game, such as BGM).

  The coin processing unit 130 is activated in response to an activation signal input from the control unit 101. When a coin is inserted into the additional coin insertion / return port 65, a process related to payment for the photo sticker creation apparatus 1 by the user (additional) Print acceptance), and supplies an activation signal to the control unit 101. The control unit 101 causes the printer 114 to perform additional printing processing in response to the activation signal.

  The printer 114 prints the result of editing work performed by the editing unit 113 on sticker paper. When the printer 114 acquires the editing work result performed by the first editing unit 113 </ b> A from the control unit 101, the printer 114 acquires the sticker paper 162 from the sticker paper unit 161 and prints the editing work result on the sticker paper 162. When the printing is finished, the printer 114 discharges the printed sticker paper 162 as a photo sticker from the photo sticker discharge port 71 and provides it to the user.

  When the external monitor 16 obtains information from the control unit 101 that the user is shooting in the shooting space 32 in the shooting unit 12, the user who is waiting to use the shooting space next time. In contrast, a video showing the progress of the game of the user who is shooting is output. In addition, while the external monitor 16 does not acquire information indicating that the user is shooting in the shooting space 32 in the shooting unit 12 from the control unit 101, the flow of the photo sticker creation game and how to play Output contents (demonstration) to guide (explain) etc. Under the control of the control unit 101, the speaker 17 outputs audio that matches the video and content output from the external monitor 16.

  Further, when the external monitor 16 acquires information indicating that the touch button 18 has been operated by the user from the control unit 101, the external monitor 16 switches and outputs the contents of the output video, content, and the like.

  When the touch button 18 is operated (touched) by a predetermined user, the touch button 18 supplies an input signal representing the operation content to the control unit 101. The control unit 101 supplies information indicating that the operation represented by the input signal has been received to the external monitor 16 and controls to switch the display content of the external monitor 16.

  Next, the control unit 101 will be described. FIG. 9 shows an example of a functional block configuration realized by the control unit 101 executing a program stored in the ROM 106 or the like.

  The control unit 101 is a shooting processing unit 202 that performs processing related to a price (coin) that is input when starting the photo sticker creation game, and processing related to a shooting work process of the photo sticker creation game such as shooting a user. An editing processing unit 203 that performs processing related to a photo sticker creation game editing process such as graffiti editing for a photographed image; The post-service processing unit 205 performs processing related to the post-service process of the photo sticker creation game that serves a user who has finished the editing work.

  That is, the control unit 101 controls processing relating to each process of the photo sticker creation game.

  FIG. 10 is a functional block diagram illustrating a more detailed configuration example of the imaging processing unit 202 in FIG.

  In the example of FIG. 10, the photographing processing unit 202 is a processing unit that performs processing in the photographing work process of the photo sticker creation game. For example, the photographing processing unit 202 accepts payment, photographs a user, and displays various GUIs. Process.

  In the example of FIG. 10, the shooting processing unit 202 includes a progress control unit 211, a shooting preparation processing unit 212, a composition image selection control unit 213, a live view display control unit 214, a captured image acquisition unit 215, and a composite image processing unit 216. Consists of

  The progress control unit 211 controls the progress of the photographing work process.

  The shooting preparation processing unit 212 performs processing related to shooting preparation, such as adjustment of reflection and adjustment of brightness.

  The composition image selection control unit 213 displays a composition image including a background and a foreground on the touch panel monitor 52, and controls processing related to the composition image selection performed by the user.

  The live view display control unit 214 performs processing related to display on the touch panel monitor 52 (live view display).

  The captured image acquisition unit 215 performs processing related to capturing, in particular, capturing of captured images.

  The composite image processing unit 216 performs processing related to generation of a composite image such as composite of captured images.

  FIG. 11 is a functional block diagram showing a more detailed configuration example of the live view display control unit 214 of FIG.

  The live view display control unit 214 includes a composition processing unit 231, a face recognition unit 232, a distance determination unit 233, a completed frame image acquisition unit 234, and a display control unit 235.

  The compositing processing unit 231 performs a shooting operation selected by the user on a real-time captured image (moving image) (captured image; hereinafter also referred to as a live view image) displayed on the touch panel monitor 52 (live view display). Synthesize the compositing image.

  The face recognition unit 232 recognizes the position (region) of the face of the user (subject) by a method such as detecting eyes in the live view image.

  The distance determination unit 233 determines whether or not the face of the subject in the live view image has a predetermined positional relationship based on the position of the face of the subject recognized by the face recognition unit 232, more specifically, the live view image. It is determined whether or not the position of the face of the subject is within a predetermined distance range.

  The completed frame image acquisition unit 234 acquires a completed frame image, which is one of the shooting composite images, based on the determination result of the distance determination unit 233.

  The display control unit 235 controls the touch panel monitor 52 to display the live view image combined with the shooting composition image.

  Next, the flow of the photo sticker creating game performed in the photo sticker creating apparatus 1 will be described with reference to the flowchart of FIG.

  In step S <b> 1, that is, while the photo sticker creation game is not performed in the shooting space 32, the shooting processing unit 202 of the control unit 101 performs a process of displaying a demonstration screen on the touch panel monitor 52.

  A user who performs a photo sticker creation game first inserts coins into the coin insertion / return slot 55 of the front unit 12A and pays for the game. The coin processing unit 121 accepts such coin insertion and supplies an activation signal to the control unit 101. In step S <b> 2, the imaging processing unit 202 determines whether or not a price has been inserted based on the activation signal, and proceeds to step S <b> 2 when determining that a valid price has been inserted. Note that until the user inserts a coin, the imaging processing unit 202 continuously performs a process of displaying a demonstration screen on the touch panel monitor 52.

  In step S <b> 3, the shooting processing unit 202 controls each unit of the shooting unit 112, and executes shooting processing that is processing related to shooting work of the photo sticker creation game performed in the shooting space 32.

  In the photographing process, the photographing processing unit 202 causes the user to select a composition image that is an image to be displayed as a background or foreground on the photographed subject image, and the photographed subject image and the composition selected by the user. A captured image obtained by combining the image for use is supplied to the edit processing unit 203. The details of the photographing process will be described later with reference to FIG. 13 and the like, but a plurality of (for example, six) photographed images are obtained by the photographing process.

  When the shooting operation is completed, in step S4, the shooting processing unit 202 gives the editing space 33 (the first editing space 33A or the second editing space) to the user in the shooting space 32 who has finished the shooting operation by an image or a sound. 33B) is provided to guide the movement.

  In step S5, the editing processing unit 203 performs an editing process in which the user who has moved to the editing space 33 performs editing input on a plurality of (for example, six) photographed images obtained by the photographing process.

  When the editing operation is completed, in step S6, the print processing unit 204 controls the printer 114 to perform a printing process for printing the edited image obtained by the editing operation on the sticker sheet 162 by the number corresponding to the standard price. .

  In step S7, the print processing unit 204 determines whether additional printing has been selected by the user. In the photo sticker creating apparatus 1, by paying the price for additional printing, it is possible to perform printing of a predetermined number of sheets more than the normal printing number. In step S6, the additional printing is performed by the user. It is determined whether or not the price for additional printing has been paid. In addition, selection of additional printing can be performed by the user paying the price for additional printing with respect to the additional coin insertion / return port 65 in the process of an edit process.

  If it is determined in step S7 that additional printing has not been selected, the print processing unit 204 skips step S8 and advances the process to step S9. On the other hand, if it is determined in step S7 that additional printing has been selected, the print processing unit 204 performs additional printing processing for printing the number of additional printings in step S8.

  In step S <b> 9, the post-service processing unit 205 performs post-service processing that provides a service for transferring the edited image to a mini game or a mobile terminal that posts the edited image for a user who is waiting for completion of printing. . When the post-service processing is completed, in step S10, the post-service processing unit 205 performs movement guidance for moving the user in the editing space 33 to the printed material receiving area 34. When the printing process is completed, in step S11, the print processing unit 204 controls the printer 114 to discharge the printed sticker sheet 162 from the photo sticker discharge port 71, and the photo sticker creation game process is ended.

  The photo sticker creation game is performed according to the above flow.

  Next, a detailed flow of the photographing process executed in step S3 of FIG. 12 will be described with reference to the flowchart of FIG. In the photographing process, as described above, for example, six photographed images are finally determined as editing processing targets.

  When the image capturing process is started, in step S31, the image capturing preparation processing unit 212 determines whether or not brightness has been selected. At this time, for example, a setting screen (GUI) for setting and inputting the brightness of the photographed image is displayed on the touch panel monitor 52, and the photographing preparation processing unit 212 is instructed by a user who operates the setting screen. An image brightness instruction is accepted.

  If it is determined in step S31 that the brightness has been selected, in step S33, the shooting preparation processing unit 212 determines the brightness of the captured image (captured image) corresponding to the brightness determined to be selected in step S31. Make adjustments. When this adjustment ends, the process proceeds to step S34.

  On the other hand, if it is determined in step S31 that no brightness has been selected, the shooting preparation processing unit 212 sets a default brightness in step S32, and in step S33, a shot image corresponding to the default brightness. Adjust the brightness of the (captured image).

  In step S34, the compositing image selection control unit 213 selects a photographing compositing image selection screen for selecting a photographing compositing image that is a foreground or background image that is prepared in advance and is combined with the captured image. GUI) is displayed on the touch panel monitor 52.

  On the shooting composition image selection screen, a composition background image and a composition foreground image are displayed as shooting composition images. The composition background image includes, for example, a normal image for determining the background color and an aura image such as an aura, a pattern, and a pattern synthesized on the back side of the subject. The composition foreground image includes, for example, the subject image. A frame image to be synthesized is included on the front side. That is, on the shooting composition image selection screen, for example, a shooting composition image is displayed for each of at least three types of genres: normal, aura, and frame.

  In step S35, the compositing image selection control unit 213 selects a photographic compositing image by the user from the photographic compositing images displayed in the process of step S34. Only the number of sheets (for example, 6 sheets) is accepted.

  In step S <b> 36, the live view display control unit 214 combines the shooting composition image and the captured image of the camera 51, and displays the combined captured image on the touch panel monitor 52 (live view display). Details of the live view display processing will be described later with reference to FIG.

  In step S37, the captured image acquisition unit 215 displays a countdown indicator on the touch panel monitor 52 or the like, controls the camera 51 to perform imaging, and obtains a captured image.

  In step S <b> 38, the composite image processing unit 216 combines the shooting composite image with the captured image obtained by shooting to generate a composite image. Further, in step S39, the composite image processing unit 216 displays the generated composite image on the touch panel monitor 52 or the like, and allows the user to confirm the composite image (photographing result).

  In step S40, the progress processing unit 211 determines whether or not the predetermined number of times has been shot. If the number of shots has not reached the predetermined number of times, the process returns to step S36, and the subsequent processing is performed. Repeated. For example, when photographing for obtaining a photographed image to be combined with each of the composition images selected on the composition image selection screen for photographing is performed and a total of six times of photographing are performed, photographing is performed a predetermined number of times in step S40. It is determined.

  If it is determined in step S40 that the image has been shot a predetermined number of times, the process proceeds to step S41 in FIG.

  In step S41 in FIG. 14, the progress control unit 211 determines whether or not it is within the shootable time, and determines whether or not shooting is possible based on the elapsed time or the remaining time. If it is determined in step S41 that shooting is possible, the process proceeds to step S42, where additional shooting, so-called “bonus shooting” is performed.

  In step S42, the progress control unit 211 displays a bonus shooting guide screen for guiding the bonus shooting on the touch panel monitor 52 and the like, and allows the user to check the outline of the bonus shooting.

  In step S43, the compositing image selection control unit 213 displays the shooting compositing image selection screen on the touch panel monitor 52 in the same manner as in step S34 in FIG. 13, and in step S44, as in step S35, by the user. The selection of a composite image for shooting is accepted.

  In step S45, as in step S36, the live view display control unit 214 combines the combining image and the captured image of the camera 51, and displays the combined captured image on the touch panel monitor 52 (live view display).

  In step S <b> 46, the captured image acquisition unit 215 performs bonus shooting, which is additional shooting. This bonus shooting is also performed in the same manner as the normal shooting described above. That is, the photographed image acquisition unit 215 displays a countdown indicator on the touch panel monitor 52 and the like, controls the camera 51, and obtains a photographed image, similarly to step S37.

  In step S47, similarly to step S38, the composite image processing unit 216 combines the shooting composite image with the captured image obtained by shooting to generate a composite image.

  In step S48, the composite image processing unit 216 displays the composite image on the touch panel monitor 52 in the same manner as in step S39, and allows the user to check the photographing result.

  In step S49, the progress control unit 211 determines whether or not a predetermined time has elapsed. If the photographing is still possible, the process returns to step S43, the subsequent processing is repeated, and bonus photographing is performed again. .

  On the other hand, if it is determined in step S49 that the predetermined time has elapsed, the process proceeds to step S50. Even if it is determined in step S41 described above that it is not within the shootable time, since bonus shooting is not performed, step S42 to step S49 are skipped, and the process proceeds to step S50.

  In step S50, the composite image processing unit 216 displays the composite image generated so far on the touch panel monitor 52, and the storage unit 102 stores these plural (for example, six) photographed images as edit target images. Remember me. When bonus shooting is performed, the composite image processing unit 216 gives the user a plurality of images (for example, 6 images) out of a plurality of images (for example, 6 images) and a captured image by bonus shooting. The image to be edited is selected, and the selected photographed image is stored in the storage unit 102.

  When the process of step S50 ends, the imaging process ends, the process returns to step S3 in FIG. 12, and the processes after step S3 are executed.

  Next, a detailed flow of the live view display process executed in step S36 in FIG. 13 and step S45 in FIG. 14 will be described with reference to the flowchart in FIG.

  In step S71, when the camera 51 acquires a live view image (captured image), in step S72, the face recognition unit 232 recognizes the position of the face of the user (subject) in the live view image acquired by the camera 51. To do.

  In step S73, the composition processing unit 231 determines whether or not the photographing composition image selected in step S35 of FIG. 13 or step S44 of FIG. 14 is a combined frame image.

  The combined frame image is a frame image that is combined with a part of the subject (specifically, the face of the subject) in the live view image, and is an image that forms a part of a predetermined figure. For example, the frame image for merging is an image representing each line obtained by vertically dividing a line that draws a heart shape, a star shape, a circle, or a rectangle into two. Further, the coalescing frame image is not limited to an image representing each line obtained by dividing the predetermined figure into two vertically, but may be an image representing each line obtained by dividing the predetermined figure into two horizontally. Alternatively, the image may be an image representing a line that draws predetermined independent figures (such as a heart shape or a star shape).

  If it is determined in step S73 that the shooting composition image is a coalesced frame image, the process proceeds to step S74, and the compositing processing unit 231 reads the corresponding coalesced frame image from the storage unit 102, and combines them. A frame image and a live view image are combined.

  In step S <b> 75, the display control unit 235 causes the touch panel monitor 52 to display a live view image display screen on which a live view image in which the frame image for combination is combined by the combining processing unit 231 is displayed. On the live view image display screen, the live view image is displayed such that the combined frame image for merging follows the motion of the subject of the live view image that is a moving image.

  FIG. 16 shows an example of a live view image display screen displayed on the touch panel monitor 52.

  As shown in FIG. 16A, a live view image display unit 411 is provided at the center of the live view image display screen 401. In the live view image display unit 411, live view images of the subject A (left side) and the subject B (right side) are displayed. In the live view image display unit 411, the positions of the faces of the subjects A and B are recognized, and rectangular frames 421A and 421B indicating the recognized face positions (regions) of the subjects A and B are the subjects. The images are superimposed on the live view image so as to follow the movement of the faces of A and the subject B. Furthermore, in the live view image display unit 411, the combined frame images 422A and 422B, which are images obtained by vertically dividing the heart-shaped line into two corresponding to the sizes of the frames 421A and 421B, are displayed on the subject A. In addition, it is superimposed on the live view image so as to follow the movement of the face of the subject B. Note that an icon representing the attribute (gender) of the subject set by being selected in advance by the user is displayed above each of the frames 421A and 421B. In the example of FIG. 16A, an icon representing a man is displayed above the frame 421A, and an icon representing a woman is displayed above the frame 421B. Furthermore, when the sex of the subject A is male, the color of the frame 421A and the union frame image 422A is blue. When the sex of the subject B is female, the color of the frame 421B and the union frame image 422B is pink. The display colors of the frames 421A and 421B and the combined frame images 422A and 422B may be changed according to the attribute of the subject, such as color.

  On the left side of the live view image display unit 411, a sample image display unit 412 is provided. The sample image display unit 412 is a finished image acquired when the positions of the face of the subject A and the face of the subject B are within a predetermined distance range in the live view image displayed on the live view image display unit 411. A model sample image obtained by combining the frame image with a still image of a subject (model) prepared in advance is displayed. In addition, the sample image display unit 412 synthesizes each model face as a model sample image when the face position of the subject is not within the predetermined distance range and within the predetermined distance range. A plurality of still images representing a state where the combined frame image is changed to a completed frame image may be displayed sequentially in sequence like a so-called flip book, or the above-described state may be a moving image. It may be displayed as an image. As a result, users who are subjects can easily see at a glance how the frame image for merging in the live view image changes to the completed frame image depending on how they move within the live view image. Will be able to confirm.

  The completed frame image is a frame image prepared corresponding to the merged frame image, and is a graphic image formed by combining the merged frame images (combined with the merged frame images). That is, in the example of FIG. 16, the completed frame image synthesized in the model sample image displayed on the sample image display unit 412 is a figure representing a heart-shaped line. The completed frame image is stored in the storage unit 102. In addition, the completed frame image corresponds to, for example, a star-shaped and star-shaped frame image when the frame image for merging is an image representing a line that draws a predetermined figure such as a heart shape or a star shape. Or a heart-shaped frame image prepared corresponding to a circle and star-shaped frame image.

  A captured image display unit 413 is provided at the bottom of the live view image display screen 401. In the captured image display unit 413, a plurality of images (example of FIG. 16) in which the selected composite image for shooting (a completed frame image corresponding to the combined frame image) is combined with the model image before shooting. 6 model sample images are displayed, and after shooting, multiple (6) shot images (including shot images in which frame images such as completed frame images are combined) obtained by shooting are displayed. Is done.

  In the upper right part of the live view image display screen 401, a remaining time display unit 414 for displaying the remaining time (remaining time) of the time limit allocated in advance to the shooting work is provided. Further, at the top of the live view image display screen 401, a message “Provide me! I ’ll shoot!” Prompting each user to shoot near each other is displayed.

  Returning to the flowchart of FIG. 15, in step S76, the distance determination unit 233 determines whether the position of the face of the subject in the live view image is within a predetermined distance range.

  Specifically, as indicated by a double-headed arrow in FIG. 17A, between the vertices of the frame 421A that represents the face area of the subject A and the vertices of the frame 421B that represents the face area of the subject B. It is determined whether the distance between the vertices having the smallest distance is smaller than a predetermined value.

  If it is determined in step S76 that the position of the subject's face in the live view image is not within the predetermined distance range, the process proceeds to step S77, and the distance determination unit 233 includes the speaker 124 provided in the photographing unit 112. (FIG. 8) is controlled, and the user (subject) is guided to bring the faces closer to each other by voice, such as “Get closer!” Or “More face up!”. Here, the distance determination unit 233 controls the display of the touch panel monitor 52 so as to display an arrow or the like that prompts the faces of the subjects to approach each other on the live view image display unit 411 illustrated in FIG. 16A. You may do it.

  For example, in the live view image displayed on the live view image display unit 411 in FIG. 16A, when the standing position changes relatively, for example, the subject A and the subject B are switched left and right, the subjects A and The merged frame images 422A and 422B displayed superimposed on the face of the subject B may be horizontally reversed with reference to the vertical center line of each face area.

  In step S78, the distance determination unit 233 determines whether a predetermined time has elapsed since the live view display process was started.

  If it is determined in step S78 that the predetermined time has not elapsed, the process returns to step S76.

  If it is determined in step S76 that the position of the face of the subject in the live view image is within the predetermined distance range before the predetermined time has elapsed since the start of the live view display process, the process proceeds to step S79. Then, the completed frame image acquisition unit 234 acquires a completed frame image corresponding to the coalescing frame image from the storage unit 102.

  For example, when it is determined that the distance between the vertex of the frame 421A and the vertex of the frame 421B indicated by the double arrow in FIG. 17A is smaller than a predetermined value, the completed frame image acquisition unit 234 is illustrated in FIG. 17B. Such a heart-shaped completed frame image 431 corresponding to the combined frame images 422A and 422B is read from the storage unit 102. At this time, the completed frame image acquisition unit 234 sets a frame 421C including the frames 421A and 421B. For example, the size (shape) of the completed frame image 431 so that the frame 421C is inscribed in the completed frame image 431. Adjust. Note that the completed frame image 431 may simply be adjusted to a size close to the size of the frame 421C or may be adjusted to a size included inside the frame 421C.

  For example, as compared with the example of FIG. 17B, when the frames 421A and 421B are arranged vertically, the shape of the frame 421C is a vertically long rectangle. In this case, the completed frame image acquisition unit 234 adjusts the shape of the completed frame image 431 so that the vertically long rectangle is inscribed in a vertically long heart shape. When the frame 421A and the frame 421B are arranged so as to be arranged horizontally, the shape of the frame 421C is a horizontally long rectangle. In this case, the completed frame image acquisition unit 234 adjusts the shape of the completed frame image 431 so that the horizontally long rectangle is inscribed in a horizontally long heart shape.

  Furthermore, the size of the frame 421A and the frame 421B differs depending on the standing position of the user corresponding to the subject A and the user corresponding to the subject B with respect to the depth direction of the camera 51 in the shooting space, and thereby the step A difference also occurs in the size of the combined frame images 422A and 422B combined with the live view image of the subject in S74. Even in such a case, the completed frame image acquisition unit 234 sets the frame 421C including the frames 421A and 421B, and the size (shape) of the completed frame image 431 so that the frame 421C is inscribed in the completed frame image 431. ) Can be adjusted.

  If there is a difference in the size of the combined frame images 422A and 422B depending on the user's standing position in the depth direction of the camera 51, the distance determination unit 233 uses the use as in the process in step S77. The person may be guided so as to match the standing position of the camera 51 in the depth direction.

  Returning to the flowchart of FIG. 15, in step S <b> 80, the composition processing unit 231 combines the completed frame image acquired (read) by the completed frame image acquisition unit 234 and the live view image acquired by the camera 51. .

  In step S81, the display control unit 235 displays the live view image obtained by the process in step S78 on the live view image display screen displayed on the touch panel monitor 52.

  In this way, as shown in FIG. 16B, the heart-shaped completed frame image 431 is synthesized (superposed) on the entire face of the subject (Subject A and Subject B) displayed on the live view image display unit 411. The live view image is displayed.

  In FIG. 16, an example of synthesis of a completed frame image when there are two users (subjects) has been described. With reference to FIG. 18, a completed frame image when there are three subjects is illustrated. An example of synthesis will be described.

  FIG. 18 shows an example of a live view image display screen displayed on the touch panel monitor 52. The configuration of the live view image display screen 401 shown in FIG. 18 is the same as that of the live view image display screen 401 described with reference to FIG.

  In the live view image display unit 411 in FIG. 18A, live view images of the subject A, the subject B, and the subject C are displayed. In the live view image display unit 411 in FIG. 18A, the positions of the faces of the subjects A, B, and C are recognized, and the positions (areas) of the recognized subjects A, B, and C are recognized. The rectangular frames 521A, 521B, and 521C indicating are superimposed on the live view image and displayed. Further, in the live view image display unit 411 in FIG. 18A, the united frame images 522A, 522B, and 522C, which are images made of lines that draw round shapes, corresponding to the sizes of the frames 521A, 521B, and 521C. Is superimposed on the live view image.

  From the state of FIG. 18A, for example, the distance between the midpoint of the line connecting the center points of the frames 521A and 521C and the center point of the frame 521B is smaller than a predetermined value, and the distance between the frames 521A and 521B When the distance between the frame 521B and the frame 521C becomes smaller than each other predetermined value, the dumplings sandwiched between the skewers corresponding to the combined frame images 522A, 522B, and 522C as shown in FIG. An image of the completed frame image 531 is read out. In this way, a completed frame image 531 that is an image of dumplings sandwiched between the faces of the subjects (Subject A, Subject B, and Subject C) displayed in the live view image display unit 411 is synthesized ( The superimposed live view image is displayed.

  Returning to the flowchart of FIG. 15, when it is determined in step S78 that a predetermined time has elapsed since the start of the live view display process, the process proceeds to step S82, and the display control unit 235 displays the live view image. The display of the combined frame image that is combined with the live view image and displayed on the display unit 411 is terminated. That is, when the position of the subject's face does not fall within the predetermined distance range within a predetermined time, only the live view image acquired by the camera 51 is displayed on the live view image. In this case, neither the combined frame image nor the completed frame image is synthesized with the captured image.

  By the way, if it is determined in step S73 that the photographic composition image is not a coalescing frame image, that is, the photographic composition image selected in step S35 of FIG. 13 or step S44 of FIG. If it is a frame image other than an image, a normal image, or an aura image, the process proceeds to step S83, and the compositing processing unit 231 reads the selected composite image for shooting from the storage unit 102, and combines the image for shooting composite. And live view image.

  In step S84, the display control unit 235 causes the touch panel monitor 52 to display a live view image display screen on which the live view image synthesized by the synthesis processing unit 231 is displayed.

  When the process of step S81, step S82, or step S84 ends, the live view display process ends, the process returns to step S36 of FIG. 13 or step S45 of FIG. 14, and the processes after step S36 or step S45 are executed. Is done.

  The completed frame image combined with the live view image in this way is reflected in the captured image (image to be edited) obtained as a result of the imaging process and the edited image obtained by the editing process.

  According to the above processing, a merged frame image forming a part of a predetermined figure is selected as a shooting composition image, and the face of the subject in which the selected merged frame image is synthesized in the live view image. Is a predetermined positional relationship, a completed frame image forming the entire predetermined figure is synthesized with the entire face of the subject. Thereby, the user can make the frame image combined with each face part of the subject in the live view image into one completed frame image by bringing the faces close to each other, while enjoying the shooting operation. It can be carried out. In addition, the completed frame image is reflected in the photographed image (image to be edited) and the edited image, so of course it will be reflected in the final photo sticker and the image transmitted to the mobile terminal. Can be. Therefore, it is possible to improve the photo sticker creation work and the user satisfaction with the photo sticker created.

  In the above description, in the process of step S76, the distance between the vertices of the rectangular frame representing the subject face area is referred to as the distance between the subject faces. The distance between the sides of each frame, the distance between the vertex and the side of each frame, and the distance between the center points of each frame may be referred to.

  In addition, the completed frame image is acquired when the positions of the faces of the subject are within a predetermined distance range, but the positions of the faces of the subject are within the predetermined distance range, and When the size of the face area (for example, the area of a rectangular frame representing the face area) is larger than a predetermined size, a completed frame image may be acquired.

  Furthermore, when the positions of the faces of the subject are within a predetermined distance range, the obtained frame image is combined with the live view image and displayed, and a predetermined aura image or frame image is displayed as an animation. Further, the corresponding aura image or frame image may be reflected in the captured image (edit target image) or the edited image.

  Further, the background color of the live view image may be adjusted according to the positional relationship (distance) between the faces of the subject. Specifically, when the faces of the subject are far away, the background color of the live view image may be blue, and when the faces of the subject are close, the background color of the live view image may be pink. Good. Further, the brightness and color of the lighting device and LEDs in the photographing space 32 may be adjusted according to the positional relationship between the faces of the subject.

  Furthermore, the completed frame image obtained by the live view display process may be used as a composition image for editing that is synthesized by a user's editing input with respect to the captured image to be edited in the editing process. Also, during the editing process, you can change the color of the completed frame image combined with the captured image in the shooting process, change the completed frame image to an image related to the completed frame image, or delete the combined completed frame image You may be able to do that.

  Alternatively, the user may select a shooting course at the start of the shooting process, and the coalesced frame image that can be selected by the user may be changed according to the selected shooting course. Specifically, when a couple course for two-gender users is selected as the shooting course, the heart-shaped image described with reference to FIG. When a frame image for merging from which a completed frame image can be obtained can be selected, and a friend course for users of the same sex or a group of three or more is selected as a shooting course, the skewer described with reference to FIG. It is also possible to make it possible to select a coalesced frame image from which a completed frame image in the image of a dumpling is obtained, a coalesced frame image from which a star-shaped completed frame image is obtained, or the like. Note that, depending on the selected shooting course, predetermined image processing is performed on the live view image and the shot image. Specifically, for example, when a couple course is selected and the sex of the subject is further selected, image processing corresponding to the sex is performed on each subject. At this time, in the live view image, as described with reference to FIG. 16A, the display colors of the frames 421A and 421B and the combined frame images 422A and 422B may be changed according to the sex of the subject.

  In the above description, in the live view image, the united frame image and the completed frame image are combined with the face portion of the subject, but the entire subject body or a part of the subject body other than the face is used. You may make it synthesize | combine. That is, for example, a combined frame image may be synthesized for each subject, and when the positions of the subjects are within a predetermined distance range, the completed frame image may be synthesized for all subjects.

  The completed frame image is stored in the storage unit 102 in correspondence with the merged frame image. However, the completed frame image acquisition unit 234 generates a completed frame image based on the merged frame image. You may make it do.

  Further, in the above description, an example in which a completed frame image is synthesized when the positions of subjects as users are within a predetermined distance range in the live view image has been described. When performing a shooting operation by a person, in the live view image, the subject as the user and the model image of the model that is another subject that is registered in advance and displayed in the live view image are combined. The frame images may be combined, and the completed frame image may be combined when the position of the subject that is the user and the model image is within a predetermined distance range.

  By the way, the above-described series of processes can be executed by hardware or can be executed by software. When the above-described series of processing is executed by software, a program constituting the software is installed from a network or a recording medium.

  For example, as shown in FIG. 8, the recording medium is distributed to distribute the program to the administrator of the photo sticker creating apparatus 1 separately from the apparatus main body, and is a magnetic disk (flexible disk) on which the program is recorded. Disk), optical disk (including CD-ROM and DVD), magneto-optical disk (including MD), or removable media 105 made of semiconductor memory, etc., but also pre-installed in the device body The ROM 106 in which the program is recorded and the hard disk included in the storage unit 102 are distributed to the administrator.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  In the above, the printing medium is not limited to sticker paper or photographic paper. For example, printing on a predetermined size of paper or film, poster paper, a card such as a telephone card, or a cloth such as a T-shirt. You may make it do.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses. In the above, the configuration described as one device may be divided and configured as a plurality of devices. Conversely, the configurations described above as a plurality of devices may be combined into a single device. Of course, configurations other than those described above may be added to the configuration of each device. Furthermore, if the configuration and operation of the entire system are substantially the same, a part of the configuration of a certain device may be included in the configuration of another device.

DESCRIPTION OF SYMBOLS 1 Photo sticker production apparatus 12 Image | photographing unit 51 Camera 101 Control part 112 Image | photographing part 202 Image | photographing process part 213 Live view display control part 231 Composition processing part 232 Face recognition part 235 Display control part

Claims (9)

An image creation device for photographing a user as a subject and outputting the obtained image,
Photographing means for photographing a plurality of the users as subjects and obtaining a photographed image;
Display control means for controlling the photographed image photographed by the photographing means to be displayed as a moving image on a display unit in real time;
Combining means for synthesizing an image for synthesis to each subject in the moving image displayed on the display unit,
The synthesizing unit is configured so that when each subject in the moving image has a predetermined positional relationship, the entire subject in the moving image differs from the compositing image synthesized in each subject. Synthesize
The image capturing device, wherein the photographing unit outputs the photographed image as a still image obtained by synthesizing the whole composition image. The image creation apparatus according to claim 1, wherein the overall synthesis image is a combination synthesis image obtained by combining the synthesis images synthesized with each of the subjects. The image for combination synthesis forms a predetermined figure,
The image creation apparatus according to claim 2, wherein the composition image forms a part of the predetermined figure. Recognizing means for recognizing the face of the subject in the moving image;
The synthesizing unit synthesizes the compositing image with each face of the subject in the moving image, and the combination is applied to the entire subject face in the moving image in which each of the subject faces in the moving image has a predetermined positional relationship. The image creating apparatus according to claim 2, wherein the image for synthesis is synthesized. 5. The combination image is combined with the entire subject face in the moving image when the position of the faces of the subject in the moving image falls within a predetermined distance range. Image creation device. The synthesizing unit is configured to detect the subject in the moving image when the positions of the faces of the subject in the moving image are within a predetermined distance range and when the size of each face of the subject is larger than a predetermined size. The image creation apparatus according to claim 5, wherein the image for combination synthesis is synthesized on the entire face. The display control means displays, on the display unit, the moving image obtained by photographing the subject and a model image that is an image of another subject registered in advance.
The synthesizing unit synthesizes a synthesis image with each of the subject and the model image in the moving image displayed on the display unit, and the subject and the model image in the moving image have a predetermined positional relationship. 2. The overall synthesis image different from the synthesis image synthesized with each of the subject and the model image is synthesized with the subject and the entire model image in the moving image. Image creation device. An image creation method of an image creation device for photographing a user as a subject and outputting the obtained image,
A shooting step of shooting a plurality of users as subjects and obtaining a shot image;
A display control step for controlling the captured image to be displayed on the display unit in real time as a moving image;
Combining a synthesis image with each subject in the moving image displayed on the display unit,
In the synthesis step, when each subject in the moving image has a predetermined positional relationship, the entire subject in the moving image is different from the synthesis image synthesized for each subject. Composite images for
The process of the photographing step is an image creation method for outputting the photographed image as a still image obtained by compositing the overall synthesis image. A program for causing a computer to execute a process of photographing a user as a subject and outputting the obtained image.
A shooting control step for controlling shooting of a plurality of users as subjects and obtaining a shot image;
A display control step for controlling the captured image to be displayed on the display unit in real time as a moving image;
Causing the computer to execute a process including: a synthesis control step for controlling synthesis of the synthesis image to each subject in the moving image displayed on the display unit;
The process of the composition control step is different from the composition image synthesized for each subject in the whole moving image when each subject in the moving image has a predetermined positional relationship. Control the synthesis of the image for total synthesis,
The process of the photographing control step is a program for controlling output of the photographed image as a still image obtained by synthesizing the whole synthesis image.

Images