JP6867587B2 - Photographing game consoles, information processing methods, and programs - Google Patents

Description

This technology has made it possible to provide a game that is convincing to the user regarding the photo creation game machine, the information processing method, and the program, in particular, regardless of the selection result of whether or not to execute the process. Photo-creating game consoles, information processing methods, and programs.

Conventionally, a photo sticker making device is known. The photo sticker creating device photographs a user, causes the user to edit the photographed image, and prints the edited image on a sticker paper to provide the photographed image. The photo sticker making device is installed in amusement facilities and the like.

The flow of one game provided by the photo sticker creation device is usually that after shooting a user in the shooting space as a subject, the user is moved to the editing space and the image is displayed according to the operation performed in the editing space. It will be edited and the edited image will be printed on the sticker paper.

Normally, the image created by the photo sticker creating device can be transferred to the user's mobile terminal. Some photo sticker creating devices have a function of extending the time for editing input work (scribble) when it is not selected to execute the process of transferring an image (Patent Document 1).

Japanese Unexamined Patent Publication No. 2006-047824

When it is selected to execute the process of transferring images, the work of selecting the images to be transferred from a plurality of images is performed. In the photo sticker making device described in Patent Document 1, the time for graffiti, which is the main work in the editing space, is not extended due to this selection work.

If the work to be done instead of the extension of the graffiti time is not the work such as image selection but the work that is interesting to change to the graffiti, it is acceptable even if the extension of the graffiti time is not allowed. Although it is possible, limiting the time for scribbling without allowing the extension for work such as image selection may lead to dissatisfaction among users.

This technology was made in view of such a situation, and makes it possible to provide a game that is convincing to the user regardless of the selection result of whether or not to execute the process. ..

The photo-creating game machine, which is one aspect of the present technology, performs the first editing process on the shooting unit that shoots the user as a subject and the shot image obtained by the shooting by the shooting unit. The first editing unit performed in response, the second editing unit that performs processing related to the processing of the captured image, and the second editing as the second editing processing that is a different type of editing processing from the first editing processing. A selection unit that selects whether or not to execute the process according to the operation of the user, and when it is selected not to execute the second edit process, it is selected to execute the second edit process. A time limit setting unit for setting a longer time limit for the first editing process is provided, and in the first editing process, an operation by the user is performed on an image obtained by the second editing process. Editing is possible according to.

It has an editing space for editing by the user and other spaces, and the first editing process and the second editing process are processed in response to an operation by the user in the editing space. be able to.

In the shooting space as the other space, it is possible for a user other than the user to shoot in parallel with the user editing in the editing space.

The selection unit selects one of a first course including the step of executing the second editing process and a second course not including the step of executing the second editing process. The course selection screen used for the above can be displayed, and the first course or the second course can be selected according to the operation of the user with respect to the course selection screen.

When the selection unit times out after displaying the course selection screen, the second course can be selected.

Before executing the second editing process, the selection unit displays a screen including a button to be operated when canceling the second editing process, and the second editing unit operates the button. The second editing process can be skipped accordingly.

The total time of the time limit of the first editing process and the time limit of the second editing process, which is set when it is selected to execute the second editing process, does not execute the second editing process. It can be equal to or substantially equal to the time limit of the first editing process set when is selected.

The process related to the processing of the captured image may be a process including processing selection of the captured image and creation of a composite image used for processing the captured image.

The processing selection of the captured image includes selection for creating a caricature image based on the captured image, selection of the type of processing applied to the face of a person appearing in the captured image, selection of a background to be combined with the captured image, and selection of a background to be combined with the captured image. , The selection of the type of processing applied to the entire captured image can be included.

The creation of the composite image used for processing the captured image can be the creation of a stamp image.

In one aspect of the present technology, whether or not to execute the second editing process is selected according to the operation of the user, and when it is selected not to execute the second editing process, the second editing process is performed. The time limit for the first editing process is set longer than when it is selected to execute the process. Further, in the first editing process, the image obtained by the second editing process can be edited according to the operation by the user.

According to the present technology, it is possible to provide a game that is convincing to the user regardless of the selection result of whether or not to execute the process.

It is a perspective view which shows the structural example of the appearance of the photograph sticker making apparatus of this technology. It is a perspective view which looked at the appearance of the photographic sticker making apparatus from another angle. It is a figure explaining the movement of a user. It is a figure which shows the structural example of the preselection part. It is a figure which shows the structural example of the photographing part. It is a figure which shows the structural example of the background part. It is a figure which shows the configuration example of the front of an editing unit. It is a figure which shows the configuration example of the side surface of an editing unit. It is a figure which shows the example of the sticker paper. It is a figure which shows the example of the layer structure of an edited image. It is a figure which shows the example of the caricature image. It is a figure which shows the example of the generation of a caricature image. It is a figure which shows an example of use of a caricature image. It is a block diagram which shows the structural example inside the photographic sticker making apparatus. It is a block diagram which shows the functional structure example of the photograph sticker making apparatus. It is a block diagram which shows the functional structure example of the photographing processing part. It is a block diagram which shows the functional structure example of an editing processing part. It is a flowchart explaining the photo sticker making game process. It is a flowchart explaining the preselection process performed in step S2 of FIG. It is a figure which shows the example of the caricature image creation selection screen. It is a flowchart explaining the shooting process performed in step S3 of FIG. It is a figure which shows the example of the live view screen before shooting for personal recognition. It is a figure which shows the example of the cutout of a face image. It is a figure which shows the example of the live view screen before a normal shooting. It is a figure which shows the example of the eye size adjustment screen. It is a flowchart explaining the editing process performed in step S5 of FIG. It is a flowchart following FIG. 26 which explains the editing process performed in step S5 of FIG. It is a figure which shows the example of the gender selection screen. It is a figure which shows the example of the parts selection screen. It is a figure which shows the example of the design selection screen. It is a figure which shows the example of the caricature image. It is a figure which shows the example of the name input screen. It is a figure which shows the example of the stamp image. It is a figure which shows the example of an edit screen. It is a figure which shows another example of an edit screen. It is a figure which shows the edit palette enlarged. It is a figure which shows the example of editing using a character stamp. It is a figure which shows the basic flow of a game. It is a figure which shows the basic flow of a game. It is a figure which shows the example of the retouch selection screen. It is a figure which shows another example of a retouch selection screen. It is a figure which shows still another example of a retouch selection screen. It is a figure which shows the example of the background selection screen. It is a figure which shows the example of the filter selection screen. It is a figure which shows the basic flow of a game. It is a figure which shows the basic flow of a game. It is a figure which shows the basic flow of a game. It is a figure which shows the example of the division number selection screen.

<Appearance configuration of photo sticker making device>
1 and 2 are perspective views showing a configuration example of the appearance of the photo sticker making device 1.

The photo sticker creating device 1 is a game machine that provides a photographed image and an edited image. The photo sticker creating device 1 provides an image to a user by printing the image on a sticker paper or making the image viewable on the user's mobile terminal. The photo sticker making device 1 is installed in an amusement facility or a store. The users of the photo sticker making device 1 are mainly high school girls and young women. In the photo sticker creating device 1, a plurality of users, such as two or three people, can enjoy the game per group. Of course, in the photo sticker creating device 1, one user can enjoy the game.

In the photo sticker creating device 1, the user takes a picture by himself / herself as a subject. By editing, the user synthesizes a composite image such as handwritten characters or a stamp image with an image selected from the captured images obtained by shooting. As a result, the captured image is edited into a colorful image. The user receives a sticker paper on which the edited image, which is an edited image, is printed, and ends the series of games.

As shown in FIG. 1, the photo sticker creating device 1 is basically configured by being installed in a state where the photographing unit 11 and the editing unit 12 are in contact with each other.

The photographing unit 11 is composed of a preselection unit 20, a photographing unit 21, and a background unit 22. The preselection unit 20 is installed on the side surface of the photographing unit 21. The space in front of the preselection unit 20 becomes a preselection space in which the preselection process is performed. Further, the photographing unit 21 and the background unit 22 are installed at a predetermined distance from each other. The space formed between the photographing unit 21 and the background unit 22 becomes a photographing space in which the photographing process is performed.

As the preselection process, the preselection unit 20 provides guidance for introducing the game provided by the photo sticker creation device 1, and makes various settings in the shooting process performed in the shooting space. The preselection unit 20 is provided with a coin slot for the user to insert a price, a touch panel monitor used for various operations, and the like. The preselection unit 20 appropriately guides the user in the preselection space to the shooting space according to the availability of the shooting space.

The photographing unit 21 is a device for photographing a user as a subject. The shooting unit 21 is located in front of the user who has entered the shooting space. A camera, a touch panel monitor used for various operations, and the like are provided in front of the photographing unit 21 facing the photographing space. Assuming that the left side surface is the left side surface and the right side surface is the right side surface when viewed from the user facing the front in the shooting space, the left side surface of the photographing unit 21 is composed of the side panel 41A and the right side surface is composed of the side panel 41B. Will be done. Further, the front surface of the photographing unit 21 is composed of the front panel 42. The above-mentioned preselection unit 20 is installed on the side panel 41A. The preselection unit 20 may be installed on the side panel 41B.

The background portion 22 is composed of a back panel 51, a side panel 52A, and a side panel 52B. The back panel 51 is a plate-shaped member located on the back side of the user facing the front. The side panel 52A is a plate-shaped member attached to the left end of the back panel 51 and having a width narrower than that of the side panel 41A. The side panel 52B is a plate-shaped member attached to the right end of the back panel 51 and having a width narrower than that of the side panel 41B.

The side panel 41A and the side panel 52A are provided on substantially the same plane. The upper portions of the side panel 41A and the side panel 52A are connected by a connecting portion 23A which is a plate-shaped member. The lower part of the side panel 41A and the side panel 52A are connected by a connecting portion 23A'which is, for example, a metal member provided on the floor surface. Similarly, the side panel 41B and the side panel 52B are provided on substantially the same plane. The upper portions of the side panel 41B and the side panel 52B are connected by a connecting portion 23B. The lower part of the side panel 41B and the side panel 52B is connected by the connecting portion 23B'.

A green chroma key sheet is attached to the surface of the back panel 51 on the shooting space side, for example. The photo sticker creating device 1 takes a picture with a sheet for chroma key as a background, and performs chroma key composition in a shooting process and an editing process. As a result, the background image desired by the user is combined with the sheet portion.

The opening formed by being surrounded by the side panel 41A, the connecting portion 23A, and the side panel 52A serves as an entrance / exit of the photographing space. Further, an opening formed by being surrounded by the side panel 41B, the connecting portion 23B, and the side panel 52B also serves as an entrance / exit of the photographing space.

A ceiling strobe unit 24 is provided on a part of the ceiling above the shooting space. One end of the ceiling strobe unit 24 is fixed to the connecting portion 23A, and the other end is fixed to the connecting portion 23B. The ceiling strobe unit 24 has a built-in strobe that irradiates light into the shooting space in accordance with shooting. Inside the ceiling strobe unit 24, a fluorescent lamp is provided in addition to the strobe. As a result, the ceiling strobe unit 24 also functions as lighting for the shooting space.

The editing unit 12 is a device for editing a captured image. The editing unit 12 is connected to the photographing unit 11 so that one side surface is in contact with the front panel 42 of the photographing unit 21.

Assuming that the configuration of the editing unit 12 shown in FIG. 1 is the configuration on the front side, the configuration used in the editing work is provided on each of the front side and the back side of the editing unit 12. With this configuration, two sets of users can perform editing work at the same time.

The front side of the editing unit 12 is composed of a surface 61 and a slope 62 formed above the surface 61. The surface 61 is perpendicular to the floor surface and substantially parallel to the side panel 41A of the photographing unit 21. A monitor with a built-in tablet and a touch pen are provided on the slope 62 as a configuration used for editing work. On the left side of the slope 62, a columnar support portion 63A that supports one end of the lighting device 64 is provided. On the right side of the slope 62, a columnar support portion 63B that supports the other end of the lighting device 64 is provided. A support portion 65 for supporting the curtain rail 26 is provided on the upper surface of the support portion 63A.

A curtain rail 26 is attached above the editing unit 12. The curtain rail 26 is composed of a combination of three rails 26A to 26C. The three rails 26A to 26C are combined so that the shape when viewed from above is U-shaped. One ends of the rail 26A and the rail 26B provided in parallel are fixed to the connecting portion 23A and the connecting portion 23B, respectively, and the other ends of the rail 26A and the rail 26B are joined to both ends of the rail 26C, respectively.

A curtain is attached to the curtain rail 26 so that the space in front of the front and the space in front of the back of the editing unit 12 cannot be seen from the outside. The space in front of the front and the space behind the back of the editing unit 12 surrounded by the curtain are the editing spaces in which the user performs editing work.

As will be described later, a discharge port for discharging the printed sticker paper is provided on the left side surface of the editing unit 12. The space in front of the left side of the editing unit 12 is a printing waiting space for the user to wait for the printed sticker paper to be ejected.

<About user movement>
Here, the flow of the photo sticker creation game and the movement of the user accompanying it will be described. FIG. 3 is a plan view of the photo sticker creating device 1 as viewed from above.

The user inserts the price into the coin slot in the preselection space A0, which is the space in front of the preselection unit 20. Next, the user makes various settings according to the screen displayed on the touch panel monitor. The user performs, for example, selection of a course related to shooting performed in the shooting space as a preselection operation.

As shown by the white arrow # 1, the user who has completed the preselection work has a shooting space A1 formed between the shooting unit 21 and the background portion 22 from the entrance / exit G1 between the side panel 41A and the side panel 52A. to go into. The user performs shooting work by using a camera or a touch panel monitor provided in the shooting unit 21.

The user who has completed the shooting work either exits the shooting space A1 from the entrance / exit G1 and moves to the editing space A2-1 as indicated by the white arrow # 2, or moves to the editing space A2-1 as indicated by the white arrow # 3. Exits the shooting space A1 and moves to the editing space A2-2.

The editing space A2-1 is an editing space on the front side of the editing unit 12. On the other hand, the editing space A2-2 is an editing space on the back side of the editing unit 12. Whether the user moves to the editing space A2-1 or the editing space A2-2 is guided by the screen display of the touch panel monitor of the photographing unit 21 or the like. For example, the vacant one of the two editing spaces is guided as the destination. The user who has moved to the editing space A2-1 or the editing space A2-2 starts the editing work. The user of the editing space A2-1 and the user of the editing space A2-2 can perform editing work at the same time.

After the editing work is completed, printing of the edited image is started. When printing is started, the user who has completed the editing work in the editing space A2-1 moves from the editing space A2-1 to the print waiting space A3 as indicated by the white arrow # 4. Further, the user who has completed the editing work in the editing space A2-2 moves from the editing space A2-2 to the print waiting space A3 as indicated by the white arrow # 5.

The user who has moved to the print waiting space A3 waits for the print to finish. When printing is completed, the user receives the sticker paper discharged from the discharge port provided on the right side surface of the editing unit 12, and ends a series of photo sticker creation games.

Next, the configuration of each device will be described.

<Structure of preselection unit>
FIG. 4 is a diagram showing a configuration example of the preselection unit 20.

A touch panel monitor 71 is provided on the upper side of the preselection unit 20. The touch panel monitor 71 is composed of a monitor such as an LCD (Liquid Crystal Display) and a touch panel laminated on the monitor. The touch panel monitor 71 has a function of displaying various GUIs (Graphical User Interfaces) and accepting a user's selection operation. The touch panel monitor 71 displays a screen used for preselection processing for selecting the number of users, selecting a shooting course, and the like.

A speaker 72 is provided below the touch panel monitor 71. The speaker 72 outputs guidance voice for preselection processing, BGM (Back Ground Music), sound effect, and the like. A coin insertion / return port 73 for inserting coins by the user is provided adjacent to the speaker 72.

<Structure of shooting section>
FIG. 5 is a diagram showing a configuration example of the front surface of the photographing unit 21. The photographing unit 21 is configured to be surrounded by the side panel 41A, the side panel 41B, and the front panel 42.

A camera unit 81 is provided slightly above the center of the front panel 42. The camera unit 81 includes a camera 91, a touch panel monitor 92, and a front strobe 93.

The camera 91 is, for example, a single-lens reflex camera, and is mounted inside the camera unit 81 so that the lens is exposed. The camera 91 has an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and photographs a user in the photographing space A1. The camera 91 functions as a shooting unit that shoots with the user as a subject.

The moving image captured by the camera 91 (hereinafter, also referred to as a live view image) is displayed on the touch panel monitor 92 in real time. A still image captured by the camera 91 at a predetermined timing such as when shooting is instructed is saved as a shot image.

The touch panel monitor 92 is provided below the camera 91. The touch panel monitor 92 is composed of a monitor such as an LCD and a touch panel laminated on the monitor. The touch panel monitor 92 has a function as a live view monitor that displays a moving image captured by the camera 91, and a function that displays various GUIs and accepts a user's selection operation. A moving image (live view image) or a still image (photographed image) captured by the camera 91 is displayed on the touch panel monitor 92.

The front strobe 93 is provided above the camera 91. The front strobe 93 has a horizontally long rectangular light emitting surface made of a milky white acrylic plate. The front strobe 93 emits light in accordance with the shooting by the camera 91 to illuminate the vicinity of the user's face as a subject from the front.

Above the camera unit 81, an upper strobe unit 82 with a curved light emitting surface facing the user is installed. The upper strobe unit 82 irradiates the user's face and upper body with light from above the front of the user.

Below the camera unit 81, a foot strobe unit 83 that irradiates the lower body and feet of the user with light is provided.

The upper strobe unit 82 and the foot strobe unit 83 are composed of a fluorescent lamp and a lighting device capable of strobe light emission. The upper strobe unit 82 and the foot strobe unit 83 brighten the shooting space, constantly illuminate the shooting space in order to ensure the operability and safety of the user, and improve the image quality of the shot image. The strobe fires at the shooting timing to illuminate the user who is the subject.

A box-shaped portion 84 is provided between the foot strobe unit 83 and the side panel 41A. Further, a box-shaped portion 85 is provided between the foot strobe unit 83 and the side panel 41B. The upper surfaces of the box-shaped portions 84 and 85 form a surface substantially horizontal to the installation surface of the photo sticker creating device 1, and are used as a luggage storage place for a user who performs photography work to put baggage and the like.

Although not shown, a speaker is provided near the ceiling of the front panel 42, for example. The speaker outputs guidance voice, BGM, sound effect, etc. of the shooting process.

<Structure of background part>
FIG. 6 is a diagram showing a configuration example of the background portion 22 on the shooting space A1 side.

A strobe 101 on the back surface is installed above the back panel 51. The strobe 101 on the back surface irradiates the user with light from above the back surface.

In the figure, the rear left strobe 102 is installed on the left side of the rear panel 51. The rear left strobe 102 irradiates the user from the rear right side. In the figure, the rear right strobe 103 is installed on the right side of the rear panel 51. The rear right strobe 103 irradiates the user from the rear left side.

Further, the chroma key sheet 121 is attached to the surface of the back panel 51 on the shooting space A1 side (front side in the drawing). The color of the chroma key sheet 121 is, for example, green.

Although not shown, a chroma key sheet is also attached to the lower side (floor surface side) of the side panels 52A and 52B on the photographing space A1 side in the same manner as the chroma key sheet 121.

<Structure of editing unit>
FIG. 7 is a diagram showing a configuration example of the front side (editing space A2-1 side) of the editing unit 12.

A tablet built-in monitor 131 is provided at substantially the center of the slope 62. A touch pen 132A is provided on the left side of the tablet built-in monitor 131. A touch pen 132B is provided on the right side of the tablet built-in monitor 131.

The tablet built-in monitor 131 is configured by stacking a tablet and a display. The tablet enables operation input using the touch pen 132A or the touch pen 132B. The tablet built-in monitor 131 displays, for example, an editing screen used for editing work. When two users edit at the same time, the touch pen 132A is used by the user on the left side of the tablet built-in monitor 131, and the touch pen 132B is used by the user on the right side of the tablet built-in monitor 131. ..

The operation using the touch pen 132A and the operation using the touch pen 132B are distinguished. As appropriate, only the operation using the touch pen 132A is possible for the display on the left side of the tablet built-in monitor 131, and only the operation using the touch pen 132B is possible for the display on the right side. Hereinafter, when it is not necessary to distinguish between the touch pen 132A and the touch pen 132B as appropriate, they are collectively referred to as the touch pen 132.

FIG. 8 is a diagram showing a configuration example of the left side surface of the editing unit 12.

A sticker paper discharge port 161 is provided on the lower side of the left side surface of the editing unit 12. A printer is provided inside the editing unit 12. The printer prints an image of the user of the editing space A2-1 or an image of the user of the editing space A2-2 on the sticker paper in a predetermined layout and discharges the image from the sticker paper discharge port 161.

<Example of sticker paper>
FIG. 9 is a diagram showing an example of a sticker paper produced by the photo sticker making device 1 having the above-mentioned appearance configuration.

On the horizontally long sticker paper shown in FIG. 9, five edited images, 181-1 to 181-5, are printed side by side.

Of the edited images 181-1 to 181-5, the edited images 181-1 to 181-3 are images generated by editing the close-up image, and the edited image 181-1-4 and the edited image 181-5 is an image generated by editing the whole body image.

The close-up image is an image in which the face and upper body of the subject are shown in a large size. On the other hand, the whole body photography is an image in which the whole body of the subject is captured.

The aspect ratio of the close-up image and the whole body image are different. For example, the ratio of the horizontal length to the vertical length of the close-up image is 1: 1.2, and the ratio of the horizontal length to the vertical length of the whole body image is 3: 4. In the example of FIG. 9, the close-up image and the whole body image are printed with the same length in the horizontal direction. In reality, a background image, which is an image of a predetermined color or pattern, is combined with the background of the user, and a foreground image such as a handwritten character or a stamp image is combined with the foreground.

In addition to the model name (LOVERY) and shooting date, the sticker ID etc. are printed in the margin on the edge of the sticker paper. The sticker ID printed in the margin area is used when viewing the image transmitted from the photo sticker creation device 1 to the server on a mobile terminal such as a mobile phone. The transmission of the image to the mobile terminal is performed via the server.

As will be described later, in the photo sticker creating device 1, when selecting the layout (number of divisions) before printing, it is possible to select a layout for printing a functional image on the edge of the sticker paper. It has been done.

For example, among a plurality of selection candidates such as an image containing the user's name, an image including a calendar for one month, an image containing a message, and an image containing a fortune-telling result, the type of image selected by the user is a captured image. Is generated and printed on the edge of the sticker paper. The user can use it by cutting off the edge on which the image is printed with scissors or the like and pasting it on stationery.

Hereinafter, the image printed on the edge of the sticker paper as an image with functionality as appropriate is referred to as "usable sticker" in the sense that the functionality is emphasized unlike the edited image printed with emphasis on design. It is called an image.

FIG. 10 is a diagram showing an example of the layer structure of the edited image.

The leftmost edited image P1 is an image generated by editing. The edited image P1 is composed of images of each layer of the background image P11, the person image P12, and the foreground image P13.

In the example of FIG. 10, the background image P11 is an image of the pattern of the wall surface on which bricks are stacked. The foreground image P13 is an image including a handwritten character image of "Love my friend" and a heart-shaped image. The handwritten character image of "Love my friend" is a pen image input by the user using the pen tool at a position below the center of the person image P12. The heart-shaped image is a stamp image input by the user at the upper left position of the person image P12 using the stamp tool.

As described above, the edited image P1 is generated by superimposing the person image P12 extracted from the captured image by the chroma key processing on the background image P11 and superimposing the foreground image P13 on the background image P11. In the person image P12, the area other than the area in which the person is captured is an area in which the transparency is set to 100%.

It is also possible to input a pen image or a stamp image on the background image P11 and display it on the background of the subject. Foreground images and background images may be combined with the captured image, and even after editing, they may not be combined depending on the user's operation.

<About caricature images>
Here, the caricature image generation function will be described.

FIG. 11 is a diagram showing an example of a caricature image.

The photo sticker creating device 1 has a function of generating an image of a character using a portrait of a user based on an image taken by the camera 91.

The image shown on the left side of FIG. 11 is a face image showing the user's face. The face image is generated by cutting out from the captured image obtained by photographing with the camera 91. On the other hand, the image shown at the tip of the arrow is a caricature image generated based on the face image.

For example, as shown by arrow # 11 in FIG. 12, the photo sticker creating device 1 extracts face parts such as eyes, eyebrows, nose, and mouth from a face image, and converts the extracted face parts into a line drawing. Performs image processing such as processing, deformation, color conversion, and size adjustment. The photo sticker creating device 1 synthesizes the face parts obtained by performing such image processing and other parts such as the face and hairstyle selected by the user as shown at the tip of arrow # 12. Then, a caricature image as shown at the tip of arrow # 13 is generated.

The face parts used to generate the caricature image are generated based on the image extracted from the face image. The caricature image is an image in which the appearance of the user including at least the face parts is deformed. Here, the deformation includes deforming, distorting, and exaggerating the appearance of the user.

The facial parts extracted from the facial image may be at least one of facial organs including eyes, eyebrows, nose, and mouth. For example, the eyes, eyebrows, and nose can be extracted from the face image and used to generate a caricature image, and the mouth can be used to generate a caricature image that the user has selected in advance. is there.

The caricature image generated in this way can be printed on a sticker paper, combined with a photographed image of a user, sent to a mobile terminal, and the like during or after the game. It is possible to use it for various purposes.

FIG. 13 is a diagram showing an example of use of a caricature image.

FIG. 13A is a diagram showing an application for printing on a sticker paper. In the example of FIG. 13A, an image P41 of a usable sticker including a message is printed on the right end of the sticker paper side by side with the captured images P31 to P35. The captured images P31 to P35 are the same images as the edited images 181-1 to 181-5 of FIG.

The caricature image P101 is used in a form of being fitted into the image P41 of a usable sticker. A message is arranged next to the caricature image P101 cut out in a circle.

In this way, the caricature image can be printed on the sticker paper as an image of a sticker that can be used. The user can cut off the right end of the sticker paper and attach it to a desired place as a sticker that can be used.

FIG. 13B is a diagram showing the use of a caricature image as a stamp image. When editing the captured image, a stamp image generated based on the caricature image is prepared as graffiti content on the edit screen. As shown in FIG. 13B, the user can use a touch pen or the like to arrange the caricature image P101 at a predetermined position on the captured image P31 and synthesize the portrait image P101.

FIG. 13C is a diagram showing an application for viewing on a mobile terminal. The caricature image P101 is transmitted to the server together with a photographed image (photograph) showing the user.

After the game is over, the user can operate the mobile terminal to access the server and enter the sticker ID printed on the sticker paper to view the caricature image on the mobile terminal. The user can upload the portrait image to the site of the SNS service and show it to his friends through the SNS service.

In this way, the user can easily create a caricature image similar to himself / herself and use it for various purposes.

When there are two users, a portrait image of each user is generated based on the face image of each user. For example, the caricature image is not generated when the number of users is selected as 3 or more. The selection of the number of users is performed before shooting as a pre-selection operation.

Of course, it is possible to generate a caricature image even when the number of users is selected as 3 or more.

<Internal configuration of photo sticker making device>
FIG. 14 is a block diagram showing an example of the internal configuration of the photo sticker making device 1. In FIG. 14, the same components as those described above are designated by the same reference numerals. Duplicate explanations will be omitted as appropriate.

As shown in FIG. 14, in the photo sticker creating device 1, the preselection unit 302, the photographing unit 304, the editing units 305A and 305B, and the printing unit 306 are external input / output interfaces 303 with respect to the PC (Personal Computer) unit 301. It is configured by being connected via. The PC unit 301, which is an information processing unit, is housed inside the housing of the editing unit 12, for example.

The CPU (Central Processing Unit) 311, ROM (Read Only Memory) 312, and RAM (Random Access Memory) 313 that make up the PC unit 301 are connected to each other by the bus 314.

The CPU 311 executes a predetermined program and controls the overall operation of the photo sticker creating device 1. The ROM 312 stores programs and data executed by the CPU 311. The RAM 312 temporarily stores data and programs processed by the CPU 311.

An input / output interface 315 is further connected to the bus 314. A storage unit 316, a communication unit 317, and a drive 318 are connected to the input / output interface 315.

The storage unit 316 is a non-volatile storage medium such as a hard disk or a flash memory. The storage unit 316 stores various setting information and the like supplied from the CPU 311. The information stored in the storage unit 316 is appropriately read out by the CPU 311.

The communication unit 317 is an interface of a network such as the Internet. The communication unit 317 communicates with an external device according to the control of the CPU 311. The communication unit 317 transmits the image selected by the user to, for example, an image acquisition site management server managed by the manufacturer of the photo sticker creation device 1. The image transmitted from the communication unit 317 is allocated and stored in a predetermined storage area, and is displayed on a mobile terminal that has accessed the image acquisition site management server, or downloaded to the mobile terminal.

A removable media 319 made of an optical disk, a semiconductor memory, or the like is appropriately mounted on the drive 318. The programs and data read from the removable media 319 by the drive 318 are supplied to the CPU 311 and stored or installed in the storage unit 316.

An external input / output interface 303 is connected to the input / output interface 315. The control of each unit by the PC unit 301 is performed via the external input / output interface 303.

The preselection unit 302 realizes the preselection process for the user in the preselection space A0. The preselection unit 302 includes a touch panel monitor 71, a speaker 72, and a coin processing unit 321.

The touch panel monitor 71 displays various selection screens according to the control by the PC unit 301, and accepts the user's operation on the selection screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and various settings are made.

The coin processing unit 321 detects the insertion of coins into the coin insertion / return port 73. When the coin processing unit 321 detects that a predetermined amount of coins has been inserted, the coin processing unit 321 outputs an activation signal instructing the start of the game to the PC unit 301.

The shooting unit 304 realizes shooting processing for the user in the shooting space A1. The photographing unit 304 includes a lighting device 331, a camera 91, a touch panel monitor 92, and a speaker 332.

The lighting device 331 is each strobe unit in the photographing space A1 and emits light according to a lighting control signal supplied from the PC unit 301.

The camera 91 shoots according to the shutter control by the PC unit 301, and outputs the image obtained by the shooting to the PC unit 301.

The editorial unit 305A realizes various processes such as editing process for the user in the editing space A2-1. The editorial unit 305A includes a tablet built-in monitor 131, touch pens 132A and 132B, and a speaker 341. The editorial unit 305B realizes processing for users in the editing space A2-2 and has the same configuration as the editorial unit 305A. Hereinafter, when the editorial units 305A and 305B are not particularly distinguished, they are simply referred to as the editorial unit 305.

The tablet built-in monitor 131 displays the edit screen according to the control by the PC unit 301, and accepts the user's operation on the edit screen. An input signal representing the content of the user's operation is supplied to the PC unit 301, and the captured image is edited.

The printing unit 306 is configured to include a printer 351. A sticker paper unit 352 is attached to the printer 351.

The printer 351 drives the built-in head 361 and prints an image on the roll-shaped sticker paper 363 stored in the sticker paper unit 352 based on the print data supplied from the PC unit 301. Further, the printer 351 cuts the sticker paper 363 on which the image is printed by the cutter 362 at a predetermined cut position, and discharges the sticker sheet to the sticker paper discharge port 161.

<Example of functional configuration of photo sticker creation device>
FIG. 15 is a block diagram showing a functional configuration example of the photo sticker creating device 1. At least a part of the functional units shown in FIG. 15 is realized by executing a predetermined program by the CPU 311.

In the photo sticker creating device 1, a preselection processing unit 401, a shooting processing unit 402, an editing processing unit 403, a printing processing unit 404, and a time limit setting unit 405 are realized.

The preselection processing unit 401 executes the preselection processing by controlling each unit of the preselection unit 302. By the pre-selection process, for example, the number of users is selected and whether or not to create a caricature image is selected. Information representing the content selected by the user is supplied to the shooting processing unit 402, the editing processing unit 403, and the time limit setting unit 405.

The photographing processing unit 402 executes the photographing process by controlling each unit of the photographing unit 304. The editing processing unit 403 executes the editing processing by controlling each unit of the editing unit 305. The print processing unit 404 executes the printing process by controlling the printer 351 of the printing unit 306.

The time limit setting unit 405 sets the time limit for various processes for the user in the editing space A2 according to the user's selection content such as at the time of pre-selection. The time limit setting unit 405 outputs the information of the set time limit to the editing processing unit 403. For example, the processing for the user in the editing space A2 mainly includes the processing related to the creation of the caricature image and the graffiti processing, and the time limit for these processing is set by the time limit setting unit 405.

The time limit is the time at which the current process is forcibly terminated after that time. For example, when the set time limit has passed from the start time of the graffiti processing, the graffiti processing is controlled to end. By the way, the multiple customer service type photo sticker creation device 1 (in parallel with a user editing in the editing space A2, a user other than the user can take a picture in the shooting space A1. In the photo sticker making device 1) to be performed, control is performed so as to extend the time limit for graffiti processing unless the next user is present. In that case, the time until the countdown display of the processing time is started and paused can be set as the time limit.

FIG. 16 is a block diagram showing a functional configuration example of the photographing processing unit 402.

The photographing processing unit 402 includes a photographing control unit 411, a chroma key processing unit 412, an image processing unit 413, a face recognition unit 414, and a display control unit 415.

The shooting control unit 411 controls the camera 91 to adjust the angle of view, and shoots with the user as a subject. The shooting control unit 411 outputs a moving image for a live view image captured by the camera 91 to the chroma key processing unit 412. Further, the shooting control unit 411 outputs a still image shot by the camera 91 to the chroma key processing unit 412 when the shooting timing of the shot image comes.

The chroma key processing unit 412 performs chroma key processing on the image supplied from the photographing control unit 411 to extract the user's area. The chroma key processing unit 412 outputs the person image obtained by the chroma key processing to the image processing unit 413.

The image processing unit 413 synthesizes a background image with each frame constituting the moving image supplied from the chroma key processing unit 412 or the background of the user appearing in the still image. The image processing unit 413 outputs a moving image in which a background image is combined with each frame to the display control unit 415 as a live view image.

When all five shootings are completed, the image processing unit 413 performs image processing such as adjusting the size of the eyes on each of the five still images. The image processing unit 413 outputs a still image whose image quality has been adjusted by image processing to the editing processing unit 403 as a captured image. The image processing unit 413 adjusts the image as appropriate by referring to the information supplied from the face recognition unit 414.

The face recognition unit 414 recognizes the face reflected in the photographed image supplied from the image capture control unit 411. The face recognition unit 414 has information for recognizing a face, such as feature information of the contour of the face and feature information of the face parts. The face recognition by the face recognition unit 414 identifies each user's face in each captured image.

The face recognition unit 414 outputs information indicating the position of each user's face in each captured image, information indicating the position of each face part such as eyes, nose, and mouth to the image processing unit 413.

Further, when the shooting is completed, the face recognition unit 414 outputs the images of the face parts such as eyes, nose, and mouth extracted from the face image to the editing processing unit 403.

The display control unit 415 controls the display of the touch panel monitor 92. For example, the display control unit 415 displays a screen of guidance regarding shooting on the touch panel monitor 92. Further, the display control unit 415 causes the touch panel monitor 92 to display the live view screen based on the information supplied from the image processing unit 413.

FIG. 17 is a block diagram showing a functional configuration example of the editing processing unit 403.

The editing processing unit 403 includes a caricature image generation unit 431, a content generation unit 432, an editing unit 433, a display control unit 434, a print data generation unit 435, and a communication control unit 436. The data of the photographed image as an editing target output from the photographing processing unit 402 is input to the editing unit 433, and the image of the face part of each user is input to the caricature image generation unit 431. The parts selection information output from the preselection processing unit 401 is also input to the caricature image generation unit 431.

The caricature image generation unit 431 performs image processing such as conversion processing to a line drawing, deformation, color conversion, and size adjustment on the image of the face part supplied from the face recognition unit 414 of the photographing processing unit 402.

The caricature image generation unit 431 generates a caricature image by synthesizing a face image of a contour selected by the user, an image of a hairstyle selected by the user, and an image of a face part subjected to image processing. .. The caricature image generation unit 431 generates a caricature image of each user and outputs it to each unit of the editing processing unit 403.

The content generation unit 432 generates a stamp image based on the caricature image generated by the caricature image generation unit 431. For example, a plurality of stamp images are generated using the portrait images of the respective users by synthesizing with other images. The stamp image data generated by the content generation unit 432 is supplied to the editorial unit 433 and the display control unit 434.

The editorial unit 433 edits the captured image according to the operation by the user. The editing unit 433 outputs information representing the editing result to the display control unit 434 and reflects it on the display of the editing screen. When the editing is completed, the editing unit 433 outputs the captured image and the edited image, which is the captured image obtained by editing, to the print data generation unit 435 and the communication control unit 436.

Hereinafter, when the edit screen is displayed, the editing of the photographed image performed by using the editing tools such as the stamp tool and the pen tool prepared on the editing screen is also referred to as graffiti.

The display control unit 434 controls the display of the tablet built-in monitor 131. For example, when the display control unit 434 is selected to create a caricature image, the display control unit 434 causes the tablet built-in monitor 131 to display screens used for various selections related to the caricature image.

Further, the display control unit 434 causes the tablet built-in monitor 131 to display the editing screen used for scribbling the captured image. On the edit screen, a caricature image generated by the caricature image generation unit 431, a button operated when selecting a stamp image generated by the content generation unit 432, and the like are also displayed as appropriate.

The print data generation unit 435 arranges the edited image supplied from the editorial unit 433 and the caricature image generated by the caricature image generation unit 431 in a predetermined layout, and generates print data. The print data generation unit 435 outputs the print data to the print processing unit 404 and causes the sticker paper to be printed.

The communication control unit 436 controls the communication unit 317, and transmits the edited image supplied from the editorial unit 433 and the caricature image generated by the caricature image generation unit 431 to the server. In addition, the communication control unit 436 transmits the image for mobile transmission to the server. The image for mobile transmission is an image for viewing on a mobile terminal without being printed on the sticker paper. For example, the image for mobile transmission is generated by the editorial unit 433 using the captured image while the edit screen is displayed.

The print data generation unit 435 and the communication control unit 436 function as an output unit that prints the portrait image on the sticker paper and transmits it to the server.

<Operation of photo sticker making device>
Here, the operation of the photo sticker creation device 1 that provides the photo sticker creation game will be described with reference to the flowchart of FIG.

In step S1, the preselection processing unit 401 determines whether or not a predetermined amount of coins have been inserted based on the activation signal supplied from the coin processing unit 321 and waits until it is determined that coins have been inserted. To do. If it is determined in step S1 that a coin has been inserted, the process proceeds to step S2.

In step S2, the preselection processing unit 401 performs the preselection processing by controlling the preselection unit 302. By the pre-selection process, for example, the number of users is selected, the shooting course for shooting performed in the shooting space A1 is selected, the background image to be the background of the shot image is selected, and the like.

The shooting course includes, for example, a course in which only close-up photography is performed and a course in which close-up photography and full-body photography are performed. Close-up photography is the taking of a close-up image, and full-body photography is the taking of a full-body image.

In the latter course in which close-up photography and full-body photography are performed, for example, the 1st to 3rd shots are close-up shots, and the 4th and 5th shots are full-body image shots. The details of the preselection process will be described later with reference to the flowchart of FIG.

In step S3, the photographing processing unit 402 performs the photographing process by controlling the photographing unit 304. For example, the shooting processing unit 402 displays a live view screen based on a moving image captured by the camera 91, and shoots a user in the shooting space A1 as a subject. The details of the shooting process will be described later with reference to the flowchart of FIG.

In step S4, the time limit setting unit 405 sets the time limit for each process included in the editing process according to the user's selection in the preselection process.

In the pre-selection process, whether or not to create a caricature image is selected. When it is selected to create a caricature image, the time limit setting unit 405 sets a time limit for processing for creating the caricature image and a time limit for graffiti processing performed after the caricature image is created. Further, the time limit setting unit 405 sets the time limit for graffiti processing when it is not selected to create a caricature image.

Here, the time limit for graffiti processing set when creating a caricature image is not selected is set longer than the time limit for graffiti processing set when creating a caricature image is selected. To.

In this way, the time limit for graffiti processing is set as a short time when it is selected to create a caricature image, but the time limit for graffiti processing and the caricature when it is selected to create a caricature image. The total time with the time limit of various selection processes for creating an image is set as a time slightly longer than the time limit of graffiti processing when creating a caricature image is not selected.

As with graffiti, various selections for creating a caricature image are tasks for demonstrating creativity and processing the image, which can be said to be an interesting task for the user.

Even if you choose to create a caricature image, the time for such an interesting task should be the same as the scribble time if you did not choose to create a caricature image. As a result, even if the time of the graffiti itself is short, it is possible to provide a game with a sense of conviction. The details of setting the time limit will be described later.

Returning to the description of FIG. 18, in step S5, the editing processing unit 403 corresponds to the editing space of the editing space A2-1 and the editing space A2-2, which is the destination of the user who has completed the shooting process. Editing is performed by controlling the editorial unit 305.

For example, the editing processing unit 403 causes the tablet built-in monitor 131 to display the editing screen, and causes the user to scribble on the captured image obtained by the photographing process. On the edit screen, along with the captured image to be edited, buttons and the like that are operated when selecting a composite image to be combined with the captured image are displayed. The editing processing unit 403 edits the captured image by synthesizing the compositing image according to the operation of the user, and generates the edited image.

After scribbling the captured image, the editing processing unit 403 displays various screens such as a screen used for selecting the number of divisions and a screen used for selecting an image to be transmitted to the server on the tablet built-in monitor 131. The editing processing unit 403 performs processing according to the user's operation on various screens. The details of the editing process will be described later with reference to the flowcharts of FIGS. 26 and 27.

In step S6, the print processing unit 404 performs the print process by controlling the printer 351. The print processing unit 404 outputs the print data generated by the editing processing unit 403 to the printer 351 and prints the edited image arranged in a predetermined layout on the sticker paper.

When printing is completed, in step S7, the printer 351 discharges the sticker paper on which the image is printed to the sticker paper discharge port 161 and ends the process.

<Preselection process>
The preselection process performed in step S2 of FIG. 18 will be described with reference to the flowchart of FIG.

In step S11, the preselection processing unit 401 displays the number of people course selection screen on the touch panel monitor 71. The number of people course selection screen is a screen used for selecting the number of users. For example, a button operated when selecting a course for two people and a button operated when selecting a course for a large number of three or more people are displayed on the number-person course selection screen. The preselection processing unit 401 manages information representing the content selected by the user. Hereinafter, a case where the number of users is two and a course for two people is selected will be mainly described.

After the number of users is selected, in step S12, the preselection processing unit 401 displays the shooting course selection screen on the touch panel monitor 71. The shooting course selection screen is a screen used for selecting a shooting course. In the case of the above example, a button operated when selecting a course for close-up shooting only and a button operated when selecting a course for close-up shooting and full-body shooting are displayed on the shooting course selection screen.

After the shooting course is selected, in step S13, the preselection processing unit 401 displays the background selection screen on the touch panel monitor 71. The background selection screen is a screen used for selecting a background image.

After the background image is selected, in step S14, the preselection processing unit 401 causes the touch panel monitor 71 to display the guidance of the caricature image. The touch panel monitor 71 displays an introduction screen for the purpose of the caricature image.

In step S15, the preselection processing unit 401 causes the touch panel monitor 71 to display the caricature image creation selection screen used for selecting whether or not to create the caricature image.

FIG. 20 is a diagram showing an example of a caricature image creation selection screen.

The message "Create" pre-carami "?" Is displayed in the upper center of the caricature image creation selection screen, and below that, the create button 531 operated when creating a caricature image and the caricature image are not created. The avoidance button 532, which is sometimes operated, is displayed. In the example of FIG. 20, the rectangular creation button 531 is displayed larger than the avoidance button 532. In addition, "pre-carami" in the message represents a caricature image. Further, the caricature image creation selection screen may be used to select the caricature style.

After selecting whether or not to create a caricature image, in step S16, the preselection processing unit 401 causes the touch panel monitor 71 to display the name input screen. A software keyboard or the like is displayed on the name input screen, and the names of the two users are input using those displays.

In step S17, the preselection processing unit 401 causes the touch panel monitor 71 to display a guidance screen prompting the user to move to the shooting space A1. The user who has completed the pre-selection work enters the shooting space A1 according to the display on the guidance screen and starts the shooting work. After that, the process returns to step S2 of FIG. 18 and the subsequent processing is performed.

In this way, in the pre-selection process, the number of users is selected and whether or not to create a caricature image is selected. The selection of whether or not to create a caricature image is a selection of one of a course including a step of creating a caricature image and a course not including a step of creating a caricature image. The caricature image creation selection screen can be said to be a screen used for selecting one of the above two courses.

The choice of whether or not to create a caricature image may be made only when the number of users is selected to be two. When the number of users is selected as 3 or more, that is, a large number of users, the selection of whether or not to create a caricature image is skipped. Of course, the caricature image may be created even when the number of users is large.

A predetermined time limit is set for selecting whether or not to create a caricature image. If the time limit has passed since the display of the caricature image creation selection screen was started and the time-out occurs, creating a caricature image may be automatically selected, or the caricature image may not be created. May be selected automatically.

<Shooting process>
Next, the photographing process performed in step S3 of FIG. 18 will be described with reference to the flowchart of FIG.

In step S31, the display control unit 415 (FIG. 16) of the shooting processing unit 402 starts displaying the live view screen. That is, the camera 91 is controlled by the photographing control unit 411, and the acquisition of the moving image is started. The moving image is captured, for example, after being adjusted to capture an image having the same angle of view as the close-up image. The moving image captured by the camera 91 is output to the display control unit 415 and used for displaying the live view screen.

When a predetermined time has elapsed since the display of the live view screen was started, in step S32, the shooting control unit 411 performs shooting for personal recognition. The captured image obtained by photographing for personal recognition is used for recognizing the face of each user. In addition, the image obtained by photographing for personal recognition is also used for generating a caricature image.

Shooting for personal recognition is done only once. That is, one shooting for personal recognition is a shooting that combines a shooting for recognizing the user's face and a shooting for generating a caricature image.

As described above, it is not necessary to increase the total number of times of shooting because one shooting has two uses. By suppressing the total number of shots, the time required for a series of games can be suppressed, and the turnover rate of the game can be improved.

FIG. 22 is a diagram showing an example of a live view screen displayed on the touch panel monitor 92 before shooting for personal recognition.

At the substantially center of the screen shown in FIG. 22, a message for instructing the photographer to take a portrait image is displayed.

A face image display area 541 and a face image display area 542 are formed side by side on the message, and a user's face image is displayed on each of them. In the face image display areas 541 and 542, guide images 541A and 542A, which are used as a reference when aligning the positions of the faces, are displayed, respectively. The two users adjust their positions so that their faces fit in the vertically elongated elliptical guide images 541A and 542A, and wait for the shooting to be performed.

FIG. 23 is a diagram showing an example of cutting out a face image.

The image shown in FIG. 23 is a one-frame image constituting a moving image captured by the camera 91. The display control unit 415 cuts out a range indicated by the frame F1 set at a fixed position from the image captured by the camera 91 and displays it in the face image display area 541, cuts out the range indicated by the frame F2, and displays the face image. It is displayed in the area 542. The position, size, and number of frames that define the cutout range may be changed by face recognition.

Before shooting for personal recognition, countdowns indicating the time until shooting are displayed in the face image display areas 541 and 542, respectively, and then shooting is performed. The still image obtained by the photographing for personal recognition is supplied to the face recognition unit 414.

In step S33, the face recognition unit 414 recognizes each user's face based on the still image supplied from the shooting control unit 411. The face recognition unit 414 generates two face images by cutting out a range described with reference to FIG. 23 from one still image supplied from the shooting control unit 411, and the face reflected in each face image. Recognize. The generated face image is supplied to the image processing unit 413 and the display control unit 415.

By face recognition by the face recognition unit 414, for example, the position of the face and the position of each face part such as eyes, nose, and mouth are specified. The face recognition unit 414 outputs information indicating the position of each user's face and information indicating the position of each face part such as eyes, nose, and mouth to the editing processing unit 403 together with the face image.

In step S34, the display control unit 415 displays the result of shooting for personal recognition on the touch panel monitor 92.

In step S35, the display control unit 415 starts displaying the live view screen for normal shooting. Normal shooting is not shooting for personal recognition, but shooting a close-up image or a full-body image.

Each frame of the moving image captured by the camera 91 is subjected to chroma key processing by the chroma key processing unit 412, and then a background image is synthesized by the image processing unit 413. The moving image in which the background image is combined is output to the display control unit 415 and used for displaying the live view screen.

FIG. 24 is a diagram showing an example of a live view screen before normal shooting.

In the center of the live view display screen, the live view display area 571 is arranged upward. In the live view display area 571, the moving image captured by the camera 91 is displayed as a live view image.

Below the live view display area 571, image display areas 572-1 to 572-5 are arranged side by side. In the image display areas 572-1 to 572-5, the captured images obtained by each shooting are displayed immediately after the shooting. From the display of the image display areas 572-1 to 572-5, the user can confirm the shooting result.

When a course in which only close-up shooting is performed is selected, the results of the first to fifth close-up shots are displayed in the image display areas 572-1 to 572-5, respectively. On the other hand, when a course for close-up shooting and full-body shooting is selected, the results of the first to third close-up shots are displayed in the image display areas 5721 to 572-3, respectively, and the image display area 572. In -1,572-2, the results of the fourth and fifth whole-body imaging are displayed, respectively.

The live view screen shown in FIG. 24 is a screen displayed before the first close-up shooting. The live view image shows the faces and upper body of the two users in a large size. The frame of the leftmost image display area 572-1 is highlighted so that the next shooting is the first shooting. On the right side of the live view display area 571, a number indicating a countdown to shooting is displayed.

Before the shooting is performed, the user looks at the live view image displayed in this way, adjusts the standing position, and confirms the pose.

When it is time to shoot, in step S36, the shooting control unit 411 shoots a close-up image. The close-up image obtained by shooting is subjected to chroma key processing by the chroma key processing unit 412, and the background image is synthesized by the image processing unit 413. The close-up image in which the background image is combined is output to the display control unit 415 and displayed on the live view screen as a shooting result.

In addition, the face recognition unit 414 performs face recognition on the close-up image obtained by shooting. Information indicating the position of each user's face reflected in the close-up image is output from the face recognition unit 414 to the image processing unit 413.

In step S37, the photographing control unit 411 determines whether or not the photographing is completed. If it is determined in step S37 that the shooting is not completed because the five shootings have not been completed, the process proceeds to step S38.

In step S38, the imaging control unit 411 determines whether or not the next imaging is close-up imaging.

If it is determined in step S38 that the next shooting is close-up shooting, the process returns to step S36, the display of the live view screen is continued, and close-up shooting is repeated.

On the other hand, if it is determined in step S37 that the shooting is finished, the process proceeds to step S39. If a course that only takes close-up images is selected, no full-body image is taken.

In step S39, the display control unit 415 displays the eye size adjustment screen on the touch panel monitor 92. Using the eye size adjustment screen, each user selects the size of his / her eyes to appear in the captured image.

FIG. 25 is a diagram showing an example of an eye size adjustment screen.

The eye size adjustment screen is composed of an area 581L and an area 581R. The area 581L is used for adjusting the image of the first user, and the area 581R is used for adjusting the image of the second user. In the example of FIG. 25, the image is adjusted one by one, and the area 581R is displayed in a grayed out state.

In the area 582L above the center of the area 581L, a face image of the first user obtained by photographing for personal recognition is displayed.

Below the area 582L, a button 583L that is operated when selecting the eye size is displayed. The button 583L is composed of three buttons, and the user can select a favorite size from three sizes of 30%, 70%, and 100%. Below the button 583L, the OK button 584L, which is operated when determining the size of the eyes, is displayed.

When the first user selects the eye size using the display of the area 581L, the display of the area 581L is grayed out. Using the display of the area 581R having the same configuration as the area 581L, the second user selects the eye size.

In step S40, the image processing unit 413 adjusts the size of the user's eyes in the captured image so that the size is selected by the user.

The face of the first user shown in each of the five captured images is identified based on the recognition result by the face recognition unit 414, and the size of the eyes of the first user is determined by using the button 583L. The image processing unit 413 adjusts the size to the selected size. Further, the face of the second user shown in each of the five captured images is identified based on the recognition result by the face recognition unit 414, and the size of the eyes of the second user presses the button 583R. It is adjusted by the image processing unit 413 so as to have the size selected by using.

After the eye size is adjusted, the process returns to step S3 of FIG. 18 and the subsequent processing is performed.

On the other hand, if it is determined in step S38 that the next shooting is not a close-up shooting but a whole body shooting, the process proceeds to step S41. If a course for close-up photography and full-body photography is selected, the 4th and 5th photography will be full-body photography.

In step S41, the photographing control unit 411 controls the camera 91 and adjusts the angle of view for capturing a whole body image. After the angle of view is adjusted, the live view screen starts to display the live view screen showing the whole body of the user by using the moving image captured by the camera 91.

When it is time to take a picture, in step S42, the picture control unit 411 takes a whole body image. The whole body image obtained by photographing is subjected to chroma key processing by the chroma key processing unit 412, and the background image is synthesized by the image processing unit 413. The whole body image in which the background image is combined is output to the display control unit 415 and displayed on the live view screen as a shooting result.

In step S43, the photographing control unit 411 determines whether or not the photographing is completed. Since the fifth shooting has not been completed, if it is determined in step S43 that the shooting is not completed, the process returns to step S42 and the subsequent processing is performed.

On the other hand, if it is determined in step S43 that the shooting is completed, the process proceeds to step S39, the eye size adjustment screen is displayed, and then the image adjustment is performed in step S40. After that, the process returns to step S3 of FIG. 18 and the subsequent processing is performed.

<Editing process>
Next, the editing process performed in step S4 of FIG. 18 will be described with reference to the flowcharts of FIGS. 26 and 27.

In step S61, the caricature image generation unit 431 determines whether or not the caricature image has been created.

Since it is selected to create a caricature image in the preselection process, if it is determined in step S61 that the caricature image is to be created, in step S62, the display control unit 434 tablets the screen of the caricature image creation guidance. Displayed on the built-in monitor 131. An explanation of the procedure for creating a caricature image is displayed on the tablet built-in monitor 131.

In step S63, the display control unit 434 causes the tablet built-in monitor 131 to display the gender selection screen, which is the screen used for selecting the gender of the user.

FIG. 28 is a diagram showing an example of a gender selection screen.

A region 601L is formed on the left side of the gender selection screen, and a region 601R is formed on the right side. A message prompting the selection of gender is displayed above the area 601L, and a selection result display area 611L is formed below the message.

In the selection result display area 611L, the face image of the first user obtained by shooting for personal recognition is displayed, and below that, a button 612L operated when selecting a woman and a man are selected. Buttons 613L that are sometimes operated are displayed side by side. Button 612L and button 613L are circular buttons, and button 612L is larger than button 613L.

Using such a display of the area 601L, the gender of the first user is selected.

The area 601R is also provided with a display similar to the display of the area 601L. Using the display of region 601R, the gender of the second user is selected.

When the gender is selected using the gender selection screen, in step S64, the caricature image generation unit 431 creates a base caricature image. The base caricature image is created based on the image of the face part extracted from the user's face image and the selected gender.

For example, the caricature image generation unit 431 performs image processing such as line drawing conversion processing, transformation, color conversion, and size adjustment on the image of the face part, and combines the default parts according to the gender to base the image. Create a caricature image.

In step S65, the display control unit 434 displays the parts selection screen on the tablet built-in monitor 131. The parts selection screen is a screen used for selecting a specific part used for creating a caricature image.

FIG. 29 is a diagram showing an example of a parts selection screen.

A message prompting the selection of parts is displayed above the area 601L formed on the left side of the parts selection screen, and a selection result display area 611L, which is a substantially square area, is formed below the message prompting the selection of parts. The image displayed in the selection result display area 611L is a caricature image. At the start of the display of the parts selection screen, the caricature image of the base is displayed in the selection result display area 611L. The display of the selection result display area 611L is switched according to the selection content using the lower display.

Below the selection result display area 611L, a part selection area 621L to 623L, which is an image display area used for selecting a specific part, is formed. In the example of FIG. 29, three types of parts, a facial contour, a hairstyle, and an option, are selected as specific parts. Images representing facial contours, hairstyles, and option selection candidates are displayed side by side in the horizontally long rectangular part selection areas 621L to 623L, respectively.

In the part selection area 621L, illustrations and characters representing four types of contours are displayed: an egg-shaped contour, a contour combining an egg shape and a face length, a round face contour, and a contour combining a round face and a face length. Will be done. The user selects a favorite contour from four types of contours.

On the left side of the parts selection area 622, illustrations representing 8 types of hairstyles are displayed side by side in 2 rows and 4 columns, and on the right side, circular buttons representing 10 types of hair colors are displayed side by side in 5 rows and 2 columns. To.

The user selects the hairstyle by pressing the illustration showing the hairstyle on the left side, and selects the hair color by pressing the circular button on the right side. The hair color in the illustration showing the hairstyle can be switched according to the color change using the circular button on the right side. Further, the image of the left-pointing triangle and the image of the right-pointing triangle arranged below the area 622L are buttons, respectively. When these buttons are pressed, an illustration showing a hairstyle different from the displayed hairstyle is displayed.

In the example of FIG. 29, accessories such as ears and ribbons to be attached to the hair, eyeglasses, and the like can be selected as optional parts. In the part selection area 623L, in addition to the illustration pressed when no option is selected, illustrations representing various optional parts are displayed.

To the right of the parts selection area 623L, a circular OK button 624L that is operated when confirming the selection of parts is displayed.

Using the display of such an area 601L, various selections for creating a caricature image for the first user are made. The caricature image generation unit 431 sequentially generates caricature images according to the user's selection contents and reflects them in the display of the selection result display area 611L.

The area 601R is also provided with a display similar to the display of the area 601L. Using the display of area 601R, various selections are made to create a caricature image for the second user.

In step S66, the display control unit 434 displays a design selection screen, which is a screen used for selecting the design of the caricature image.

FIG. 30 is a diagram showing an example of a design selection screen.

A message prompting the selection of the design of the caricature image is displayed above the area 601L formed on the left side of the design selection screen, and a selection area 631L which is a substantially square area is formed below the message. In the selection area 631L, sample images in which various designs are applied to caricature images reflecting the selection contents using the parts selection screen are displayed side by side in 3 rows and 4 columns.

Using the display of the area 601L, the design of the caricature image for the first user is selected, and the design of the caricature image for the second user is selected using the display of the area 601R. Will be done.

When the design selection is completed, in step S67, the caricature image generation unit 431 generates a caricature image as shown in FIG. 31 that reflects the user's selection. The caricature image P101'in FIG. 31 is a caricature image for the first user.

In this way, the caricature image is created after selecting three items: gender selection, parts selection, and design selection. Instead of making these selections using the design selection screen of FIG. 30, at least a part of the selections may be made using the editing screen described later. In this case, a caricature image is generated in the process of step S71 below.

When the creation of the caricature image is completed, in step S68, the display control unit 434 displays the name input screen on the tablet built-in monitor 131. The name input screen displayed here is a screen used for inputting a name for a caricature image. The name for the caricature image is used for generating a stamp image, a frame with a name (foreground image), and the like. The name input in step S16 of FIG. 19 may be used as the name for the caricature image.

FIG. 32 is a diagram showing an example of a name input screen.

A region 641L is formed on the left side of the name input screen, and a region 641R is formed on the right side. Region 641L is used by the first user and region 641R is used by the second user.

In the caricature image display area 651L on the upper right of the area 641L, the caricature image P101 which is the caricature image of the first user is displayed. A balloon is displayed on the left side of the caricature image P101, and a name input field 652L is displayed inside the balloon. In the name input field 652L, the name input using the keyboard 653L displayed below is displayed.

The area 641R is provided with a display similar to the display of the area 641L. In the caricature image display area 651R formed on the upper left of the area 641R, the caricature image P102 which is the caricature image of the second user is displayed.

Between the caricature image display area 651L and the caricature image display area 651R, a replacement button 642 that is operated when the caricature image displayed in each area is replaced is displayed. When the replacement button 642 is pressed once in the state of FIG. 32, the caricature image P101 is displayed in the caricature image display area 651R, and the caricature image P102 is displayed in the caricature image display area 651L.

The name input using the area 641L and the caricature image displayed in the caricature image display area 651L are linked, and the name input using the area 641R and the caricature image displayed in the caricature image display area 651R are linked. Be done.

After the name for the caricature image is input, in step S69, the content generation unit 432 generates a stamp image as shown in FIG. 33 based on the caricature image generated by the caricature image generation unit 431.

In the stamp image P121 of FIG. 33, the caricature image P101 for the first user and the caricature image P102 for the second user are superimposed on the heart-shaped background image, and the caricature image is under each caricature image. It is an image composed of characters representing the name for.

Stamp images of such various designs are generated by the content generation unit 432.

If it is determined in step S61 that the caricature image is not created, the above processes of steps S62 to S69 are skipped.

In step S70 of FIG. 27, the display control unit 434 displays the edit screen on the tablet built-in monitor 131.

The edit screen is a screen used for scribbling a photographed image. On the edit screen, a button for selecting a photographed image to be scribbled and various scribble contents (composite images) such as a stamp image and a pen image used for scribble is displayed.

FIG. 34 is a diagram showing an example of an edit screen.

The edit screen is basically configured by providing the main configurations symmetrically. The area on the left side is an area used by the user on the left side of the tablet built-in monitor 131. The area on the right side is an area used by the user on the right side of the tablet built-in monitor 131. The operation on the left area can be performed using the touch pen 132A, and the operation on the right area can be performed using the touch pen 132B.

With such an editing screen configuration, two users can perform editing work at the same time. The broken lines surrounding each area on the editing screen shown in FIG. 34 are not actually displayed on the screen.

A thumbnail display area 711L is provided above the center of the area on the left side of the editing screen. The thumbnail display area 711L is a display area for a thumbnail image representing a captured image. Thumbnail images are generated, for example, by reducing each of the captured images.

In the example of FIG. 34, the thumbnail image of the caricature image P101 is displayed in the thumbnail display area 711L side by side with the thumbnail images representing the first to fifth captured images P31 to P35.

An editing area 712L is provided below the thumbnail display area 711L. The editing area 712L is a display area of a captured image to be edited, which is selected by using the thumbnail image of the thumbnail display area 711L.

In the example of FIG. 34, the first captured image P31 is enlarged and displayed in the editing area 712L. The user can select graffiti content using the touch pen 132A and scribble the captured image displayed in the editing area 712L.

When the caricature image P101 is selected as the object of graffiti, as shown in FIG. 35, the caricature image P101 is enlarged and displayed in the editing area 712L.

That is, in this example, the scribble of the caricature image P101 can be performed by using various graffiti contents as in the photographed image. In the area on the right side of FIG. 35, the caricature image P102 is selected as the object of graffiti and is enlarged and displayed in the editing area 712R.

Below the editing area 712L of FIG. 34, an editing palette 713L, which is a horizontally long rectangular area, is displayed. The editing palette 713L is an area in which buttons used for selecting various graffiti contents such as a pen image and a stamp image to be combined with the captured image displayed in the editing area 712L are displayed.

Buttons used for selecting graffiti content generated by the content generation unit 432 are also displayed on the edit palette 713L as appropriate.

FIG. 36 is an enlarged view of the editing palette 713L.

On the edit palette 713L, five types of tabs used for selecting the category of graffiti content are displayed. The user can switch the category of the graffiti content to be displayed on the edit palette 713L by using these tabs.

In the example of FIG. 36, the character stamp is selected as the category of the stamp image. Character stamps are a category of stamp images generated using caricature images.

On the left side of the editing palette 713L, the contents 731-1 to 731-4 are arranged side by side in the upper row, and the contents 732-1 to 732-4 are arranged side by side in the lower row.

The contents 731-1 and the contents 731-2 in the upper row are stamp images using the caricature images P101 and P102 as they are, respectively.

The contents 731-3 and the contents 731-4 are stamp images in which the caricature images P101 and P102 are covered with an animal headgear, respectively. The contents 731-3 and the contents 731-4 are generated by synthesizing the images of the animal headgear with the caricature images P101 and P102.

The lower contents 732-1 and 732-2 are stamp images in which the caricatures of the caricature images P101 and P102 are sitting with their feet held, respectively. The content 732-1 and the content 732-2 are generated by synthesizing the default body image with the caricature images P101 and P102.

The content 732-3 and the content 732-4 are stamp images obtained by synthesizing the user's name input using the name input screen under the faces of the caricature images P101 and P102, respectively. The name to be combined with the caricature image can be corrected by pressing the correction button 737 at the right end.

The contents 733-1 to 733-4 are arranged side by side on the right side of the arrangement of the contents 731-1 to 731-4, and the contents 734-1 to 734-4 are arranged side by side below the contents 733-1 to 733-4.

The contents 733-1 to 733-4 in the upper row are stamp images in which the facial expressions of the caricature image P101 are changed so as to express emotions. The contents 734-1 to 734-4 in the lower row are stamp images in which the facial expressions of the caricature image P102 are changed, respectively.

The horizontally long contents 735-1 and content 735-2 arranged under the contents 734-1 to 734-4 are stamp images using both caricature images of the caricature image P101 and the caricature image P102. According to the shooting order, the caricature image P101 of the first user is arranged on the left side, and the caricature image P102 of the second user is arranged on the right side.

In content where caricature images are arranged side by side, even if there is a height difference between users, the face part is extracted and generated, so the caricature image is generated with no height difference, that is, with the same height. Be placed.

The vertically long content 736 arranged at the right end of the editing palette 713L is a stamp image showing a state in which the caricature of the caricature image P101 is standing. The content 736 is generated by synthesizing the default body image with the caricature image P101.

The user selects a favorite stamp image from such stamp images with the touch pen 132A, and in that state, specifies the position on the captured image displayed in the editing area 712L, so that the stamp using the caricature image is used. The image can be combined with the captured image.

FIG. 37 is a diagram showing an example of editing using a character stamp.

FIG. 37A shows an example of editing a close-up image. The stamp images P111 to P114 combined with the close-up image of FIG. 37A are stamp images synthesized using the contents 732-2, 732-4, 736, 732-3 of FIG. 36, respectively.

FIG. 37B shows an example of editing a whole body image. The stamp images P121 and P122 combined with the whole body image of FIG. 37B are stamp images synthesized using the contents 732-1,736 of FIG. 36, respectively.

In this way, the user can edit the captured image using the stamp image generated based on the caricature image. For example, the user can confirm how similar the caricature images are by arranging a stamp image using the caricature image near his / her face in the photographed image.

Further, by synthesizing the stamp image generated based on the caricature image with the background area, it is possible to generate a highly original background image. It is also possible to select whether the stamp image composition destination is the foreground or the background of the subject in the captured image.

Other information such as the date may be entered as a choice for creating the stamp image.

A correction tool selection area 714L is formed on the right side of the editing area 712L in FIG. 34. The correction tool selection area 714L is an area in which buttons used for selecting various tools used for correcting the edited content, such as an eraser tool, are displayed vertically.

To the right of the correction tool selection area 714L, a creation button 715L operated when creating an image for mobile transmission is displayed. The image for mobile transmission is generated by, for example, performing image processing such as trimming and color conversion on one captured image selected by the user according to a template selected by the user.

Above the correction tool selection area 714L, an end button 716L that is operated when the editing process is finished is displayed.

In the area on the right side of the edit screen, the same configuration as the configuration of the left area described above is arranged symmetrically in position.

The user operates the editing screen as described above using the touch pen 132 to scribble the photographed image and the caricature image.

Returning to the description of FIG. 27, in step S71, the editorial unit 433 edits the photographed image and the caricature image according to the operation of the user. Editing of the captured image and the portrait image is continued until the time limit set by the time limit setting unit 405 elapses or the end buttons 716L and 716R of the edit screen are pressed.

When the editing is completed, in step S72, the display control unit 434 displays the division number selection screen on the tablet built-in monitor 131.

The division number selection screen is a screen used for selecting the sticker layout. The sticker layout determines the number, position, size, position, size, etc. of the image of the sticker that can be used to be printed on one sticker paper.

In step S73, the print data generation unit 435 arranges an edited image or an image of a usable sticker according to the sticker layout selected from the division number selection screen, and generates print data. The print data generated by the print data generation unit 435 is output to the print processing unit 404, and printing is performed on the sticker paper (step S6 in FIG. 18).

In step S74, the display control unit 434 causes the tablet built-in monitor 131 to display the transmission image selection screen. The transmission image selection screen is a screen used for selecting an image to be transmitted to the mobile terminal.

A total of nine images, for example, five captured images, up to two mobile transmission images if created, and two caricature images, are transmitted to the server. The image to be transmitted to the mobile terminal (the image that can be downloaded and acquired to the mobile terminal) is managed by the server so as to be one image selected from the transmission image selection screen and two caricature images.

In step S75, the display control unit 434 causes the tablet built-in monitor 131 to display the address input screen, which is the screen used for inputting the e-mail address. Using the address input screen, the e-mail address to which the image selected from the transmission image selection screen is sent is input.

When the e-mail address is input, in step S76, the communication control unit 436 controls the communication unit 317 and transmits each image to the server. The information sent to the server also includes the email address entered by the user and the sticker ID.

The server that receives the information sent from the photo sticker creation device 1 sends an e-mail containing the URL necessary for accessing from the mobile terminal and acquiring the image to the e-mail address entered by the user. .. When the user operates the mobile terminal to access the server based on the URL included in the e-mail and enters the sticker ID, the image sent to the server can be viewed on the mobile terminal.

In step S77, the display control unit 434 guides the user who has completed the editing work to move to the print waiting space A3. Guidance for moving to the print waiting space A3 is performed by displaying a guidance screen on the tablet built-in monitor 131 or by outputting voice from the speaker 241. After that, the process returns to step S5 of FIG. 18 and the subsequent processing is performed.

<Setting time limit>
Here, the time limit setting by the time limit setting unit 405 will be described.

・ Example 1
(1) Setting example according to the course selection with / without creating a caricature image When creating a caricature image (a course including the process of creating a caricature image) is selected, and not creating a caricature image (caricature) A different time is set as the time limit for the process included in the editing process, depending on whether the process that does not include the process of creating an image) is selected.

(1-1) When Creating a Caricature Image is Selected FIG. 38A is a diagram showing a basic flow of the game when creating a caricature image is selected.

As shown in FIG. 38A, the user who has started to use the photo sticker creation device 1 selects to create a caricature image in the preselection space A0, and moves to the shooting space A1 as shown at the tip of the arrow # 51. As shown at the tip of arrow # 52, in the editing space A2, a caricature image is created before the graffiti.

The creation of the caricature image (steps S62 to S69 in FIG. 26) is performed through the selection of three items of gender selection, parts selection, and design selection, as described above. For the selection of these three items, for example, a time limit of 30 seconds is set. The user operates the gender selection screen (FIG. 27), the parts selection screen (FIG. 28), and the design selection screen (FIG. 29), and selects each item within 30 seconds.

After creating the caricature image, editing (scribble) using the editing screen is performed as shown at the tip of arrow # 53 (steps S70 and S71 in FIG. 27). For example, a time limit of 185 seconds is set for the graffiti when it is selected to create a caricature image. The user operates the edit screen and scribbles the photographed image or the caricature image within 185 seconds.

After the graffiti, in the editing space A2, the number of divisions is selected, the transmitted image is selected, and the like. When various selections after scribbling are completed, printing is started as shown at the tip of arrow # 54.

In this way, when it is selected to create a caricature image, the selection and scribbling of each item for creating the caricature image is performed within, for example, 215 seconds.

The specific number of seconds is just an example and can be changed as appropriate. The selection of whether or not to create a caricature image may be performed in a space other than the preselection space A0.

(1-2) When it is selected not to create a caricature image FIG. 38B is a diagram showing the basic flow of the game when it is selected not to create a caricature image.

As shown in FIG. 38B, the user who has started to use the photo sticker creation device 1 selects not to create a portrait image in the preselection space A0, and moves to the shooting space A1 as shown at the tip of the arrow # 61. As shown at the tip of arrow # 62, editing (doodle) using the editing screen is performed in the editing space A2.

The graffiti when it is selected not to create a caricature image is set to a time limit of, for example, 195 seconds, which is longer than the time limit of 185 seconds when it is selected to create a caricature image. The user operates the edit screen and scribbles the captured image within 195 seconds.

After the graffiti, in the editing space A2, the number of divisions is selected, the transmitted image is selected, and the like. When various selections after scribbling are completed, printing is started as shown at the tip of arrow # 63.

Thus, if it is selected not to create a caricature image, the graffiti will be done, for example, in 195 seconds.

In this example, when it is selected to create a caricature image, the total time of the caricature image creation time limit and the graffiti time limit is set to, for example, 215 seconds, and it is selected not to create the caricature image. In this case, the time limit for graffiti is set to, for example, 195 seconds, and each time is set to a different time, but the time may be the same, or the time difference may be substantially the same time such as within several seconds.

The time limit for scribbling when it is selected to create a caricature image and the time limit for scribbling when it is selected not to create a caricature image can be the same, but do not do so. By suppressing the former time limit, it is possible to provide a fairer game regardless of whether or not a caricature image is created.

Also, even if the time limit for graffiti is suppressed, apart from the time limit, it is possible to create a caricature image as an interesting work that can be replaced with graffiti. Even when is selected, it is possible to obtain a sense of conviction of the user.

When the communication function of the photo sticker creation device 1 is set to be off by the administrator, the function of creating a caricature image may be automatically disabled. Even if the function to create a caricature image is automatically disabled, a long time limit is set for graffiti, which also makes it possible to provide a fair game.

The graffiti process (steps S70 and S71 in FIG. 27) corresponds to the “first editing process”.

Assuming that the image processing for the captured image is "processing", the creation of a caricature image using the image obtained by performing the imaging also corresponds to "processing". Since the selection of each item for creating a caricature image is a selection related to "processing", it can be said to be "processing selection". As will be described later, "processing selection" also includes other selections relating to image processing.

Further, creating a stamp image using a caricature image corresponds to "creating a composite image used for processing". It can be said that "processing selection" and "creation of a composite image used for processing" are included in "processing related to processing". These choices cannot be made during the scribble process. Therefore, the processes of steps S62 to S69 in FIG. 26 can be said to be a second editing process, which is a different type of editing process from the first editing process.

In the editing process, "first editing process" and "processing related to processing" as "second editing process" are performed.

(2) Setting example according to course selection with / without retouching Instead of performing the processes of steps S39 and S40 in FIG. 21, in the editing process, the face is partially adjusted before the scribble. The retouching may be performed according to the operation of the user. In this case, for example, in the preselection process, whether or not to perform retouching is selected. In the selection of the number of users performed during the preselection process, if the number of users is selected as two, retouching is performed, and if the number of users is selected as a large number, the number of users is selected. Retouching may not be performed.

Time limit for processing included in the editing process depending on whether retouching (course including retouching process) is selected or not retouching (course not including retouching process) is selected. Different times are set as.

(2-1) When Performing Retouch is Selected FIG. 39A is a diagram showing a basic flow of the game when performing retouching is selected.

As shown in FIG. 39A, the user who has started to use the photo sticker creating device 1 selects to perform retouching in the preselection space A0, and moves to the shooting space A1 as shown at the tip of the arrow # 71. When shooting is performed, as shown at the tip of arrow # 72, retouching is performed before the graffiti in the editing space A2.

Details of selecting each item for retouching will be described later. For example, a time limit of 20 seconds is set for selecting each item for retouching. The user operates the selection screen and selects each item within 20 seconds. Each captured image is processed (image processing) according to the user's selection. Graffiti is performed on the photographed image after processing.

After retouching, as shown at the tip of arrow # 73, editing (scribble) using the editing screen is performed. For example, a time limit of 185 seconds is set for the graffiti when retouching is selected. The user operates the edit screen and scribbles the captured image within 185 seconds.

After the graffiti, in the editing space A2, the number of divisions is selected, the transmitted image is selected, and the like. When various selections after scribbling are completed, printing is started as shown at the tip of arrow # 74.

In this way, when retouching is selected, the selection and scribbling of each item for retouching is performed within, for example, 205 seconds.

(2-2) When No Retouching is Selected FIG. 39B is a diagram showing a basic flow of the game when no retouching is selected.

As shown in FIG. 39B, the user who has started to use the photo sticker creating device 1 selects not to perform retouching in the preselection space A0, and moves to the shooting space A1 as shown at the tip of the arrow # 81. As shown at the tip of arrow # 82, editing (doodle) using the editing screen is performed in the editing space A2.

For graffiti when it is selected not to retouch, a time limit of 195 seconds, which is longer than the time limit of 185 seconds when retouching is selected, is set. The user operates the edit screen and scribbles the captured image within 195 seconds.

After the graffiti, in the editing space A2, the number of divisions is selected, the transmitted image is selected, and the like. When various selections after scribbling are completed, printing is started as shown at the tip of arrow # 83.

Thus, if it is selected not to retouch, the graffiti will be done, for example, in 195 seconds.

FIG. 40 is a diagram showing an example of a retouch selection screen.

For example, at the start of the editing process, a screen used for selecting a feeling of swelling as shown in FIG. 40 is displayed as a retouch selection screen. The feeling of swelling represents the degree of emphasis on facial parts such as eyes.

In the retouch selection screen of FIG. 40, the main configurations are provided on the left and right. With such a screen configuration, two users can select the feeling of excitement at the same time. The configuration on the left side of the retouch selection screen will be described, but a similar display is provided on the right side.

For example, an image display unit 811L is provided above the center of the left area. The image display unit 811L displays a face image obtained by shooting for personal recognition. Various selection contents are reflected in the display of the face image of the image display unit 811L.

Below the image display unit 811L, the selection unit 812L is displayed. In the center of the selection unit 812L, buttons 821-1L to 821-3L for selecting the feeling of the user's face appearing in each of the close-up images obtained by the shooting process are displayed.

Each of the buttons 821-1L to 821-3L corresponds to the degree of processing that gives a feeling of swelling. Button 821-1L is a button for selecting "natural" as a feeling of swelling, button 821-2L is a button for selecting "recommended" as a feeling of swelling, and button 821-3L is a button for selecting "satisfaction" as a feeling of swelling. It is a button for selecting "Gekimori" as.

By pressing the OK button 822L with any of the buttons 821-1L to 821-3L selected, the degree of processing that gives a feeling of swelling to the user's face area in each captured image is determined. To. The editorial unit 433 processes the face to be reflected in each photographed image so as to give a feeling of swelling according to the determined degree.

On the left side of the button 821-1L, the sensation OFF button 823L, which is operated when canceling the retouch, is displayed. When the swelling OFF button 823L is operated, the retouch is canceled.

FIG. 41 is a diagram showing another example of the retouch selection screen.

For example, when a predetermined feeling of swelling is selected using the retouch selection screen of FIG. 40, the retouch selection screen of FIG. 41 used for selecting the eye shape and the size of the black eyes is displayed on the tablet built-in monitor 131.

Below the image display unit 811L, the selection unit 812L is displayed. In the center of the selection unit 812L, there is a button operated to select the eye shape from the three types and a button operated to select the size of the black eye from the three types. Is displayed.

In response to the operation of these buttons, the editorial unit 433 processes the shape of the eyes reflected in each captured image so as to have the selected shape, and each of them has the selected size. Process the size of the black eyes that appear in the captured image.

FIG. 42 is a diagram showing still another example of the retouch selection screen.

For example, when a predetermined eye shape and black eye size are selected using the retouch selection screen of FIG. 41, the retouch selection screen of FIG. 42 used for selecting the skin color and the lip cheek color is displayed. Is displayed.

Below the image display unit 811L, the selection unit 812L is displayed. In the center of the selection unit 812L, a button operated to select the skin tone from three types and an adjustment bar operated to select the lip cheek color are displayed. ..

The editorial unit 433 processes the skin tone and the lip cheek tint appearing in each captured image so as to obtain the selected tint according to the operation of these displays.

If retouching is selected, such items as selection of swelling, selection of eye shape and size of black eyes, selection of skin tone and lip cheek tone, etc. For example, 20 seconds is set as the time limit. The captured image processed according to the selected content is used as the object of graffiti.

Retouching is "processing" applied to the face in the captured image. The selection for retouching corresponds to the selection of the type of "processing" applied to the face and is included in the "processing selection".

(3) Other setting example Although "processing selection" is assumed to be a selection for creating a caricature image or a selection for retouching, it is another selection related to processing such as background selection and filter selection. You may.

The background selection is the selection of the background image used for compositing with the person image. On the other hand, the filter selection is the selection of the type of processing applied to the captured image. Of a plurality of image processes such as contrast adjustment, color adjustment, brightness adjustment, superimposition of a predetermined texture and / or color layer image (foreground image), and smoothing by processing using a predetermined filter. At least one type of image processing is applied.

FIG. 43 is a diagram showing an example of a background selection screen.

At the left end of the area 601L formed on the left side of the background selection screen, tabs 851-1L to 851-5L used for selecting the category of the background image are displayed. The user can switch the sample background image displayed on the right side by switching the tab selection. In the example of FIG. 43, tab 851-1L is selected and a sample set of background images is displayed.

At the right end of the area 601L, thumbnail images representing the photographed images P31 to P35 to be combined with the background image are displayed vertically side by side. Two users can select the background image at the same time by using such a screen.

FIG. 44 is a diagram showing an example of a filter selection screen.

In the center of the filter selection screen, the button 861 operated when the filter A is selected and the button 862 operated when the filter B is selected are displayed side by side. Each button displays a sample image obtained when each filter is applied. When any of the buttons 861 and 862 is operated, the filter used for the filtering process is selected.

In this way, various selections related to processing can be adopted as the "processing selection".

When it is selected to process the captured image such as creating a caricature image or performing retouching, the processing content selection screen (parts selection screen, retouch selection screen) displayed at the start of the editing process is displayed. When the image is left in the displayed state and a time-out occurs, the processing may proceed assuming that the processing of the captured image is not selected. In this case, the graffiti time limit is extended from, for example, 185 seconds to 195 seconds.

Similarly, when a button for canceling the selection of the processing content is operated, such as the fluffy OFF button 823L, 823R in FIG. 40, it is processed as if processing of the captured image is not selected. May be advanced. In this case as well, the graffiti time limit is extended from, for example, 185 seconds to 195 seconds.

-Example 2
The "processing selection" performed as the "second editing process" before the graffiti as the "first editing process" may be not one type but a plurality of types.

(1-1) When it is selected to create a caricature image and to perform retouching In FIG. 45, it is selected to create a caricature image and to perform retouching. It is a figure which shows the basic flow of a case game.

As shown in FIG. 45, the user who has started to use the photo sticker creation device 1 selects in the preselection space A0 to create a caricature image and to perform retouching, and as shown at the tip of arrow # 101. When the photograph is taken by moving to the photographing space A1, a caricature image is created in the editing space A2 as shown at the tip of the arrow # 102.

A time limit of, for example, 30 seconds is set for the selection for creating the caricature image. The user operates the gender selection screen (FIG. 28), the parts selection screen (FIG. 29), and the design selection screen (FIG. 30), and selects each item within 30 seconds.

When the caricature image is created, retouching is performed as shown at the tip of arrow # 103.

A time limit of, for example, 20 seconds is set for the selection for retouching. The user operates the selection screen and selects each item within 20 seconds.

When retouching is performed, background selection is performed as shown at the tip of arrow # 104, and when background selection is performed, filter selection is performed as shown at the tip of arrow # 105. The captured image that has been retouched, combined with the background image, and filtered according to the selected content is used as the editing target.

After selecting the filter, editing (scribbling) using the editing screen is performed as shown at the tip of arrow # 106. For the graffiti in this case, for example, a time limit of 185 seconds is set. The user operates the edit screen and scribbles the photographed image or the caricature image within 185 seconds.

After the graffiti, in the editing space A2, the number of divisions is selected, the transmitted image is selected, and the like. When various selections after scribbling are completed, printing is started as shown at the tip of arrow # 107.

(1-2) When it is selected not to create a caricature image and not to retouch In FIG. 46, it is selected not to create a caricature image and it is selected not to retouch. It is a figure which shows the basic flow of the game when it is done.

As shown in FIG. 46, the user who has started to use the photo sticker creating device 1 selects in the preselection space A0 not to create a caricature image and not to perform retouching, as shown at the tip of arrow # 111. When the photograph is taken by moving to the photographing space A1, the background is selected before the graffiti in the editing space A2 as shown by the arrow # 112.

When the background is selected, the filter is selected as shown at the tip of arrow # 113. The captured image that has been subjected to the composition and filtering of the background image according to the selected content is used as the editing target.

After selecting the filter, editing (scribbling) using the editing screen is performed as shown at the tip of arrow # 114. For example, a time limit of 195 seconds is set for the graffiti when it is selected not to create a caricature image and it is selected not to perform retouching. The user operates the edit screen and scribbles the captured image within 195 seconds.

After the graffiti, in the editing space A2, the number of divisions is selected, the transmitted image is selected, and the like. When various selections after scribbling are completed, printing is started as shown at the tip of arrow # 115.

In this way, it is possible to have a plurality of types of "machining selection" performed as the "second editing process". The "processing selection" may be at least one of a selection for creating a caricature image, a selection for retouching, a background selection, and a filter selection. Also, when a caricature image is created and there is no retouching, an intermediate value such as 190 seconds (for example, a value between 185 seconds and 195 seconds such as 186 to 194 seconds) is set as the time limit for graffiti. You may do it. Alternatively, the control for extending the graffiti time limit may be performed only when neither the caricature image is created nor the retouching is performed.

・ Example 3
FIG. 47 is a diagram showing a basic flow of the game when it is selected to create a caricature image or perform processing such as retouching, and when the cancellation is performed. Here, a case where the retouching is canceled by operating the swelling OFF button 823L will be described.

As shown in FIG. 47, the user who has started to use the photo sticker creating device 1 selects to perform retouching in the preselection space A0, and moves to the shooting space A1 as shown at the tip of the arrow # 121. When shooting is performed, as shown at the tip of arrow # 122, in the editing space A2, a selection for retouching is made before the graffiti.

At this time, the graffiti has a time limit of 185 seconds, which is shorter than the time limit set when retouching is not performed.

When canceling the retouch is selected, the selection for the retouch is canceled, and editing (scribbling) using the edit screen is performed as shown at the tip of the arrow # 123. The graffiti time limit is extended from, for example, the previously set 185 seconds to 195 seconds. The user operates the edit screen and scribbles the captured image within 195 seconds.

After the graffiti, in the editing space A2, the number of divisions is selected, the transmitted image is selected, and the like. When various selections after scribbling are completed, printing is started as shown at the tip of arrow # 124.

In this way, after once selecting to perform processing such as retouching, the once selected content may be canceled at an arbitrary timing. It is also possible to appropriately switch the time limit for graffiti according to the cancellation of the selected content. Since the selection to perform the processing is canceled, the time for scribbling can be extended by the time required for the selection regarding the processing.

In addition to retouching, the creation of a caricature image may be canceled at any time. Such cancellation such as retouching is appropriately performed after the selection of whether or not to create a caricature image is performed using the caricature image creation selection screen. In addition, the selection of whether or not to create a caricature image may time out, so that the caricature image may not be created after being automatically selected.

-Other Examples The process performed as the "second editing process" may be a process other than the "processing selection" for the user in the editing space A2.

For example, if you can select with / without ads during the editing process, when a course without ads is selected, a longer time than when a course with ads is selected is set as the graffiti time limit. You may do so.

Also, if you can select whether or not to watch the entertainer's video during the editing process, when a course without watching the video is selected, the time will be longer than when the course with watching is selected. It may be set as a time limit.

If you can select with / without the passcode input (including the shooting of the QR code (registered trademark)) attached to the purchased product, if the course without the passcode is selected, the passcode will be entered. A longer time than when a course is selected may be set as the graffiti time limit.

For example, if a passcode is entered, special graffiti content will be prepared on the edit screen. By making it possible to perform graffiti using special graffiti content, it is possible to increase user satisfaction even if the graffiti time is slightly short.

If you can select with / without the number of divisions of the sticker, when a course without the number of divisions is selected, the time limit for graffiti is longer than when the course with the number of divisions is selected. It may be set as.

This allows the user to choose between spending time choosing the design of the sticker or spending time on graffiti.

FIG. 48 is a diagram showing an example of a division number selection screen.

A tab is displayed at the top of the division number selection screen. Depending on which tab is selected, the display of the division number selection screen is switched.

In the example of FIG. 48, the tab with the name of "pocket pre" is selected. The balloon 911L above the center of the left side region 901L is an region used for selecting the number of divisions (designer of the sticker paper). In the example of FIG. 48, sample images representing four types of designs are displayed.

Further, in the example of FIG. 48, the bonus area 912L is displayed, and it is possible to select the design of the sticker that can be received as a bonus. Two users can select the number of divisions at the same time by using such a screen.

If you can select with / without special shooting (shooting that combines the faces of two people, shooting that is different from normal shooting such as collage shooting), special when a course without special shooting is selected A longer time than when a course with shooting is selected may be set as the time limit for graffiti.

When special shooting is performed, it is necessary to display the shooting result on the tablet built-in monitor 131 or the like and have the user confirm it, so that the time limit for graffiti is reduced by the amount of time. In this way, it is possible to set the time limit for editing instead of the time limit for shooting, which is changed according to the presence / absence of special shooting.

When the selection for creating the caricature image is made at the time of the pre-selection process, the selection may be made again at the time of the editing process. In this case, when it is selected not to perform the reselection for creating the caricature image, a longer time than when the reselection is selected may be set as the graffiti time limit.

The case where the time limit of the first editing process is shortened according to the user's selection has been described, but the time limit of the second editing process is shortened without changing the time limit of the first editing process. You may.

Further, in the above embodiment, the case where the time limit of the first editing process is set longer than the time limit of the second editing process has been described, but the time limit of the second editing process is limited to the first editing process. It may be set longer than the time.

The series of processes described above can be executed by hardware or software. When the series of processes described above are executed by software, the programs constituting the software are installed from a network or a recording medium.

As shown in FIG. 14, this recording medium is, for example, a magnetic disk on which the program is recorded, which is distributed to the administrator of the photo sticker creation device 1 separately from the device main body. It is composed of a removable medium 319 including a flexible disk), an optical disk (including a CD-ROM and a DVD), a magneto-optical disk, or a semiconductor memory. In addition to these, the recording medium is composed of a ROM 312 in which a program to be distributed to the administrator is recorded in a state of being incorporated in the apparatus main body in advance, a hard disk included in the storage unit 316, and the like.

In the present specification, the steps for describing a program to be recorded on a recording medium are not necessarily processed in chronological order in the order described, but also in parallel or in parallel or not necessarily in chronological order. It also includes processes that are executed individually.

In the above, the print medium is not limited to the sticker paper and the photographic paper. For example, the image may be printed on a paper or film of a predetermined size, a card such as a prepaid card or an IC (Integrated Circuit) card, or a cloth such as a T-shirt. In this case, the sticker layout image in which one or a plurality of captured images are arranged may be printed on these print media.

Further, the embodiment of the present technology is not limited to the above-described embodiment, and various changes can be made without departing from the gist of the present technology.

1 Photo sticker making device, 91 camera, 92 touch panel monitor, 401
Control unit, 402 Imaging processing unit, 403 Editing processing unit, 404 Printing processing unit, 405 Time limit setting unit, 411 Imaging control unit, 412 Chroma key processing unit, 413 Image processing unit, 414 Face recognition unit, 415 Display control unit, 431 Caricature image generation unit, 432 content generation unit, 433 editorial unit, 434 display control unit, 435 print data generation unit, 436 communication control unit

Claims (12)

A shooting unit that shoots with the user as the subject,
A first editing unit that performs a first editing process on a photographed image obtained by photographing by the photographing unit according to the operation of the user, and a first editing unit.
As a second editing process, which is a type of editing process different from the first editing process, a second editing unit that performs processing related to the processing of the captured image and a second editing unit.
A selection unit that selects whether or not to execute the second editing process according to the operation of the user, and
When it is selected not to execute the second editing process, it is provided with a time limit setting unit for setting a longer time limit for the first editing process than when it is selected to execute the second editing process. ,
In the first editing process, a photo-creating game machine capable of editing an image obtained by the second editing process according to an operation by the user. It has an editing space for editing by the user and another space.
The photo-creating game machine according to claim 1, wherein the first editing process and the second editing process are processes performed in response to an operation by the user in the editing space. 2. In the shooting space as the other space, a user other than the user can shoot in parallel with the user editing in the editing space. Photographing game machine described in. The selection unit
A course selection screen used to select one of the first course including the step of executing the second editing process and the second course not including the step of executing the second editing process. To display
The photo-creating game machine according to any one of claims 1 to 3, wherein the first course or the second course is selected according to the operation of the user on the course selection screen. The photo-creating game machine according to claim 4, wherein the selection unit selects the second course when a time-out occurs after displaying the course selection screen. The selection unit displays a screen including a button operated when canceling the second editing process before executing the second editing process.
The photo-creating game machine according to any one of claims 1 to 5, wherein the second editing unit cancels the second editing process in response to the operation of the button. The total time of the time limit of the first editing process and the time limit of the second editing process, which is set when it is selected to execute the second editing process, does not execute the second editing process. The photo-creating game machine according to any one of claims 1 to 6, which is equal to or substantially equal to the time limit of the first editing process set when is selected. The photograph according to any one of claims 1 to 7, wherein the process related to the processing of the photographed image is a process including processing selection of the photographed image and creation of a composite image used for processing the photographed image. Creation game machine. The processing selection of the captured image includes selection for creating a caricature image based on the captured image, selection of the type of processing applied to the face of a person appearing in the captured image, selection of a background to be combined with the captured image, and selection of a background to be combined with the captured image. The photo-creating game machine according to claim 8, further comprising at least one of the selection of the type of processing applied to the entire captured image. The photo-creating game machine according to claim 8 or 9, wherein the compositing image used for processing the photographed image is created as a stamp image. A shooting unit that shoots with the user as the subject,
A first editing unit that performs a first editing process on a photographed image obtained by photographing by the photographing unit according to the operation of the user, and a first editing unit.
An information processing method for a photo-creating game machine including a second editing unit that performs processing related to the processing of the captured image as a second editing process, which is a type of editing process different from the first editing process.
Whether or not to execute the second editing process is selected according to the operation of the user, and the process is selected.
When it is selected not to execute the second editing process, the time limit for the first editing process is set longer than when it is selected to execute the second editing process.
In the first editing process, an information processing method including a step in which an image obtained by the second editing process can be edited according to an operation by the user. A shooting unit that shoots with the user as the subject,
A first editing unit that performs a first editing process on a photographed image obtained by photographing by the photographing unit according to the operation of the user, and a first editing unit.
As a second editing process, which is a type of editing process different from the first editing process, a computer that controls a photo creation game machine including a second editing unit that performs processing related to the processing of the captured image is provided.
Whether or not to execute the second editing process is selected according to the operation of the user, and the process is selected.
When it is selected not to execute the second editing process, the time limit for the first editing process is set longer than when it is selected to execute the second editing process.
In the first editing process, a program for executing a process including a step in which an image obtained by the second editing process can be edited according to an operation by the user.

Images