JP7772027B2 - Game image capture device - Google Patents

Description

The present invention relates to the capture of game images, and in particular to technology for adjusting the layout of captured images.

Playful image capture devices, such as Purikura (registered trademark), are extremely popular, especially among female high school students. With these devices, users take pictures of themselves and then decorate the captured images in various ways on an editing display. The decorated images are then provided to the user by being printed on sticker paper or downloaded from a device such as a smartphone or computer.

Patent No. 5246524

Users playing with game image capture devices decorate their captured images in various ways, such as by writing messages or attaching stamps to them. When writing messages, users often want to write the message in the blank space of the captured image. For example, if the user's face appears at the bottom of the image to be decorated, there will be more blank space at the top of the image than if the user's face appears in the center of the image. This allows the user more space to write their message. It is also desirable for the user to be able to freely change the size of such blank space depending on the message they want to write.

The present invention was completed by the inventors based on the above-mentioned perspective, and its main purpose is to provide technology for adjusting the position of a subject in an image captured by a game image capture device.

In one aspect of the present invention, a play image capture device includes a capture processing unit that captures images of a user in a capture space; an editing processing unit that accepts editing input from the user for the captured image in an editing space; an image output unit that outputs the edited captured image to an external medium; and an area designation unit that designates an output area in the captured image that indicates the range to be output to the external medium. In a first direction, the area designation unit fixes the output area to a predetermined position in the captured image according to preset conditions, and in a second direction different from the first direction, the output area is variably set in response to instructions from the user.

This invention makes it easier for users to edit captured images in a more flexible layout using a game image capture device.

FIG. 1 is a diagram illustrating the overall configuration of a game image capturing system. FIG. 2 is a perspective view of the appearance of the game image capturing device. FIG. 10 is a flowchart showing the flow of play in the game image capturing device. FIG. 2 is a plan view of the game image capturing device seen from above. FIG. 2 is a functional block diagram of the play image capturing device. 1 is a schematic diagram of an original still image, a captured image, an adjusted image, and modifiable areas. FIG. 2 is a schematic diagram showing a captured image in the first embodiment. 3A and 3B are schematic diagrams showing a still original image and a captured image in the first embodiment. FIG. 4 is a schematic diagram illustrating an adjustment process in the first embodiment. FIG. 3 is a schematic diagram showing an editing screen in the first embodiment. FIG. 10 is a schematic diagram showing readjustment in the first embodiment. FIG. 4 is a schematic diagram showing a readjusted image in the first embodiment. FIG. 2 is a schematic diagram showing an edited image in the first embodiment. FIG. 10 is a schematic diagram showing a captured image in the second embodiment. 10A and 10B are schematic diagrams showing a still original image and a captured image in the second embodiment. FIG. 10 is a schematic diagram illustrating an adjustment process in the second embodiment. FIG. 11 is a schematic diagram showing an editing screen in the second embodiment. FIG. 11 is a schematic diagram showing a captured image in the third embodiment. FIG. 11 is a schematic diagram illustrating an adjustment process in the third embodiment. FIG. 11 is a schematic diagram showing an editing screen in the third embodiment.

First, an overview of the game image capture device of the present invention will be described. Next, the detailed configuration of the game image capture system will be described. Next, the detailed processing flow will be described for each of the first to third embodiments. Finally, a modified example will be described. Hereinafter, the first to third embodiments will be collectively referred to as "the present embodiment."

First, an outline of the game image device according to this embodiment will be described.
The game image capturing device in this embodiment is equipped with a photo booth (photography space) and an editing booth (editing space). Users take photos of themselves in the photo booth. Hereinafter, an image captured of a subject (user) in the photo booth will be referred to as a "captured image." The game image capturing device adjusts the position of the display range of the captured image based on the position of the user in the photo booth (hereinafter, such automatic adjustment processing will be simply referred to as an "adjustment processing"). Details of the adjustment processing will be described later. Hereinafter, a captured image that has undergone adjustment processing will be referred to as an "adjusted image."

In this embodiment, the shooting space and the editing space are described as being separate spaces, but the shooting space and the editing space may also be the same space. In this case, a specific space may be used as the shooting space during shooting and as the editing space during editing.

The adjusted image is sent to the editing booth. In the editing booth, the user can further adjust the position of the display range of the adjusted image (hereinafter, such manual adjustments will be referred to as "readjustments"). Below, an image that has been readjusted by the user will be referred to as a "readjusted image." Furthermore, the user can decorate the readjusted image as desired, such as by drawing with a stylus or attaching stamp images (hereinafter, such image decoration and readjustment will be referred to as "editing work"). A readjusted image that has completed editing work will be referred to as an "edited image."

The user selects a mount image that defines the layout and background of the edited image. The user then composites the edited image onto the selected mount image. Hereinafter, the final product obtained by embedding the edited image into the mount image will be referred to as the "finished image."

The game image capture device prints the completed image onto a sticker mount or photo printing paper (external medium). The game image capture device also uploads the completed image, which is an image with the edited image embedded into the mount image, and the edited image, which is an image before the mount image is embedded, to a server (external medium). Users can also download edited images by accessing the server from a user terminal such as a smartphone or PC. As described above, the game image capture device in this embodiment has capture functions, editing functions, printing functions, and communication functions.

Next, the detailed configuration of the game image photographing system will be described.
FIG. 1 is a diagram showing the overall configuration of a game image capturing system 200. As shown in FIG.
In the game image capturing system 200, the game image capturing device 100 is connected to a server 202 and a user terminal 206 (a mobile device and a PC) via the Internet 204. Hereinafter, the user terminal 206 is assumed to be a mobile device such as a smartphone. The user captures a picture of themselves using the game image capturing device 100. The game image capturing device 100 acquires a captured image including the subject (user), performs adjustment processing on the captured image, and accepts editing work by the user. As mentioned above, the editing work here also includes readjusting the position of the display range (described below).

After editing, the edited image and the completed image are uploaded from the game image capture device 100 to the server 202 along with the user ID. The server 202 stores the user ID, capture date and time, edited image, and completed image (a composite image of the edited image and the mount image) in association with each other. The user can download the edited image, etc. from the server 202 by accessing the server 202 by specifying the user ID.

FIG. 2 is a perspective view of the appearance of the game image capturing device 100. As shown in FIG.
The game image capturing device 100 includes a reception device 102, a photo booth 104, an editing booth 106, and a printing device 110. The reception device 102 includes a reception monitor 108. A user reserves use of the game image capturing device 100 at the reception device 102. At the reception device 102, the user inputs a user ID into the reception monitor 108 and pays a play fee in cash or electronic money.

The user takes a photo in the photo booth 104. After taking the photo, the user moves to the editing booth 106. An editing device 126 is installed in the editing booth 106. The editing device 126 is equipped with an editing monitor 120. The edited image (the image to be readjusted or decorated) is displayed on the editing monitor 120. In this embodiment, the editing monitor 120 is formed by a capacitive touch panel. Two stylus pens 122a and 122b are provided for each editing monitor 120. The user uses the stylus pens 122 and their fingers to readjust or decorate the adjusted image. After editing is complete, the printing device 110 prints the completed image on a sticker mount. The editing device 126 also uploads the edited image, etc. to the server 202.

FIG. 3 is a perspective view of the exterior of the photo booth 104. As shown in FIG.
The photo booth 104 is shielded from the outside by a curtain 124. A photo taking device 128 is installed in the photo booth 104. The photo taking device 128 includes a lighting device 116, which is a light that illuminates the user, who is the subject, from three directions, a camera 118 for acquiring photographed images, and a photo taking monitor 112. The lighting device 116 is a large lighting device that illuminates the entire photo taking booth 104. The photo taking monitor 112 displays a live view image that allows the user to check their own appearance, as well as a countdown image that indicates the timing for taking photos.

Fig. 4 is a flowchart showing the flow of play in the game image capturing device 100. Fig. 5 is a plan view of the game image capturing device 100 as seen from above.
When a user makes a reservation for use at the reception device 102, the reception device 102 executes a reception process (S10). When making a reservation, the user selects the size of the display area of the photographed image on the reception monitor 108 corresponding to the number of players. Hereinafter, the image display area will be referred to as a "frame." There are two sizes of frame for photographed images: a "for two people" size suitable for photographing two people, and a "for three or more people" size suitable for photographing three or more people. The vertical widths of the "for two people" frame and the "for three or more people" frame are both set to the same length. On the other hand, the horizontal width of the "for three or more people" frame is set to be longer than the "for two people" frame. After completing the reception, the user enters the photo booth 104.

The photographing device 128 acquires the user's photographed image (S12). During photographing, a live view image with the frame size selected by the user in S10 is displayed on the photographing monitor 112. In the photographing booth 104, the user can acquire a specified number of photographed images. In this embodiment, the specified number is eight. The photographing device 128 performs an adjustment process on the photographed image (S14). In the adjustment process, the photographing device 128 automatically changes the frame position of the photographed image to generate an adjusted image. The frame size of the adjusted image is the same as that of the live view image (photographed image), but the frame position of the adjusted image differs from that of the live view image. Specific processing will be described later.

After the adjustment process is completed, the camera device 128 determines whether or not the specified number of captured images (eight times) have been acquired (S16). If the specified number of captured images have not been acquired (N in S16), the camera device 128 continues capturing images. If the specified number of captured images have been acquired (Y in S16), the camera device 128 ends capturing images. In other words, when capturing images with the camera device 128, the process of capturing captured images, adjusting the frame position of the captured images, and capturing adjusted images is repeated eight times (the specified number of times).

After shooting, information instructing one of the two editing booths 106 is displayed on the shooting monitor 112. The user moves to the editing booth 106 specified by the shooting monitor 112, out of the two editing booths 106a and 106b. The adjusted image is transferred from the shooting device 128 to the editing device 126. The user performs editing work on the editing device 126. First, the user readjusts the transferred adjusted image. In readjustment, the user changes the position of the frame of the adjusted image to generate a readjusted image. Note that the frame size of the readjusted image is the same as that of the adjusted image. Specific processing will be described later. The user then applies decorative processing to the readjusted image to create an edited image (S18). After completing the editing work, the user selects a mount image and creates a finished image by laying out the edited image on the mount image.

The editing device 126 sends the completed image to the printing device 110, which then prints the completed image on a sticker sheet (S20). The editing device 126 also uploads the edited image and completed image to the server 202 via the Internet 204 (S22). By accessing the server 202, the user can download the edited image, etc. from the server 202 to the user terminal 206.

Generally, editing takes longer than photography. In this embodiment, the game image capture device 100 has two editing booths 106a, 106b (editing devices 126a, 126b) for each photography booth 104, thereby increasing customer turnover.

FIG. 6 is a functional block diagram of the play image capturing device 100. As shown in FIG.
The components of the game image capture device 100 are realized by hardware including computing units such as a CPU (Central Processing Unit) and various co-processors, storage devices such as memory and storage, and wired or wireless communication lines connecting them, as well as software stored in the storage devices that supplies processing instructions to the computing units. The computer program may be composed of device drivers, an operating system, various application programs located at higher levels than these, and libraries that provide common functions to these programs.
As described above, the game image capture device 100 is configured as a collection of the capture device 128, the reception device 102, the editing device 126, and the printing device 110. Each block described below represents a functional block, not a hardware configuration.

The play image capturing device 100 includes a user interface processing unit 130, a data processing unit 132, a communication unit 134, and a data storage unit 136. As described above, the play image capturing device 100 also includes a camera 118 and a lighting device 116.
The user interface processing unit 130 is responsible for user interface processing via the reception monitor 108, the editing monitor 120, etc. The communication unit 134 is responsible for communication processing with the server 202 via the Internet 204. The communication unit 134 can also communicate directly with the user terminal 206 via short-range wireless communication such as Wi-Fi (registered trademark). For example, the communication unit 134 may directly transmit an edited image to the user terminal 206. The data storage unit 136 stores various data. The data processing unit 132 performs various processes based on the data acquired by the communication unit 134 and the data stored in the data storage unit 136. The data processing unit 132 also functions as an interface between the user interface processing unit 130, the communication unit 134, and the data storage unit 136.

The user interface processing unit 130 includes an input unit 140 that accepts operational inputs from the user, and an output unit 142 that presents information to the user.

The input unit 140 detects user inputs made to touch panels installed on the reception device 102, the imaging device 128, the editing device 126, etc. The input unit 140 also detects inputs made using the stylus pen 122. The input unit 140 also detects the user ID on the reception device 102.

The output unit 142 performs various output processes, such as image display on the reception device 102, the photographing device 128, the editing device 126, etc., as well as audio output and print output.

When taking a photo, the output unit 142 displays a live view image of the user (subject) on the shooting monitor 112. The user can check their own image in the live view image as if they were looking in a mirror while taking the photo.

The data processing unit 132 includes a photography processing unit 144 , an area designation unit 146 , an editing processing unit 148 , a reception processing unit 150 , and an image output unit 152 .
The photography processing unit 144 controls the photography processing in the photography booth 104. The photography processing unit 144 also fires a strobe (not shown). The photography processing unit 144 notifies the user of the photography timing by instructing the output unit 142 to display a countdown and provide an audio notification. The area designation unit 146 generates an adjusted image using a method described below. The area designation unit 146 also readjusts the adjusted image in accordance with operation input from the user to generate a readjusted image. The output unit 142 displays the adjusted image on the editing monitor 120 (a capacitive touch panel). The editing processing unit 148 decorates the readjusted image in accordance with operation input from the user to generate an edited image. The reception processing unit 150 manages the payment of play fees by users at the reception device 102. The reception processing unit 150 also accepts the user's selection of the frame size for the photographed image. Each time photography work in the photography booth 104 is completed, the reception processing unit 150 guides users with reservations to the photography booth 104. The image output unit 152 controls the printing of the completed image in the printing device 110 and the output of the edited image and the like to the user terminal 206 .

The communication unit 134 includes a receiving unit 230 that receives data and a transmitting unit 232 that transmits data.

Here, the photographing process (S12), the adjustment process (S14), and the editing process (S18) in this embodiment will be described in detail.
First, the photographing process (S12) will be described in detail.
FIG. 7 is a schematic diagram of a still original image 300, a captured image 310, an adjusted image 320, and a modifiable region 330.
When a user who has completed check-in at the reception device 102 enters the photo booth 104, the camera 118 begins capturing an original image. The original image is an image captured with the widest angle of view that the camera 118 can capture. The photo processing unit 144 also extracts a portion of the original image based on the frame size selected by the user at check-in, and displays the extracted portion as a live view image on the photo monitor 112. In this way, the camera 118 captures a relatively wide range as the original image, but only a portion of the original image is displayed as the live view image.

The image capture processing unit 144 instructs the output unit 142 to output an announcement that image capture should begin. The image capture processing unit 144 also sends an instruction to the camera 118 to acquire a still original image 300 (described below) the moment the countdown time ends. Note that the countdown time refers to the time required for the countdown. At the same time, the image capture processing unit 144 instructs the output unit 142 to display the countdown and notify the user by voice.

The moment the countdown ends, the camera 118 acquires the original image captured at that moment as the still original image 300. At the same time, the image capture processing unit 144 acquires the live view image at the moment the countdown time ends as the captured image 310 (solid line area). In other words, the original image at the time of capture is acquired as the still original image 300, and the live view image, which is a part of the original image, is acquired as the captured image 310. As a result, the still original image 300, which is a relatively large still image, and the captured image 310, which is a relatively small image cropped from the still original image 300, are obtained.

Next, the adjustment process (S14) will be described in detail.
The original still image 300 and the captured image 310 are transferred to the area designation unit 146. The area designation unit 146 changes the position of the frame of the captured image 310 vertically and horizontally within the range of the original still image 300, and generates an adjusted image 320 (area indicated by dashed lines).

For example, consider a situation in which a user is taking a photo, as shown in Figure 7. In the captured image 310, the user's face is visible in the upper left. In this case, the area designation unit 146 detects the position of the face in the still original image 300 and automatically changes the position of the frame of the captured image 310 so that the user's face is positioned at the center of the adjusted image 320. As a result, an adjusted image 320 is generated in which the user's face is positioned at the center. The frame size of the adjusted image 320 is the same as that of the captured image 310 (live view image), but the cropping position in the still original image 300 differs from that of the captured image 310. As described above, the captured image 310 is acquired corresponding to the live view image (the image viewed by the user), and then the cropping position is adjusted to match the user's position, thereby acquiring the adjusted image 320. This control method allows for appropriate position adjustment even if the user ends up in the corner of the captured image 310.

After generating the adjusted image 320, the area designation unit 146 sets a modifiable area 330 (area indicated by a two-dot chain line) on the still original image 300. The modifiable area 330 is an area in which the position of the adjusted image 320 can be changed when the user performs readjustment, as described below. The width of the modifiable area 330 is the same as that of the adjusted image 320, but the height is set to be longer than that of the adjusted image 320. In other words, the modifiable area 330 is set within the still original image 300 at a position and size based on the adjusted image 320. Note that in this embodiment, the height of the modifiable area 330 is set to 1.5 times the height of the adjusted image 320, but does not exceed the extent of the original image.

The above-mentioned shooting and adjustment processes are performed a specified number of times, eight times, for each captured image, and the adjusted image 320 and the still original image 300 with the modifiable area 330 set are transferred to the editing device 126. The shooting processing unit 144 also instructs the output unit 142 to display and sound notifications regarding movement to the editing booth 106. The user who received the instruction moves to the editing booth 106.

Next, the editing process (S18) will be described in detail.
After completing the shoot, the user enters the editing booth 106 and uses the editing device 126 to edit the adjusted image 320. The adjusted image 320 is displayed on the editing monitor 120. The user then vertically repositions the frame of the adjusted image 320 within the modifiable area 330 and fixes it at a desired location. In other words, the modifiable area 330 is the range within which the frame position of the adjusted image 320 can be changed. This operation of changing and fixing the frame position is called readjustment. Specific user operations for readjustment will be described later. In FIG. 7 , readjustment is possible within the range indicated by the double-headed arrows drawn above and below the adjusted image 320. In this way, the user repositions and fixes the frame position of the adjusted image 320, generating a readjusted image 340. After the readjusted image 340 is generated, the user decorates the image by writing a message, for example. The editing processing unit 148 accepts input from the user and creates an edited image 350.

Next, we will explain the detailed processing flow for each of the first to third embodiments. In the first embodiment, we will explain a situation where two users are taking a photo side by side. In the second embodiment, we will explain a situation where three users are taking a photo side by side. In the third embodiment, we will explain a situation where two users are taking a photo with their faces lined up above each other.

[First embodiment]
In the first embodiment, a scene is assumed in which two users A1 and A2 are taking pictures.
First, users A1 and A2 pay a play fee at the reception device 102 and enter their user IDs. Users A1 and A2 also select a frame size at the reception device 102. Users A1 and A2 select "for two players" as the frame size for the photographed image 310. At this time, the reception processing unit 150 detects that the play fee has been paid and accepts the user ID and the selection of the "for two players" frame. The reception processing unit 150 instructs the output unit 142 to output an announcement urging the users to enter the photo booth 104. At this time, the photo processing unit 144 instructs the lighting device 116 to turn on. In response to this instruction, the lighting device 116 illuminates the inside of the photo booth 104.

Following the instruction to enter the photo booth 104, users A1 and A2 enter the photo booth 104. The photo processing unit 144 extracts an area equivalent to the size of the "two-person" frame from the original image captured by the camera 118. The photo processing unit 144 instructs the output unit 142 to display this area as a live view image on the photo monitor 112.

The photography processing unit 144 instructs the output unit 142 to output an announcement that photography should begin. The photography processing unit 144 also sends an instruction to the camera 118 to acquire a still original image 300 the moment the countdown time ends. At the same time, the photography processing unit 144 instructs the output unit 142 to display the countdown and notify the user by voice. When the countdown begins, users A1 and A2 pose for the photo shoot while checking their appearance in the live view image displayed on the photography monitor 112. The moment the countdown time ends, the camera 118 acquires the still original image 300. At the same time, the photography processing unit 144 acquires a captured image 310, which is part of the still original image 300.

The area designation unit 146 performs adjustment processing based on the still original image 300 and the captured image 310. When the adjustment processing by the area designation unit 146 is complete, the shooting processing unit 144 again sends an instruction to the camera 118 to acquire the still original image 300. At the same time, the area designation unit 146 instructs the output unit 142 to notify a countdown. This process is repeated eight times to acquire the still original image 300 and the captured image 310. In other words, a set of the still original image 300 and the captured image 310, which is an extracted portion of the still original image 300, can be acquired in one shooting session. Eight sets of these sets are acquired after eight shooting sessions (the specified number of times).

FIG. 8 is a schematic diagram showing a captured image 310 in the first embodiment.
8, users A1 and A2 are shown hugging each other and shifting to the right of the center. In other words, in the captured image 310 before adjustment processing, the positions of the two users are shifted to the right.

FIG. 9 is a schematic diagram showing a still original image 300 and a captured image 310 in the first embodiment.
The camera 118 captures an original image during shooting. The shooting processing unit 144 extracts an area from the original image that corresponds to the size of the "two-person" frame and displays it as a live view image on the shooting monitor 112. The moment the countdown time ends, the camera captures a still original image 300. At the same time, the shooting processing unit 144 captures a captured image 310.

FIG. 10 is a schematic diagram showing the adjustment process in the first embodiment.
Based on the still original image 300 and the captured image 310, the region designation unit 146 performs an adjustment process to generate an adjusted image 320. During the adjustment process, the region designation unit 146 automatically detects a position where the faces of users A1 and A2 are displayed near the center while vertically and horizontally changing the frame position of the captured image 310 within the range of the still original image 300. In this embodiment, the region designation unit 146 detects the midpoint (not shown) between the faces of users A1 and A2 and changes the position of the frame of the captured image 310 so that this point is the center of the image. The range (the range indicated by the dashed line) that appears when this position is confirmed becomes the frame of the adjusted image 320. In the adjusted image 320 after adjustment, the two users are positioned at the center. The region designation unit 146 also sets a modifiable region 330 based on the position and frame size of the adjusted image 320. The adjusted image 320 and the original still image 300 with the modifiable region 330 set therein are transferred to the editing device 126 .

When filming is complete, the filming processing unit 144 instructs the output unit 142 to display and sound notifications regarding moving to the editing booth 106. Upon receiving the instructions, users A1 and A2 move to the editing booth 106.

FIG. 11 is a schematic diagram showing an editing screen 400 in the first embodiment.
An editing screen 400 is displayed on the editing monitor 120 in the editing device 126 of the editing booth 106. As described above, the editing device 126 acquires the still original image 300, but what is displayed on the editing screen 400 is the adjusted image 320, which is a portion of the still original image 300. The edit screen 400 displays the adjusted image 320 and a slider bar 410 with a slider 420. Users A1 and A2 make readjustments on the edit screen 400.

Specifically, users A1 and A2 move slider 420 on slider bar 410 on the right side of editing screen 400 to adjust the frame position of adjusted image 320 vertically within modifiable area 330. Slider 420 represents the user's appearance. Therefore, when slider 420 is moved downward, the user's appearance on adjusted image 320 also moves downward. In other words, the further slider 420 is moved downward, the more white space there is at the top of adjusted image 320.

FIG. 12 is a schematic diagram showing readjustment in the first embodiment.
As users A1 and A2 operate slider 420, area designation unit 146 changes the position of the frame of adjusted image 320 within the range of the double-headed arrow in changeable area 330. When users A1 and A2 fix the position of slider 420 at a desired location, area designation unit 146 generates readjusted image 340 based on the frame position at that time.

The flow of Figures 11 and 12 will be explained in a different form. The adjusted image 320 and the still original image 300 with the modifiable area 330 set are transferred to the editing device 126 upon completion of the adjustment process. Of the transferred still original images 300, the adjusted image 320 is designated as the first image to be displayed on the editing screen 400. Furthermore, the modifiable area 330 is designated as the range within which the frame position of the adjusted image 320 can be changed. Initially, the adjusted image 320 is displayed on the editing screen 400, but users A1 and A2 can move the slider 420 to change the frame position within the modifiable area 330. When the position of the slider 420 is fixed at a desired location, the area designation unit 146 generates a readjusted image 340 based on the frame position at that time. For example, if the slider 420 is moved downward while the adjusted image 320 shown in Figure 12 is displayed, the adjusted image 320 moves upward. In the adjusted image 320 after the movement, users A1 and A2 are displayed lower than before the movement. In other words, moving the slider downwards means moving the users downwards. As a result, an image with white space above the heads of users A1 and A2 (readjusted image 340) can be created, as shown in Figure 13 below.

FIG. 13 is a schematic diagram showing a readjusted image 340 in the first embodiment.
As a result of the readjustment by users A1 and A2, a readjusted image 340 as shown in Figure 13 is generated. Compared to the adjusted image 320, there is more blank space at the top of the readjusted image 340. The user can decorate this blank space by writing any message or attaching a stamp.

FIG. 14 is a schematic diagram showing an edited image 350 in the first embodiment.
Users A1 and A2 decorate the blank space at the top of the readjusted image 340 by touching the editing monitor 120 or using the stylus pen 122. Users A1 and A2 write the message "We'll always be friends" in this blank space and affix multiple heart-shaped stamps. The editing processing unit 148 accepts such input from the users and generates an edited image 350.

After the edited image 350 is generated, users A1 and A2 then select a mount image and lay out the edited image 350 on the mount image to create a completed image. Once the completed image is created, image output unit 152 instructs output unit 142 to print the completed image. In accordance with the instructions of image output unit 152, the completed image is printed on a sticker mount or photo printing paper by printing device 110. Image output unit 152 also uploads the edited image and completed image to server 202 via the Internet 204. Users A1 and A2 can download the edited image, etc. to their user terminal 206 by accessing server 202.

Second Embodiment
In the second embodiment, a scene is assumed in which three users, A3, A4, and A5, are taking a photo. Unlike the first embodiment, in the second embodiment, the three users select a frame for "three or more people." Here, the horizontal adjustment process performed by the area designation unit 146 will be described in detail.

At check-in, users A3, A4, and A5 select "for three or more people" as the frame size for the captured image 310. Following instructions to enter the photo booth 104, users A3, A4, and A5 enter the photo booth 104 after completing check-in. The photo processing unit 144 extracts an area equivalent to the "for three or more people" frame size from the original image captured by the camera 118. The photo processing unit 144 instructs the output unit 142 to display this area as a live view image on the photo monitor 112.

The photography processing unit 144 instructs the output unit 142 to display a countdown and notify the user by audio. When the countdown begins, users A3, A4, and A5 pose for the photo while checking their appearance in the live view image displayed on the photography monitor 112. The moment the countdown time ends, the camera 118 captures the still original image 300. At the same time, the photography processing unit 144 captures the captured image 310. The area designation unit 146 performs adjustment processing based on the still original image 300 and the captured image 310. This process is repeated eight times, and the still original image 300 and the captured image 310 are acquired.

FIG. 15 is a schematic diagram showing a captured image 310 in the second embodiment.
In the photographed image 310 of FIG. 15, users A3 and A4 are close to each other in the center, and the right side of A5's face is outside the photographed image 310 .

FIG. 16 is a schematic diagram showing a still original image 300 and a captured image 310 in the second embodiment.
As in the first embodiment, the camera 118 captures an original image during shooting. The shooting processor 144 extracts an area from the original image that corresponds to the frame size for "three or more people" and displays it as a live view image on the shooting monitor 112. The moment the countdown time ends, the camera captures a still original image 300. At the same time, the shooting processor 144 captures a captured image 310.

FIG. 17 is a schematic diagram showing the adjustment process in the second embodiment.
The region designation unit 146 sets point P1 at the left edge of the face of the leftmost person among the users appearing in the still original image 300, and point P2 at the right edge of the face of the rightmost person. In FIG. 17 , the region designation unit 146 sets point P1 on the outside of the right ear of user A3, and point P2 on the outside of the left ear of user A5. The region designation unit 146 sets a reference line in the vertical direction of the image so as to pass through the set points P1 and P2. The reference line passing through point P1 is called a left reference line 321. The reference line passing through point P2 is called a right reference line 322. The region designation unit 146 sets a vertical center line 323 at a location midway between the left reference line 321 and the right reference line 322. Similarly, the area designation unit 146 sets a center line (not shown) at a location midway between the top of the head of user A3, whose face is displayed at the highest position, and the tip of the chin of user A4, whose face is displayed at the lowest position. The area designation unit 146 moves the position of the frame of the captured image 310 so that the point where this center line intersects with the vertical center line 323 is the center of the image. The range that appears when this position is confirmed becomes the frame of the adjusted image 320. At this time, the area designation unit 146 also sets a modifiable area 330 based on the position and size of the adjusted image 320. The adjusted image 320 and the still original image 300 with the modifiable area 330 set are transferred to the editing device 126.

FIG. 18 is a schematic diagram showing an editing screen 400 in the second embodiment.
Users A3, A4, and A5 move slider 420 on slider bar 410 on editing screen 400. This causes area designation unit 146 to adjust the margins of adjusted image 320 within the range of modifiable area 330, generating readjusted image 340. Users A3, A4, and A5 decorate the margins of readjusted image 340 by writing any message or attaching a stamp, for example. Editing processing unit 148 accepts such input from the users and generates edited image 350.

[Third embodiment]
In the third embodiment, a scene is assumed in which two users, A6 and A7, are taking a photograph. In the third embodiment, as in the first embodiment, the two users select a "two-person" frame. Here, the vertical adjustment process by the area designation unit 146 will be described in detail. At the time of reception, users A6 and A7 select "two-person" as the frame size of the photographed image 310. Following the instruction to enter the photography booth 104, users A6 and A7 enter the photography booth 104 after completing the reception. The photography processing unit 144 extracts an area corresponding to the "two-person" frame size from the original image captured by the camera 118. The photography processing unit 144 instructs the output unit 142 to display this area on the photography monitor 112 as a live view image.

The photography processing unit 144 instructs the output unit 142 to display a countdown and notify the user by audio. When the countdown begins, users A6 and A7 pose for the photo while checking their appearance in the live view image displayed on the photography monitor 112. The moment the countdown time ends, the camera 118 captures the still original image 300. At the same time, the photography processing unit 144 captures the captured image 310. The area designation unit 146 performs adjustment processing based on the still original image 300 and the captured image 310. This process is repeated eight times, and the still original image 300 and the captured image 310 are acquired.

FIG. 19 is a schematic diagram showing a captured image 310 in the third embodiment.
In the photographed image 310 of FIG. 19, the faces of users A6 and A7 are shown one above the other, slightly shifted to the right.

FIG. 20 is a schematic diagram showing the adjustment process in the third embodiment.
The region designation unit 146 sets point P3 at the top of the head of the topmost user (user A6) among the users appearing in the still original image 300, and point P4 at the bottom of the face of the bottommost user (user A7). In FIG. 19 , the region designation unit 146 sets point P3 at the tip of user A6's head and point P4 at the tip of user A7's chin. The region designation unit 146 sets a reference line in the horizontal direction of the image so as to pass through the set points P3 and P4. The reference line passing through point P3 is called an upper reference line 324. The reference line passing through point P4 is called a lower reference line 325. The region designation unit 146 sets a horizontal center line 326 at a location midway between the upper reference line 324 and the lower reference line 325. Similarly, the area designation unit 146 sets a center line (not shown) at a location midway between the tip of the right cheek of user A6, who appears on the far left, and the tip of the left cheek of user A7, who appears on the far right. The area designation unit 146 moves the position of the frame of the captured image 310 so that the point where this center line intersects with the horizontal center line 326 is the center of the image. The range that appears when this position is confirmed becomes the frame of the adjusted image 320. At this time, the area designation unit 146 also sets a modifiable area 330 based on the position and size of the adjusted image 320. The adjusted image 320 and the still original image 300 with the modifiable area 330 set are transferred to the editing device 126.

FIG. 21 is a schematic diagram showing an editing screen 400 in the third embodiment.
Users A6 and A7 move slider 420 on slider bar 410 on editing screen 400. This causes area designation unit 146 to adjust the margins of adjusted image 320 within the range of modifiable area 330, generating readjusted image 340. Users A6 and A7 decorate the margins of readjusted image 340 by writing any message or attaching a stamp, for example. Editing processing unit 148 accepts such input from the users and generates edited image 350.

The game image capturing device 100, the server 202, and the game image capturing system 200 have been described above based on the embodiments.
In the present invention, the adjusted image 320 is generated by automatically correcting the frame position of the captured image 310 so that the user's face is centered. Furthermore, the user can change the frame position of the adjusted image 320 in a specific direction to generate a readjusted image 340. Compared to the adjusted image 320, the readjusted image 340 can be provided with a larger margin. The user can decorate the readjusted image 340 by writing a message in the margin, for example.

When multiple users are taking a photo, it is desirable for all users to appear in the captured image. For this reason, the frame position of the captured image 310 is automatically adjusted horizontally so that all users appear near the center of the image. This allows users to take photos comfortably without worrying about where they are standing or the position of their faces. On the other hand, it is desirable for users to be able to freely adjust the margins vertically depending on the amount of messages they write or stamps they affix. For this reason, by setting room for margins in one direction, users can freely change the position of the frame vertically and adjust the space for the margins.

Generally, it is desirable to set such blank space above the user's head. The monochrome background (chromakey) of the photo booth 104 is projected above the user's head. Therefore, in the area above the head, the user can write a message or affix a stamp without it overlapping the user's face or clothing. Therefore, in the present invention, the position of the adjusted image 320 is initially set to the bottom of the modifiable area 330 to make it easier to create a blank space above the user's head (see Figures 7, 12, 20, etc.). The blank space can be freely set within the modifiable area 330. For example, a user who wants to clearly capture both the user's face and clothing and does not require a blank space may generate the adjusted image 320 in its default position as the readjusted image 340. A user who wishes to write a large message in the blank space of the image, even if it obscures some of the user's clothing, can create a blank space of the desired size by changing the position of the frame of the adjusted image 320 within the modifiable area 330. These users can write messages freely without worrying about the white space in the image, allowing them to create photos with more original designs.

The present invention is not limited to the above-described embodiments and modifications, and the components can be modified within the scope of the gist of the invention. Various inventions may be created by appropriately combining multiple components disclosed in the above-described embodiments and modifications. Furthermore, some components may be omitted from all of the components shown in the above-described embodiments and modifications.

The play image capture system 200 has been described as being made up of the play image capture device 100, server 202, and user terminal 206, and in particular the play image capture device 100 and server 202. However, some of the functions of the play image capture device 100 may be realized by the server 202, or some of the functions of the server 202 may be assigned to the play image capture device 100. Furthermore, a third device other than the play image capture device 100 or server 202 may perform some of the functions of these devices. How the multiple functions required to realize the present invention are allocated to one or more pieces of hardware can be determined taking into account the processing capabilities of each piece of hardware and the specifications required of the play image capture system 200.

In this embodiment, when generating the readjusted image 340, the horizontal position of the adjusted image 320 is fixed, and the user changes the position of the frame of the adjusted image 320 vertically within the changeable area 330. As a variation, the user may be able to generate the readjusted image 340 by moving the adjusted image 320 both horizontally and vertically. Alternatively, after generating the readjusted image 340, the user may be able to further change the position of the frame of the readjusted image 340 horizontally or vertically.

In this embodiment, it has been explained that a margin is created at the top of the adjusted image 320 by the user adjusting the position of the frame of the adjusted image 320 vertically within the modifiable area 330. As a variation, a margin may also be created at the bottom of the adjusted image 320. For example, when taking a photo that mainly shows the coordination of clothing, it is desirable to focus on the area below the face. In such a case, the vertical width of the modifiable area 330 can be set long below the still original image 300, and the user can adjust the position of the frame of the adjusted image 320 downward.

In this embodiment, the horizontal width of the modifiable area 330 is the same as that of the adjusted image 320, and the vertical width is set longer than that of the adjusted image 320. It has been explained that the user can change the position of the frame of the adjusted image 320 within the vertical range of the modifiable area 330 and fix the position at any location. As a variant, the vertical width of the modifiable area 330 may be set to be the same as that of the adjusted image 320, and the horizontal width may be set longer than that of the adjusted image 320. In this case, the user may move the adjusted image 320 horizontally.

For example, when a user decorates a readjusted image 340, they can write messages and attach stamps, as well as attach photos of idols and illustrated images of characters. As an example, suppose two users take a photo using the game image capture device 100 and edit it in the editing booth 106. As a result, a readjusted image 340 is generated in which both users are on the right side and there is a blank space on the left side. When decorating, both users attach a photo of the idol to the blank space on the left side. By decorating in this way, the users can create an edited image 350 in which they appear virtually with the idol.

In this embodiment, when photographing multiple people, the reference line is set using the tips of the faces of the users at both ends as a reference, and the center of the adjusted image 320 is determined based on this reference line. As a variation, the reference line may be set using the center of the faces of the users at both ends (for example, the nose) as a reference. Alternatively, the reference line may be set using the center of the bodies of the users at both ends as a reference.

When accepting an order, the user may be able to select whether they want to set more white space in the adjusted image 320 (top, bottom, left, or right). Depending on this selection, the size of the white space may be adjusted by fixing either the vertical or horizontal position within the modifiable area 330 and changing the position of the frame of the adjusted image 320 in the other direction. For example, suppose that the user selects, when accepting an order, to set more white space to the right of the adjusted image 320. In this case, the area designation unit 146 fixes the position in the vertical direction and sets the modifiable area 330 so that there is more room to adjust the frame position to the right. Similarly, if the user selects, when accepting an order, to set more white space to the left, the area designation unit 146 fixes the position in the vertical direction and sets the modifiable area 330 so that there is more room to adjust the frame position to the left.

The user may be able to specify the number of people being photographed at the time of reception. Furthermore, the direction in which the larger margins are set for the adjusted image 320 (top, bottom, left, or right) may be determined depending on the number of people selected by the user. For example, assume that the information "right" is previously associated with the information that the number of people being photographed is one. In this case, when the user selects the number of people being photographed as "1," the area designation unit 146 sets the modifiable area 330 so that the adjustment room for the adjusted image 320 increases in the rightward direction. Similarly, when the user selects the number of people being photographed as "2," the area designation unit 146 may set the modifiable area 330 so that the adjustment room for the adjusted image 320 increases in the leftward direction. When the user selects the number of people being photographed as "3," the area designation unit 146 may not set any adjustment room for the adjusted image 320. In this way, the number of people selected by the user may be associated with the direction in which the larger adjustment room for the adjusted image 320 is provided.

The orientation of the subject may determine whether more white space is set in the adjusted image 320 (top, bottom, left, or right). Note that the orientation of the subject may refer to the orientation of the user's face, body, or line of sight.

For example, suppose a user is facing right when taking a photo. In this case, the area designation unit 146 may detect that the user's face is facing right, and set the modifiable area 330 so that there is more room to adjust the frame position to the right relative to the adjusted image 320.

Imagine a scene in which two users are taking a photo side by side. At the time of shooting, the user standing on the left is facing left, and the user standing on the right is facing right. In this case, the area designation unit 146 detects the orientation of the users' faces and may set the modifiable area 330 to suit the user on the right as a representative, for example, so that there is more room to adjust the frame position to the right relative to the adjusted image 320. Alternatively, since the two users' faces are facing different directions, no adjustment room may be set for the adjusted image 320. If both users' faces are facing left (the same direction), the area designation unit 146 may set the modifiable area 330 so that there is more room to adjust the frame position to the left (the direction they are facing) relative to the adjusted image 320.

Imagine a scene in which three users are taking a photo side by side. At the time of shooting, the user standing on the left is facing left, while the users standing in the center and on the right are facing right. For example, since many users are facing right, the area designation unit 146 may set the modifiable area 330 so that there is more room to adjust the frame position to the right in the adjusted image 320. As a representative example, the area designation unit 146 may set the adjustment room for the adjusted image 320 to the right, matching the orientation of the face of the user standing in the center. Alternatively, since the three users' faces are facing different directions, no adjustment room may be set for the adjusted image 320.

Specifically, consider a scene in which two users are taking a photo side by side. When taking the photo, both users turn their bodies to the right and pose as if they are surprised. At this time, the area designation unit 146 detects the orientation of both users' bodies and sets the modifiable area 330 so that there is more room to adjust the frame position to the right in the adjusted image 320. After taking the photo, the two users edit the image in the editing booth 106. Both users further add a blank space to the right and create a readjusted image 340. When decorating, the users can paste a photo image of an idol onto the readjusted image 340. When decorating, both users paste a photo image of the idol into the blank space on the right side of the readjusted image 340. By decorating in this way, both users can create an edited image 350 in which they appear surprised that the idol has appeared.

In this embodiment, the frame size has been described as being available in two sizes: "for two people" and "for three or more people." However, the frame size may be freely changeable. The entire still original image 300 may also be set as the modifiable area 330. In other words, the adjusted image 320 and the readjusted image 340 may be freely movable within the range of the still original image 300. Alternatively, the entire still original image 300 may be treated as the modifiable area 330.

In this embodiment, the horizontal position of the adjusted image 320 is fixed, and then the position of the frame of the adjusted image 320 is changed vertically within the modifiable area 330 to generate the readjusted image 340. As a variation, the vertical position of the adjusted image 320 may be fixed, and then the position of the frame of the adjusted image 320 may be changed horizontally within the modifiable area 330 with a longer width to generate the readjusted image 340.

As described above, in the game image capture device 100 of this embodiment, the capture booth 104 (capture space) and the editing booth 106 (editing space) are configured separately, but the capture booth 104 and the editing booth 106 may be shared. For example, the capture booth 104 shown in FIG. 2 may be equipped with not only the capture device 128 but also the editing device 126. After taking a photo using the capture device 128, the user may continue editing using the editing device 126 in the capture booth 104.

The user may access the server 202 from the user terminal 206 by specifying the user ID and set the frame size. The server 202 registers the user ID and the frame size in association with each other. Next, when the user enters the user ID on the reception monitor 108, the server 202 notifies the game image capture device 100 of the frame size that is pre-associated with the user ID. The game image capture device 100 may set the frame size in accordance with this notification.

In addition, the user may select the frame size after entering the photo booth 104. For example, the output unit 142 may cause the photo monitor 112 to display a screen for selecting the frame size when the user enters, allowing the user to select the frame size.

In this embodiment, the area designation unit 146 detects the position of the face in the still original image 300 and automatically changes the position of the frame of the captured image 310 so that the user's face is centered. As a result, the adjusted image 320 is generated. It has also been described that the area designation unit 146 sets a modifiable area 330 whose width is the same as that of the adjusted image 320 but whose height is longer than that of the adjusted image 320. As a variation, the area designation unit 146 may set a modifiable area 330 within the still original image 300 whose width is the same as that of the captured image 310 but whose height is longer than that of the captured image 310. Next, the area designation unit 146 may generate the adjusted image 320 by automatically changing the position of the frame of the captured image 310 so that the user's face is centered. Note that the position of the modifiable area 330 also changes in conjunction with the change in the position of the frame of the captured image 310. In this way, the modifiable area 330 may be set to match the captured image 310, and when the adjusted image 320 is determined by moving the captured image 310, the area designation unit 146 may move the modifiable area 330 to match the adjusted image 320.

In this embodiment, the area designation unit 146 automatically detects the position where the user's face appears near the center while changing the frame position of the captured image 310 vertically and horizontally within the range of the still original image 300, and generates the adjusted image 320. As a variation, the area designation unit 146 may generate the adjusted image 320 so that the user's face is not located near the center in the vertical direction. In other words, in the adjusted image 320, the user's face may appear above or below the center of the image. Furthermore, the user or an administrator of the game image capture device 100 may be able to separately set the position where the user's face appears in the vertical direction in the adjusted image 320. Once the adjusted image 320 has been determined, the user can simply readjust the position of their face, as in this embodiment.

100 Game image capturing device, 102 Reception device, 104 Photo booth, 106 Editing booth, 108 Reception monitor, 110 Printing device, 112 Photo monitor, 116 Lighting device, 118 Camera, 120 Editing monitor, 122 Stylus pen, 124 Curtain, 126 Editing device, 128 Photo capture device, 130 User interface processing unit, 132 Data processing unit, 134 Communication unit, 136 Data storage unit, 140 Input unit, 142 Output unit, 144 Photo capture processing unit, 146 Area designation unit, 148 Editing processing unit, 150 Reception processing unit, 152 Image output unit, 200 Game image capturing system, 202 Server, 204 Internet, 206 User terminal, 300 Still original image, 310 Captured image, 320 Adjusted image, 321 Left reference line, 322 Right reference line, 323 vertical center line, 324 top reference line, 325 bottom reference line, 326 horizontal center line, 330 modifiable area, 340 re-adjusted image, 350 edited image, 400 edit screen, 410 slider bar, 420 slider

Claims (7)

an imaging processing unit that images a user in an imaging space;
an editing processing unit that accepts editing input for the captured image from a user in the editing space;
an image output unit that outputs an edited image corresponding to a partial image cut out as part of the photographed image to an external medium;
an area designation unit that designates an output area indicating a range to be cut out as the partial image in the captured image,
A game image capturing device in which the area designation unit fixes the output area to the captured image in a first direction according to predetermined conditions, and in a second direction different from the first direction, sets the output area variably based on instructions from the user. The game image capturing device of claim 1, wherein the area designation unit fixes the output area to a changeable area within the captured image in the first direction, and sets it variably within the changeable area in the second direction based on instructions from the user. The game image capture device of claim 1, wherein the area designation unit sets the position of the output area in the first direction based on the position of the subject appearing in the captured image. The game image capturing device of claim 2, wherein the area designation unit initially sets the output area to a position shifted to one side from the center of the second direction in the changeable area, and when a movement instruction is received from the user, changes the output area along the second direction. The game image capture device of claim 1, wherein the area designation unit determines the initial position of the output area based on the position of the subject appearing in the captured image, and changes the output area along the second direction when a movement instruction is received from the user. The game image capture device of claim 1, wherein the area designation unit determines the initial setting position of the output area within the captured image depending on the number of people being photographed. The game image capture device of claim 1, wherein the area designation unit determines the initial setting position of the output area within the captured image depending on the orientation of the subject.