JP7832437B2 - Imaging device, information processing method, and program - Google Patents

Description

This technology relates to a shooting device , an information processing method, and a program, and more particularly to a shooting device , an information processing method, and a program that enable appropriate changes to the game content when the user of the game is a repeat user.

Conventionally, photo sticker creation devices are known. These devices photograph the user, allow the user to edit the image, and then print the edited image onto sticker paper. Photo sticker creation devices are typically installed in amusement facilities and similar establishments.

The typical workflow for a photo sticker creation machine involves taking a photo of the user in a shooting booth, then moving the user to an editing booth, where they edit the image according to the instructions, and finally printing the edited image onto sticker paper.

Japanese Patent Publication No. 2012-142773

The photo sticker creation machine game is typically used by multiple users. If all users are repeat users, it may be preferable to modify the game content.

This technology was developed in light of these circumstances, and aims to enable appropriate changes to game content when the user is a repeat player.

One aspect of this technology is a shooting device comprising: a shooting unit that photographs multiple users playing the game together as subjects; an acquisition unit that determines whether or not a user is a repeat user who has played the game before, based on the images obtained from photographing the multiple users; and a control unit that modifies the game content based on the determination result for each of the multiple users as to whether or not they are a repeat user.

The information processing device for another aspect of this technology includes an authentication unit that authenticates individuals in images transmitted from a camera that captures multiple users playing the game together; a determination unit that determines, based on the authentication results of the individuals, whether or not the multiple users are repeat users who have previously played the game; and a communication unit that transmits information regarding the determination results of whether or not each of the multiple users is a repeat user to the camera.

In one aspect of this technology, multiple users playing the game together are photographed, and a determination of whether or not they are repeat users who have played the game before is obtained based on the images obtained from photographing these multiple users. Furthermore, the content of the game is modified based on the determination of whether or not each of the multiple users is a repeat user.

In another aspect of this technology, the individuals in images transmitted from a camera that captures multiple users playing the game together are authenticated. Based on the authentication results, it is determined whether or not the multiple users are repeat users who have played the game before. Information regarding the determination of whether or not each of the multiple users is a repeat user is also transmitted to the camera.

This technology allows for appropriate changes to game content when the user is a repeat player.

This figure shows an example configuration of an information processing system according to one embodiment of this technology. This figure shows an example of input and output for a facial recognition engine. This diagram shows the processing flow during gameplay. This figure shows an example of game management information. This figure shows an example of a display screen. This diagram shows an example of store installation information. This is a perspective view showing the external appearance of a photo sticker creation device. This is a block diagram showing an example configuration of a photo sticker creation device. This figure shows an example of face image generation. This is a diagram illustrating the user's position. This is a block diagram showing an example of a hardware configuration for an information processing server. This is a block diagram showing an example of the functional configuration of an information processing server. This is a flowchart illustrating the process of providing a photo sticker creation game performed by a photo sticker creation device. This is a flowchart illustrating the shooting process in step S2 of Figure 13. This figure shows an example of how the analysis results screen is displayed. This figure shows an example of what is displayed at the start of a facial diagnosis. This figure shows an example of the facial recognition screen display. This figure shows other examples of how the face diagnosis screen will be displayed. This figure shows an example of the editing screen display. This diagram shows the scene inside the editing booth. This figure shows an example of how the editing palette looks. This is a flowchart explaining the operation of an information processing server. This diagram shows examples of when facial recognition should be performed. This figure shows other examples of when facial recognition should be performed. This figure shows an example of a facial recognition engine. This figure shows another example configuration of a photo sticker making device. This figure shows an example of how information regarding one's position can be presented.

<Providing games using facial recognition>
• System Configuration Figure 1 is a diagram showing an example configuration of an information processing system according to one embodiment of this technology.

As shown in Figure 1, an information processing system according to one embodiment of this technology is configured such that a photo sticker creation device 1 and an information processing server 2 are connected via a network 3 such as the Internet.

The photo sticker creation device 1 is a game machine that provides a photo creation game. The photo sticker creation device 1 is installed in stores such as game centers. While one photo sticker creation device 1 is shown in Figure 1, multiple photo sticker creation devices 1 installed in different stores are connected to the network 3. Multiple photo sticker creation devices 1 may also be installed in a single store.

The users of the photo sticker creation device 1 are primarily high school girls and young women. The photo sticker creation device 1 allows multiple users, such as two or three people per group, to enjoy the game. Of course, a single user can also enjoy the game using the photo sticker creation device 1.

In the photo creation game using the photo sticker creation device 1, the user takes a photograph of themselves. The user then edits the resulting photograph by adding composite images such as handwritten text and stamp images, transforming the photograph into a colorful image. The user then receives a sticker sheet printed with the edited photograph, marking the end of the game.

Here, the photo sticker creation device 1 is, for example, a device compatible with 5G communication (fifth-generation mobile communication system). Because the photo sticker creation device 1 is connected to network 3 via 5G communication, communication between the photo sticker creation device 1 and the information processing server 2 is high-speed and low-latency. During gameplay on the photo sticker creation device 1, various types of information, described later, are transmitted and received between the photo sticker creation device 1 and the information processing server 2.

The information processing server 2 is an internet server managed by the manufacturer of the photo sticker creation device 1, etc. The information processing server 2 has a facial recognition engine 11. The facial recognition engine 11 is an image processing engine that assigns a unique facial ID to the faces of people in an image. The facial recognition engine 11 is composed of, for example, an inference model generated by machine learning.

Figure 2 shows an example of the input/output of the facial recognition engine 11.

As shown in Figure 2, the facial recognition engine 11 is an inference model that takes a facial image as input and outputs a facial ID. In the example in Figure 2, when the facial image of user U1 is input, the ID "000001" is output as the facial ID. If the same person's facial image is input, the facial recognition engine 11 will output the same facial ID. In training the facial recognition engine 11, facial images of various people are used as training data.

Any method that can assign a unique ID to each face may be used, other than the inference model method. For example, the face recognition engine 11 may be an image processing engine that assigns face IDs to faces in the authentication face image by matching them with pre-registered face images. Face image matching is performed, for example, by calculating the degree of agreement between features extracted from pre-registered face images and features extracted from the authentication face image.

The facial recognition engine 11 performs facial ID detection (assignment of facial ID) on facial images transmitted from the photo sticker creation device 1. The photo sticker creation device 1 transmits facial images of each user utilizing the game on the device.

• Flow of the photo creation game Figure 3 is a diagram showing the processing flow during the game.

This section describes a scenario where two users, User U1 and User U2, use the photo sticker creation device 1 together, as shown on the left side of Figure 3. For example, User U1 and User U2 are friends.

When users U1 and U2 pay the predetermined amount of money and enter the shooting booth according to the instructions, a photograph is taken of them. A camera is installed in the shooting booth. The game of the photo sticker creation device 1 primarily proceeds by having the users perform a series of tasks: pre-selection before shooting, entering the shooting booth and taking the photograph, and moving from the shooting booth to the editing booth to edit the captured image.

The photo sticker creation device 1 generates individual facial images of user U1 and user U2 based on an image in which both users U1 and U2 are pictured together, and transmits these images to the information processing server 2 as shown by arrow #1.

The information processing server 2 inputs the facial images transmitted from the photo sticker creation device 1 into the facial recognition engine 11 and detects the facial IDs of user U1 and user U2 as described above.

Furthermore, the information processing server 2 determines, based on the detected facial ID, whether user U1 and user U2, who are playing the game using the photo sticker creation device 1, are repeat users who have used the photo sticker creation device 1 in the past.

The information processing server 2 manages game management information, including the face IDs of users who have used the photo sticker creation device 1. The repeat user determination, which determines whether a user playing the game using the photo sticker creation device 1 is a repeat user, is performed based on whether the detected face ID is already registered in the game management information.

Figure 4 shows an example of game management information.

As shown in Figure 4, a game management information database 12 is constructed on the information processing server 2. For example, game management information is generated each time a game is played in the photo sticker creation device 1 and stored in the game management information database 12.

As shown in the speech bubble, game management information is a collection of linked pieces of information, including game usage date and time, arcade machine ID, facial ID, game information, and attribute information.

The game usage date and time refers to the date and time the game was used (the date and time the game was provided).

The enclosure ID is the ID of the enclosure of the photo sticker creation device 1. Each photo sticker creation device 1 installed in each store has a unique enclosure ID assigned to it.

The face ID is the face ID of the user who played the game. If user U1 and user U2 played the game together, both user U1's and user U2's face IDs will be registered. Since the face IDs of all users who played the game in each session are registered, it becomes possible to identify who played the game together based on the game management information.

Game information represents the user's choices in past gameplay. Various choices are made by the user during the pre-shoot selection process, the shooting process in the shooting booth, and the editing process in the editing booth. For example, during editing in the editing booth, the user selects the tools to be used for editing the captured images, and selects content.

Various pieces of information representing the user's past gameplay, such as their position in the photo booth (whether they were standing on the right or left), their position in the editing booth, and the number of users who played the game together, may be managed as game information.

Attribute information refers to user attributes such as gender and age. The facial recognition engine 11 may be equipped with functions to estimate the gender and age of a person in a facial image. In this case, the facial recognition engine 11 would have an inference model that takes a facial image as input and outputs gender information, and another inference model that takes a facial image as input and outputs age information.

If the face ID detected based on the face image transmitted from the photo sticker creation device 1 is registered in the game management information, which includes all such information, the user playing the game using the photo sticker creation device 1 is determined to be a repeat user. Conversely, if the face ID detected based on the face image is not registered in the game management information, the user playing the game using the photo sticker creation device 1 is determined not to be a repeat user. The determination of whether or not a user is a repeat user is performed for each individual user.

The results of this repeat user detection are transmitted from the information processing server 2 to the photo sticker creation device 1 along with the face ID, as shown by arrow #2 in Figure 3. Based on the information transmitted from the information processing server 2, the photo sticker creation device 1 can determine whether the user currently using the game has used it before.

In the photo sticker creation device 1, the game content provided to users U1 and U2 is changed based on the results of the repeat check.

Figure 5 shows an example of a display screen.

As will be detailed later, in the game of the photo sticker creation device 1, the user's face is analyzed during shooting in the shooting booth. Face analysis is the process of identifying which of several pre-defined face categories the user's face belongs to. The screen shown in Figure 5 is the analysis results screen used to display the results of the facial feature analysis. The shooting booth is equipped with a shooting monitor used to display various screens, such as the live view screen during shooting and the analysis results screen.

When users U1 and U2 are playing the game together, the analysis results screen will display the analysis results for both user U1 and user U2's facial features. The left-hand area of the analysis results screen displays the analysis results for user U1, who is standing to the left of the camera (the monitor used for recording), while the right-hand area displays the analysis results for user U2, who is standing to the right of the camera. In this example, user U1 is standing to the left of the camera, and user U2 is standing to the right.

For example, if user U1 is a repeat user and user U2 is not, as shown in Figure 5A, a message for repeat users, "Thank you for taking photos again," will be displayed to user U1 in the left-hand area of the analysis results screen along with the analysis results. In this case, the message for repeat users will not be displayed in the right-hand area of the analysis results screen.

User U1 realizes that the photo sticker creation device 1 recognizes them, and can feel a sense of specialness. Information for repeat users, such as messages, may also be presented using voice.

On the other hand, if both User U1 and User U2 are repeat users, as shown in Figure 5B, a message for repeat users will be displayed to both User U1 and User U2 in the left and right areas of the analysis results screen, along with the analysis results.

Users U1 and U2 each realize that the photo sticker creation device 1 recognizes them, and thus gain a sense of specialness.

Thus, the display of the analysis results screen changes based on the repeat user determination result, depending on whether all users playing the game together are repeat users or whether there are users who are not repeat users. The display position and number of messages for repeat users also change depending on whether all users playing the game together are repeat users or whether there are users who are not repeat users. At least one of the display position or number of messages for repeat users may also be changed.

Not only can the display position and number of messages be changed, but the content of the messages can also be modified. For example, if all users playing the game together are repeat users, a message such as "Thank you both for taking pictures again!" could be displayed.

In addition to displaying the analysis results screen, it is possible to change the content of the photo sticker creation device 1 at each stage of the game depending on whether all users playing the game together are repeat users or whether there are users who are not repeat users.

After reviewing the analysis results, users U1 and U2 proceed with the game according to the instructions provided by the photo sticker creation device 1.

In the above, a user who has used the game on Photo Sticker Creation Device 1, which is a photo sticker creation device with a specific cabinet ID, is determined to be a repeat user. However, it is also possible to determine a repeat user as a user who has used the game on a photo sticker creation device installed in the same store where Photo Sticker Creation Device 1 is installed.

Whether a user has previously used a photo sticker creation device installed in the same store as the photo sticker creation device 1 is determined using game management information along with store installation information as shown in Figure 6.

The store installation information is information that links the ID of the store where the photo sticker creation device is installed, the model ID of the photo sticker creation device, etc., to the enclosure ID. The information processing server 2 has a store installation information database 13, which is a database of store installation information. By referring to the store installation information, the information processing server 2 can identify the store where the photo sticker creation device is installed, based on the enclosure ID of the photo sticker creation device that sent the facial image.

Furthermore, users who have previously used a photo sticker creation device of the same model as device 1 may be identified as repeat users. The determination of whether a user has previously used a photo sticker creation device of the same model as device 1 is performed using the device ID included in the store installation information.

Thus, repeat users may be users who have used the same photo sticker printing machine before, or users who have used the same photo sticker printing machine at the same store. They may also be users who have used the same model of photo sticker printing machine before.

The store installation information database 13 may be built on a server different from the information processing server 2.

<Configuration of each device>
• Configuration of the photo sticker creation device 1 Figure 7 is a perspective view showing the external appearance of the photo sticker creation device 1.

As shown in Figure 7, a pre-operation unit 21 is provided on the side of the photo sticker creation device 1, which has a box-shaped casing. The pre-operation unit 21 is a device used for pre-selection operations, such as selecting the number of users who will play the game together and selecting the shooting course. A touch panel monitor 21A is provided above the pre-operation unit 21. Below the touch panel monitor 21A is a coin slot 21B for paying the play fee.

The screen used for various selections is displayed on the touch panel monitor 21A. After making various selections according to the display on the touch panel monitor 21A, the user enters the shooting booth through the entrance/exit G and takes a photograph. A box-shaped shooting unit 31 containing a camera 31A is provided at the front of the shooting booth. A shooting monitor 31B is provided in the shooting unit 31.

An editing unit 41 is located to the left of the pre-operation unit 21. The editing unit 41 is a device used for editing images obtained by shooting with the camera 31A. Users who have taken photos in the shooting booth move to the editing booth in front of the editing unit 41 to edit the images. An editing monitor 41A is provided on a sloped surface above the editing unit 41. The screen used for editing the images is displayed on the editing monitor 41A.

Figure 8 is a block diagram showing an example of the configuration of the photo sticker manufacturing device 1. Components in Figure 8 that are the same as those described above are denoted by the same reference numerals. Repetitive explanations are omitted as appropriate.

As shown in Figure 8, the photo sticker creation device 1 is configured by connecting a pre-operation unit 21, a shooting unit 31, an editing unit 41, a communication unit 52, and a printing unit 53 to a control unit 51, which is configured as a PC.

The control unit 51 executes a program using the CPU and controls the overall operation of the photo sticker creation device 1 according to the progress of the game. In the control unit 51, the game control unit 61 and the authentication result acquisition unit 62 are realized when a predetermined program is executed.

The game control unit 61 controls a series of game processes, including pre-selection, shooting, editing, and printing.

The pre-selection process involves having the user perform pre-selection tasks, such as selecting a shooting course.

The image capture process involves having the user take photographs of themselves. In addition to the regular images provided to the user, images used for facial recognition are also captured during this process. During facial recognition, the game control unit 61 controls the camera 31A to capture images of the user playing the game and acquire images for facial recognition. These facial recognition images are supplied to the authentication result acquisition unit 62.

The editing process involves allowing the user to perform editing tasks on the captured images obtained through the shooting process.

The printing process involves arranging the edited image obtained through the editing process on sticker paper in a predetermined layout. The sticker paper with the edited image printed on it is provided to the user through a designated opening in the housing of the editing unit 41.

The game control unit 61 modifies the content of each process based on the results of the repeat user determination obtained by the authentication result acquisition unit 62. The game control unit 61 functions as a control unit that modifies the game content based on the determination results of whether each of the multiple users is a repeat user or not. Furthermore, the game control unit 61 functions as a control unit that modifies the game content depending on whether all users playing the game together are repeat users or whether there are users who are not repeat users.

Furthermore, the game control unit 61 controls the communication unit 52 and transmits game information, such as the user's selections in the game, to the information processing server 2. This game information, along with information such as the date and time the game was played and the user's facial ID, is transmitted to the information processing server 2 when the game ends.

The authentication result acquisition unit 62 generates a facial image showing each user's face based on the facial recognition image supplied by the game control unit 61.

Figure 9 shows an example of face image generation.

As shown in the upper part of Figure 9, when an image P containing users U1 and U2 is taken as an image for facial recognition, the facial images of user U1 and user U2 are extracted from image P, as indicated by the arrow #11.

In the example shown in Figure 9, the person standing to the left of camera 31A (the person shown on the right) is user U1, and the person standing to the right of camera 31A (the person shown on the left) is user U2. Images of the rectangular regions containing the faces of both user U1 and user U2 are extracted as face images.

As shown in Figure 10, if user U1 is standing to the left of camera 31A and user U2 is standing to the right of camera 31A, it is possible to determine the position of each user based on their position in the image.

As shown in image P of Figure 9, the original image before any processing is applied is used for facial recognition. While typical captured images provided to users after editing are processed images, the facial image extracted from image P, which has not undergone such processing, is transmitted to the information processing server 2 and used for facial recognition.

The image processing includes at least one of the following: eye enlargement, face reduction, skin tone adjustment, and hair color adjustment.

For example, if facial recognition is performed based on an image that has been processed to enlarge the eyes, false positives may occur, such as detecting different facial IDs even when using images of the same user. By performing facial recognition based on the original image, such false positives can be prevented.

An image P containing images of users U1 and U2 may be transmitted to the information processing server 2, and face image generation may be performed on the information processing server 2. The face recognition engine 11 provided on the information processing server 2 may be configured as an image processing engine that takes image P as input and outputs the face IDs of user U1 and user U2.

The authentication result acquisition unit 62 in Figure 8 controls the communication unit 52 and transmits the generated face image to the information processing server 2. The authentication result acquisition unit 62 acquires the authentication result transmitted from the information processing server 2. The authentication result acquired by the authentication result acquisition unit 62 includes the face ID and the repeat judgment result. Other information managed in conjunction with the face ID, such as game information and attribute information, is also provided to the photo sticker creation device 1 as appropriate.

The pre-operation unit 21 displays a predetermined screen on the touch panel monitor 21A, allowing the user to make various selections before starting shooting. The pre-operation unit 21 receives the user's selections and outputs information representing the selections to the control unit 51.

The shooting unit 31 drives the camera 31A and takes photographs of the user in the shooting booth. For example, multiple images are acquired by taking multiple shots. The images acquired by the shooting unit 31 are supplied to the control unit 51.

The editing unit 41 performs editing processing for users in the editing booth. This editing process includes image processing for editing captured images. Editing of captured images is performed using the editing screen displayed on the editing monitor 41A. After completing the editing of the captured images, the editing unit 41 generates print data by arranging the edited images in a predetermined layout and outputs it to the control unit 51.

The communication unit 52 communicates with external devices such as the information processing server 2. The communication unit 52 transmits the facial image to the information processing server 2. Along with the facial image, information such as the date and time of game use and the arcade cabinet ID is also transmitted as appropriate.

The printing unit 53 has a printer. The printing unit 53 drives the printer and prints the edited photographic image onto sticker paper based on the print data.

• Configuration of Information Processing Server 2 Figure 11 is a block diagram showing an example of the hardware configuration of Information Processing Server 2.

As shown in Figure 11, the information processing server 2 is composed of computers. The information processing server 2 may also be composed of multiple computers. When the information processing server 2 is composed of multiple computers, the various processes of the information processing server 2 are realized through the cooperation of each computer.

The CPU (Central Processing Unit) 101, ROM (Read Only Memory) 102, and RAM (Random Access Memory) 103 are interconnected by a bus 104.

An input/output interface 105 is further connected to bus 104. An input unit 106, an output unit 107, a storage unit 108, a communication unit 109, and a drive 110 are connected to the input/output interface 105.

The input unit 106 consists of a keyboard, mouse, etc. The output unit 107 consists of a display, etc.

The storage unit 108 is composed of a hard disk, non-volatile memory, and other components. The storage unit 108 stores programs executed by the CPU 101 and various types of information used to provide facial recognition services.

The game management information DB 12 and the store installation information DB 13 are constructed, for example, in the storage unit 108. The storage unit 108 functions as a storage unit that stores game management information, which links various pieces of information such as game usage date and time, cabinet ID, face ID, game information, and attribute information, and store installation information, which links cabinet ID, store ID, and machine ID. The combination of information stored in the storage unit 108 can be arbitrarily changed. If the game information includes information representing the user's selections in the game and information about the user's standing position at the time of each photo, the storage unit 108 stores at least one of the following: the face ID assigned to each user as a result of face recognition, the information representing the user's selections in the game, and the information about the user's standing position at the time of each photo.

The communication unit 109 is an interface to the network 3. For example, the communication unit 109 communicates with the photo sticker creation device 1 and receives facial images transmitted from the photo sticker creation device 1. The communication unit 109 also transmits information such as authentication results to the photo sticker creation device 1.

Drive 110 controls the writing of data to and reading of data from the removable media 111.

Figure 12 is a block diagram showing an example of the functional configuration of the information processing server 2.

As shown in Figure 12, the information processing server 2 implements an information processing unit 121. The information processing unit 121 consists of an image acquisition unit 131, a facial recognition unit 132, a determination unit 133, and a game information acquisition unit 134. At least some of the functional units shown in Figure 12 are implemented by the execution of a predetermined program by the CPU 101. The information processing unit 121 also includes the aforementioned game management information DB 12.

The image acquisition unit 131 acquires the face image transmitted from the photo sticker creation device 1 and received by the communication unit 109. The face image acquired by the image acquisition unit 131 is supplied to the face recognition unit 132.

The facial recognition unit 132 is implemented by the facial recognition engine 11. The facial recognition unit 132 inputs the facial image supplied from the image acquisition unit 131 to the facial recognition engine 11 and detects the facial ID. The facial recognition unit 132 outputs the facial ID detected using the facial recognition engine 11 to the determination unit 133.

Furthermore, the facial recognition unit 132 outputs the facial ID detected using the facial recognition engine 11 to the game management information DB 12 and registers it in conjunction with other information in the game management information related to the current game.

The determination unit 133 performs a repeat user determination by referring to the game management information stored in the game management information DB 12 and determining whether the same face ID as the face ID supplied by the face recognition unit 132 is already registered. If the same face ID as the face ID supplied by the face recognition unit 132 is already registered, the user assigned to that face ID is determined to be a repeat user. On the other hand, if the same face ID as the face ID supplied by the face recognition unit 132 is not registered, the user assigned to that face ID is determined to be a non-repeat user.

The determination unit 133 transmits information including the face ID supplied from the face recognition unit 132 and the result of the repeat judgment as an authentication result to the photo sticker creation device 1.

The game information acquisition unit 134 receives game information transmitted from the photo sticker creation device 1 at predetermined timings, such as when the game ends, and registers it in the game management information.

<Operation of each device>
• Operation of the photo sticker creation device 1 The process of providing a photo sticker creation game performed by the photo sticker creation device 1 will be explained with reference to the flowchart in Figure 13. The process in Figure 13 starts, for example, when a predetermined amount of money is paid.

In step S1, the game control unit 61 performs a pre-selection process for users who are outside the shooting booth. This pre-selection process includes selecting the number of users and the shooting course. All selections are made using the selection screen displayed on the shooting monitor 31B of the pre-operation unit 21. Once the pre-selection process is complete, users are instructed to move to the shooting booth.

In step S2, the game control unit 61 performs a shooting process targeting the user in the shooting booth. The shooting process includes taking photos of the user, facial analysis, and facial diagnosis. Details of the shooting process will be described later, referring to the flowchart in Figure 14.

In step S3, the game control unit 61 performs editing processing for the user in the editing booth. Specifically, the game control unit 61 displays the editing screen on the editing monitor 41A and allows the user to perform editing work on the captured image obtained through the shooting process. Editing work is performed using various tools such as the pen tool and stamp tool. The game control unit 61 performs image processing in response to the user's operations and generates the edited image.

In step S4, the game control unit 61 outputs print data to the printing unit 53 and prints the edited image onto sticker paper. When printing is complete, the sticker paper with the edited image printed on it is ejected from the dispenser opening of the casing and provided to the user.

In step S5, the game control unit 61 controls the communication unit 52 to upload the captured and edited images to an image management server (not shown). The image management server is an internet server managed by the manufacturer of the photo sticker creation device 1, etc. Users can access the image management server using a mobile device such as a smartphone to view and download images created in the game.

In step S6, the game control unit 61 controls the communication unit 52 and transmits game information, including information representing the user's selections in the game, to the information processing server 2. The transmitted information is then registered in the game management information, linked to a facial ID, etc.

Next, referring to the flowchart in Figure 14, we will explain the image capture process performed in step S2 of Figure 13. Here, we assume that users U1 and U2 are playing the game together.

In step S21, the game control unit 61 controls the camera 31A to perform face analysis photography. Face analysis photography is performed to capture a face analysis image, which is used to analyze facial features. For example, as explained with reference to Figure 9, a single image showing both user U1 and user U2 together is captured as the face analysis image. The face image generated based on the face analysis image is also used for face recognition. The face analysis image is also the image used for face recognition.

In step S22, the authentication result acquisition unit 62 generates face images containing the faces of user U1 and user U2 based on the face analysis images.

In step S23, the game control unit 61 analyzes the facial images and analyzes the facial features of user U1 and user U2.

For example, the game control unit 61 analyzes each face image to detect feature points of specific facial features such as contours, eyes, nose, and mouth. The game control unit 61 also quantifies the facial features of the users in the face images and maps them onto a feature space to identify the facial categories of user U1 and user U2. Each of user U1's and user U2's faces is identified as belonging to one of several categories, such as cute, baby-like, fashionable, or mature.

In step S24, the authentication result acquisition unit 62 controls the communication unit 52 to transmit the facial image to the information processing server 2. Upon transmission of the facial image, the information processing server 2 transmits the authentication result. By using 5G communication or similar technologies, low-latency communication becomes possible.

In step S25, the authentication result acquisition unit 62 receives the authentication results and acquires the face IDs of user U1 and user U2, as well as the result of the repeat user determination. If at least one of user U1 or user U2 is determined to be a repeat user, the repeat user's game information is included in the authentication result. Based on the game information acquired here, for example, the various selections made during the previous game are identified.

In step S26, the game control unit 61 displays an analysis results screen on the capture monitor 31B, corresponding to the result of the repeat judgment. As described above, the analysis results screen is used to display the analysis results of the user's facial features.

Figure 15 shows an example of the analysis results screen.

The analysis results screen displayed on the shooting monitor 31B has two display areas 201L and 201R arranged side by side. Display area 201L is the display area for the analysis results of the facial features of user U1, who is standing to the left of camera 31A (shooting monitor 31B). Display area 201L is the area assigned to user U1, who is standing to the left of camera 31A.

Display area 201R is the display area for the analysis results of the facial features of user U2, who is standing to the right of camera 31A. Display area 201R is the area assigned to user U2, who is standing to the right of camera 31A.

In the example in Figure 15, the display area 201L shows that the analysis result of user U1's facial features is "cute." Above the facial feature analysis result, a message for repeat users, "Thank you for taking another photo," is displayed along with an illustration of a girl.

On the other hand, in the example in Figure 15, the display area 201R shows that the analysis result of user U2's facial features is "baby-like." The display area 201R does not show any messages for repeat users. In other words, the analysis results screen shown in Figure 15 is the analysis results screen displayed when user U1 is a repeat user and user U2 is not, as explained with reference to Figure 5A.

After the analysis results screen is displayed, in step S27 of Figure 14, the game control unit 61 displays the face diagnosis screen on the capture monitor 31B. The face diagnosis proceeds as the user answers questions regarding their preferences for how their face appears in photos. Multiple options are presented to the user along with the questions. The image processing, such as the processing applied to the face, is changed according to the results of the face diagnosis.

Figure 16 shows an example of the display at the start of a facial diagnosis.

At the start of the facial analysis, a message is displayed instructing the user to begin the analysis with the person standing on the left, as shown in Figure 16. Facial analysis is performed one person at a time. After a predetermined time has elapsed, the facial analysis screen displays the image shown in Figure 17.

In this example, user U1, standing on the left, is a repeat user. At the start of a facial recognition test for a repeat user, the facial recognition screen displays a message asking whether to apply the same selections made during the previous game to the current game, as shown in Figure 17. Below the message, a YES button 211 is displayed to apply the selections, and a NO button 212 is displayed to decline them.

In other words, the game information provided by the information processing server 2 includes information about the selections made by user U1 during the face diagnosis in the previous game. By pressing the YES button 211, user U1 can use the same selections from the previous game as the face diagnosis result. User U1 can also skip the face diagnosis selection process.

Furthermore, by pressing the NO button 212, user U1 can make selections regarding facial appearance, similar to a non-repeat user, without using the same selections as in the previous game.

In the lower right corner of the face recognition screen, a false authentication button 213 is displayed, containing the text "I've never taken a picture before." This false authentication button 213 is pressed when a screen similar to the one shown in Figure 17 is displayed to a non-repeat user. When the false authentication button 213 is pressed, the same face recognition process as for non-repeat users begins.

If a false positive occurs during facial ID detection using the facial recognition engine 11, a screen for repeat users, as shown in Figure 17, may be displayed to non-repeat users. Non-repeat users can select their preferred facial image appearance by pressing the false positive button 213.

For example, if user U1 presses the YES button 211 and chooses to use the same selections as in the previous game as the facial diagnosis result, the facial diagnosis for user U1 ends. Following the facial diagnosis for user U1, the facial diagnosis for user U2 begins. At the start of the facial diagnosis for user U2, a facial diagnosis screen is displayed, including a message instructing the system to diagnose user U2, who is standing on the right. After a predetermined time has elapsed, the facial diagnosis screen switches to the display shown in Figure 18.

Here, user U2, standing on the right, is not a repeat user. Facial recognition for non-repeat users is performed by user U2 answering questions as shown in Figure 18.

At the top of the face diagnosis screen in Figure 18, a message is displayed asking what kind of face the user desires. Below the message, buttons 221 and 222 are displayed as options. User U2 answers the question by pressing either button 221 or button 222. These questions are repeated multiple times with variations in content.

Repeat user U1 can also perform this facial analysis again, separate from the facial analysis performed during the previous game, by pressing the NO button 212 in Figure 17.

If both User U1 and User U2 are repeat users, a screen will appear during the facial recognition process for User U2 allowing them to choose to apply the same selections made during their previous game session. The number of times this screen is displayed will differ depending on whether all users playing the game together are repeat users or if there are non-repeat users among them.

Returning to the explanation of Figure 14, in step S28, the game control unit 61 accepts the user's selection for the face diagnosis screen. The processing in steps S27 and S28 is performed for each individual user.

Once all users' facial recognition is complete, in step S29, the game control unit 61 controls the camera 31A to perform normal shooting. Normal shooting is the process of generating images to be provided to the users. Normal shooting is performed multiple times, for example, five times.

In step S30, the game control unit 61 processes the face portion of each user in the captured image based on face parameters corresponding to the combination of the analysis results of each user's facial features and the face diagnosis results. Face parameters corresponding to the combination of the analysis results of facial features and the face diagnosis results are pre-set.

The face portion of user U1 in the captured image obtained through normal shooting is processed using face parameters corresponding to the combination of the analysis results of user U1's facial features and the facial diagnosis results of user U1. Similarly, the face portion of user U2 in the captured image is processed using face parameters corresponding to the combination of the analysis results of user U2's facial features and the facial diagnosis results of user U2.

As a result, the appearance of user U1's face in the captured image will be appropriate based on the analysis of user U1's facial features and the facial diagnosis results for user U1. Similarly, the appearance of user U2's face in the captured image will be appropriate based on the analysis of user U2's facial features and the facial diagnosis results for user U2.

In step S31, the game control unit 61 determines whether or not the shooting is complete. If it is determined that the shooting is not complete, the process returns to step S29, and normal shooting is repeated.

For example, if it is determined in step S31 that the shooting process is complete because five images have been captured, the process returns to step S2 in Figure 13, and the shooting process ends. After the shooting process, the editing process is performed on the user who has moved to the editing booth.

- Displaying the editing screen Figure 19 shows an example of the editing screen.

During image editing (step S3 in Figure 13), the editing monitor 41A in the editing booth displays an editing screen with editing areas 301L and 301R arranged side-by-side. Between the editing areas 301L and 301R is a thumbnail display area 302, which displays thumbnail images used to select the image to be edited.

Editing area 301L is the area used by user U1, who is standing to the left of the editing monitor 41A. Editing area 301R is the area used by user U2, who is standing to the right of the editing monitor 41A.

Editing area 301L is assigned to user U1, who is standing to the left of the editing monitor 41A, and editing area 301R is assigned to user U2, who is standing to the right of the editing monitor 41A. As shown in Figure 20, the editing screen is displayed assuming that users U1 and U2 are editing from the same positions as during filming. If users U1 and U2 are standing in opposite positions to those shown in Figure 20, it is possible to change the screen display so that user U2 uses editing area 301L and user U1 uses editing area 301R.

In the editing area 301L used by user U1, a repeat user, a message for repeat users, "Thank you for taking another photo," is displayed overlaid on the image being edited. This also allows user U1 to realize that the photo sticker creation device 1 recognizes them, giving them a sense of specialness.

Although not shown in the example in Figure 19, if user U2 is a repeat user, a message for repeat users will also be displayed in the editing area 301R used by user U2.

The message for repeat users disappears, for example, after a predetermined amount of time has elapsed since the editing screen was displayed.

As described above, the display of the editing screen changes depending on whether all users playing the game together are repeat users or whether there are non-repeat users among them. The display position and number of messages for repeat users also change depending on whether all users playing the game together are repeat users or whether there are non-repeat users among them.

Below the editing areas 301L and 301R, the editing palettes 303L and 303R are displayed, respectively. The editing palettes 303L and 303R display buttons used to select various editing tools, such as the pen tool and stamp tool. Users U1 and U2 operate the buttons displayed on the editing palettes 303L and 303R using the stylus pen 41B (Figure 20), respectively, to edit the captured image to be edited. Near the editing monitor 41A, separate stylus pens 41B are provided for user U1 and user U2.

To the left of the editing area 301L, the personal chart 304L is displayed, which is used to select recommended makeup treatments set for user U1. The personal chart 304L displays buttons and other elements used to select makeup treatments based on the combination of the analysis results of user U1's facial features and the user U1's facial diagnosis results. Makeup treatments include processes such as adding highlights and eye color through image processing.

Similarly, on the right side of the editing area 301R, the personal chart 304R, used for selecting recommended makeup treatments set for user U2, is displayed. The personal chart 304L displays buttons and other elements used for selecting makeup treatments based on the combination of the analysis results of user U2's facial features and the user U2's facial diagnosis results.

The captured images are edited by two separate users using this editing screen.

Figure 21 shows an example of the display of the editing palette 303L.

Information for repeat users may be displayed overlaid on the editing palette 303L used by user U1, who is a repeat user. In the example shown in Figure 21, a message is displayed asking whether to apply the same make-up settings used in the previous game to the current game.

Below the message, a YES button 321 is displayed to indicate that the changes should be applied, and a NO button 322 is displayed to indicate that the changes should not be applied. To the right of the NO button 322, a false authentication button 323 is displayed, containing the text "I've never taken a picture before."

In other words, in this example, user U1, a repeat user, can choose to reflect the content of their previous make-up process. The game information transmitted from the information processing server 2 as an authentication result includes information about the make-up process selected by user U1 during their previous game.

In this way, information representing various choices made in past games can be linked to facial recognition data and managed for use in the current game.

• Operation of Information Processing Server 2: The operation of Information Processing Server 2 will be explained with reference to the flowchart in Figure 22.

In step S51, the image acquisition unit 131 (Figure 12) acquires the face image transmitted from the photo sticker creation device 1.

In step S52, the facial recognition unit 132 inputs the facial image acquired by the image acquisition unit 131 to the facial recognition engine 11 and detects the facial ID.

In step S53, the determination unit 133 refers to the game management information stored in the game management information DB 12 and performs a repeat determination by determining whether the same face ID detected by the face recognition unit 132 is already registered.

In step S54, the determination unit 133 transmits information including the face ID detected by the face recognition unit 132 and the result of the repeat determination as an authentication result to the photo sticker creation device 1.

In step S55, the game information acquisition unit 134 determines whether or not game information has been transmitted from the photo sticker creation device 1, and waits until game information is transmitted.

If, in step S55, it is determined that game information has been transmitted from the photo sticker creation device 1, then in step S56, the game information acquisition unit 134 includes the game information transmitted from the photo sticker creation device 1 in the game management information and registers it in the game management information DB 12.

In this way, facial ID can be included in game management information and used for repeat user detection.

If facial recognition using images obtained through facial analysis fails (i.e., facial ID cannot be detected), the game on the photo sticker creation device 1 can proceed in the same way as if it were for a non-repeat user, even if the user is actually a repeat user.

Possible reasons for facial recognition failure include, for example, poor image quality preventing face recognition from the image, or communication errors between the photo sticker creation device 1 and the information processing server 2. In either case, the game on the photo sticker creation device 1 proceeds in the same manner as when targeting a non-repeat user.

<Different example>
- Example of images used for facial recognition: Although facial recognition is performed using images that are captured at the start of the shooting process and are not provided to the user, facial recognition may also be performed based on images obtained through normal shooting. Images obtained through normal shooting are images that are provided to the user either printed on sticker paper or as data via an image management server.

Figure 23 shows an example of the timing for facial recognition.

After users U1 and U2 enter the shooting booth, a live view image is displayed on the shooting monitor 31B located in the booth. After a certain period of time has elapsed since the live view image was displayed, the first shooting is performed, and facial recognition is conducted based on the still image P1 obtained from the first shooting. The facial image extracted from the captured image P1 is transmitted to the information processing server 2.

Furthermore, a second image is taken, and facial recognition is performed based on the image P2 obtained from the second image. In this way, facial recognition is repeated each time an image is taken. When facial recognition is performed based on the image P5 obtained from the final image, for example, the fifth image, both the image and the facial recognition process end.

Depending on the orientation of the face, it may not be possible to detect the facial ID with a single facial recognition attempt. Also, there may be cases where only user U2, who is using the system with user U1, is visible in the image. By repeatedly performing facial recognition, it becomes possible to improve the accuracy of repeat user detection.

Figure 24 shows another example of the timing of facial recognition.

As shown in Figure 24, facial recognition may be performed based on the five images obtained from the five captures after all captures have been completed. When the fifth capture is complete, the facial images extracted from each of the captured images P1 to P5 are transmitted to the information processing server 2, and facial recognition is performed based on each facial image.

For example, if, in five facial recognition attempts, a predetermined facial ID is detected three times and a different facial ID is detected twice, the former facial ID, which was detected three times, will be assigned as the user's facial ID. By using the most frequently detected facial ID in a kind of majority vote system, the accuracy of repeat detection can be improved.

The confidence level of the face ID may be calculated based on the facial state captured in the facial image used as input to the face recognition engine 11. The confidence level of the face ID is calculated based on parameters representing the facial state, such as face size, face orientation, and facial expression. For example, a face ID detected using a large image of a face facing forward will have a higher confidence level than a face ID detected using an image of a face facing sideways or a face ID detected using an image of a small face.

In this case, for example, repeat user detection is performed using a facial ID with a calculated confidence level above a certain threshold.

The reliability information of the facial ID may be included in the authentication result and provided from the information processing server 2 to the photo sticker creation device 1, and used to control the game content. Information presented to users identified as repeat users, such as changes in message content or message size, is modified based on the reliability of the facial ID used for repeat user determination.

For example, users identified as repeat users based on a facial ID with a confidence level above the threshold will be shown the message "Thank you for taking my picture again," as described above. On the other hand, users identified as repeat users based on a facial ID with a confidence level below the threshold will be shown a different message, such as "Did you take my picture last time too?"

This makes it possible to display messages based on the reliability of facial recognition, that is, the reliability of repeat customer detection.

- Example of a facial recognition engine As described above, the facial recognition engine 11 is an image processing engine that takes a facial image as input and outputs a unique facial ID. There is a limit to the number of facial IDs (number of faces that can be classified) that the facial recognition engine 11 can output. As shown in Figure 25, the information processing server 2 may be provided with facial recognition engines for each attribute of the photo sticker creation device, such as a facial recognition engine for each housing, a facial recognition engine for each model, a facial recognition engine for each store, and a facial recognition engine for the region where the store is located.

The facial recognition engines 11-1A to 11-1C shown in Figure 25 are each facial recognition engines for different housings. Which facial recognition engine to use for facial recognition is determined, for example, based on the housing ID of the photo sticker creation device 1 that transmitted the facial image.

The facial recognition engines 11-2A to 11-2C are each designed for different models. Which facial recognition engine to use for facial recognition is determined, for example, based on the model ID corresponding to the model of the photo sticker creation device 1 that transmitted the facial image.

The facial recognition engines 11-3A to 11-3C are each different facial recognition engines designed for different stores. Which facial recognition engine to use for facial recognition is determined, for example, based on the store ID of the store where the photo sticker creation device 1 that transmitted the facial image is installed.

The facial recognition engines 11-4A to 11-4C are each designed for different regions. Which facial recognition engine to use for facial recognition is determined, for example, based on a regional ID corresponding to the region where the store with the photo sticker creation device 1 that transmitted the facial image is located.

By providing a separate facial recognition engine for each attribute of the photo sticker creation device, the number of faces that can be classified can be increased, thereby improving the accuracy of repeat detection.

The facial ID detected by facial recognition may be managed in conjunction with identification information such as the Bluetooth® ID of the user's smartphone. The smartphone's identification information could, for example, be included in game management information.

The photo sticker creation device 1 acquires the user's smartphone's Bluetooth® ID at the start of the game and transmits it along with the facial image to the information processing server 2. The information processing server 2 inputs the facial image into the facial recognition engine 11. If the detected facial ID matches the facial ID associated with the Bluetooth ID transmitted from the photo sticker creation device 1 in the game management information, the server determines that the user is a repeat user.

By using smartphone identification information, it becomes possible to improve the accuracy of repeat customer detection.

As shown in Figure 26, the facial recognition engine 11 and the game management information DB 12 may be provided in the photo sticker creation device 1. This allows the photo sticker creation device 1 to independently determine whether a user is a repeat customer of its own device.

The facial recognition engine 11 may be provided in the photo sticker creation device 1, and the game management information DB 12 may be provided in the information processing server 2. Conversely, the facial recognition engine 11 may be provided in the information processing server 2, and the game management information DB 12 may be provided in the photo sticker creation device 1. In this way, it is possible to provide at least one of the functional units of the information processing server 2 shown in Figure 12 on the photo sticker creation device 1 side.

- Example of Repeat User Detection: A detection period for repeat users can be set. A predetermined period such as one day, one week, one month, or one year can be set as the detection period. Users who use the game again before the detection period has elapsed since their last use of the game will be detected as repeat users.

This prevents the system from mistakenly classifying users who haven't played the game for a long time as repeat users.

The number of repeat visits can be determined based on game management information. For example, if three game management entries containing the same face ID are registered, the user with that face ID will be determined to be a repeat user on their third visit.

By combining the number of repeat plays with the game usage date and time included in the game management information, it becomes possible to display messages tailored to repeat users, such as "This is your third time today."

By using the game usage date and time, it becomes possible to display more detailed, usage-specific messages, such as "Thank you for taking pictures again today," to users who also played the game the previous day, as information for repeat users.

In this way, it is possible to modify the game's content based on various pieces of information included in the game management data.

Example 1 of game changes
The game's content is designed to change depending on whether all users playing together are repeat users or if there are non-repeat users among them. However, the game's content may be further modified based on attribute information. For example, the types of makeup available may change depending on the user's age, or parameters used in various image processing operations such as editing may be changed.

Information other than gender and age, such as hair color, whether or not colored contact lenses are worn, and whether or not makeup is worn, may be estimated based on the facial image and managed as attribute information.

Example 2 of game changes
If all users playing the game together are determined to be repeat users, the system may further determine whether or not those users have played together in the past.

For example, if user U1 and user U2 have played the game together, the game management information DB 12 on the information processing server 2 will register game management information including the combination of user U1's face ID and user U2's face ID. Based on the face ID combination, it is also possible to determine whether they are repeat users who have played together in the past. Since the same friends often play together, multiple game management entries containing the same face ID combination will be registered.

If a user playing the game with another user is determined to be a repeat user who has played with the same user before, the game will offer different content than when all users playing together are repeat users, or when some users playing together are repeat users. For example, a message such as "We've played together before!" will be displayed to all friends playing the game together.

Repeat users who use the game together will notice that the photo sticker creation device 1 recognizes them, giving them a sense of specialness.

Example 3 of game changes
If the game management information includes information about the player's position at the time of shooting, the game management information may be used to display information about the player's position during their previous game session to repeat users who are playing the game together.

Figure 27 shows an example of how information regarding standing positions is presented.

As shown on the left side of Figure 27, if, during the previous game, user U1 stood to the left of camera 31A and user U2 stood to the right of camera 31A while taking pictures, then information indicating this will be registered in the game information of the game management information. The game management information also includes the combination of user U1's face ID and user U2's face ID.

In this state, if users U1 and U2 use the photo sticker creation device 1 game again, they will be determined to be repeat users who used the game together in the game's repeat usage determination process.

As shown on the right side of Figure 27, in this game, if user U1 is standing to the right of camera 31A and user U2 is standing to the left of camera 31A while taking a picture, the game control unit 61 of the photo sticker creation device 1 determines that the standing positions of user U1 and user U2 are opposite to their previous positions based on the standing position information included in the game information transmitted from the information processing server 2. When the game control unit 61 determines that the standing positions of user U1 and user U2 are opposite to their previous positions, it displays a message to user U1 and user U2 indicating this.

This allows users U1 and U2 to realize that their positions are reversed compared to when they took photos during the previous game, and they can switch positions. When taking photos with the same friends, their positions are often predetermined. By providing information about their positions, they can take photos with the same composition as the photos taken during the previous game.

Instead of only displaying information about the user's position if it's the opposite of their previous position, the information about their position may always be displayed when both User U1 and User U2 are using the system together. In this case, a message such as "You were standing on the left last time" would be displayed to User U1, and a message such as "You were standing on the right last time" would be displayed to User U2.

Information regarding user positioning is provided, for example, when user U1 and user U2 are using the service together. If user U1 is using the service with a different friend than user U2, or if user U2 is using the service with a different friend than user U1, information regarding their positioning is not provided. However, it may be possible to provide information regarding their positioning even when user U1 is using the service with a different friend than user U2, or when user U2 is using the service with a different friend than user U1.

- Other: If all users playing the game together are repeat users, guidance on how to proceed with the game may be omitted or simplified. Normally, guidance is provided at various points during the game, explaining what to do at that time.

The guidance displayed will change depending on whether all users playing the game together are repeat users or if there are some non-repeat users among them. This will allow for shorter game times.

While user authentication is currently based on facial recognition, it may also be based on other biometric information such as iris scans or fingerprints. User authentication may also be based on information such as an ID entered by the user.

Regarding the program: The series of processes described above can be executed by hardware or by software. When the series of processes are executed by software, the programs that make up the software are installed from a program storage medium onto a computer that is built into dedicated hardware, or a general-purpose personal computer.

The program to be installed is provided by recording it on removable media 111, as shown in Figure 11, which consists of optical discs (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or semiconductor memory. Alternatively, it may be provided via wired or wireless transmission media such as a local area network, the internet, or digital broadcasting. The program can be pre-installed in ROM 102 or storage unit 108.

The programs executed by the computer may be programs that are processed chronologically in the order described herein, or they may be programs that are processed in parallel or at necessary times, such as when a call is made.

In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all components reside in the same enclosure. Therefore, multiple devices housed in separate enclosures and connected via a network, and a single device containing multiple modules within a single enclosure, are both considered systems.

The effects described herein are illustrative and not limited to those described herein, and other effects may also occur.

The embodiments of this technology are not limited to those described above, and various modifications are possible without departing from the spirit of this technology.

For example, this technology can be configured as cloud computing, where a single function is shared and processed collaboratively by multiple devices via a network.

Furthermore, each step described in the flowchart above can be performed by a single device, or it can be divided and executed by multiple devices.

Furthermore, if a single step includes multiple processes, these processes can be executed by a single device or distributed among multiple devices.

1. Photo sticker creation device, 2. Information processing server, 11. Face recognition engine, 12. Game management information database, 13. Store installation information database, 51. Control unit, 61. Game control unit, 62. Authentication result acquisition unit, 121. Information processing unit, 131. Image acquisition unit, 132. Face recognition unit, 133. Judgment unit, 134. Game information acquisition unit

Claims (10)

The photography team photographs multiple users playing the game together,
A display unit that displays the screen of the aforementioned game,
An acquisition unit that determines whether or not a user is a repeat user who has used the aforementioned game, based on images obtained by photographing multiple such users,
A shooting device comprising: a control unit that, based on the determination result for each of the multiple users as to whether or not they are repeat users, displays information for repeat users at a position on the screen corresponding to the standing position of the user determined to be a repeat user . The shooting apparatus according to claim 1, wherein the control unit changes the display on the screen depending on whether all of the multiple users are repeat users or whether any of the multiple users are not repeat users. The shooting apparatus according to claim 1, wherein the control unit displays information for repeat users on the left side of the screen if the user standing on the left side is a repeat user, and displays information for repeat users on the right side of the screen if the user standing on the right side is a repeat user . The acquisition unit acquires information regarding the selections made by the repeat user in the past games.
The shooting device according to any one of claims 1 to 3 , wherein the control unit displays information used to determine whether or not to reflect the same selections made in past games in the current game, as information for repeat users. The shooting device according to any one of claims 1 to 4 , wherein the control unit changes the display on the screen depending on whether the multiple users are repeat users who have been using the game together. The acquisition unit acquires information regarding the standing position of the repeat user during past gameplay.
The shooting device according to claim 5 , wherein the control unit presents information regarding the standing position when multiple users are repeat users who have been using the game together. The shooting device according to claim 6 , wherein the control unit presents information regarding the standing position when the standing positions of multiple users during shooting in the current game differ from the standing positions during shooting in past games. The acquisition unit authenticates a person based on a facial image and transmits each of the multiple facial images of the user generated based on the image to an information processing device that determines whether or not the authenticated person is a repeat user, and obtains information from the information processing device regarding the determination result of whether or not the person is a repeat user, as described in any one of claims 1 to 7 . The imaging device,
The photographs were taken of multiple users playing the game together,
The screen of the aforementioned game is displayed,
The determination of whether or not a user is a repeat user who has used the aforementioned game is obtained based on images taken of multiple such users.
Based on the determination result for each of the multiple users whether or not they are repeat users, information for repeat users is displayed on the screen at a position corresponding to the location of the user determined to be a repeat user.
Information processing methods. On the computer,
The photographs were taken of multiple users playing the game together,
The screen of the aforementioned game is displayed,
The determination of whether or not a user is a repeat user who has used the aforementioned game is obtained based on images taken of multiple such users.
Based on the determination result for each of the multiple users whether or not they are repeat users, information for repeat users is displayed on the screen at a position corresponding to the location of the user determined to be a repeat user.
A program to execute a process .