JP7750384B2 - Server device, system, server device control method and program - Google Patents

Description

The present invention relates to a server device, a system, a method for controlling a server device, and a storage medium.

There is a system that photographs users using camera devices installed at tourist spots, etc., and provides the users with the image data obtained through the photographs.

For example, Patent Document 1 describes an image provision system that conducts a photo rally in which users are automatically photographed at multiple locations in a tourist spot or the like, and provides the captured images after the rally is over. The image provision system in Patent Document 1 includes multiple photography systems and a server communicably connected to the multiple photography systems. The multiple photography systems each have a photography unit that photographs the user, a communication unit that transmits the photographed image data and identification information that identifies the user to the server, and a display unit that presents information to the user. The server generates an image to provide to the user using at least a portion of the photographed image data received from the multiple photography systems.

Japanese Patent Application Laid-Open No. 2018-098755

As shown in Patent Document 1, efforts are being made to install photographic devices (cameras) at tourist spots to increase the attractions of those spots. However, installing the photographic devices requires costs, and there is a problem in that installation of the photographic devices will not progress unless the installers are motivated.

However, this problem cannot be solved by applying the technology disclosed in the above-mentioned Patent Document 1. Patent Document 1 does not take into account the installation costs of the imaging device.

The primary objective of the present invention is to provide a server device, a system, a method for controlling a server device, and a storage medium that contribute to enhancing the appeal of tourist destinations and the like.

According to a first aspect of the present invention, a server device is provided which includes: a storage unit which stores biometric information of an album production applicant; an acquired image control unit which receives image data from at least one photography terminal and determines whether the album production applicant appears in the received image data by performing a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the album production applicant appears; an album production unit which allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant appears, and produces the album using the image data selected by the album production applicant; and a preferential treatment processing execution unit which performs a process to give preferential treatment to the installer of the photography terminal that provided the image data used in the album.

According to a second aspect of the present invention, a system is provided which includes at least one photography terminal installed at a photography point in a tourist destination, and a server device, wherein the server device is equipped with: a memory unit which stores biometric information of an album production applicant; an acquired image control unit which receives image data from the at least one photography terminal, determines whether the album production applicant appears in the received image data by a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the album production applicant appears; an album production unit which allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant appears, and produces the album using the image data selected by the album production applicant; and a preferential treatment processing execution unit which performs processing to give preferential treatment to the installation entity of the photography terminal that provided the image data used in the album.

According to a third aspect of the present invention, a control method for a server device is provided, the server device having a memory unit that stores biometric information of an album production applicant, receives image data from at least one photography terminal, determines whether the album production applicant is depicted in the received image data by performing a matching process using the stored biometric information and biometric information extracted from the received image data, stores information regarding the image data in which the album production applicant is depicted, allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is depicted, creates the album using the image data selected by the album production applicant, and performs a process that gives preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.

According to a fourth aspect of the present invention, a computer-readable storage medium is provided that stores a program for causing a computer mounted on a server device, the computer having a storage unit that stores biometric information of an album production applicant, to receive image data from at least one or more photography terminals, determine whether the album production applicant is depicted in the received image data by performing a matching process using the stored biometric information and biometric information extracted from the received image data, and store information regarding the image data in which the album production applicant is depicted, allow the album production applicant to select image data to be used in the album from at least one or more image data in which the album production applicant is depicted, and create the album using the image data selected by the album production applicant, and provide preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.

According to each aspect of the present invention, a server device, a system, a method for controlling a server device, and a storage medium are provided that contribute to increasing the appeal of tourist destinations and the like. Note that the effects of the present invention are not limited to those described above. The present invention may achieve other effects instead of or in addition to the effects described above.

FIG. 1 is a diagram for explaining an overview of an embodiment. FIG. 2 is a flowchart illustrating the operation of one embodiment. FIG. 3 is a diagram illustrating an example of a schematic configuration of an information processing system according to the first embodiment. FIG. 4 is a diagram for explaining the operation of the information processing system according to the first embodiment. FIG. 5 is a diagram for explaining the operation of the information processing system according to the first embodiment. FIG. 6 is a diagram illustrating an example of a processing configuration of the signage according to the first embodiment. FIG. 7 is a diagram illustrating an example of a signage display according to the first embodiment. FIG. 8 is a diagram illustrating an example of a processing configuration of a server device according to the first embodiment. FIG. 9 is a diagram illustrating an example of the applicant information database according to the first embodiment. FIG. 10 is a flowchart illustrating an example of the operation of the captured image control unit according to the first embodiment. FIG. 11 is a sequence diagram illustrating an example of the operation of the information processing system according to the first embodiment. FIG. 12 is a diagram illustrating an example of a display on a terminal according to the second embodiment. FIG. 13 is a diagram illustrating an example of the applicant information database according to the second embodiment. FIG. 14 is a diagram illustrating an example of a processing configuration of a server device according to the third embodiment. FIG. 15 is a diagram illustrating an example of a preference information database according to the third embodiment. FIG. 16 is a diagram illustrating an example of a hardware configuration of a server device according to the present disclosure.

First, an overview of one embodiment will be described. Note that the reference numerals in this overview are added to each element for convenience as an example to aid understanding, and the description of this overview is not intended to be limiting in any way. Furthermore, unless otherwise specified, the blocks shown in each drawing represent functional units, not hardware units. Connection lines between blocks in each drawing include both bidirectional and unidirectional lines. Unidirectional arrows are used to schematically indicate the flow of the main signal (data) and do not exclude bidirectionality. Note that in this specification and drawings, elements that can be similarly described may be assigned the same reference numerals to avoid redundant explanation.

The server device 100 according to one embodiment includes a storage unit 101, an acquired image control unit 102, an album production unit 103, and a preferential treatment processing execution unit 104 (see FIG. 1). The storage unit 101 stores biometric information of the album production applicant (step S1 in FIG. 2). The acquired image control unit 102 receives image data from at least one photography device (step S2). The acquired image control unit 102 performs a matching process using the stored biometric information and biometric information extracted from the received image data (step S3). The acquired image control unit 102 determines through the matching process whether the album production applicant is depicted in the received image data, and stores information about the image data depicting the album production applicant (applicant image information, described below) (step S4). The album production unit 103 allows the album production applicant to select image data to be used in the album from at least one image data depicting the album production applicant, and creates the album using the image data selected by the album production applicant (step S5). The preferential treatment execution unit 104 performs a process of giving preferential treatment to the entity that installed the photographing terminal that provided the image data used in the album (step S6).

The server device 100 extracts image data of the album production applicant from image data captured by photography terminals (signage 20 and camera device 30, described below) installed at various locations in the tourist destination and presents the extracted image data to the applicant. The server device 100 performs a process to provide preferential treatment to the installer of the photography terminal that captured the image data selected by the album production applicant. For example, the server device 100 pays all or a portion of the album production fee received from the user to the installer of the photography terminal that captured the image data selected by the album production applicant. As a result, a large amount of distribution money is paid to businesses that install photography terminals that capture image data selected by many users. In other words, businesses that cooperate in installing photography terminals are given incentives according to the number of photos used in the album. In other words, providing attractive photos to users leads to profits for businesses that install photography terminals. If this leads to profits for businesses, businesses in tourist destinations will install photography terminals in locations where better photos can be taken. If better photos are taken and a more complete album is provided to the user, the reputation of the tourist destination will improve, leading to the revitalization of the area. In this way, the server device 100 realizes a virtuous cycle of revitalizing the local economy and the tourist destination.

Specific embodiments are described in further detail below with reference to the drawings.

[First embodiment]
The first embodiment will be described in more detail with reference to the drawings.

[System configuration]
3 is a diagram showing an example of a schematic configuration of an information processing system (album production system) according to the first embodiment. As shown in FIG. 3, the information processing system includes a server device 10, signages 20-1 to 20-4, and camera devices 30-1 to 30-3.

In the following explanation, unless there is a particular reason to distinguish between signage 20-1 to 20-4, they will simply be referred to as "signage 20." Similarly, for other elements, the symbol to the left of the hyphen will represent that element.

The information processing system according to the first embodiment is operated with the aim of revitalizing tourist destinations. The information processing system achieves the revitalization of tourist destinations by improving the satisfaction of users (tourists) who visit the destinations.

More specifically, the information processing system provides "album production" services to tourists who visit tourist spots and take part in tours (cycling tours) that take them around scenic spots by bicycle or other means.

Users taking part in a cycling tour can request the creation of an album from organizations, businesses, etc. related to the tourist destination. Specifically, users can apply for a service to create an electronic album (digital photo album) using photos taken at photography points set up at various locations from the start of the cycling tour to the finish line.

Examples of organizations and businesses related to tourist destinations include tourist associations, travel agencies, and tourism businesses. Users can apply to have an album produced through a tourist association or at the contract desk of a travel agency.

The above-mentioned photography points can be various locations. For example, the starting point of a cycling tour, scenic spots along the route (coasts, cliffs, lakeside, etc.), rest areas, retail stores selling souvenirs, difficult cycling spots such as uphill sections, and the finish line are examples of such photography points.

Signage 20 and camera devices 30 are installed at each of the above-mentioned shooting points. For example, in the example shown in Figure 3, signage 20-1 is installed at the start point, and signage 20-2 is installed at the finish point. In addition, signage 20-3 is installed by the lake, and signage 20-4 is installed next to a retail store. Furthermore, camera devices 30 are installed at various points along the cycling course.

Each signage 20 installed at the photography point photographs a predetermined area periodically or at a predetermined timing, and transmits the obtained image data to the server device 10. Similarly, a camera device 30 installed at the photography point photographs a predetermined area periodically or at a predetermined timing, and transmits the obtained image data to the server device 10.

In the following explanation, the signage 20 and camera device 30 may be collectively referred to as the "photography terminal."

Here, the photography terminals (signage 20, camera device 30) at the above photography points are installed at the expense of businesses operating in tourist destinations. More specifically, the photography terminals are installed by businesses that support the revitalization of tourist destinations or businesses that manage tourist resources.

For example, signage 20-1 is installed at the expense of a retail store operating near the starting point. Alternatively, camera devices 30 installed at various locations along the cycling course are installed at the expense of accommodation providers (hotel operators) operating in tourist areas.

The server device 10 is a device that mainly controls and manages the production of the above-mentioned album. The server device 10 may be installed in the same building as the tourist association, etc., or may be installed on a network (cloud).

The devices shown in Figure 3 are interconnected. For example, the server device 10 and the photography terminals (signage 20, camera device 30) are connected by wired or wireless communication means and are configured to be able to communicate with each other. Note that in Figure 3, some of the connection lines connecting the server device 10 and the photography terminals are not shown.

The configuration of the information processing system shown in Figure 3 is an example and is not intended to be limiting. For example, the information processing system may include multiple server devices 10. Furthermore, it goes without saying that the number of signage devices 20 and camera devices 30 installed at tourist spots (cycling courses) is not limited to the configuration shown in Figure 3.

[Overview of operation]
Next, the general operation of the information processing system according to the first embodiment will be described.

<Application for album production>
First, a user participating in a cycling tour applies for album production to a tourist association or the like of a tourist spot. For example, the user operates terminal 40 to access a WEB page provided by server device 10.

On the web page, the user inputs the information necessary to create the album into the server device 10 (see Figure 4). Specifically, the user registers personal information (name, gender, telephone number, email address, account information, etc.) and biometric information into the server device 10.

Biometric information includes, for example, data (features) calculated from physical characteristics unique to an individual, such as the face, fingerprint, voiceprint, veins, retina, and iris pattern. Alternatively, biometric information may be image data such as a face image or fingerprint image. Biometric information may be any information that includes the user's physical characteristics. This disclosure describes the use of biometric information related to a person's "face" (a face image or features generated from a face image).

Also, as shown in Figure 4, the user inputs their requests for album production (hereinafter referred to as album production information) into the server device 10. For example, the user inputs information into the server device 10 regarding how many photos they want to use in creating the album. The fee varies depending on the number of photos used in the album.

When the server device 10 acquires personal information, biometric information, album production information, etc. from a user, it generates a user ID to identify the user. The server device 10 associates the generated user ID, personal information, biometric information, album production information, etc. and stores them in the applicant information database. Details of the applicant information database will be described later.

When the server device 10 successfully pays the album production fee using the account information (bank account information, credit card account information) entered by the user, it notifies the user that the application for album production has been completed.

In the following explanation, users who apply for album production will be referred to as "album production applicants" or simply "applicants."

<Photo collection>
The server device 10 collects photos to be used for album production (materials for the album, candidates for photos to be used in the album) from photography terminals installed at various locations in the tourist spot (cycling course).

When each photographing device acquires image data, it transmits the acquired image data and the terminal ID to the server device 10. The terminal ID is an ID used to identify the photographing device installed at each location in the tourist destination. The terminal ID can be the MAC (Media Access Control) address or IP (Internet Protocol) address of the photographing device.

The server device 10 extracts biometric information from image data acquired from the photographing terminal (signage 20, camera device 30). The server device 10 performs a matching process using the extracted biometric information (facial image) with the biometric information registered in the applicant information database, and identifies the album production applicant who appears in the image data.

The server device 10 associates the applicant identified by the matching process with information regarding image data in which the applicant appears (hereinafter referred to as applicant image information) and stores them in the applicant information database. The applicant image information includes an image ID that identifies the image data, the photographing point where the applicant was photographed, the photographing date and time, etc.

The server device 10 performs the above process each time it obtains image data from the photographing terminal and collects image data depicting the applicant.

In this way, the server device 10 extracts image data that shows the user who requested the album creation from the image data acquired from the photography terminals installed at various locations in the tourist destination. More specifically, the server device 10 extracts image data that shows the person applying for album creation from the image data taken between the start point and the finish point.

<Album production>
The server device 10 presents the photos (image data) collected for the album to the album applicant when the user finishes the cycling tour, etc. For example, if the applicant appears in image data captured by the signage 20-2 installed at the finish point, the server device 10 determines that the cycling tour has ended and presents the applicant with a photo in which the applicant appears.

For example, the server device 10 sends the URL (Uniform Resource Locator) of a web page for viewing the photos collected for creating the above album to the email address previously registered by the applicant (an email address that can be received by the terminal 40).

When an applicant accesses the web page at the above URL, the server device 10 displays a GUI (Graphical User Interface) that allows the applicant to select image data to be included in the album. For example, the server device 10 displays a GUI such as that shown in Figure 5 on the applicant's terminal 40.

The server device 10 creates an album using the image data selected by the user. The server device 10 then transmits the created album to the terminal 40 held by the user.

In this way, when the tourist (applicant for album creation) arrives at the finish point, the server device 10 displays a list of image data taken during the cycling tour on the user's terminal 40. The applicant selects photos to use in the album from the displayed list. The server device 10 creates an album using the selected photos and submits (delivers) it to the applicant.

<Revenue distribution>
When the album is submitted to the applicant, the server device 10 performs post-processing related to the album production. Specifically, the server device 10 performs processing to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.

As mentioned above, when a user applies for the production of an album, they pay an album production fee to a tourism association, etc. The tourism association, etc. distributes (returns) all or part of the album production fee to the business operator that covered the installation costs of the photography terminal. At that time, the tourism association (server device 10) pays the distribution amount in a way that gives preferential treatment to the manager and installer of the photography terminal that captured the image data used by the applicant in the electronic album.

As a result, businesses that install photography devices that capture the image data selected by many users will receive large dividends. In other words, providing users with attractive photos leads to profits for businesses that install photography devices. If this leads to profits for businesses, businesses in tourist destinations will be motivated to install photography devices in locations where better photos can be taken, or to install photography devices that allow photos to be taken in collaboration with tourist destination characters. If better photos are taken and users are provided with fulfilling albums, the reputation of the tourist destination will improve, leading to the revitalization of the area.

Next, we will explain in detail each device included in the information processing system related to the first embodiment.

[Signage]
6 is a diagram illustrating an example of a processing configuration (processing module) of the signage 20 according to the first embodiment. Referring to FIG. 6, the signage 20 includes a communication control unit 201, a message output unit 202, an image capture control unit 203, and a storage unit 204.

The communication control unit 201 is a means for controlling communication with other devices. For example, the communication control unit 201 receives data (packets) from the server device 10. The communication control unit 201 also transmits data to the server device 10. The communication control unit 201 passes data received from other devices to other processing modules. The communication control unit 201 transmits data obtained from other processing modules to other devices. In this way, other processing modules send and receive data to other devices via the communication control unit 201. The communication control unit 201 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

The message output unit 202 is a means for outputting a predetermined message. The message output unit 202 displays a message on an LCD display or the like according to the location (photography point) where the device is installed.

For example, the message output unit 202 of signage 20-1 installed at the starting point of a cycling tour outputs a message welcoming participants to the cycling tour. Alternatively, the message output unit 202 of signage 20-2 installed at the finishing point of the cycling tour outputs a message congratulating participants on completing the cycling tour.

The photography control unit 203 is a means for controlling a camera device (a camera device provided in the signage 20; not shown) and photographing a predetermined area. Specifically, the photography control unit 203 detects the presence of a person in front of its own device based on the output signal of a human presence sensor and image data obtained from the camera device. When a person is detected, the photography control unit 203 photographs the predetermined area while displaying a message specified for each photography point on an LCD display or the like.

The shooting control unit 203 acquires image data by capturing an image of the specified area. For example, the shooting control unit 203 displays a screen as shown in Figure 7 and acquires image data. Note that in Figure 7, the captured image data is displayed together with a message.

The shooting control unit 203 transmits the acquired image data and terminal ID to the server device 10.

The terminal ID is shared between the server device 10 and each photographing terminal by any method. For example, the system administrator determines the terminal ID and sets the determined terminal ID in the server device 10. The system administrator also sets the determined terminal ID in each photographing terminal.

The memory unit 204 is a means for storing information necessary for the operation of the signage 20.

[Camera equipment]
A description of the configuration and operation of the camera device 30 will be omitted because the configuration and operation of the camera device 30 will be apparent to those skilled in the art. The camera device 30 simply takes images of a predetermined area periodically or at a predetermined timing, and transmits the obtained image data and terminal ID to the server device 10.

[Device]
Examples of the terminal 40 include a smartphone, a mobile phone, a game console, a mobile terminal device such as a tablet, a computer (personal computer, laptop computer), etc. The terminal 40 can be any equipment or device that can accept user operations and communicate with the server device 10, etc. The configuration of the terminal 40 is clear to those skilled in the art, so a detailed description will be omitted.

[Server device]
8 is a diagram showing an example of a processing configuration (processing module) of the server device 10 according to the first embodiment. Referring to FIG. 8, the server device 10 includes a communication control unit 301, an application control unit 302, an acquired image control unit 303, an album creation unit 304, a preferential treatment processing execution unit 305, and a storage unit 306.

The communication control unit 301 is a means for controlling communication with other devices. For example, the communication control unit 301 receives data (packets) from the signage 20. The communication control unit 301 also transmits data to the signage 20. The communication control unit 301 passes on data received from other devices to other processing modules. The communication control unit 301 transmits data obtained from other processing modules to other devices. In this way, other processing modules send and receive data to other devices via the communication control unit 301. The communication control unit 301 has a function as a receiving unit that receives data from other devices and a function as a transmitting unit that transmits data to other devices.

The application control unit 302 is a means for controlling applications for the creation of an electronic album from users. For example, when a user operates the terminal 40 and selects "Apply for album creation" on a web page provided by the server device 10, the application control unit 302 displays a GUI such as that shown in Figure 4 on the terminal 40.

The applicant for album production operates terminal 40 to input the information shown in Figure 4. When the applicant has completed inputting the information, he/she presses the "OK" button and inputs personal information (name, gender, age, contact details, etc.), biometric information (e.g., facial image), album production information (e.g., number of photos to be used in the album), etc. into server device 10.

When the application control unit 302 acquires a facial image, it generates features from the facial image.

Since existing technology can be used for the feature generation process, a detailed explanation will be omitted. For example, the application control unit 302 extracts the eyes, nose, mouth, etc. from the facial image as feature points. The application control unit 302 then calculates the position of each feature point and the distance between each feature point as feature amounts, and generates a feature vector (vector information that characterizes the facial image) consisting of multiple feature amounts.

Furthermore, the application control unit 302 performs payment processing for the album production fee using the account information obtained from the user. The application control unit 302 charges payment of the album production fee to the credit card account, etc., listed in the account information.

The application control unit 302 generates a user ID to identify the applicant. The user ID may be any information that can uniquely identify the user requesting album production. For example, the application control unit 302 may assign a unique value each time an application for album production is received and use this as the user ID.

The application control unit 302 associates the generated user ID, biometric information (features), personal information, album production information, etc. and stores them in the applicant information database (see Figure 9). Note that the applicant information database shown in Figure 9 is an example and is not intended to limit the items to be stored.

The acquired image control unit 303 is a means for controlling images acquired from the photographing terminal (signage 20, camera device 30).

The acquired image control unit 303 receives image data from at least one photography device and performs a matching process using pre-stored biometric information and biometric information extracted from the received image data. Through the matching process, the acquired image control unit 303 determines whether the album production applicant appears in the received image data and stores information regarding the image data in which the album production applicant appears.

Figure 10 is a flowchart showing an example of the operation of the acquired image control unit 303 according to the first embodiment. The operation of the acquired image control unit 303 will be explained with reference to Figure 10.

When the acquired image control unit 303 acquires image data and the terminal ID from the photographing terminal, it attempts to extract a facial image from the image data (extraction of facial image; step S101).

Note that the facial image extraction process performed by the acquired image control unit 303 can use existing technology, so a detailed explanation will be omitted. For example, the acquired image control unit 303 may extract facial images (facial areas) from image data using a learning model trained by a CNN (Convolutional Neural Network). Alternatively, the acquired image control unit 303 may extract facial images using a technique such as template matching.

If a facial image cannot be extracted from the image data (step S102, No branch), the acquired image control unit 303 does not perform any special processing.

If a facial image can be extracted from the image data (step S102, Yes branch), the acquired image control unit 303 performs a matching process using the biometric information extracted from the image data and the biometric information stored in the applicant information database (step S103).

The acquired image control unit 303 generates features from the extracted facial image. The acquired image control unit 303 sets the generated features as the target for matching and performs a matching process (1:N matching; N is a positive integer, same below) with the features registered in the applicant information database.

The acquired image control unit 303 calculates the similarity between the feature to be matched and each of the multiple feature values on the registration side. The similarity can be calculated using chi-square distance, Euclidean distance, or the like. Note that the greater the distance, the lower the similarity, and the closer the distance, the higher the similarity.

The acquired image control unit 303 determines that the matching process has failed if there is no feature among the multiple features registered in the applicant information database whose similarity with the feature to be matched is greater than or equal to a predetermined value.

The acquired image control unit 303 determines that the matching process is successful if there is a feature among the multiple features registered in the applicant information database whose similarity with the feature to be matched is greater than or equal to a predetermined value.

If the matching process fails (step S104, No branch), the acquired image control unit 303 does not perform any special processing.

If the matching process is successful (step S104, Yes branch), the acquired image control unit 303 adds the applicant image information to the entry with the highest similarity (step S105). Specifically, the acquired image control unit 303 adds the image ID of the image data from which the facial image was extracted, the shooting point derived based on the terminal ID received from the shooting terminal, the shooting date and time, etc. as "applicant image information" to the entry identified by the matching process.

The image ID is an ID that identifies the image data in which the album creation applicant appears. The acquired image control unit 303 associates the image ID with the storage location of the image data corresponding to the image ID and stores them.

In addition, the acquired image control unit 303 refers to table information that stores the terminal ID and the name of the shooting point where the shooting terminal is installed in association with each other, and acquires the shooting point based on the terminal ID.

The acquired image control unit 303 repeats the above process for each person appearing in the image data. For example, if multiple album production applicants are appearing in a single image data piece, the acquired image control unit 303 adds applicant image information for each of the multiple album production applicants to the corresponding entry in the applicant information database.

The album production unit 304 is a means for producing an album related to the album production applicant. The album production unit 304 allows the album production applicant to select image data to be used in the album from at least one image data that depicts the album production applicant. The album production unit 304 produces the album using the image data selected by the album production applicant.

The album production unit 304 accesses the applicant information database periodically or at a predetermined timing to identify applicants who have completed a cycling tour. For example, the album production unit 304 determines that an applicant photographed by signage 20-2 installed at the finish line has completed the cycling tour.

For example, if the photo point "Finish Point" corresponding to signage 20-2 is stored in the applicant image information field, the album production unit 304 determines that the applicant of the corresponding entry has completed the cycling tour.

The album production unit 304 guides the applicant who has completed the cycling tour to a web page for selecting image data to be used in the electronic album. Specifically, the album production unit 304 transmits the URL of the web page to the terminal 40 of the applicant who has completed the cycling tour.

The applicant operates terminal 40 to access the web page at the above URL. In response to the applicant's access, album production unit 304 creates a web page that allows the applicant to select photos (image data) to use in the electronic album, and displays it on terminal 40. Album production unit 304 arranges image data featuring the album production applicant in a predetermined order and displays it on terminal 40, allowing the album production applicant to select image data to use in the album.

For example, the album creation unit 304 creates a web page such as that shown in Figure 5. As shown in Figure 5, the album creation unit 304 accesses the applicant information database and displays a list of image data in which the applicant appears (image data whose image ID is stored in the applicant image information field in the applicant's entry) in chronological order.

The album production unit 304 may reduce the original image data and display it as a thumbnail image on the selection screen for accepted photos as shown in Figure 5, and the applicant may touch the thumbnail image to enlarge it. In this way, the album production unit 304 may provide an interface that improves user convenience on the selection screen for accepted photos.

In addition, the album production unit 304 obtains the number of photos to be used in the album of the album production applicant by referring to the applicant information database, subtracts the number of selected photos from the stored number, and displays the remaining number of photos that the applicant can select.

When the applicant has finished selecting photos (pressing the OK button shown in Figure 5), the album creation unit 304 creates an electronic album by storing the image data selected by the applicant in a file in a specified format. The album creation unit 304 creates an electronic album that is compatible with the application for viewing electronic albums installed on the terminal 40.

The album production unit 304 delivers the produced album to the applicant. Specifically, the album production unit 304 transmits the album to the terminal 40 possessed by the applicant.

The preferential treatment processing execution unit 305 is a means for performing processing to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album. For example, the preferential treatment processing execution unit 305 determines the distribution destination of the album production fee paid by the album production applicant so as to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.

In this way, the preferential treatment processing execution unit 305 controls the distribution of all or part of the album production fee received from the album production applicant to the parties involved in the information provision system. The preferential treatment processing execution unit 305 determines the distribution amount to each installer so as to give preferential treatment to the installer of the photography terminal that provided the image data used by the applicant in the electronic album.

For example, the preferential treatment processing execution unit 305 counts the number of photos used in the electronic album for each installation company of the photography terminal.The preferential treatment processing execution unit 305 then apportions the album production fee according to the number of photos for each installation company and determines the distribution amount to be paid to the installation company of the photography terminal.

For example, consider the case where three businesses, Business A, Business B, and Business C, install photography devices at a photography point, and photos taken by Business A's and Business B's photography devices are used in an album. Furthermore, suppose three photos are selected from the photography device installed by Business A, and one photo is selected from the photography device installed by Business B. In this case, 75% of the album production fee is paid to Business A, and 25% of the album production fee is paid to Business B.

Alternatively, the preferential treatment processing execution unit 305 may deduct the system operating costs to be paid to the tourist association from the album fee, and use the remaining album fee as the source of funds to be distributed to each installation business. Alternatively, the preferential treatment processing execution unit 305 may distribute a predetermined percentage of the album fee equally to each installation business, and distribute the remaining album fee so that the installation business of the photography terminal that took the photo adopted by the applicant is given preferential treatment.

Note that we will omit the explanation regarding the dividend payment process by the preferential treatment processing execution unit 305. The preferential treatment processing execution unit 305 simply transfers the dividend to be paid to each business operator to the bank account of each business operator at a predetermined timing (e.g., the end of the month, etc.).

The memory unit 306 is a means for storing information necessary for the operation of the server device 10. An applicant information database is constructed in the memory unit 306. The applicant information database stores biometric information of the applicant for album production.

[System Operation]
Next, the operation of the information processing system according to the first embodiment will be described. Note that a description of the operation relating to an application for creating an electronic album will be omitted. Fig. 11 is a sequence diagram showing an example of the operation of the information processing system according to the first embodiment.

When the signage 20 photographs the user, it transmits the image data obtained by the photograph to the server device 10 (step S01).

The camera device 30 photographs a specified area periodically or at a specified timing and transmits the obtained image data to the server device 10 (step S02).

The server device 10 extracts a facial image from the image data obtained from the photographing terminal (signage 20, camera device 30) and performs a matching process using the extracted facial image and the biometric information stored in the applicant information database (step S03).

The server device 10 identifies the applicant appearing in the image data through a matching process and adds the applicant image information to the entry for the identified applicant (entry in the applicant information database) (step S04).

The signage 20, camera device 30 and server device 10 repeat the operations of steps S01 to S04 above.

When the user finishes the cycling tour, the server device 10 displays a selection screen for the applicant's photos to be adopted on the terminal 40 (selection display of adopted photos; step S11).

Once the photos selected by the applicant are obtained, the server device 10 creates an album and sends it to the applicant's terminal 40 (step S12).

<Modification 1 of the First Embodiment>
In the above embodiment, it was explained that the server device 10 (acquired image control unit 303) generates applicant image information from image data in which the album production applicant appears, and stores the generated applicant image information in the applicant information database.

The acquired image control unit 303 may extract more information by analyzing image data showing the applicant, and store the extracted information in the applicant information database as applicant image information.

For example, if the person in the image data is the applicant for album creation (if the matching process using biometric information is successful), the acquired image control unit 303 may quantify the facial expression of that person. More specifically, the acquired image control unit 303 may calculate a "smile score" that quantifies the degree to which the applicant is smiling.

The acquired image control unit 303 acquires a smile score using a learning model that outputs a smile score when a facial image is input. The learning model is generated by machine learning using training data in which labels (smile scores) are assigned to image data. Any algorithm, such as a support vector machine, boosting, or neural network, can be used to generate the learning model. Note that well-known technologies can be used for the algorithms such as the support vector machine, so their explanation will be omitted.

The acquired image control unit 303 stores the calculated smile score in the applicant information database along with the image ID, etc.

Alternatively, the acquired image control unit 303 may quantify the natural facial expression of the album production applicant. For example, the acquired image control unit 303 may input image data into a learning model to calculate an "expression score" that quantifies the natural facial expression, and store the expression score in the applicant information database together with the image ID, etc.

The acquired image control unit 303 may store the size of the applicant's facial image shown in the image data in the applicant information database as applicant image information.The acquired image control unit 303 may calculate the area of the applicant's facial region and store that area in the applicant information database as applicant image information.

The acquired image control unit 303 may calculate the number of people who appear in the same image data as the album production applicant and store it in the applicant information database as applicant image information.The acquired image control unit 303 may also store the number of facial images of people other than the applicant extracted from the image data in the applicant information database.

The acquired image control unit 303 may quantify the quality of the image data as a "quality score" and store the quality score in the applicant information database as applicant image information. For example, the acquired image control unit 303 may perform a fast Fourier transform or the like on the image data to determine whether the image data is in focus, and set a low quality score for out-of-focus photos. Alternatively, the acquired image control unit 303 may calculate the brightness of the image data as the quality score, or may calculate the quality score from focus and brightness.

<Modification 2 of First Embodiment>
In the first embodiment, the server device 10 (album production unit 304) displays the image data in the order in which they were photographed when displaying a screen for selecting photos to be used in an album to an album production applicant who has completed a cycling tour. However, the album production unit 304 may determine the order in which the image data are presented to the applicant in a manner other than the order in which they were photographed.

For example, the album production unit 304 may arrange image data depicting the album production applicant based on the attributes of the applicant (e.g., gender, age, etc.). In other words, the album production unit 304 may determine the order in which the image data are displayed in a list based on the attributes of the applicant.

For example, for a male applicant, the album production unit 304 displays image data sequentially from the start point to the finish point. Conversely, for a female applicant, the album production unit 304 displays image data from the finish point back to the start point.

Alternatively, for older applicants, the album production unit 304 displays image data in order from the start point to the finish point. Conversely, for younger applicants, the album production unit 304 displays image data in the order of predetermined photo spots (most popular photo spots).

Older applicants tend to prefer photos with a large background, while younger applicants tend to prefer photos in which they are with friends, etc. In other words, applicant preferences are thought to be biased depending on attributes (gender, age), and the album production unit 304 determines the order in which image data is displayed to match these preferences.

The album production unit 304 may arrange and display (present to the applicant) image data in which the album creation applicant appears based on the smile score. That is, the album production unit 304 may determine the order in which the image data to be displayed is based on the smile score of the album creation applicant. For example, the album production unit 304 may display the image data in descending order of smile score (highest smile score first).

Alternatively, the album production unit 304 may determine the order in which image data is displayed based on the number of people appearing in the photo together with the album production applicant. For example, the album production unit 304 may display the image data in descending order of the number of people appearing in the photo together (in descending order of the number of people).

The album production unit 304 may determine the order in which image data is displayed based on the quality (quality score) of the image data. For example, the album production unit 304 may display image data in order of highest quality. Alternatively, the album production unit 304 may not present image data with a quality score lower than a predetermined value to the applicant. For example, the album production unit 304 may discard so-called out-of-focus photos.

The album production unit 304 may determine the display order based on the size of the applicant (size of the facial image) in the image data. For example, the album production unit 304 displays the image data in order of the size of the facial image (in order of close-up of the applicant).

As described above, in the first embodiment, the server device 10 collects image data of the album applicant from the photography terminals (signage 20, camera device 30) installed at various locations in the tourist destination. When the album applicant completes the cycling tour, the server device 10 provides the applicant with an interface that enables the applicant to select photos to be used in the album. When the server device 10 completes the album production, it executes a process to provide preferential treatment to the installer of the photography terminal that captured the image data selected by the album applicant. Specifically, the server device 10 pays all or a portion of the album production fee received from the user as a dividend to the installer. As a result, a large dividend is paid to a business that installs a photography terminal that captures image data selected by many users. Businesses that spend money to install photography terminals are given incentives according to the number of photos used in the album. In other words, providing attractive photos to users leads to profits for businesses that install photography terminals. Increased profits motivate businesses in tourist destinations to install photography terminals in locations where better photos can be taken. If better photos are taken and users are provided with more comprehensive albums, the attractiveness of tourist destinations will increase, leading to their revitalization.

In addition, tourists (cycling tour participants) can feel very satisfied at the end of the cycling tour because photos of their faces are compiled into an album, allowing them to keep a record of their sightseeing memories. Furthermore, because the camera device 30 can be installed at various locations in tourist spots with a high degree of freedom, the server device 10 can collect attractive photos taken at angles and timings that would be difficult for users to capture themselves, and use these photos as material for the album.

Second Embodiment
Next, the second embodiment will be described in detail with reference to the drawings.

In the first embodiment, we have described a case where the biometric information (facial image) of the applicant for album production is registered in the server device 10. In the second embodiment, we will describe a case where the biometric information of other people is registered in the server device 10 in addition to the applicant's biometric information. For example, the applicant registers facial images of tour companions, such as family members, friends, and acquaintances, in the server device 10 along with their own facial image.

When creating a selection screen for photos to be included in the electronic album, the server device 10 will, for example, prioritize displaying image data that shows more of the faces of accompanying persons registered with the applicant.

Note that the configuration of the information processing system according to the second embodiment can be the same as that of the first embodiment, and therefore the explanation corresponding to Figure 3 will be omitted. Furthermore, the processing configuration of the server device 10 and the like according to the second embodiment can also be the same as that of the first embodiment, and therefore the explanation thereof will be omitted.

The following will focus on the differences between the first and second embodiments.

When accepting an application for album production from a user, the application control unit 302 according to the second embodiment provides the user with an interface that allows the user to register facial images of accompanying persons. For example, the application control unit 302 displays a GUI such as that shown in FIG. 12 on the terminal 40.

When the "Register facial images of family, friends, etc." button shown in Figure 12 is pressed, the application control unit 302 displays a GUI for selecting facial images of accompanying persons who will accompany the applicant, and acquires the facial images of those accompanying persons.

The application control unit 302 generates features from the acquired facial images of each accompanying person, associates them with the applicant's user ID, biometric information, etc., and stores them in the applicant information database (see Figure 13). As shown in Figure 13, the storage unit 306 stores the biometric information of the album production applicant and the biometric information of at least one or more accompanying persons accompanying the album production applicant, in association with each other.

In the second embodiment, when an applicant for album production appears in image data acquired from a photography terminal, the acquired image control unit 303 counts how many of the applicant's accompanying persons appear in the same image data.

Specifically, the acquired image control unit 303 performs a matching process using facial images extracted from the image data, which are facial images of persons other than the applicant, and the features recorded in the applicant information database as biometric information of the applicant's companion. If the matching process is successful, the acquired image control unit 303 determines that the applicant's companion is captured in the image data.

The acquired image control unit 303 repeats the above-described matching process for each facial image in the image data containing the applicant, and counts the number of accompanying persons appearing in the photo with the applicant. The acquired image control unit 303 stores the number of accompanying persons as applicant image information in the applicant information database.

In this way, the acquired image control unit 303 performs a matching process using the biometric information extracted from the image data containing the album production applicant and the biometric information of the accompanying persons stored in association with the biometric information of the album production applicant. Through the matching process, the acquired image control unit 303 calculates the number of accompanying persons who appear simultaneously with the image data containing the album production applicant, and stores the calculated number of accompanying persons in association with the image data containing the album production applicant.

The album production unit 304 according to the second embodiment may arrange the image data in which the album production applicant appears based on the number of accompanying persons appearing in the image data. The album production unit 304 may determine the order in which the image data is to be presented to the album production applicant, depending on the number of accompanying persons appearing in the image data. For example, the album production unit 304 may give priority to (display first) the image data in which as many accompanying persons as possible appear.

The acquired image control unit 303 according to the second embodiment may calculate the smile scores of accompanying persons and store them as applicant image information, as in the modified example of the first embodiment. Furthermore, the album production unit 304 may arrange image data in which the album production applicant appears based on the smile score of the album production applicant and the smile scores of the accompanying persons. For example, the album production unit 304 may prioritize and display (list) image data in descending order of the number of accompanying persons appearing and the highest total smile scores of the applicant and accompanying persons.

In the second embodiment, as with the modified examples of the first embodiment, the order in which photos are presented to the album creation applicant may also be determined based on the quality of the image data, etc.

As described above, in the second embodiment, by registering the biometric information of not only the applicant for album creation but also their companions in the system, it is possible to collect photos that are more valuable to the applicant. As a result, the applicant for album creation can gain greater satisfaction.

[Third embodiment]
Next, a third embodiment will be described in detail with reference to the drawings.

In the third embodiment, a case will be described in which the server device 10 generates information regarding the preferences of a user (an applicant for album production). More specifically, in the third embodiment, a case will be described in which information such as photo spots preferred by young people and photo spots preferred by older people is generated.

Note that the configuration of the authentication system for the third embodiment can be the same as that of the first embodiment, so explanations corresponding to Figure 3 will be omitted.

The following will focus on the differences between the first to third embodiments.

Figure 14 is a diagram showing an example of the processing configuration (processing module) of the server device 10 according to the third embodiment. Referring to Figure 14, a preference information generation unit 307 has been added to the configuration of the server device 10 according to the first embodiment.

When the album creation unit 304 in the third embodiment sends an album to an applicant, it notifies the preference information generation unit 307 of the applicant's user ID and the shooting points of the image data used by the applicant in the album.

The preference information generation unit 307 is a means for generating information (preference information) regarding the user's (applicant's) preferences for photography points. For example, the preference information generation unit 307 generates preference information for each applicant's attribute, such as the number of applicants who selected photos taken at each photography point.

The preference information generation unit 307 manages the above preference information using a preference information database (see Figure 15). As shown in Figure 15, the preference information database stores the number of applicants who have used photos taken at each shooting point in their albums, for each applicant's attribute (e.g., by age group). Note that the preference information database shown in Figure 15 is an example and is not intended to limit the items to be stored.

When the preference information generation unit 307 obtains the user ID of a user who has completed album production from the album production unit 304, it searches the applicant information database using the user ID as a key to identify the corresponding applicant.

The preference information generation unit 307 reads the attributes (gender, age) of the identified applicant from the applicant information database. The preference information generation unit 307 reflects the applicant's attributes and the shooting points used by the applicant in the album in the preference information database.

For example, if a teenage applicant includes in their album a photo taken at a starting point, the preference information generation unit 307 adds "1" to the setting value of the starting point field for teenagers in the preference information database and updates the preference information database.

The preference information database shown in Figure 15 stores the number of applicants who selected photos at each shooting point by age group. The preference information database may also store the number of applicants who selected photos at each shooting point by gender, or by gender and age group.

Alternatively, if the user's nationality, etc. can be obtained when accepting an album application, the preference information generation unit 307 may generate preference information based on the number of photo selectors at each shooting point for each nationality.

When a staff member of a tourist association or the like requests preference information, the preference information generation unit 307 provides the staff member with preference information such as that shown in Figure 15. For example, the preference information generation unit 307 transmits the preference information to a terminal used by the staff member, prints the preference information, or displays the preference information on an LCD display or the like.

By checking the preference information, staff can understand the preferences of each attribute. For example, in the example in Figure 15, it can be seen that relatively young people prefer cliffs as photo spots, while relatively older people prefer lakeside locations as photo spots.

Tourist destination operators can refer to the preference information to understand applicants' preferences and use it as a reference when installing new photography devices. Alternatively, when a tourism association rolls out an album production system at another tourist destination, it can refer to the preference information to decide where to install photography devices. For example, in tourist destinations visited by many elderly people, many photography devices are installed in relatively quiet places such as along lakes. Or, in tourist destinations popular with young people, many photography devices are installed in thrilling locations such as on cliffs.

As described above, the server device 10 according to the third embodiment generates preference information regarding the photography points of an album production applicant based on the installation location of the photography terminal that provided the image data used in the album by the album production applicant. For example, the server device 10 generates preference information for each attribute of the album production applicant. As a result, staff at tourism associations and the like can learn generalized information about tourists (e.g., places preferred by young people, places preferred by older people). Staff and the like can also utilize the knowledge gained from the preference information to expand the album production system disclosed herein to other regions.

Next, we will explain the hardware of each device that makes up the information processing system. Figure 16 is a diagram showing an example of the hardware configuration of server device 10.

The server device 10 can be configured as an information processing device (so-called a computer) and has the configuration shown in Figure 16. For example, the server device 10 has a processor 311, memory 312, an input/output interface 313, a communication interface 314, etc. The components such as the processor 311 are connected by an internal bus or the like and are configured to be able to communicate with each other.

However, the configuration shown in FIG. 16 is not intended to limit the hardware configuration of the server device 10. The server device 10 may include hardware not shown, and may not have an input/output interface 313, if necessary. Furthermore, the number of processors 311, etc. included in the server device 10 is not intended to be limited to the example shown in FIG. 16; for example, the server device 10 may include multiple processors 311.

Processor 311 is a programmable device such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), or DSP (Digital Signal Processor). Alternatively, processor 311 may be a device such as an FPGA (Field Programmable Gate Array) or ASIC (Application Specific Integrated Circuit). Processor 311 executes various programs including an operating system (OS).

Memory 312 is RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc. Memory 312 stores the OS program, application programs, and various data.

The input/output interface 313 is an interface for a display device and an input device (not shown). The display device is, for example, an LCD display. The input device is, for example, a device that accepts user operations such as a keyboard or mouse.

The communication interface 314 is a circuit, module, etc. that communicates with other devices. For example, the communication interface 314 includes a NIC (Network Interface Card), etc.

The functions of the server device 10 are realized by various processing modules. The processing modules are realized, for example, by the processor 311 executing a program stored in the memory 312. The program can also be recorded on a computer-readable storage medium. The storage medium can be a non-transitory medium such as a semiconductor memory, a hard disk, a magnetic recording medium, or an optical recording medium. In other words, the present invention can also be embodied as a computer program product. The program can also be downloaded via a network or updated using a storage medium that stores the program. Furthermore, the processing modules may be realized by a semiconductor chip.

Signage 20, etc. can also be configured using an information processing device, just like server device 10, and its basic hardware configuration is no different from that of server device 10, so a description will be omitted. For example, signage 20 may be equipped with a camera device for photographing users.

The server device 10, which is an information processing device, is equipped with a computer, and the functions of the server device 10 can be realized by having the computer execute a program. The server device 10 also executes the control method of the server device 10 using the program.

[Modification]
The configuration, operation, etc. of the information processing system described in the above embodiment are merely examples, and are not intended to limit the configuration, etc. of the system.

In the above embodiment, we have described a case where a user applies for album production to a tourist association or the like. However, applications for album production are not limited to this form, and album production may also be included in a sightseeing tour package. Specifically, a business model may be created in which album production is offered as an option for a sightseeing tour, and users can obtain the album by paying an additional fee.

In the above embodiment, we have described creating an album for users who have participated in a cycling tour. However, it goes without saying that the target audience for album creation is not limited to participants in cycling tours. For example, the target audience for album creation may be ordinary people who tour tourist spots on foot.

In the above embodiment, the server device 10 was described as producing an electronic album (digital photo album). However, the server device 10 may also produce an album consisting of ordinary photographs (image data printed on paper media). In this case, the server device 10 may print the album from a terminal installed in a hotel or the like, or may request the album production from a printing company.

In the above embodiment, the server device 10 was described as giving preferential treatment to the installation company of the photography device that provided the photos used in the album by paying a larger share of the album production costs. However, the method of giving preferential treatment to the installation company is not limited to the distribution of album production costs, and other methods may also be used. For example, the server device 10 may give preferential treatment to the installation company by posting an advertisement for the installation company on the tourism association's homepage.

In the above embodiment, the server device 10 was described as displaying a list of image data on the terminal 40 of the album production applicant. However, the server device 10 may also display the list of image data on a signage 20 or a terminal installed in a hotel. For example, the list of image data may be displayed on a signage 20-2 installed at the finish line.

In the above embodiment, the case where the album creation applicant selects the image data to be used in the album was described. However, the server device 10 may select the image data to be used in the album and create the album. For example, the server device 10 may create an album that is likely to be accepted by the album creation applicant based on the user's attributes, smile score, number of accompanying persons, etc., and present it to the user. If the user rejects the presented album, the server device 10 may present the user with an album created based on different criteria. Alternatively, if the user rejects the presented album, the server device 10 may provide an interface that allows the user to modify the presented album. In other words, the server device 10 may display a list of images selected and unselected for the presented album to the user, and display a GUI on the terminal 40 that allows the user to select whether to include or exclude images from the list in the album.

In the above embodiment, it was explained that the album production applicant registers the number of photos to be included in the album as album production information in the system. Here, the album production applicant may register different options (requests) in addition to the number of photos in the system. For example, the applicant may input the album format, whether or not to decorate the photos, the album format, etc. as album production information into the server device 10.

Alternatively, the server device 10 may not need to obtain album production information from the album production applicant. For example, the server device 10 may set the number of photos to be used in the album to a predetermined number.

When substantially identical photos are obtained from a photographing terminal, the server device 10 (acquired image control unit 303) may keep one photo and delete the others. For example, when the server device 10 acquires multiple pieces of image data showing the same person from the same photographing terminal, it may determine that substantially identical image data have been acquired, keep one piece of representative image data, and delete the other pieces of image data.

In the above embodiment, the album production fee is paid in advance, but the album production fee may also be paid later. Alternatively, the server device 10 may refund the album production fee if the desired number of photographs cannot be prepared by the album creation applicant.

In the above embodiment, it was explained that an album is created when the user finishes a cycling tour. However, the timing at which an album is created is not limited to the end of a cycling tour. For example, an album may be created when images are taken by the last camera device 30 installed on the cycling course, or when a predetermined date and time arrives. Alternatively, the user may complete the procedure at a terminal installed in a predetermined location or point (e.g., a hotel or airport), and the album may be created when a request for album creation is made from that terminal. Alternatively, if the server device 10 receives a request for album creation from an album creation applicant even during the cycling tour, the server device 10 may start album creation for that applicant. In other words, a user can check the images taken for the album and apply for album creation even during the cycling tour.

In the above embodiment, it was explained that users who wish to have an album created must apply for album creation in advance and register their biometric information in advance. However, the server device 10 can also provide album creation services to users who have not applied in advance. Specifically, the server device 10 acquires facial images captured by a predetermined terminal (a kiosk terminal installed in a rest area, etc.) and manages (stores) the facial images captured by the predetermined terminal as facial images of the person for whom the album is to be created. The server device 10 then compares the facial images captured by the predetermined terminal with the facial images captured by the photographing terminal, and if they match, stores the facial image as the facial image of the person for whom the album is to be created. For example, if the server device 10 has stored a facial image (facial image of the person for whom the album is to be created) that matches a facial image captured by signage 20-2 or the like installed at the finish line of a cycling tour, it displays a list of facial images of that person on signage 20-2. If a user who has checked the images displayed on signage 20-2 wishes to purchase an album, the user can obtain the album by selecting the photos to be used in the album on signage 20-2 and completing the necessary procedures such as payment. After the facial image is captured at a predetermined terminal (kiosk terminal), the server device 10 stores the facial image captured by the photographing terminal in association with the facial image captured by the kiosk terminal, thereby making it possible to provide the album production service to users who have not applied in advance.

Alternatively, the server device 10 may manage (store) the facial images of each user captured by a photography terminal as the facial images of the album production target without any prior procedures. Each time a new facial image is extracted from image data obtained from the photography terminal, the server device 10 manages the user corresponding to the new facial image as the album production target. As described above, if the server device 10 stores a facial image (facial image of the album production target) that matches a facial image captured by signage 20-2 or the like installed at the finish line of the cycling tour, it displays a list of the facial images of that target on signage 20-2. Users can purchase the album by completing the necessary procedures on signage 20-2. The server device 10 prevents resource waste by deleting the facial images of the album production target periodically or at a predetermined timing (e.g., when the date changes).

The server device 10 performs biometric authentication on the user's facial images taken with each photographing device and sorts each photograph into groups with matching facial image similarities. That is, the server device 10 classifies and stores facial images (photos including faces) taken with each photographing device by user. Furthermore, when a user inputs a desire to purchase an album at a specified terminal (a terminal capable of handling album purchase procedures) installed at a finish line or the like, the specified terminal takes a facial image of the person wishing to purchase the album and transmits the acquired facial image to the server device 10. The server device 10 identifies the group corresponding to the acquired facial image based on the similarity of the facial image acquired through biometric authentication. The server device 10 presents the user with a list of photos belonging to the identified group. The user selects all or some of the photos from the presented list. The server device 10 may create an album using the selected photos.

In the above embodiment, the applicant information database is configured within the server device 10, but the database may also be configured on an external database server, etc. In other words, some of the functions of the server device 10 may be implemented on another server. More specifically, the above-described "album production unit (album production means)," "preferential treatment processing execution unit (preferential treatment processing execution means)," etc. may be implemented on any of the devices included in the system.

There are no particular limitations on the format of data transmission between each device (server device 10, signage 20, etc.), but data transmitted and received between these devices may be encrypted. Users' biometric information, etc. is transmitted and received between these devices, and in order to properly protect this information, it is desirable that encrypted data be transmitted and received.

In the flow charts (flowcharts, sequence diagrams) used in the above explanation, multiple steps (processes) are listed in order, but the order in which the steps are executed in the embodiments is not limited to the order listed. In the embodiments, the order of the steps shown in the diagrams can be changed to the extent that it does not interfere with the content, for example, by executing each process in parallel.

The above embodiments have been described in detail to facilitate understanding of the present disclosure, and it is not intended that all of the configurations described above are required. Furthermore, when multiple embodiments are described, each embodiment may be used alone or in combination. For example, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of one embodiment with another configuration.

The above explanation makes clear the industrial applicability of the present invention, and the present invention is particularly applicable to information processing systems that provide album production services to users.

Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.
[Appendix 1]
a storage unit for storing biometric information of an applicant for album production;
an acquired image control unit that receives image data from at least one or more photographing terminals, determines whether or not the photo album production applicant appears in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the photo album production applicant appears;
an album production section that allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is photographed, and produces the album using the image data selected by the album production applicant;
a preferential treatment processing execution unit that performs processing to give preferential treatment to an entity that installed the photographing terminal that provided the image data used in the album;
A server device comprising:
[Appendix 2]
The server device described in Appendix 1, wherein the preferential treatment processing execution unit determines the distribution destination of the album production fee paid by the album production applicant so as to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.
[Appendix 3]
The server device according to claim 1 or 2, wherein the album production unit arranges image data in which the album production applicant appears in a predetermined order, and enables the album production applicant to select image data to be used in the album.
[Appendix 4]
The server device according to Supplementary Note 3, wherein the album production section arranges image data in which the album production applicant appears based on attributes of the album production applicant.
[Appendix 5]
the acquired image control unit calculates a smile score indicating the degree of smile of the photo album production applicant appearing in the image data, and stores the calculated smile score in association with the image data in which the photo album production applicant appears;
5. The server device according to claim 3, wherein the album production unit arranges image data in which the album production applicant appears based on the smile score.
[Appendix 6]
the storage unit stores biometric information of the album production applicant and biometric information of at least one or more accompanying persons accompanying the album production applicant in association with each other;
the acquired image control unit calculates the number of accompanying persons appearing in the image data of the photo album applicant by performing a matching process using biometric information extracted from the image data of the photo album applicant and biometric information of accompanying persons stored in association with the biometric information of the photo album applicant, and stores the image data of the photo album applicant in association with the calculated number of accompanying persons;
The server device according to any one of Supplementary Notes 3 to 5, wherein the album production section arranges the image data in which the album production applicant appears based on the number of accompanying persons.
[Appendix 7]
The server device according to claim 6, wherein the album production unit arranges image data in which the album production applicant appears based on the smile score of the album production applicant and the smile scores of the accompanying persons.
[Appendix 8]
A server device as described in any one of Appendices 1 to 7, further comprising a preference information generation unit that generates preference information regarding the photography points of the album production applicant based on the installation location of the photography terminal to which the album production applicant provided the image data used in the album.
[Appendix 9]
The server device according to claim 8, wherein the preference information generating unit generates the preference information for each attribute of the album production applicant.
[Supplementary Note 10]
The server device according to any one of appendices 1 to 9, wherein the photographing terminal is a signage or camera device installed at a tourist spot.
[Appendix 11]
11. The server device according to any one of claims 1 to 10, wherein the biometric information is a facial image or a feature amount generated from the facial image.
[Appendix 12]
At least one photography device installed at a photography point in a tourist spot;
a server device;
Including,
The server device
a storage unit for storing biometric information of an applicant for album production;
an acquired image control unit that receives image data from the at least one or more photographing terminals, determines whether the photo album production applicant appears in the received image data by performing a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the photo album production applicant appears;
an album production section that allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is photographed, and produces the album using the image data selected by the album production applicant;
a preferential treatment processing execution unit that performs processing to give preferential treatment to an installation entity of the photography terminal that provided the image data used in the album;
A system comprising:
[Appendix 13]
A server device including a storage unit for storing biometric information of an album production applicant,
receiving image data from at least one or more photographing terminals, determining whether or not the photo album production applicant is photographed in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and storing information relating to the image data in which the photo album production applicant is photographed;
allowing the applicant for album production to select image data to be used in the album from at least one image data in which the applicant for album production is photographed, and producing the album using the image data selected by the applicant for album production;
A control method for a server device that performs processing to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album.
[Appendix 14]
A computer installed in a server device, which has a storage unit for storing biometric information of an applicant for album production,
receiving image data from at least one or more photographing terminals, determining whether or not the photo album production applicant is included in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and storing information regarding the image data in which the photo album production applicant is included;
a process of allowing the applicant for album production to select image data to be used in the album from at least one image data in which the applicant for album production is photographed, and producing the album using the image data selected by the applicant for album production;
A process of giving preferential treatment to the entity that installed the photographing terminal that provided the image data used in the album;
A computer-readable storage medium that stores a program for executing the above.

The disclosures of the above cited prior art documents are incorporated herein by reference. While embodiments of the present invention have been described above, the present invention is not limited to these embodiments. Those skilled in the art will understand that these embodiments are merely illustrative and that various modifications are possible without departing from the scope and spirit of the present invention. In other words, the present invention naturally includes various modifications and alterations that may be made by those skilled in the art in accordance with the entire disclosure, including the scope of the claims, and the technical concepts.

10 Server device 20 Signage 20-1 Signage 20-2 Signage 20-3 Signage 20-4 Signage 30 Camera device 30-1 Camera device 30-2 Camera device 30-3 Camera device 40 Terminal 100 Server device 101 Memory unit 102 Acquired image control unit 103 Album production unit 104 Preferential treatment processing execution unit 201 Communication control unit 202 Message output unit 203 Photography control unit 204 Memory unit 301 Communication control unit 302 Application control unit 303 Acquired image control unit 304 Album production unit 305 Preferential treatment processing execution unit 306 Memory unit 307 Preference information generation unit 311 Processor 312 Memory 313 Input/output interface 314 Communication interface

Claims (14)

a storage unit for storing biometric information of an applicant for album production;
an acquired image control unit that receives image data from at least one or more photographing terminals, determines whether or not the photo album production applicant appears in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the photo album production applicant appears;
an album production section that allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is photographed, and produces the album using the image data selected by the album production applicant;
a preferential treatment processing execution unit that performs processing to give preferential treatment to an installation entity of the photography terminal that provided the image data used in the album;
Equipped with
The preferential treatment processing execution unit is a server device that gives preferential treatment to the entity that installed the photography terminal that provided the image data used in the album by posting an advertisement about the entity that installed the photography terminal that provided the image data used in the album on a homepage . The server device of claim 1, wherein the preferential treatment processing execution unit determines the distribution destination of the album production fee paid by the album production applicant so as to give preferential treatment to the entity that installed the photography terminal that provided the image data used in the album. The server device of claim 1 or 2, wherein the album production unit arranges image data in which the album production applicant appears in a predetermined order and allows the album production applicant to select image data to use in the album. The server device of claim 3, wherein the album production unit arranges image data depicting the album production applicant based on the attributes of the album production applicant. the acquired image control unit calculates a smile score indicating the degree of smile of the photo album production applicant appearing in the image data, and stores the calculated smile score in association with the image data in which the photo album production applicant appears;
5. The server device according to claim 3, wherein the album creating section arranges image data in which the applicant for album creation appears based on the smile score. the storage unit stores biometric information of the album production applicant and biometric information of at least one or more accompanying persons accompanying the album production applicant in association with each other;
the acquired image control unit calculates the number of accompanying persons appearing in the image data of the photo album applicant by performing a matching process using biometric information extracted from the image data of the photo album applicant and biometric information of accompanying persons stored in association with the biometric information of the photo album applicant, and stores the image data of the photo album applicant in association with the calculated number of accompanying persons;
6. The server device according to claim 3, wherein the album creating section arranges the image data in which the applicant for album creation appears based on the number of accompanying persons. The server device of claim 6, wherein the album production unit arranges image data of the album production applicant based on the smile score of the album production applicant and the smile scores of the accompanying persons. The server device described in any one of claims 1 to 7 further comprises a preference information generation unit that generates preference information regarding the photography points of the album production applicant based on the installation location of the photography terminal that provided the image data used in the album by the album production applicant. The server device of claim 8, wherein the preference information generation unit generates the preference information for each attribute of the album creation applicant. The server device described in any one of claims 1 to 9, wherein the photographing terminal is a signage or camera device installed at a tourist spot. The server device described in any one of claims 1 to 10, wherein the biometric information is a facial image or features generated from the facial image. At least one photography device installed at a photography point in a tourist spot;
a server device;
Including,
The server device
a storage unit for storing biometric information of an applicant for album production;
an acquired image control unit that receives image data from the at least one or more photographing terminals, determines whether the photo album production applicant appears in the received image data by performing a matching process using the stored biometric information and biometric information extracted from the received image data, and stores information regarding the image data in which the photo album production applicant appears;
an album production section that allows the album production applicant to select image data to be used in the album from at least one image data in which the album production applicant is photographed, and produces the album using the image data selected by the album production applicant;
a preferential treatment processing execution unit that performs processing to give preferential treatment to an installation entity of the photography terminal that provided the image data used in the album;
Equipped with
The preferential treatment processing execution unit gives preferential treatment to the entity that installed the photography terminal that provided the image data used in the album by posting an advertisement about the entity that installed the photography terminal that provided the image data used in the album on a homepage . A server device including a storage unit for storing biometric information of an album production applicant,
receiving image data from at least one or more photographing terminals, determining whether or not the photo album production applicant is photographed in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and storing information relating to the image data in which the photo album production applicant is photographed;
allowing the applicant for album production to select image data to be used in the album from at least one image data in which the applicant for album production is photographed, and producing the album using the image data selected by the applicant for album production;
A control method for a server device that performs processing to give preferential treatment to an installation entity of the photography terminal that provided image data used in the album ,
The process of giving preferential treatment to the entity that installed the photographing terminal is a control method for a server device, in which an advertisement about the entity that installed the photographing terminal that provided the image data used in the album is posted on a homepage, thereby giving preferential treatment to the entity that installed the photographing terminal that provided the image data used in the album . A computer installed in a server device, which has a storage unit for storing biometric information of an applicant for album production,
receiving image data from at least one or more photographing terminals, determining whether or not the photo album production applicant is included in the received image data through a matching process using the stored biometric information and biometric information extracted from the received image data, and storing information regarding the image data in which the photo album production applicant is included;
a process of allowing the applicant for album production to select image data to be used in the album from at least one image data in which the applicant for album production is photographed, and producing the album using the image data selected by the applicant for album production;
A process of giving preferential treatment to the entity that installed the photographing terminal that provided the image data used in the album;
A program for executing
The process of giving preferential treatment to the entity that installed the photographing terminal is a program that gives preferential treatment to the entity that installed the photographing terminal that provided the image data used in the album by posting an advertisement about the entity that installed the photographing terminal that provided the image data used in the album on a homepage .