JP7724481B2 - Terminal and program - Google Patents

Description

This disclosure relates to a terminal and a program.

In recent years, the use of artificial intelligence (hereinafter sometimes referred to as AI) has led to the collection of a variety of data. For example, behavioral data on human behavior is being collected using image data from cameras installed around town and in stores. By having AI learn from the collected behavioral data, it becomes possible, for example, to predict things like crowds and purchasing trends, and to provide real-time recommendations that match the user's own preferences.

Patent document 1 discloses a device that allows users to select the type of data to provide to a business operator.

Japanese Patent Application Laid-Open No. 2018-25938

Incidentally, for services that use cameras to collect people's behavioral data and provide it to various businesses, it is important to have a system that allows people whose behavioral data is collected to easily understand the content of the collected behavioral data and how it will be handled.

Non-limiting examples of the present disclosure contribute to providing an information processing device, data provision method, and program that allows people whose behavioral data is collected to easily understand how to handle the behavioral data in a service that collects behavioral data and provides it to businesses.

An information processing device according to one embodiment of the present disclosure includes a receiving unit that receives facial image data from a camera, a control unit that collects behavioral data based on the facial image data, and a transmitting unit that transmits the behavioral data to a business operator's server, and the control unit transmits to the terminal first screen data for accepting consent to the business operator providing services using the behavioral data, and second screen data for accepting consent to the business operator's use of the behavioral data.

A data provision method according to one embodiment of the present disclosure includes receiving facial image data from a camera, collecting behavioral data based on the facial image data, transmitting the behavioral data to a business operator's server, and transmitting to a terminal first screen data for accepting consent to the business operator providing services using the behavioral data, and second screen data for accepting consent to the business operator's use of the behavioral data.

A program according to one embodiment of the present disclosure causes a computer to execute the following processes: receive facial image data from a camera, collect behavioral data based on the facial image data, transmit the behavioral data to a business operator's server, and transmit to a terminal first screen data for accepting consent to the business operator providing services using the behavioral data, and second screen data for accepting consent to the business operator's use of the behavioral data.

Note that these comprehensive or specific aspects may be realized as a system, device, method, integrated circuit, computer program, or recording medium, or as any combination of a system, device, method, integrated circuit, computer program, and recording medium.

According to one embodiment of the present disclosure, in a service that collects behavioral data and provides it to a business, the person whose behavioral data is collected can easily understand how the behavioral data is handled. Furthermore, the person whose behavioral data is collected can check the contents of the collected data themselves, and manage and provide the behavioral data themselves, including requesting deletion as necessary.

Further advantages and benefits of one embodiment of the present disclosure will become apparent from the specification and drawings. While such advantages and/or benefits may be provided by some of the embodiments and features described in the specification and drawings, not all of them necessarily need to be provided to obtain one or more identical features.

FIG. 1 is a diagram illustrating an overview of a data providing service according to an embodiment of the present disclosure. A diagram showing an example of the configuration of a data provision system that realizes a data provision service Diagram showing an example of a server block configuration An example of the screen for the first consent step of the two-step consent method A diagram showing an example of a screen for selecting and changing the recipient of behavioral data An example of the screen for the second consent step in the two-step consent method A diagram showing an example of a screen for selecting and changing behavioral data to be provided to a provider FIG. 10 is a diagram showing an example of the configuration of user registration data stored in the server; FIG. 10 is a diagram showing an example of the configuration of destination-related data stored in a server; FIG. 10 is a diagram showing an example of the configuration of behavior data stored in a server; A diagram illustrating an example of the operation of the server in collecting and providing behavioral data. Flowchart showing an example of operations related to user registration and user settings on a server Flowchart showing an example of the operation of the server in providing behavioral data

Embodiments of the present disclosure will be described in detail below, with appropriate reference to the drawings. However, more detailed explanations than necessary may be omitted. For example, detailed explanations of matters that are already well-known or duplicate explanations of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

<Data provision service overview>
1 is a diagram illustrating an overview of a data provision service according to an embodiment of the present disclosure, showing a user 1, a terminal 2, a data provision PF (Platform) 3, cameras 4a to 4e, businesses 5a to 5c, and IC card systems 6a to 6c.

Using terminal 2, user 1 accesses data provider PF 3 and registers for the data provision service provided by data provider PF 3. At this time, user 1 registers personal data with data provider PF 3. Personal data is personal information that user 1 can enter, such as name, age, gender, address, date of birth, financial accounts, credit cards, and facial image. Behavioral data is data that indicates user 1's behavior, and specific examples include product purchase history, travel route information, entry and exit information, boarding and disembarking stations, visited facilities, etc.

Using terminal 2, user 1 also selects (specifies) which of user 1's behavioral data may be provided to data provision PF 3 and to which of business operators 5a-5c the data may be provided. In other words, user 1 can select the business operators 5a-5c to which user 1's behavioral data may be provided. Terminal 2 may be, for example, a device such as a smartphone, tablet terminal, or personal computer.

The data provision PF3 shown in FIG. 1 uses facial recognition on captured images (hereinafter referred to as facial image data) containing the user's face captured by cameras 4a-4e to authenticate people (users) previously registered in the data provision PF3, collect the people's (users') behavioral data, and provide the collected behavioral data that the people (users) have authorized to be provided to businesses 5a-5c (hereinafter referred to as the data provision service). While facial recognition is used to authenticate the user, authentication methods other than facial recognition may also be used. In such cases, the captured images taken by the cameras do not need to include the user's face; any image that allows a person to be recognized will suffice. While a camera is used to collect behavioral data, sensors capable of collecting behavioral data may also be used. The data provision PF3 may be managed by a business (not shown) different from businesses 5a-5c that receive the data provision service.

The business managing the data provider PF3 recruits users who are willing to collect behavioral data, for example, using cameras 4a to 4e. Users whose behavioral data may be collected register with the data provision service provided by the data provider PF3. As described above, registration involves entering the necessary personal data. Recruitment may also be initiated when users begin using a service provided by the business managing the data provider PF3. When registering for a data provision service in conjunction with a service, convenience can be ensured by allowing the user to provide the data to the target service at the same time as registration. User 1 shown in Figure 1 represents a user who has registered for the data provision service provided by the data provider PF3.

Data provision PF3 is a platform that realizes data provision services. For example, Data provision PF3 authenticates User 1 based on facial image data of User 1 captured by cameras 4a-4e, and collects (acquires) behavioral data of User 1. Specifically, Data provision PF3 authenticates User 1 based on facial image data of User 1 captured by cameras 4a-4e, and collects behavioral data such as User 1's movements between stations, routes traveled within stations and on streets, and purchases of items at stores.

More specifically, by authenticating user 1 from facial image data captured by a camera installed at the ticket gate for paying fares, information on the stations user 1 entered and exited can be collected; by authenticating user 1 from facial image data captured by cameras installed inside stations or on the streets, user 1's travel route can be collected; and by authenticating user 1 from facial image data captured by a camera installed at a store for facial payment, information on user 1's purchases can be collected.

The data providing PF3 transmits the collected behavioral data of user 1 to the operators 5a to 5c selected by user 1. For example, if user 1 selects operators 5a and 5b, the data providing PF3 transmits the collected behavioral data of user 1 to operators 5a and 5b.

Cameras 4a-4e are installed in various locations and capture images of users. Cameras 4a-4e transmit facial image data of the captured user to Data Provision PF 3. Data Provision PF 3 performs facial authentication using the received facial image data. Cameras are installed at transportation ticket gates, venue entrances and exits, checkpoints and other passing points, in front of cash registers, store entrances and exits, and other locations where people move around. These cameras may also be installed at gates that manage entry and exit.

For example, camera 4a is installed at a ticket gate and captures images of users passing through the gate. Camera 4a then transmits the captured facial image data of the user to data provision PF3.

For example, camera 4b is installed near a cash register in a store or the like and captures a picture of a user making a payment. Camera 4b then transmits the captured facial image data of the user to the data provision PF3.

For example, camera 4c is installed near the entrance of a store or the like and captures images of users entering or leaving the store. Camera 4c then transmits the captured facial image data of the users to data provision PF3.

For example, camera 4d is installed on a structure such as a building or a utility pole, and captures images of users passing through corridors or streets within the building. Camera 4d transmits facial image data of the captured user to data provision PF3.

For example, camera 4e is installed at an entrance/exit management gate at the entrance/exit of a place such as an amusement park or theme park, and captures images of users passing through the gate. Camera 4e sends the captured image data of the user's face to the entrance/exit management system and also to the data provision PF3.

In this way, by installing cameras 4a-4e in various locations, the data providing PF 3 can collect behavioral data of users 1 registered in the data providing PF 3 over a wide range. Note that cameras 4a-4e may also be surveillance cameras.

Facial image data of users captured by cameras is collected, but it is not limited to facial image data. User behavior data can also be collected by performing person detection and movement analysis on images captured by cameras. For example, by tracking User 1 identified from facial image data in images captured by multiple cameras, behavioral data such as User 1's movement can also be collected.

Businesses 5a-5c are provided with behavioral data of user 1 registered in data provision PF3 by data provision PF3. However, businesses 5a-5c are only provided with user 1's behavioral data if selected by user 1 as a recipient of behavioral data. Businesses 5a-5c may be, for example, businesses that operate amusement parks, commercial facilities, accommodation facilities, retail stores, etc.

User 1 can select the specific types of behavioral data to provide to each recipient, and only the selected types of data will be provided to recipient businesses 5a-5c.

Businesses 5a to 5c may provide O2O (one-to-one) services to user 1 using the behavioral data of user 1 provided by data provider PF3. For example, businesses 5a to 5c may input the behavioral data of user 1 provided by data provider PF3 into AI and provide services tailored to user 1 (individual). Businesses 5a to 5c may also use the behavioral data of user 1 provided by data provider PF3 to determine the location of a store or the like. For example, businesses 5a to 5c may input the behavioral data of user 1 (which may be behavioral data of multiple people) provided by data provider PF3 into AI and determine the optimal location for a store.

IC card systems 6a-6c are, for example, transportation IC card systems managed by transportation companies such as train, bus, or airplane companies. IC card systems 6a-6c work in conjunction with cameras installed near user entrance/exit points, such as ticket gates, to detect users entering and exiting the premises and transmit the detected data to data providing PF3. Data providing PF3 collects behavioral data of user 1 based on the entrance/exit detection data and facial image data from cameras installed near the entrance/exit points. In other words, data providing PF3 may work in conjunction with other systems, such as IC card systems 6a-6c, to collect behavioral data of user 1. In addition to transportation IC card systems, data may also be collected by working in conjunction with a wide range of systems, such as entrance/exit management system monitoring systems.

As explained below, the data provision service shown in Figure 1 obtains two consents from user 1. The first consent is for the data provision service in data provision PF3. The second consent is for the use of behavioral data by the provider 5a-5c selected by user 1.

Furthermore, as explained below, user 1 can select the type of behavioral data to provide to businesses 5a-5c. For example, user 1 can select the type of behavioral data to provide to businesses 5a-5c, such as behavioral data related to station ticket gate entry/exit logs, behavioral data related to travel routes within a station, or behavioral data related to payments within a store.

As will be explained below, users 1 who provide behavioral data are given benefits such as points and coupons. By being given benefits, users 1 have an incentive to register with the data provision service shown in Figure 1. Furthermore, businesses that manage the data provision PF 3 can more easily recruit users whose behavioral data they are willing to collect. Furthermore, by increasing the number of users whose behavioral data they are willing to collect, businesses that manage the data provision PF 3 can increase the number of businesses that want to receive user behavioral data.

Data may also be referred to as information. User 1's behavioral data may be considered personal information. The business that manages the data provision PF3 may be different from the business that provides the data provision service. In the above, it was stated that the business that manages the data provision PF3 is different from businesses 5a to 5c, but one or more of businesses 5a to 5c may manage the data provision PF3. In addition, the facial image data received from cameras 4a to 4c may also include images of parts of the body other than the face.

<System configuration example>
Fig. 2 is a diagram showing an example of the configuration of a data provision system 10 that realizes a data provision service. In Fig. 2, the same components as in Fig. 1 are assigned the same reference numerals. As shown in Fig. 2, the data provision system 10 has cameras 4a to 4e and a server 11. The server 11 realizes the function of the data provision PF 3 shown in Fig. 1. The server 11 may also be called an information processing device.

In addition to the data provision system 10, Figure 2 also shows a terminal 2 used by user 1, a server 21a managed by business operator 5a, a server 21b managed by business operator 5b, and a server 21c managed by business operator 5c. In addition to the data provision system 10, Figure 2 also shows a server 22a constituting IC card system 6a, a server 22b constituting IC card system 6b, and a server 22c constituting IC card system 6c.

Server 11 is connected to cameras 4a-4e via a network such as a local area network (LAN), the Internet, or a wireless network such as a mobile phone network. Server 11 receives facial image data of user 1 captured by cameras 4a-4e via the network.

Server 11 is connected to servers 21a-21c via a network such as a LAN, the Internet, or a wireless network. Server 11 transmits collected behavioral data of user 1 to servers 21a-21c via the network.

Server 11 is connected to servers 22a-22c via a network such as a LAN, the Internet, or a wireless network. Server 11 receives behavioral data of user 1 via the network.

<Server block configuration example>
3 is a diagram showing an example of a block configuration of the server 11. As shown in FIG. 3, the server 11 includes a processor 31, a RAM (Random Access Memory) 32, a HDD (Hard Disk Drive) 33, a communication interface 34, and a bus 35.

The processor 31 controls the entire server 11. The processor 31 may be, for example, a CPU (Central Processing Unit). The processor 31 is connected to the RAM 32, HDD 33, and communication interface 34 via a bus 35.

By executing the program, the processor 31 functions as the control unit 31a. The control unit 31a implements the functions of the data provision PF3 described in Figure 1 and provides the data provision service.

RAM 32 temporarily stores the OS (Operating System) program and application programs executed by processor 31. RAM 32 also temporarily stores various data required for processing by CPU 31. Note that RAM 32 is a storage device that temporarily stores programs and the like, and is not limited to RAM. For example, RAM 32 may be a storage device such as DRAM (Dynamic RAM).

The HDD 33 stores the OS, application programs, etc. The HDD 33 also stores various data necessary for processing by the CPU 31. Note that the HDD 33 is a storage device that stores programs, etc., and is not limited to an HDD. For example, the HDD 33 may be a storage device such as an SSD (Solid State Drive).

The communication interface 34 communicates with the cameras 4a-4e via networks such as a LAN, the Internet, and a mobile phone network. The communication interface 34 also communicates with the servers 21a-21c and 22a-22c via networks such as a LAN, the Internet, and a mobile phone network.

Servers 21a-21c and servers 22a-22c may also have blocks similar to those shown in Figure 3.

<Handling of behavioral data>
The handling of behavioral data will now be described. Behavioral data is personal information of user 1. Therefore, server 11 receives (acquires) consent from user 1 regarding the handling of user 1's behavioral data via terminal 2. When consent is obtained from user 1, server 11 collects user 1's behavioral data. Furthermore, server 11 transmits the collected behavioral data to servers 21a to 21c of businesses 5a to 5c.

The server 11 employs a two-stage consent system. That is, the server 11 obtains two consents from the user 1 via the terminal 2. The first consent is consent to the data provision service in the data provision PF 3. The second consent is consent to the use of behavioral data by the provider 5a-5c selected by the user 1.

In addition, Data Providing PF3 will not provide behavioral data to businesses without the second consent, so businesses will only be able to use the data to the extent that the second consent has been obtained. Data Providing PF3 will not use the acquired data for marketing its own services.

Figure 4 shows an example screen for the first consent step of the two-step consent method. Screen 41 shown in Figure 4 is displayed on the display of terminal 2 by server 11, for example, when user 1 registers for the data provision service.

Screen 41 includes an explanation of how behavioral data (personal information) will be handled by the data provision service in Data Provision PF3. For example, screen 41 includes information indicating that User 1's facial image will be saved for personal authentication purposes, and that the collected behavioral data of User 1 will be provided to third-party businesses (businesses 5a-5c). Screen 41 also includes information indicating that the use and purpose of the behavioral data will be subject to the separate handling (second consent) of the business to which the behavioral data is provided (business to which the data will be disclosed).

Screen 41 displays buttons 41a and 41b that ask user 1 whether or not he or she agrees to the handling of behavioral data (hereinafter sometimes referred to as terms of use) as shown on screen 41. For example, when button 41a is pressed, terminal 2 transmits information (a signal) to server 11 indicating that user 1 has agreed to the first term of use.

Once User 1 agrees to the terms of use for the data provision service in Data Provision PF 3, they can select the recipient (business) to which User 1's behavioral data will be provided.

User 1 can select the recipient of their behavioral data at any time. For example, User 1 can select the recipient of their behavioral data immediately after agreeing to the first terms of use, or at a later date. User 1 can also change the recipient of their behavioral data at any time.

Figure 5 shows an example screen for selecting and changing the recipient of behavioral data. Screen 42 shown in Figure 5 may be displayed on the display of terminal 2, for example, when a button for selecting and changing the recipient of behavioral data is pressed on a menu screen displayed on the display of terminal 2.

Screen 42 displays a list of businesses to which behavioral data will be provided. Screen 41 also displays toggle switches 42a-42d for selecting businesses to which behavioral data will be provided, corresponding to the businesses to which behavioral data will be provided.

The recipient of User 1's behavioral data is selected according to the operation of toggle switches 42a to 42d. For example, toggle switches 42a and 42d shown in Figure 5 indicate that the businesses corresponding to toggle switches 42a and 42d (XX Co., Ltd. and ** Real Estate) have been selected as recipients of behavioral data.

As shown in FIG. 5, multiple destinations for providing behavioral data may be selected. Also, one or no destinations for providing behavioral data may be selected. If no destinations for providing behavioral data are selected, User 1's behavioral data will not be provided to any business operators.

When toggle switches 42a-42d are switched on or off, terminal 2 transmits information about the switched state to server 11. When toggle switches 42a-42d are switched from off to on, server 11 transmits screen data to terminal 2 that includes an explanation of how the business operator that switched the switch on handles behavioral data. In other words, server 11 transmits screen data related to the second consent step of the two-step consent method to terminal 2.

Figure 6 shows an example screen relating to the second consent step of the two-step consent method. Screen 43 shown in Figure 6 is displayed on the display of terminal 2 by server 11. Screen 43 includes an explanation (terms of use) of how the business operator selected by user 1 to provide his/her behavioral data will handle the behavioral data. Note that the terms of use are specific to each business operator and will differ from one business operator to another.

Screen 43 displays buttons 43a and 43b that ask user 1 whether or not he or she agrees to the terms of use shown on screen 43. For example, when button 43a is pressed, terminal 2 transmits information to server 11 indicating that user 1 has agreed to the second set of terms of use.

When User 1 agrees to the terms of use (second terms of use) of the business to which behavioral data is provided, as shown on screen 43, he or she can select the type of behavioral data to provide to the business with which he or she has agreed to the second terms of use.

User 1 can select the type of behavioral data at any time. For example, User 1 can select the type of behavioral data immediately after agreeing to the second terms of use, or at a later date. User 1 can also change the type of behavioral data provided to the provider at any time.

Figure 7 shows an example screen for selecting and changing behavioral data to be provided to a destination business operator. Screen 44 shown in Figure 7 may be displayed on the display of terminal 2, for example, when a button for selecting and changing the type of behavioral data is pressed on a menu screen displayed on the display of terminal 2.

Screen 44 displays a list of the types of behavioral data to be provided to the recipient business. Screen 44 also displays toggle switches 44a to 44e for selecting the type of behavioral data, corresponding to the type of behavioral data.

The type of behavioral data of User 1 to be provided to the destination business is selected according to the operation of toggle switches 44a to 44e. For example, toggle switches 44a, 44c, and 44e shown in Figure 7 indicate that the types of behavioral data corresponding to toggle switches 44a, 44c, and 44e (ticket gate entry/exit logs, in-store flow lines, and coupon usage history) have been selected as the behavioral data to be provided to the destination business.

As shown in FIG. 7, multiple types of behavioral data may be selected. Also, one destination for providing the behavioral data may be selected. If no types of behavioral data are selected (for example, if all toggle switches 44a to 44e are off), the server 11 may send screen data to the terminal 2 prompting the user 1 to select one or more types of behavioral data.

The type of behavioral data may be set (or may differ) for each provider to which the behavioral data is provided. For example, the type of behavioral data may differ for each provider to which the behavioral data is provided, selected on screen 42 shown in FIG. 5. This is because different providers may want different types of behavioral data.

<Data configuration example>
8 is a diagram showing an example of the configuration of user registration data stored in the server 11. As shown in Fig. 8, the user registration data 51 includes an ID (identifier) for identifying the user, the user's name, gender, age, and address, and facial image data of the user. The user registration data may also include other necessary personal data of the user.

When the user agrees to the first terms of use, the user's user registration data 51 is stored in the HDD 33 of the server 11. In other words, when the user agrees to the first terms of use, the user is registered with the data provision service provided by the data provision PF 3.

After obtaining consent from user 1 to the first set of terms of use, server 11 transmits screen data for accepting each piece of information (data) in user registration data 51 to terminal 2. Terminal 2 accepts each piece of information in user registration data 51 from user 1 and transmits the accepted information to server 11. Server 11 stores each piece of information transmitted from terminal 2 in HDD 33 as user registration data 51.

Figure 9 shows an example of the configuration of recipient-related data stored in server 11. As shown in Figure 9, recipient-related data 52 includes an ID for identifying the user, recipient business information, and disclosure scope information.

The recipient business information in the recipient-related data 52 is stored in the HDD 33 of the server 11 when a user selects a recipient business for behavioral data. For example, if a user with ID "001" selects recipient businesses "XX Co., Ltd." and "** Real Estate" on the screen 42 shown in FIG. 5, information indicating the recipient businesses "XX Co., Ltd." and "** Real Estate" is stored in the recipient business information field corresponding to ID "001" in the recipient-related data 52.

The disclosure scope information of the recipient-related data 52 is stored in the HDD 33 of the server 11 when the user selects the type of behavioral data to provide to the recipient business. For example, if the user with ID "001" selects the behavioral data types "ticket gate entry/exit log" and "store flow lines" on the screen 44 shown in FIG. 7, information indicating the behavioral data types selected by the user, "ticket gate entry/exit log" and "store flow lines," is stored in the disclosure scope information field corresponding to ID "001" in the recipient-related data 52.

Figure 10 is a diagram showing an example of the configuration of behavioral data stored on the server 11. As shown in Figure 10, behavioral data 53 includes an ID that identifies the user, information about the user's entry into a facility, etc., and information about the user's exit from a facility, etc. The information about entry includes information about the date and time the user entered the facility, etc., and the location from which the user entered. The information about exit includes information about the date and time the user left the facility, etc., and the location from which the user left.

The server 11 receives facial image data from the cameras 4a to 4e. The server 11 compares the facial image data received from the cameras 4a to 4e with the facial image data in the user registration data 51 described in FIG. 8, and determines whether the facial image data received from the cameras 4a to 4e includes facial image data registered with the data provision service. If the facial image data received from the cameras 4a to 4e includes facial image data registered with the data provision service, the server 11 stores the behavioral data of the user of that facial image data in the HDD 33.

The server 11 may obtain the date and time of the user's entry and exit from a facility, etc., based on the reception time of facial image data received from cameras 4a-4e, for example. The server 11 may also obtain information about the locations (facilities, etc.) where the user entered and exited based on information about the installation locations of cameras 4a-4e.

In addition, behavioral data 53 may also include information regarding the user's payment and coupon usage. Information regarding the user's payment may include, for example, information regarding the date and time of payment and the location of payment (facility, etc.). Information regarding the user's coupon usage may include, for example, information regarding the date and time of coupon usage and the location of coupon usage (for example, the name of the facility, etc.).

<Explanation of behavioral data collection and provision>
11 is a diagram illustrating an example of the operation of the server 11 regarding the collection and provision of behavioral data. The server 11 receives facial image data from the cameras 4a to 4e. The server 11 extracts features from the received facial image data and compares it with the facial image data of the user registration data 51 described in FIG. 8. In other words, the server 11 compares the facial image data received from the cameras 4a to 4e with the facial image data of the users registered with the data provision service.

If the result of the comparison shows that the facial image data received from cameras 4a-4e does not match the facial image data of a user registered with the data provision service, server 11 determines that the user of the facial image data received from cameras 4a-4e is not registered with the data provision service (see arrow A1 in Figure 11). If server 11 determines that the user of the facial image data received from cameras 4a-4e is not registered with the data provision service, it discards the facial image data received from cameras 4a-4e.

On the other hand, if the result of the comparison shows that the facial image data received from cameras 4a to 4e matches the facial image data of a user registered with the data provision service, the server 11 determines that the user of the facial image data received from cameras 4a to 4e is registered with the data provision service (see arrow A2 in Figure 11).

In addition, the server 11 may determine that the facial image data received from the cameras 4a to 4e matches the facial image data of the user registered with the data provision service if the degree of match between the facial image data received from the cameras 4a to 4e and the facial image data of the user registered with the data provision service is equal to or greater than a certain threshold.

If the server 11 determines that the user of the facial image data received from the cameras 4a-4e is registered with the data provision service, it stores the behavioral data of the user of the facial image data received from the cameras 4a-4e (see arrow A3 in Figure 11). For example, the server 11 stores the behavioral data 53 described in Figure 10 in the HDD 33.

Furthermore, if the server 11 determines that the user of the facial image data received from the cameras 4a to 4e is registered with the data provision service, it references the user registration data 51 described in FIG. 8 and acquires the ID of the user of the facial image data. Based on the acquired ID, the server 11 references the provider-related data 52 described in FIG. 9 and determines whether provider-related data 52 stores provider business information for the user of the facial image data received from the cameras 4a to 4e (hereinafter sometimes referred to as the registered user).

If server 11 determines that destination business information for the registered user is stored in destination-related data 52, it transmits the registered user's behavioral data to the server of the destination business indicated in the destination business information. At that time, server 11 extracts the type of behavioral data based on the registered user's disclosure scope information (see destination-related data 52 in Figure 9) and transmits it to the server of the destination business indicated in the destination business information (see arrow A4 in Figure 11).

On the other hand, if the server 11 determines that the registered user's destination business information is not stored in the destination-related data 52, the server 11 does not send the registered user's behavioral data to the business's server (see arrow A5 in Figure 11). For example, if the registered user has not selected any business to which the behavioral data will be provided on screen 42 in Figure 5, the server 11 does not send the registered user's behavioral data to the business's server.

The server 11 may transmit registered user behavior data to the destination business's servers 21a-21c in real time. The server 11 may also transmit registered user behavior data stored (accumulated) on the HDD 33 to the destination business's servers 21a-21c at a predetermined time, such as midnight.

Furthermore, when the user selects a provider to which behavioral data is to be provided, if there is unsent behavioral data to the selected provider, server 11 may transmit the unsent behavioral data dating back a certain period of time from the present to the provider's server.Furthermore, when the user selects a type of behavioral data, if there is unsent behavioral data of that type, server 11 may transmit the unsent behavioral data dating back a certain period of time from the present to the provider's server.

<Example of operation of server 11>
12 is a flowchart showing an example of the operation of user registration and user settings of the server 11. The server 11 may execute the process of the flowchart shown in FIG. 12 in response to a user registration request from a user via the terminal 2, for example.

S1: The server 11 accepts consent to use of the data provision service from the user via the terminal 2. For example, the server 11 accepts consent to use of the data provision service from the user via the screen 41 of the terminal 2 described in FIG. 4. In other words, the server 11 accepts consent to the first terms of use from the user.

S2: The server 11 registers the user who has agreed to the first set of terms of use. For example, the server 11 accepts information related to user registration from the user via the terminal 2 and stores the accepted information in the HDD 33 (see user registration data 51 in Figure 8).

S3: The server 11 accepts the business to which the behavioral data will be provided from the user via the terminal 2. For example, the server 11 accepts the business to which the behavioral data will be provided from the user via the screen 42 of the terminal 2 described in FIG. 5.

S4: Server 11 accepts, via terminal 2, consent to the terms of use of the destination provider accepted in S3 from the user. For example, server 11 accepts consent to the terms of use of the destination provider from the user via screen 43 of terminal 2 described in FIG. 6. That is, server 11 accepts consent to the second set of terms of use from the user. Note that, upon accepting consent to the second set of terms of use, server 11 stores the destination provider information of the destination provider accepted in S3 in HDD 33 (see destination provider information in destination-related data 52 in FIG. 9).

S5: The server 11 accepts disclosure range information for behavioral data from the user via the terminal 2. For example, the server 11 accepts disclosure range information (type of behavioral data to be provided to the business operator) via the screen 44 of the terminal 2 described in FIG. 7. The server 11 stores the disclosure range information accepted in S5 in the HDD 33 (see disclosure range information of the recipient-related data 52 in FIG. 9).

By performing the above steps, the user is registered with the data provision service. Information regarding the recipients and types of user behavioral data is also set in the data provision service.

Note that the user registration and user setting processes are not limited to the order shown in the flowchart in Figure 12. For example, the server 11 may receive, from a registered user, information about the business to which the behavioral data will be provided at any time. The server 11 may also receive, from a registered user, information about the disclosure scope of the behavioral data at any time.

Figure 13 is a flowchart showing an example of the operation of server 11 in providing (transmitting) behavioral data. Server 11 may execute the processing of the flowchart shown in Figure 13, for example, periodically.

S11: The server 11 receives facial image data from the cameras 4a to 4e.

S12: The server 11 performs authentication processing on the facial image data received in S11. For example, the server 11 extracts features from the received facial image data and compares it with the facial image data in the user registration data 51 described in Figure 8. In other words, the server 11 compares the facial image data received from the cameras 4a to 4e with the facial image data of the user registered with the data provision service.

S13: Based on the facial recognition process of S12, the server 11 determines whether the user of the facial image data received from the cameras 4a to 4e is a user registered with the data provision service. For example, the server 11 may determine that the user of the facial image data received from the cameras 4a to 4e is a registered user if the degree of match between the facial image data received from the cameras 4a to 4e and the facial image data of a user registered with the data provision service is equal to or greater than a certain threshold.

S14: If the server 11 determines in S13 that the user of the facial image data received from the cameras 4a to 4e is not a user registered with the data provision service (No in S13), it discards the facial image data received from the cameras 4a to 4e. This protects the privacy of users who are not registered with the data provision service. After discarding the facial image data, the server 11 ends the processing of this flowchart.

S15: If the server 11 determines in S13 that the user of the facial image data received from the cameras 4a-4e is a user registered with the data provision service (registered user) (Yes in S13), it stores the behavioral data of the registered user. For example, the server 11 stores the behavioral data 53 described in FIG. 10 in the HDD 33.

S16: The server 11 determines whether the destination business information of the registered user for whom S13 was determined to be "Yes" is stored in the destination-related data 52 (see FIG. 9). For example, the server 11 references the user registration data 51 described in FIG. 8 and obtains the ID of the registered user for whom S13 was determined to be "Yes." Based on the obtained ID, the server 11 references the destination-related data 52 in FIG. 9 and determines whether the destination business information of the registered user is stored in the destination-related data 52. If the server 11 determines that the destination business information of the registered user is not stored in the destination-related data 52 (No in S16), it terminates the processing of this flowchart. In other words, the server 11 does not transmit the behavioral data of the registered user for whom S13 was determined to be "Yes" to the business's servers 21a to 21c.

S17: If the server 11 determines that the registered user's destination business information is stored in the destination-related data 52 (Yes in S16), it extracts the type of behavioral data based on the registered user's disclosure range information (see destination-related data 52 in Figure 9) and transmits it to the server of the destination business indicated by the destination business information.

Through the above operations, the type of behavioral data selected by the user is sent (provided) to the provider selected by the user.

Note that the behavioral data transmission process is not limited to the order shown in the flowchart in Figure 13. For example, the server 11 may provide the registered user's behavioral data stored (accumulated) on the HDD 33 to the provider at a predetermined time, such as midnight.

<Summary of the embodiment>
As described above, the server 11 includes a receiving unit (communication interface 34) that receives facial image data from the cameras 4a to 4e, a control unit 31a that collects behavioral data of the user 1 based on the facial image data, and a transmitting unit (communication interface 34) that transmits the collected behavioral data to the servers 21a to 21c of the businesses 5a to 5c.

The control unit 31a transmits to the terminal 2 first screen data for accepting consent to the provision of services using the behavioral data to the businesses 5a to 5c, and second screen data for accepting consent to the use of the behavioral data by the businesses 5a to 5c. For example, the control unit 31a transmits to the terminal 2 first screen data for displaying the screen 41 shown in FIG. 4 on the display of the terminal 2, and second screen data for displaying the screen 43 shown in FIG. 6 on the display of the terminal 2.

As a result, in a data provision service that collects User 1's behavioral data and provides it to a business, User 1, whose behavioral data is collected, can easily understand how the behavioral data is handled. For example, User 1 can understand from screen 41 of terminal 2, based on the first screen data, that the behavioral data is collected by the data provision service (or the business operator) and provided to businesses 5a-5c, and from screen 43 of terminal 2, based on the second screen data, how the behavioral data is used by businesses 5a-5c, thereby easily understanding how the behavioral data is handled.

Furthermore, after consent to the data provision service has been obtained, the control unit 31a transmits the second screen data to the terminal 2. This clearly separates and presents to the user how the behavioral data is handled by the data provision service and how the behavioral data is handled by the businesses 5a to 5c, allowing the user to more easily understand how the behavioral data is handled.

The control unit 31a also transmits to the terminal 2 third screen data for selecting the business operators 5a-5c to which the behavioral data will be provided. For example, the control unit 31a transmits to the terminal 2 third screen data for displaying the screen 42 shown in FIG. 5 on the display of the terminal 2. This allows the user to control the recipients of the behavioral data.

The control unit 31a also transmits the second screen data for the business selected in the third screen data to the terminal 2. For example, the control unit 31a transmits data for the consent acceptance screen (screen 43 in Figure 6) for the business selected in screen 42 in Figure 5 to the terminal 42. This allows the user to decide whether or not to consent to the use of behavioral data by the business selected by the user.

The control unit 31a also transmits to the terminal 2 fourth screen data for selecting the type of behavioral data to be provided to the businesses 5a to 5c. For example, the control unit 31a transmits to the terminal 2 fourth screen data for displaying the screen 44 shown in FIG. 7 on the display of the terminal 2. This allows the user to control the type of behavioral data to be provided to the businesses 5a to 5c.

The control unit 31a also transmits to the terminal 2 the fourth screen data of the business for which consent was obtained in the second screen data. For example, the control unit 31a transmits to the terminal 2 the data of the behavioral data type selection screen (screen 44 in Figure 7) of the business for which consent was obtained in screen 43 in Figure 6. This allows the user to select the type of behavioral data from the behavioral data of the business for which the user has consented to the use of the behavioral data.

<Modification 1>
The control unit 31a may award a benefit to the user 1 depending on the type of behavioral data selected. For example, the control unit 31a may award more points to the user 1 the more important the selected type of behavioral data is to the businesses 5a to 5c. This provides the user 1 with an incentive to register for a behavioral data provision service. Furthermore, the businesses 5a to 5c can acquire behavioral data that is highly important to them.

In addition, as shown in Figure 7, along with the display of the types of behavioral data and the toggle switches 44a to 44e for selecting the types of behavioral data, the contents of the benefits to be granted to User 1 may be displayed for each type of behavioral data. This makes it easy to see the contents of the benefits to be granted when selecting the behavioral data to provide, and serves as a basis for selection.

In addition, the control unit 31a may stop providing the reward when the selection of a type of behavioral data is canceled. This provides an incentive for user 1 to maintain the selection (provision) of behavioral data.

<Modification 2>
Some users 1 may wish to delete behavioral data stored (accumulated) in the server 11. In response to a request from the user 1, the control unit 31a may delete the behavioral data stored in the server 11. In this case, the control unit 31a may accept a deletion period for the behavioral data. For example, the control unit 31a may accept a deletion period for the behavioral data, such as a period going back three months from the present.

When deleting behavioral data, the control unit 31a may withdraw the benefits granted to user 1. For example, the control unit 31a may subtract points corresponding to the deletion period from the points granted to user 1.

In addition, when collecting a bonus, the control unit 31a may send the details of the collection to the user 1's device 2. For example, the control unit 31a may send the number of points to be subtracted to the user 1's device 2. This allows the user 1 to know the amount of bonus that will be collected by deleting the behavioral data.

<Modification 3>
In the present disclosure, the behavioral data of user 1 collected by the data providing PF 3 is provided to the businesses 5a to 5c, but it is also possible to provide not only behavioral data but also personal data of user 1 held by the data providing PF 3 to the businesses 5a to 5c. In this case, the personal data provided to the businesses 5a to 5c is treated in the same way as behavioral data, and it is possible to select recipients, grant benefits, etc.

In the above-described embodiments, the notation "... section" used for each component may be replaced with other notations such as "... circuit," "... assembly," "... device," "... unit," or "... module."

Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art could conceive of various modifications or alterations within the scope of the claims. Such modifications or alterations are understood to fall within the technical scope of the present disclosure. Furthermore, the components in the embodiments may be combined in any manner as long as they do not deviate from the spirit of the present disclosure.

This disclosure can be realized by software, hardware, or software in conjunction with hardware. Each functional block used in the description of the above embodiments may be realized, in whole or in part, as an LSI, which is an integrated circuit, and each process described in the above embodiments may be controlled, in whole or in part, by a single LSI or a combination of LSIs. An LSI may be composed of individual chips, or may be composed of a single chip that includes some or all of the functional blocks. An LSI may have data input and output. Depending on the level of integration, an LSI may also be referred to as an IC, system LSI, super LSI, or ultra LSI.

The integrated circuit method is not limited to LSI, and may be realized using a dedicated circuit, a general-purpose processor, or a dedicated processor. It may also be possible to use a field programmable gate array (FPGA), which can be programmed after LSI manufacturing, or a reconfigurable processor, which allows the connections and settings of circuit cells within the LSI to be reconfigured. The present disclosure may be realized as digital processing or analog processing.

Furthermore, if advances in semiconductor technology or derivative technologies result in the emergence of integrated circuit technology that can replace LSI, it is natural that such technology could be used to integrate functional blocks. The application of biotechnology, for example, is also a possibility.

This disclosure is useful for data provision services that use camera images.

1 User 2 Terminal 3 Data provision PF
4a to 4e Cameras 5a to 5c Business operators 6a to 6c IC card systems 11, 21a to 21c, 22a to 22c Servers

Claims (4)

a receiving unit that receives, from an information processing device that collects user behavior data, image data of a first term of use regarding the handling of the behavior data, which indicates that the behavior data may be provided to a business operator, and image data that accepts a selection by the user as to whether or not the user agrees to the first term of use;
a display unit that displays a first screen including an image of the first terms of use and an image for accepting a selection of consent to the first terms of use;
a control unit that determines whether or not a selection to agree to the first terms of use has been accepted from the user on the first screen;
have
When the control unit determines that the user has selected to agree to the first terms of use, the receiving unit receives , from the information processing device, image data of second terms of use regarding the purpose of use of the behavioral data by the business operator and image data for accepting a selection by the user as to whether or not to agree to the second terms of use;
the display unit displays a second screen including an image of the second terms of use and an image for accepting a selection of consent to the second terms of use;
the control unit determines whether or not a selection to agree to the second terms of use has been accepted from the user on the second screen;
When the control unit determines that the user has selected to agree to the second terms of use, the receiving unit receives , from the information processing device, image data indicating a list of types of the behavioral data that may be provided to the business operator and image data accepting the types of behavioral data that may be provided to the business operator;
the display unit displays a third screen including an image of the list and an image for accepting the type of behavioral data that may be provided to the business operator.
Terminal. the control unit determines whether or not a type of behavioral data that is allowed to be provided to the business operator has been accepted from the user on the third screen;
the receiving unit receives, when the control unit determines that the type of behavioral data that is permitted to be provided to the business operator from the user , image data indicating a benefit to be granted to the user from the information processing device;
the display unit displays a fourth screen including an image showing the benefit.
The terminal according to claim 1 . the control unit, after accepting, on the third screen, from the user, the type of behavioral data that may be provided to the business operator, determines whether or not an operation to cancel the acceptance has been accepted;
When the control unit determines that the operation to cancel the acceptance has been accepted, the receiving unit receives, from the information processing device, image data indicating that all or part of the benefit granted to the user will be collected;
The display unit displays a fifth screen including an image indicating the collection.
The terminal according to claim 2. Computer ,
a receiving unit that receives, from an information processing device that collects user behavior data, image data of a first term of use regarding the handling of the behavior data, which indicates that the behavior data may be provided to a business operator, and image data that accepts a selection by the user as to whether or not the user agrees to the first term of use;
a display unit that displays a first screen including an image of the first terms of use and an image for accepting a selection of consent to the first terms of use;
a control unit that determines whether or not a selection to agree to the first terms of use has been accepted from the user on the first screen;
It functions as
When the control unit determines that the user has selected to agree to the first terms of use, the receiving unit receives , from the information processing device, image data of second terms of use regarding the purpose of use of the behavioral data by the business operator and image data for accepting a selection by the user as to whether or not to agree to the second terms of use;
the display unit displays a second screen including an image of the second terms of use and an image for accepting a selection of consent to the second terms of use;
the control unit determines whether or not a selection to agree to the second terms of use has been accepted from the user on the second screen;
When the control unit determines that the user has selected to agree to the second terms of use, the receiving unit receives , from the information processing device, image data indicating a list of types of the behavioral data that may be provided to the business operator and image data accepting the types of behavioral data that may be provided to the business operator;
the display unit displays a third screen including an image of the list and an image for accepting the type of behavioral data that may be provided to the business operator .
program .