JP7607268B2 - Information processing device, data providing method, program, behavioral data providing processing system, and behavioral data providing processing method - Google Patents

Description

The present disclosure relates to an information processing device, a data providing method, and a program.

In recent years, various data has been collected with the use of artificial intelligence (hereinafter sometimes referred to as AI). For example, behavioral data on human behavior is collected using image data from cameras installed around town and in stores. By having AI learn from the collected behavioral data, it becomes possible, for example, to predict crowds and purchasing trends, and to notify users of recommendations that match their own hobbies and preferences in real time.

Patent document 1 discloses a device that allows users to select the type of data to provide to a business operator.

JP 2018-25938 A

Incidentally, for a service that uses cameras to collect people's behavioral data and provides the collected behavioral data to various businesses, it is important to have a mechanism that allows the people whose behavioral data is collected to easily understand the content of the collected behavioral data and how it should be handled.

Non-limiting examples of the present disclosure contribute to providing an information processing device, a data providing method, and a program that allow people whose behavioral data is collected to easily understand how to handle the behavioral data in a service that collects behavioral data and provides it to a business.

An information processing device according to an embodiment of the present disclosure includes a receiving unit that receives facial image data from a camera, a control unit that collects behavioral data based on the facial image data, and a transmitting unit that transmits the behavioral data to a business operator's server, and the control unit transmits to a terminal first screen data for accepting consent to the provision of the behavioral data to the business operator, and second screen data for accepting consent to the business operator's use of the behavioral data.

A data provision method according to one embodiment of the present disclosure includes receiving facial image data from a camera, collecting behavioral data based on the facial image data, transmitting the behavioral data to a business operator's server, and transmitting to a terminal first screen data for accepting consent to the provision of the behavioral data to the business operator, and second screen data for accepting consent to the business operator's use of the behavioral data.

A program according to an embodiment of the present disclosure causes a computer to execute a process of receiving facial image data from a camera, collecting behavioral data based on the facial image data, transmitting the behavioral data to a business's server, and transmitting to a terminal first screen data for accepting consent to the provision of the behavioral data to the business, and second screen data for accepting consent to the business's use of the behavioral data.

These comprehensive or specific aspects may be realized as a system, device, method, integrated circuit, computer program, or recording medium, or as any combination of a system, device, method, integrated circuit, computer program, and recording medium.

According to one embodiment of the present disclosure, in a service in which behavioral data is collected and provided to a business operator, the person whose behavioral data is collected can easily understand how the behavioral data is to be handled. Furthermore, the person whose behavioral data is collected can check the contents of the collected data for themselves, and manage and provide the behavioral data for themselves, such as by requesting deletion as necessary.

Further advantages and benefits of an embodiment of the present disclosure will become apparent from the specification and drawings. Such advantages and/or benefits may be provided by some of the embodiments and features described in the specification and drawings, respectively, but not necessarily all of them need be provided to obtain one or more identical features.

FIG. 1 is a diagram for explaining an overview of a data providing service according to an embodiment of the present disclosure. A diagram showing an example of the configuration of a data provision system that realizes a data provision service. A diagram showing an example of a server block configuration A diagram showing an example of the screen for the first consent step of the two-step consent method A diagram showing an example of a screen for selecting and changing the recipient of behavioral data An example of the screen for the second consent step of the two-step consent method A diagram showing an example of a screen for selecting and changing behavioral data to be provided to a recipient business operator FIG. 13 is a diagram showing an example of the configuration of user registration data stored in the server; FIG. 13 is a diagram showing an example of the configuration of destination-related data stored in a server; FIG. 13 is a diagram showing an example of the configuration of behavior data stored in a server; FIG. 1 is a diagram for explaining an example of operations related to collection and provision of behavioral data of a server. A flowchart showing an example of operations related to user registration and user settings of a server Flowchart showing an example of operation of the server for providing behavioral data

Below, the embodiments of the present disclosure will be described in detail with appropriate reference to the drawings. However, more detailed explanation than necessary may be omitted. For example, detailed explanations of already well-known matters and duplicate explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to make it easier for those skilled in the art to understand.

The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

<Outline of data provision service>
Fig. 1 is a diagram for explaining an overview of a data providing service according to an embodiment of the present disclosure. Fig. 1 shows a user 1, a terminal 2, a data providing PF (Platform) 3, cameras 4a to 4e, businesses 5a to 5c, and IC card systems 6a to 6c.

Using terminal 2, user 1 accesses data provider PF 3 and registers for the data provision service provided by data provider PF 3. At this time, user 1 registers personal data to data provider PF 3. Personal data is personal information that user 1 can input, such as name, age, sex, address, date of birth, financial accounts, credit cards, and facial image. Behavioral data is data that indicates user 1's behavior, and specifically includes product purchase history, movement route information, entry and exit information, boarding/departing stations, visited facilities, etc.

Furthermore, the user 1 uses the terminal 2 to select (designate) which of the user 1's behavioral data may be provided to the data provision PF 3 and to which of the businesses 5a to 5c the data may be provided. In other words, the user 1 can select the businesses 5a to 5c to which the user 1's behavioral data may be provided. The terminal 2 may be, for example, a device such as a smartphone, a tablet terminal, or a personal computer.

The data provision PF3 shown in FIG. 1 performs a service (hereinafter, sometimes referred to as a data provision service) in which a person (user) who has been registered in advance in the data provision PF3 is authenticated using face recognition on the captured image (hereinafter, referred to as face image data) including the user's face captured by the cameras 4a to 4e, collects the behavioral data of the person (user), and provides the collected behavioral data that the person (user) has permitted to be provided to the businesses 5a to 5c. At this time, the user is authenticated using face recognition, but an authentication method other than face recognition may be used. In such a case, it is not necessary for the captured image captured by the camera to include the user's face, and it is sufficient that the image is one in which a person can be recognized. Although a camera is used as an example for collecting behavioral data, a sensor capable of collecting behavioral data may also be used. Note that the data provision PF3 may be managed by a business (not shown) different from the businesses 5a to 5c that receive the data provision service.

The business managing the data provision PF3 recruits users who may collect behavioral data, for example, using cameras 4a to 4e. Users whose behavioral data may be collected register with the data provision service provided by the data provision PF3. As described above, registration is performed by inputting the necessary personal data. At this time, recruitment may be initiated when users start using a service provided by the business managing the data provision PF3. When registering with the data provision service in conjunction with a service, it is also possible to ensure convenience by allowing the provision of data to the target service at the same time as registration. User 1 shown in FIG. 1 indicates a user who has registered with the data provision service provided by the data provision PF3.

The data provision PF3 is a platform that realizes a data provision service. For example, the data provision PF3 authenticates the user 1 based on the facial image data of the user 1 captured by the cameras 4a to 4e, and collects (acquires) behavioral data of the user 1. Specifically, the data provision PF3 authenticates the user 1 based on the facial image data of the user 1 captured by the cameras 4a to 4e, and collects behavioral data such as the user 1's movements between stations, the routes he or she takes within the station premises and on the streets, and the purchase of goods at stores.

More specifically, the system collects station information where user 1 entered and exited by authenticating user 1 from facial image data captured by a camera installed at the ticket gate for paying fares, collects user 1's travel route by authenticating user 1 from facial image data captured by cameras installed inside stations and on the streets, and collects information on user 1's purchases by authenticating user 1 from facial image data captured by a store's facial payment camera.

The data providing PF3 transmits the collected behavioral data of the user 1 to the businesses 5a to 5c selected by the user 1. For example, if the user 1 selects the businesses 5a and 5b, the data providing PF3 transmits the collected behavioral data of the user 1 to the businesses 5a and 5b.

The cameras 4a to 4e are installed in various locations and capture images of users. The cameras 4a to 4e transmit the captured facial image data of the user to the data provision PF 3. The data provision PF 3 performs facial authentication using the received facial image data. The cameras are installed at transportation ticket gates, entrances and exits to venues, checkpoints and other passing points, in front of cash registers, store entrances and exits, and other locations where people move around. These cameras may also be installed at gates that manage entrance and exit.

For example, camera 4a is installed at a ticket gate and captures a user passing through the ticket gate. Camera 4a transmits the captured facial image data of the user to data provision PF 3.

For example, camera 4b is installed near a cash register in a store or the like, and captures a picture of a user who has made a payment for an item. Camera 4b transmits the captured face image data of the user to data provision PF 3.

For example, camera 4c is installed near the entrance of a store or the like and captures images of users who enter or leave the store. Camera 4c transmits the captured facial image data of the users to data provision PF3.

For example, camera 4d is installed on a structure such as a building or a utility pole, and captures a user passing through a passageway or street within the building. Camera 4d transmits the captured facial image data of the user to data provision PF3.

For example, camera 4e is installed at an entrance/exit management gate at the entrance of amusement parks, theme parks, and other locations, and captures images of users passing through the gate. Camera 4e transmits the captured image data of the user's face to the entrance/exit management system and also to the data provision PF 3.

In this way, by installing the cameras 4a to 4e in various locations, the data providing PF 3 can collect behavioral data of the user 1 registered in the data providing PF 3 over a wide range. The cameras 4a to 4e may be surveillance cameras.

Facial image data of users captured by cameras is collected, but it is not limited to facial image data. User behavior data may also be collected by performing person detection and movement analysis on images captured by the cameras. For example, behavior data such as the movement of user 1 can be collected by tracking user 1 identified from facial image data in images captured by multiple cameras.

The data providing PF 3 provides the businesses 5a to 5c with behavioral data of the user 1 registered in the data providing PF 3. However, the businesses 5a to 5c are provided with the behavioral data of the user 1 only if the user 1 selects the businesses 5a to 5c as a recipient of the behavioral data. The businesses 5a to 5c may be businesses that operate, for example, amusement parks, commercial facilities, accommodation facilities, retail stores, etc.

User 1 can select the detailed type of behavioral data to provide to each destination, and only the selected type of data is provided to the destination businesses 5a to 5c.

The businesses 5a to 5c may provide O2O (one to one) services to the user 1 using the behavioral data of the user 1 provided by the data provision PF 3. For example, the businesses 5a to 5c may input the behavioral data of the user 1 provided by the data provision PF 3 into an AI and provide a service suited to the user 1 (individual). The businesses 5a to 5c may also use the behavioral data of the user 1 provided by the data provision PF 3 to determine the location of a store or the like. For example, the businesses 5a to 5c may input the behavioral data of the user 1 (which may be behavioral data of multiple people) provided by the data provision PF 3 into an AI and determine the optimal location of the store.

The IC card systems 6a to 6c are, for example, transportation IC card systems managed by transportation companies such as trains, buses, or airplanes. The IC card systems 6a to 6c detect the entry and exit of users into and from the premises in cooperation with cameras installed near the user's entrance and exit points, such as ticket gates, and transmit the detected data to the data providing PF 3. The data providing PF 3 collects behavioral data of the user 1 based on the entrance and exit detection data and the facial image data of the camera installed near the entrance and exit points. In other words, the data providing PF 3 may collect behavioral data of the user 1 in cooperation with other systems such as the IC card systems 6a to 6c. In addition to transportation IC card systems, data may be collected in cooperation with a wide range of systems, such as an entrance and exit management system monitoring system.

As explained below, in the data provision service shown in FIG. 1, two consents are obtained from user 1. The first consent is for the data provision service in data provision PF3. The second consent is for the use of behavioral data by the business operators 5a to 5c selected by user 1.

As described below, user 1 can also select the type of behavioral data to provide to businesses 5a to 5c. For example, user 1 can select the type of behavioral data to provide to businesses 5a to 5c, such as behavioral data related to station ticket gate entry and exit logs, behavioral data related to travel routes within a station, or behavioral data related to payments within a store.

As will be explained below, users 1 who provide behavioral data are given rewards such as points and coupons. The rewards provide an incentive for users 1 to register with the data provision service shown in FIG. 1. Furthermore, businesses managing the data provision PF 3 can more easily recruit users whose behavioral data may be collected. Furthermore, by increasing the number of users whose behavioral data may be collected, businesses managing the data provision PF 3 can increase the number of businesses that want to receive user behavioral data.

Data may be referred to as information. Behavioral data of user 1 may be considered as personal information. The business that manages data provision PF3 may be different from the business that provides the data provision service. In the above, the business that manages data provision PF3 is different from businesses 5a to 5c, but one or more of businesses 5a to 5c may manage data provision PF3. In addition, facial image data received from cameras 4a to 4c may also include images of parts of the body other than the face.

<System configuration example>
Fig. 2 is a diagram showing an example of the configuration of a data provision system 10 that realizes a data provision service. In Fig. 2, the same components as in Fig. 1 are given the same reference numerals. As shown in Fig. 2, the data provision system 10 has cameras 4a to 4e and a server 11. The server 11 realizes the function of the data provision PF 3 shown in Fig. 1. The server 11 may be called an information processing device.

In addition to the data provision system 10, FIG. 2 shows a terminal 2 used by a user 1, a server 21a managed by an operator 5a, a server 21b managed by an operator 5b, and a server 21c managed by an operator 5c. In addition to the data provision system 10, FIG. 2 also shows a server 22a constituting an IC card system 6a, a server 22b constituting an IC card system 6b, and a server 22c constituting an IC card system 6c.

The server 11 is connected to the cameras 4a to 4e via a network, such as a local area network (LAN), the Internet, or a wireless network such as a mobile phone network. The server 11 receives facial image data of the user 1 captured by the cameras 4a to 4e via the network.

Server 11 is connected to servers 21a to 21c via a network such as a LAN, the Internet, or a wireless network. Server 11 transmits the collected behavioral data of user 1 to servers 21a to 21c via the network.

Server 11 is connected to servers 22a to 22c via a network such as a LAN, the Internet, or a wireless network. Server 11 receives behavioral data of user 1 via the network.

<Server block configuration example>
Fig. 3 is a diagram showing an example of a block configuration of the server 11. As shown in Fig. 3, the server 11 includes a processor 31, a RAM (random access memory) 32, a HDD (hard disk drive) 33, a communication interface 34, and a bus 35.

The processor 31 controls the entire server 11. The processor 31 may be, for example, a CPU (Central Processing Unit). The processor 31 is connected to the RAM 32, the HDD 33, and the communication interface 34 via the bus 35.

The processor 31 functions as a control unit 31a by executing a program. The control unit 31a realizes the functions of the data provision PF3 described in FIG. 1 and realizes the data provision service.

RAM 32 temporarily stores the OS (Operating System) program and application programs to be executed by processor 31. RAM 32 also temporarily stores various data necessary for processing by CPU 31. Note that RAM 32 is a storage device that temporarily stores programs and the like, and is not limited to RAM. For example, RAM 32 may be a storage device such as DRAM (Dynamic RAM).

The HDD 33 stores the OS, application programs, and the like. The HDD 33 also stores various data necessary for processing by the CPU 31. Note that the HDD 33 is a storage device that stores programs and the like, and is not limited to an HDD. For example, the HDD 33 may be a storage device such as an SSD (Solid State Drive).

The communication interface 34 communicates with the cameras 4a-4e via networks such as a LAN, the Internet, and a mobile phone network. The communication interface 34 also communicates with the servers 21a-21c and the servers 22a-22c via networks such as a LAN, the Internet, and a mobile phone network.

Servers 21a to 21c and servers 22a to 22c may also have blocks similar to those shown in FIG. 3.

<Handling of behavioral data>
The handling of behavioral data will now be described. Behavioral data is personal information of user 1. Therefore, server 11 receives (acquires) consent regarding the handling of user 1's behavioral data from user 1 via terminal 2. When consent is obtained from user 1, server 11 collects user 1's behavioral data. Furthermore, server 11 transmits the collected behavioral data to servers 21a to 21c of businesses 5a to 5c.

The server 11 adopts a two-stage consent method. That is, the server 11 acquires two consents from the user 1 via the terminal 2. The first consent is consent to the data provision service in the data provision PF 3. The second consent is consent to the use of behavioral data by the business operators 5a to 5c selected by the user 1.

The Data Providing PF3 will not provide the behavioral data to the business operator unless the second consent is obtained, and the business operator will only be able to utilize the data to the extent that the second consent is obtained. The Data Providing PF3 will not utilize the acquired data for marketing its own services.

Figure 4 shows an example of a screen related to the first consent step of the two-step consent method. Screen 41 shown in Figure 4 is displayed on the display of terminal 2 by server 11, for example, when user 1 registers for the data provision service.

Screen 41 includes an explanation of how the data provision service in Data Provision PF3 handles behavioral data (personal information). For example, screen 41 includes information indicating that a facial image of user 1 will be stored for personal authentication, and that the collected behavioral data of user 1 will be provided to third-party businesses (businesses 5a to 5c). Screen 41 also includes information indicating that the use and purpose of the behavioral data will be subject to the separate handling (second consent) of the business to which the behavioral data is provided (business to which the data is disclosed).

Screen 41 displays buttons 41a and 41b that ask user 1 whether or not he or she agrees to the handling of behavioral data (hereinafter, sometimes referred to as terms of use) as shown on screen 41. For example, when button 41a is pressed, terminal 2 transmits information (signal) to server 11 indicating that user 1 agrees to the first term of use.

When User 1 agrees to the terms of use for the data provision service in Data Provision PF3, he/she can select the recipient (business) of User 1's behavioral data.

User 1 can select the recipient of the behavioral data at any time. For example, User 1 can select the recipient of the behavioral data immediately after agreeing to the first terms of use, or at a later date. User 1 can also change the recipient of the behavioral data at any time.

Figure 5 is a diagram showing an example of a screen for selecting and changing the destination of behavioral data. Screen 42 shown in Figure 5 may be displayed on the display of terminal 2, for example, when a button for selecting and changing the destination of behavioral data is pressed on a menu screen displayed on the display of terminal 2.

A list of business entities to which behavioral data will be provided is displayed on screen 42. Toggle switches 42a to 42d for selecting a business entity to which behavioral data will be provided are also displayed on screen 41, corresponding to the business entities to which behavioral data will be provided.

The destination of user 1's behavioral data is selected according to the operation of toggle switches 42a to 42d. For example, toggle switches 42a and 42d shown in FIG. 5 indicate that the businesses corresponding to toggle switches 42a and 42d (XX Corporation and ** Real Estate) have been selected as the businesses to which behavioral data will be provided.

As shown in FIG. 5, multiple destinations for providing behavioral data may be selected. Also, one or no destinations for providing behavioral data may be selected. If no destinations for providing behavioral data are selected, user 1's behavioral data will not be provided to any business operator.

When toggle switches 42a to 42d are switched on and off, terminal 2 transmits information on the switched state to server 11. When toggle switches 42a to 42d are switched from off to on, server 11 transmits screen data to terminal 2 that includes an explanation of how the business operator that switched the switch on handles the behavioral data. In other words, server 11 transmits screen data related to the second consent step of the two-step consent method to terminal 2.

Figure 6 is a diagram showing an example of a screen relating to the second consent step of the two-step consent method. Screen 43 shown in Figure 6 is displayed on the display of terminal 2 by server 11. Screen 43 includes an explanation (terms of use) of how the business operator selected by user 1 to provide the behavioral data will handle the behavioral data. Note that the terms of use are specific to each business operator and will differ from one business operator to another.

Buttons 43a and 43b are displayed on screen 43, asking user 1 whether or not he or she agrees to the terms of use shown on screen 43. For example, when button 43a is pressed, terminal 2 transmits information to server 11 indicating that user 1 agrees to the second set of terms of use.

When user 1 agrees to the terms of use (second terms of use) of the business to which the behavioral data is to be provided, as shown on screen 43, user 1 can select the type of behavioral data to be provided to the business that has agreed to the second terms of use.

User 1 can select the type of behavioral data at any time. For example, User 1 can select the type of behavioral data immediately after agreeing to the second terms of use, or at a later date. User 1 can also change the type of behavioral data to be provided to the provider at any time.

Figure 7 shows an example of a screen for selecting and changing behavioral data to be provided to a destination business operator. Screen 44 shown in Figure 7 may be displayed on the display of terminal 2, for example, when a button for selecting and changing the type of behavioral data is pressed on a menu screen displayed on the display of terminal 2.

Screen 44 displays a list of types of behavioral data to be provided to the recipient business. Screen 44 also displays toggle switches 44a to 44e for selecting the type of behavioral data corresponding to the type of behavioral data.

The type of behavioral data of user 1 to be provided to the destination business is selected according to the operation of toggle switches 44a to 44e. For example, toggle switches 44a, 44c, and 44e shown in FIG. 7 indicate that the types of behavioral data corresponding to toggle switches 44a, 44c, and 44e (ticket gate entry/exit logs, in-store traffic patterns, and coupon usage history) have been selected as the behavioral data to be provided to the destination business.

As shown in FIG. 7, multiple types of behavioral data may be selected. Also, one destination for providing the behavioral data may be selected. If no types of behavioral data are selected (for example, when all of the toggle switches 44a to 44e are off), the server 11 may transmit screen data to the terminal 2 that prompts the user 1 to select one or more types of behavioral data.

The type of behavioral data may be set (may be different) for each business to which the behavioral data is provided. For example, the type of behavioral data may be different for each business to which the behavioral data is provided, selected on screen 42 shown in FIG. 5. This is because the type of behavioral data desired may differ for each business.

<Data configuration example>
Fig. 8 is a diagram showing an example of the configuration of user registration data stored in the server 11. As shown in Fig. 8, the user registration data 51 includes an ID (identifier) for identifying a user, the user's name, sex, age, and address, and face image data of the user. The user registration data may also include other required personal data of the user.

When the user agrees to the first terms of use, the user's user registration data 51 is stored in the HDD 33 of the server 11. In other words, when the user agrees to the first terms of use, the user is registered in the data provision service provided by the data provision PF 3.

After obtaining consent to the first set of terms of use from user 1, server 11 transmits screen data for accepting each piece of information (data) in user registration data 51 to terminal 2. Terminal 2 accepts each piece of information in user registration data 51 from user 1 and transmits the accepted pieces of information to server 11. Server 11 stores each piece of information transmitted from terminal 2 in HDD 33 as user registration data 51.

Figure 9 shows an example of the configuration of the recipient-related data stored in the server 11. As shown in Figure 9, the recipient-related data 52 includes an ID for identifying a user, recipient business information, and disclosure range information.

The recipient business information of the recipient-related data 52 is stored in the HDD 33 of the server 11 when the user selects a recipient business of the behavioral data. For example, when the user with ID "001" selects the recipient businesses "XX Corporation" and "** Real Estate" on the screen 42 shown in FIG. 5, information indicating the recipient businesses "XX Corporation" and "** Real Estate" is stored in the recipient business information field corresponding to ID "001" in the recipient-related data 52.

The disclosure range information of the destination-related data 52 is stored in the HDD 33 of the server 11 when the user selects the type of behavioral data to be provided to the destination business operator. For example, when a user with ID "001" selects the behavioral data types "ticket gate entry/exit log" and "store flow lines" on the screen 44 shown in FIG. 7, information indicating the behavioral data types selected by the user, "ticket gate entry/exit log" and "store flow lines", is stored in the disclosure range information column corresponding to ID "001" of the destination-related data 52.

Figure 10 is a diagram showing an example of the configuration of behavioral data stored in server 11. As shown in Figure 10, behavioral data 53 has an ID that identifies a user, information about the user's entry into a facility, etc., and information about the user's exit from a facility, etc. The information about entry includes information about the date and time when the user entered the facility, etc., and information about the location of entry. The information about exit includes information about the date and time when the user exited the facility, etc., and information about the location of exit.

The server 11 receives facial image data from the cameras 4a to 4e. The server 11 compares the facial image data received from the cameras 4a to 4e with the facial image data of the user registration data 51 described in FIG. 8, and determines whether the facial image data received from the cameras 4a to 4e includes facial image data registered in the data provision service. If the facial image data received from the cameras 4a to 4e includes facial image data registered in the data provision service, the server 11 stores the behavioral data of the user of that facial image data in the HDD 33.

The server 11 may obtain the date and time of the user's entry into and exit from a facility, etc., based on the reception time of the facial image data received from the cameras 4a to 4e, for example. The server 11 may also obtain information on the locations (facilities, etc.) where the user entered and exited, based on information on the locations where the cameras 4a to 4e are installed.

The behavioral data 53 may also include information regarding the user's payment and information regarding the use of coupons. Information regarding the user's payment may include, for example, information regarding the date and time of payment and the location of payment (facility, etc.). Information regarding the user's coupon usage may include, for example, information regarding the date and time of coupon usage and the location of coupon usage (for example, the name of the facility, etc.).

<Explanation of the collection and provision of behavioral data>
Fig. 11 is a diagram for explaining an example of the operation of the server 11 regarding the collection and provision of behavioral data. The server 11 receives facial image data from the cameras 4a to 4e. The server 11 extracts features of the received facial image data and compares it with the facial image data of the user registration data 51 described in Fig. 8. In other words, the server 11 compares the facial image data received from the cameras 4a to 4e with the facial image data of the users registered in the data provision service.

If the result of the comparison shows that the facial image data received from cameras 4a-4e does not match the facial image data of a user registered with the data provision service, server 11 determines that the user of the facial image data received from cameras 4a-4e is not registered with the data provision service (see arrow A1 in FIG. 11). If server 11 determines that the user of the facial image data received from cameras 4a-4e is not registered with the data provision service, server 11 discards the facial image data received from cameras 4a-4e.

On the other hand, if the result of the comparison shows that the facial image data received from the cameras 4a to 4e matches the facial image data of a user registered with the data provision service, the server 11 determines that the user of the facial image data received from the cameras 4a to 4e is registered with the data provision service (see arrow A2 in Figure 11).

In addition, the server 11 may determine that the facial image data received from the cameras 4a to 4e matches the facial image data of the user registered with the data provision service if the degree of match between the facial image data received from the cameras 4a to 4e and the facial image data of the user registered with the data provision service is equal to or greater than a certain threshold value.

When the server 11 determines that the user of the facial image data received from the cameras 4a to 4e is registered with the data provision service, the server 11 stores the behavioral data of the user of the facial image data received from the cameras 4a to 4e (see arrow A3 in FIG. 11). For example, the server 11 stores the behavioral data 53 described in FIG. 10 in the HDD 33.

If the server 11 determines that the user of the facial image data received from the cameras 4a to 4e is registered with the data provision service, the server 11 refers to the user registration data 51 described in FIG. 8 to acquire the ID of the user of the facial image data. Based on the acquired ID, the server 11 refers to the destination-related data 52 described in FIG. 9 to determine whether the destination-related data 52 stores destination business information for the user of the facial image data received from the cameras 4a to 4e (hereinafter sometimes referred to as a registered user).

When the server 11 determines that the destination business information of the registered user is stored in the destination related data 52, it transmits the behavioral data of the registered user to the server of the destination business indicated by the destination business information. At that time, the server 11 extracts the type of behavioral data based on the disclosure range information of the registered user (see the destination related data 52 in FIG. 9) and transmits it to the server of the destination business indicated by the destination business information (see arrow A4 in FIG. 11).

On the other hand, if the server 11 determines that the destination business information of the registered user is not stored in the destination related data 52, the server 11 does not transmit the registered user's behavioral data to the business's server (see arrow A5 in FIG. 11). For example, if the registered user has not selected any business to which the behavioral data is to be provided on screen 42 in FIG. 5, the server 11 does not transmit the registered user's behavioral data to the business's server.

The server 11 may transmit the behavioral data of registered users to the servers 21a to 21c of the destination business in real time. The server 11 may also transmit the behavioral data of registered users stored (accumulated) in the HDD 33 to the servers 21a to 21c of the destination business at a predetermined timing, for example, at midnight.

Furthermore, when the user selects a destination provider of behavioral data, if there is unsent behavioral data to the selected destination provider, server 11 may transmit the unsent behavioral data dating back a certain period of time from the present to the server of the destination provider. Furthermore, when the user selects a type of behavioral data, if there is unsent type of behavioral data, server 11 may transmit the unsent behavioral data dating back a certain period of time from the present to the server of the destination provider.

<Example of operation of server 11>
Fig. 12 is a flowchart showing an example of an operation related to user registration and user settings of the server 11. The server 11 may execute the process of the flowchart shown in Fig. 12 in response to a user registration request from a user via the terminal 2, for example.

S1: The server 11 accepts consent to use of the data provision service from the user via the terminal 2. For example, the server 11 accepts consent to use of the data provision service from the user via the screen 41 of the terminal 2 described in FIG. 4. That is, the server 11 accepts consent to the first terms of use from the user.

S2: The server 11 registers the user who has agreed to the first set of terms of use. For example, the server 11 accepts information about user registration from the user via the terminal 2, and stores the accepted information in the HDD 33 (see user registration data 51 in FIG. 8).

S3: The server 11 accepts the business to which the behavioral data will be provided from the user via the terminal 2. For example, the server 11 accepts the business to which the behavioral data will be provided from the user via the screen 42 of the terminal 2 described in FIG. 5.

S4: The server 11 accepts, via the terminal 2, consent to the terms of use of the destination provider accepted in S3 from the user. For example, the server 11 accepts consent to the terms of use of the destination provider from the user via the screen 43 of the terminal 2 described in FIG. 6. That is, the server 11 accepts consent to the second set of terms of use from the user. When the server 11 accepts consent to the second set of terms of use, it stores the destination provider information of the destination provider accepted in S3 in the HDD 33 (see the destination provider information in the destination related data 52 in FIG. 9).

S5: The server 11 accepts disclosure range information of the behavioral data from the user via the terminal 2. For example, the server 11 accepts the disclosure range information (type of behavioral data to be provided to the business operator) via the screen 44 of the terminal 2 described in FIG. 7. The server 11 stores the disclosure range information accepted in S5 in the HDD 33 (see disclosure range information of the recipient-related data 52 in FIG. 9).

By performing the above steps, the user is registered with the data provision service. In addition, information regarding the destination and type of the user's behavioral data is set in the data provision service.

The process of user registration and user settings is not limited to the order of the flowchart shown in FIG. 12. For example, the server 11 may receive, from a registered user, at any time, the provider of behavioral data. The server 11 may also receive, from a registered user, information on the disclosure range of behavioral data at any time.

Figure 13 is a flowchart showing an example of the operation of server 11 in providing (transmitting) behavioral data. Server 11 may execute the process of the flowchart shown in Figure 13, for example, at a fixed interval.

S11: The server 11 receives face image data from the cameras 4a to 4e.

S12: The server 11 performs authentication processing on the facial image data received in S11. For example, the server 11 extracts features of the received facial image data and compares it with the facial image data of the user registration data 51 described in FIG. 8. That is, the server 11 compares the facial image data received from the cameras 4a to 4e with the facial image data of the user registered with the data provision service.

S13: Based on the face recognition process of S12, the server 11 determines whether the user of the facial image data received from the cameras 4a to 4e is a user registered with the data provision service. For example, the server 11 may determine that the user of the facial image data received from the cameras 4a to 4e is a registered user when the degree of match between the facial image data received from the cameras 4a to 4e and the facial image data of a user registered with the data provision service is equal to or greater than a certain threshold.

S14: If the server 11 determines in S13 that the user of the facial image data received from the cameras 4a to 4e is not a user registered with the data provision service (No in S13), the server 11 discards the facial image data received from the cameras 4a to 4e. This protects the privacy of users who are not registered with the data provision service. After discarding the facial image data, the server 11 ends the processing of this flowchart.

S15: If the server 11 determines in S13 that the user of the facial image data received from the cameras 4a to 4e is a user who is registered with the data provision service (registered user) (Yes in S13), the server 11 stores the behavioral data of the registered user. For example, the server 11 stores the behavioral data 53 described in FIG. 10 in the HDD 33.

S16: The server 11 judges whether or not the destination business information of the registered user for which the answer in S13 is determined to be "Yes" is stored in the destination-related data 52 (see FIG. 9). For example, the server 11 refers to the user registration data 51 described in FIG. 8, and acquires the ID of the registered user for which the answer in S13 is determined to be "Yes". Based on the acquired ID, the server 11 refers to the destination-related data 52 in FIG. 9, and judges whether or not the destination business information of the registered user is stored in the destination-related data 52. If the server 11 judges that the destination business information of the registered user is not stored in the destination-related data 52 (No in S16), the server 11 ends the processing of the flowchart. In other words, the server 11 does not transmit the behavioral data of the registered user for which the answer in S13 is determined to be "Yes" to the business's servers 21a to 21c.

S17: If the server 11 determines that the destination business information of the registered user is stored in the destination related data 52 (Yes in S16), it extracts the type of behavioral data based on the disclosure range information of the registered user (see the destination related data 52 in Figure 9) and transmits it to the server of the destination business indicated by the destination business information.

By performing the above operations, the type of behavioral data selected by the user is sent (provided) to the provider selected by the user.

The process of transmitting behavioral data is not limited to the order of the flowchart shown in FIG. 13. For example, the server 11 may provide the behavioral data of registered users stored (accumulated) in the HDD 33 to the provider at a predetermined time, such as midnight.

Summary of the embodiment
As described above, the server 11 includes a receiving unit (communication interface 34) that receives facial image data from the cameras 4a to 4e, a control unit 31a that collects behavioral data of the user 1 based on the facial image data, and a transmitting unit (communication interface 34) that transmits the collected behavioral data to the servers 21a to 21c of the businesses 5a to 5c.

The control unit 31a transmits to the terminal 2 first screen data for accepting consent to the provision of services of the behavioral data to the businesses 5a to 5c, and second screen data for accepting consent to the use of the behavioral data by the businesses 5a to 5c. For example, the control unit 31a transmits to the terminal 2 first screen data for displaying the screen 41 shown in FIG. 4 on the display of the terminal 2, and second screen data for displaying the screen 43 shown in FIG. 6 on the display of the terminal 2.

As a result, in a data provision service that collects user 1's behavioral data and provides it to a business, user 1, whose behavioral data is collected, can easily understand how the behavioral data is handled. For example, user 1 can understand from screen 41 of terminal 2, which is based on the first screen data, that the behavioral data is collected by (the business of) the data provision service and provided to businesses 5a to 5c, and can understand from screen 43 of terminal 2, which is based on the second screen data, how the behavioral data is used by businesses 5a to 5c, and can therefore easily understand how the behavioral data is handled.

In addition, after consent to the data provision service is obtained, the control unit 31a transmits the second screen data to the terminal 2. This allows the user to clearly distinguish between how the behavioral data is handled in the data provision service and how the behavioral data is handled by the businesses 5a to 5c, and allows the user to more easily understand how the behavioral data is handled.

The control unit 31a also transmits to the terminal 2 third screen data for selecting one of the businesses 5a to 5c to which the behavioral data will be provided. For example, the control unit 31a transmits to the terminal 2 third screen data for displaying the screen 42 shown in FIG. 5 on the display of the terminal 2. This allows the user to control the destination to which the behavioral data will be provided.

The control unit 31a also transmits the second screen data of the business selected in the third screen data to the terminal 2. For example, the control unit 31a transmits data of the consent acceptance screen (screen 43 in FIG. 6) of the business selected in screen 42 in FIG. 5 to the terminal 42. This allows the user to determine whether or not to consent to the use of the behavioral data of the business selected by the user.

The control unit 31a also transmits to the terminal 2 fourth screen data for selecting the type of behavioral data to be provided to the businesses 5a to 5c. For example, the control unit 31a transmits to the terminal 2 fourth screen data for displaying the screen 44 shown in FIG. 7 on the display of the terminal 2. This allows the user to control the type of behavioral data to be provided to the businesses 5a to 5c.

The control unit 31a also transmits to the terminal 2 the fourth screen data of the business for which consent has been obtained in the second screen data. For example, the control unit 31a transmits to the terminal 2 the data of the behavioral data type selection screen (screen 44 in FIG. 7) of the business for which consent has been obtained in screen 43 in FIG. 6. This allows the user to select the type of behavioral data from the behavioral data of the business for which the user has consented to the use of the behavioral data.

<Modification 1>
The control unit 31a may provide a privilege to the user 1 according to the type of selected behavioral data. For example, the control unit 31a may provide more points to the user 1 as the selected type of behavioral data is more important to the businesses 5a to 5c. This provides an incentive to the user 1 to register for a behavioral data providing service. Furthermore, the businesses 5a to 5c can obtain behavioral data that is more important to the businesses 5a to 5c.

In addition, as shown in FIG. 7, along with the display of the types of behavioral data and the toggle switches 44a to 44e for selecting the types of behavioral data, the contents of the benefits to be granted to User 1 may be displayed for each type of behavioral data. In this way, when selecting the behavioral data to be provided, the contents of the benefits to be granted can be easily seen and serve as a criterion for selection.

The control unit 31a may also stop providing the reward when the selection of the type of behavioral data is cancelled. This provides an incentive to the user 1 to maintain the selection (provision) of the behavioral data.

<Modification 2>
Some users 1 may wish to delete the behavioral data stored (accumulated) in the server 11. In response to a request from the user 1, the control unit 31a may delete the behavioral data stored in the server 11. In this case, the control unit 31a may accept a deletion period for the behavioral data. For example, the control unit 31a may accept a deletion period for the behavioral data, such as a period going back three months from the present.

When deleting behavioral data, the control unit 31a may withdraw the rewards granted to the user 1. For example, the control unit 31a may subtract points corresponding to the deletion period from the points granted to the user 1.

When collecting rewards, the control unit 31a may transmit the details of the collection to the terminal 2 of the user 1. For example, the control unit 31a may transmit the number of points to be subtracted to the terminal 2 of the user 1. This allows the user 1 to know the amount of rewards to be collected by deleting the behavioral data.

<Modification 3>
In the present disclosure, the behavioral data of the user 1 collected by the data providing PF 3 is provided to the businesses 5a to 5c, but the data providing PF 3 may provide not only the behavioral data but also the personal data of the user 1 held by the data providing PF 3 to the businesses 5a to 5c. In this case, the personal data provided to the businesses 5a to 5c is treated in the same way as the behavioral data, and it is possible to select the recipient of the data, grant benefits, etc.

In the above-described embodiments, the notation "part" used for each component may be replaced with other notations such as "circuitry", "assembly", "device", "unit", or "module".

Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modified or amended examples within the scope of the claims. It is understood that such modified or amended examples also fall within the technical scope of the present disclosure. Furthermore, the components in the embodiments may be combined in any manner as long as it does not deviate from the spirit of the present disclosure.

The present disclosure can be realized by software, hardware, or software in conjunction with hardware. Each functional block used in the description of the above embodiments may be realized, in part or in whole, as an LSI, which is an integrated circuit, and each process described in the above embodiments may be controlled, in part or in whole, by one LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of one chip that includes some or all of the functional blocks. The LSI may have data input and output. Depending on the degree of integration, the LSI may be called an IC, a system LSI, a super LSI, or an ultra LSI.

The integrated circuit method is not limited to LSI, and may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. In addition, a field programmable gate array (FPGA) that can be programmed after LSI manufacturing, or a reconfigurable processor that can reconfigure the connections and settings of circuit cells inside the LSI, may be used. The present disclosure may be realized as digital processing or analog processing.

Furthermore, if an integrated circuit technology that can replace LSI emerges due to advances in semiconductor technology or other derived technologies, it is natural that such technology can be used to integrate functional blocks. The application of biotechnology, etc. is also a possibility.

This disclosure is useful for data provision services that use camera images.

1 User 2 Terminal 3 Data provision PF
4a to 4e Cameras 5a to 5c Business operators 6a to 6c IC card systems 11, 21a to 21c, 22a to 22c Servers

Claims (13)

an acquisition unit that receives face image data of a user from a camera;
a control unit that collects behavioral data of the user as a history of face recognition processing based on the face image data;
Equipped with
The control unit is
transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data;
When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal;
When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator;
extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business;
Information processing device. The control unit transmits the behavioral data of the user selected by the user to a server of the business in real time.
The information processing device according to claim 1 . The control unit transmits the first screen data, and after a selection is made on a screen of the first screen data to agree to terms of use regarding the handling of the behavioral data with respect to the behavioral data being provided to the business operator, transmits the second screen data to the terminal.
3. The information processing device according to claim 1 or 2. the control unit transmits, to the terminal, fourth screen data for selecting a provider of the behavioral data;
The information processing device according to claim 1 . The control unit transmits the second screen data of the business operator selected in the fourth screen data to the terminal.
The information processing device according to claim 4. The control unit transmits to the user's terminal a screen displaying information on a privilege to be granted to the user in accordance with the type of the user's behavioral data selected by the user.
The information processing device according to claim 1 . The control unit stops providing the privilege information to the user when a selection of the type of behavioral data of the user is cancelled.
The information processing device according to claim 6. The control unit transmits, when the behavioral data of the user is deleted, a message to the user indicating that the privilege of the privilege information is to be collected to the user's terminal.
The information processing device according to claim 6. The information processing device according to claim 6, wherein when the user's behavioral data is deleted , the control unit transmits a message to the user's terminal informing the user that the bonus information previously granted will be redeemed according to the period during which the selection of the type of behavioral data was deactivated. An information processing device,
receiving face image data of a user from a camera;
Collecting behavioral data of the user as a history of face recognition processing based on the face image data;
transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data;
When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal;
When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator;
extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business;
How data is provided. On the computer,
receiving face image data of a user from a camera;
Collecting behavioral data of the user as a history of face recognition processing based on the face image data;
transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data;
When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal;
When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator;
extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business;
A program that executes a process. A behavioral data providing processing system including a control processing device, a server of a business entity that receives behavioral data of a user transmitted from the control processing device, and a terminal that receives screen data transmitted from the control processing device,
The control processing device includes:
receiving face image data of a user from a camera;
Collecting behavioral data of the user as a history of face recognition processing based on the face image data;
transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data;
When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal;
When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator;
extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business;
Behavioral data provision and processing system. A behavioral data providing processing method for a behavioral data providing processing system including a control processing device, a server of a business entity that receives user behavioral data transmitted from the control processing device, and a terminal that receives screen data transmitted from the control processing device, comprising:
The control processing device,
receiving face image data of a user from a camera;
Collecting behavioral data of the user as a history of face recognition processing based on the face image data;
transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data;
When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal;
When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator;
extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business;
How behavioral data is provided and processed.

Images