JP7648565B2 - Information processing device, information processing method, and information processing program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and an information processing program.

Various technologies have been provided for managing information related to sensors. For example, there is a technology that stores information identifying the sensor that detects a physical quantity in a measurement atmosphere and the date and time when the sensor began to be used as sensor information.

JP 2021-051052 A

However, there is room for improvement in the above conventional technology. For example, the above conventional technology merely stores information identifying a sensor and the date and time when the sensor began to be used as sensor information, and does not necessarily allow for appropriate management of information detected by the sensor. As a result, the above conventional technology makes it difficult to provide services that use information detected by the sensor, and there is a need to make it possible to appropriately manage information detected by sensors.

The present application has been made in consideration of the above, and aims to provide an information processing device, an information processing method, and an information processing program that enable appropriate management of information detected by a sensor.

The information processing device according to the present application is characterized by comprising an acquisition unit that acquires sensor information detected by a sensor from a terminal device used by a user, and a registration unit that associates the sensor information acquired by the acquisition unit with the context of the sensor information at the time of detection by the sensor and registers the associated information in a database.

According to one aspect of the embodiment, it is possible to appropriately manage information detected by the sensor.

FIG. 1 is a diagram illustrating an example of information processing according to an embodiment. FIG. 2 is a diagram illustrating an example of information processing according to the embodiment. FIG. 3 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. FIG. 4 is a diagram illustrating an example of the configuration of an information processing device according to an embodiment. FIG. 5 is a diagram illustrating an example of a user information storage unit according to the embodiment. FIG. 6 is a diagram illustrating an example of a store information storage unit according to the embodiment. FIG. 7 is a diagram illustrating an example of a registration information storage unit according to the embodiment. FIG. 8 is a flowchart illustrating an example of information processing according to the embodiment. FIG. 9 is a flowchart illustrating an example of information processing according to the embodiment. FIG. 10 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device.

Below, the information processing device, information processing method, and information processing program according to the present application will be described in detail with reference to the drawings. Note that the information processing device, information processing method, and information processing program according to the present application are not limited to these embodiments. In addition, the same parts in the following embodiments will be denoted by the same reference numerals, and duplicated descriptions will be omitted.

(Embodiment)
[1. Information Processing]
[1-1. Overall overview〕
First, an example of information processing according to an embodiment will be described with reference to Fig. 1 and Fig. 2. Fig. 1 and Fig. 2 are diagrams showing an example of information processing according to an embodiment.

Specifically, FIG. 1 is a diagram showing an example of information processing related to the registration of information. In FIG. 1, the information processing device 100 acquires sensor information detected by a sensor from the terminal device 10 used by the user, and registers the acquired sensor information in a sensor database (hereinafter referred to as "sensor data DB") in association with the context at the time of detection by the sensor of the sensor information. The sensor information includes various information detected by the sensor regarding the state of the terminal device 10 or the environment surrounding the terminal device 10. For example, the sensor information may be information regarding various objects such as temperature, air pressure, sound, vibration, acceleration, illuminance (brightness), and position. Note that the above is only an example, and the sensor information may be information regarding any object detected by the sensor. For example, the sound is not limited to audible frequency sound, but may be ultrasonic, and the audible frequency sound is not limited to voice such as the user's (person's) speech, but may be environmental sound, noise, etc. Also, for example, the sensor information may be biological information such as blood glucose level information indicating the user's blood glucose level and heart rate information indicating the heart rate.

In the example shown below, the state of a user using the terminal device 10 is described as an example of a context that is registered in association with sensor information. For example, in FIG. 1, states related to a user's entry and exit from a store, such as a state in which the user has entered a store, a state in which the user has left the store, and a state in which the user is outside the store, are described as examples of context.

Note that the above is merely an example, and the context registered in association with the sensor information may be any information as long as it is the context at the time of detection by the sensor. For example, the context may be various situations of the user estimated based on the situation of the user or the terminal device 10 or the environment (background) of the user or the terminal device 10. The context may also be the physical environment in which the user is placed, the social environment in which the user is placed, the user's motion state, and the estimated emotions of the user. The context may also be the psychological state of the user estimated based on the situation of the user or the terminal device 10 or the environment (background) of the user or the terminal device 10.

In addition, FIG. 2 is a diagram showing an example of information processing related to information estimation. In FIG. 2, the information processing device 100 acquires sensor information detected by a sensor from a terminal device 10 used by a user to be estimated (also referred to as a "target user"), and estimates the target user's entry and exit into a store to be estimated (also referred to as a "target store") based on the acquired sensor information (also referred to as "target sensor information"). For example, FIG. 2 illustrates an example in which user U5 is the target user and the information processing device 100 estimates the entry and exit into a store of user U5.

1-1-1. Configuration of Information Processing System
In the following, the configuration of the information processing system 1 will be described first with reference to FIG. 3, and then the details of the processing in FIG. 1 and FIG. 2 will be described. FIG. 3 is a diagram showing a configuration example of the information processing system according to the embodiment. As shown in FIG. 3, the information processing system 1 includes a terminal device 10, a store device 20, a data providing device 50, and an information processing device 100. The terminal device 10, the store device 20, the data providing device 50, and the information processing device 100 are connected to each other via a predetermined network N so as to be able to communicate with each other by wire or wirelessly. Note that the information processing system 1 shown in FIG. 3 may include a plurality of terminal devices 10, a plurality of store devices 20, a plurality of data providing devices 50, and a plurality of information processing devices 100.

The terminal device 10 is a computer used by a user. The terminal device 10 is realized, for example, by a smartphone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a PDA (Personal Digital Assistant), etc. FIG. 1 shows a case where the terminal device 10 is a smartphone. Note that, below, the terminal device 10 may be referred to as a user. In other words, below, the user can also be read as the terminal device 10.

The terminal device 10 has various sensors that detect various sensor information. The terminal device 10 detects sensor information using various sensors. The terminal device 10 transmits the sensor information detected by the sensors to the information processing device 100. The terminal device 10 has a temperature sensor and detects temperature information (sensor information) of the environment surrounding the user. The terminal device 10 has an air pressure sensor and detects air pressure information (sensor information) of the environment surrounding the user. The terminal device 10 has a sound sensor such as a microphone and detects audio information (sensor information) of the environment surrounding the user. The terminal device 10 has a vibration sensor and detects vibration information (sensor information) related to the terminal device 10. The terminal device 10 has an acceleration sensor and detects acceleration information (sensor information) related to the terminal device 10. The terminal device 10 has an illuminance sensor and detects illuminance information (sensor information) of the environment surrounding the user. The terminal device 10 may also have an image sensor such as an image sensor and detect image information (sensor information) of the environment surrounding the user.

The terminal device 10 also has a position sensor and detects the user's position information (sensor information). For example, the terminal device 10 has a GPS (Global Positioning System) sensor. The terminal device 10 may also detect and acquire the user's position information (sensor information) using a specific wireless communication function such as Wi-Fi (registered trademark) (Wireless-Fidelity) or Bluetooth (registered trademark), a function such as a beacon, or position information of a base station with which the terminal device 10 is communicating. Note that, hereinafter, position information may be simply referred to as "position". For example, the terminal device 10 may increase the accuracy of estimating the user's position by combining information from the GPS, the above-mentioned wireless communication function, and a beacon. The terminal device 10 also transmits the user's position to the information processing device 100.

In addition, the terminal device 10 collects various information other than the sensor information and transmits it to the information processing device 100. The terminal device 10 transmits behavioral information indicating the behavior of the user using the terminal device 10 to the information processing device 100. The terminal device 10 transmits behavioral information related to payment using the terminal device 10 to the information processing device 100. The terminal device 10 transmits behavioral information related to payment (settlement) at a store using the terminal device 10 to the information processing device 100. The terminal device 10 transmits behavioral information indicating operations by the user to the information processing device 100. The terminal device 10 transmits behavioral information indicating the user's behavior on the Internet to the information processing device 100. For example, the terminal device 10 transmits behavioral information including posting information (input information) such as posts by the user to a social networking service (SNS) to the information processing device 100. For example, the terminal device 10 transmits behavioral information including posting information posted by the user to Twitter (registered trademark), Facebook (registered trademark), Instagram (registered trademark), etc., to the information processing device 100.

In the following, a user identified by user ID "U1" may be referred to as "user U1". In this way, when "user U* (* is an arbitrary numerical value)" is written below, it indicates that the user is identified by user ID "U*". For example, when "user U2" is written, the user is identified by user ID "U2". In addition, in the example shown in FIG. 1 and FIG. 2, the terminal device 10 is described as terminal device 10-1 to 10-3, 10-5, etc. according to the user who uses the terminal device 10. For example, the terminal device 10-1 is the terminal device 10 used by a user (user U1) identified by user ID "U1". In addition, for example, the terminal device 10-5 is the terminal device 10 used by (user U5) identified by user ID "U5". In addition, when the terminal devices 10-1 to 10-3, 10-5, etc. are described below without any particular distinction, they are described as terminal device 10.

The store device 20 is a computer used by the manager of each store. For example, the manager of Restaurant A uses the store device 20 to send and receive information to and from the information processing device 100. For example, the store device 20 is realized by a smartphone, a tablet terminal, a notebook PC, a desktop PC, a mobile phone, a PDA, or the like. The store device 20 transmits various information related to the store to the information processing device 100. The store device 20 transmits information requested by the information processing device 100 to the information processing device 100. The store device 20 transmits store information to the information processing device 100, including various information such as the location of the store and the state of the store's entrances and exits.

The data providing device 50 is a server that provides various data to the information processing device 100. For example, the data providing device 50 may provide data related to weather, such as weather and temperature, to the information processing device 100. The data providing device 50 may provide event information related to the weather in the area where each store is located to the information processing device 100. For example, the data providing device 50 provides open data, which is data that is permitted for wide-open use, to the information processing device 100. For example, the data providing device 50 may be an information processing device that is managed by each local government and provides data held by the local government to the outside as data. The data providing device 50 may provide various data, such as data related to traffic such as road information, geospatial information, disaster prevention and mitigation information, procurement information, statistical information, etc., as long as the data (information) is permitted for use.

The information processing device 100 is a computer that executes processes related to the registration of information and processes related to the estimation of information. The information processing device 100 is an information processing device that can communicate with various devices via a predetermined network N such as the Internet, and is realized, for example, by a server device or a cloud system. For example, the information processing device 100 is connected to various other devices via the network N so as to be able to communicate with them.

The information processing device 100 executes a registration process in which sensor information detected by a sensor is associated with other information and registered in a sensor data DB. The information processing device 100 executes a process of estimating a context based on the sensor information (also referred to as a "context estimation process"). The information processing device 100 associates the estimated context with the sensor information used for the estimation and registers them in the sensor data DB. For example, the information processing device 100 associates the estimated context indicating entry and exit into a store, information indicating the store, and the sensor information used for the estimation and registers them in the sensor data DB. The information processing device 100 provides a service using the sensor data DB.

The information processing device 100 also executes an entry/exit estimation process (also simply referred to as an "estimation process") that estimates the target user's entry and exit from the target store based on the target sensor information detected by the sensor. The information processing device 100 executes the estimation process using a sensor data DB in which sensor information acquired when the user enters and leaves the target store and history information that associates the target store with the sensor information are registered. The information processing device 100 estimates the target user's entry and exit from the target store based on a comparison between the history information registered in the sensor data DB and the target sensor information. The information processing device 100 provides information to the target user according to the target user's entry and exit from the target store.

[1-2. Information processing related to information registration]
From here, the flow of information processing will be described with reference to FIG. 1. In FIG. 1, the positions of users U1 to U3 are shown in a schematic manner using a map MP1 or the like. The information processing device 100 acquires sensor information SD11 from the terminal device 10-1 used by the user U1 (step S11-1). In FIG. 1, the terminal device 10-1 performs sensor detection when the user U1 enters the store SP11. The terminal device 10-1 transmits sensor information SD11 based on the sensor detection to the information processing device 100. The information processing device 100 receives the sensor information SD11 from the terminal device 10-1. In FIG. 1, the information processing device 100 receives sensor information SD11 corresponding to the user U1's entry into the store SP11 from the terminal device 10-1. As described above, the sensor information such as the sensor information SD11 may be information on various targets such as temperature, air pressure, sound, acceleration, illuminance (brightness), and position.

Then, the information processing device 100 acquires information indicating the context corresponding to the sensor information SD11 (step S12-1). In FIG. 1, the information processing device 100 acquires information indicating that the context of the user U1 at the time of detection corresponding to the sensor information SD11 is entry into a store SP11. For example, the information processing device 100 acquires context information CD11 including information indicating that the context corresponding to the sensor information SD11 is the context CN11 of entry into a store and information indicating that the store is store SP11.

The information processing device 100 may acquire the context information CD11 by any method as long as it is possible to acquire the context information CD11. For example, the information processing device 100 may acquire the context information CD11 from the terminal device 10-1. In this case, the terminal device 10-1 transmits the context information CD11 to the information processing device 100 in response to an operation by the user U1. The information processing device 100 receives the context information CD11 from the terminal device 10-1.

Note that the above is merely an example, and the information processing device 100 may estimate the context information CD11 using various information. For example, the information processing device 100 may estimate that the user U1 has entered the store SP11 at the time of detection corresponding to the sensor information SD11, using various information acquired from the terminal device 10-1. In this case, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD11 is the context CN11 based on behavioral information of the user U1 acquired from the terminal device 10-1, etc. The information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD11 is the context CN11 based on behavioral information indicating that the user U1 has opened the door to the store SP11.

Then, the information processing device 100 registers the sensor information SD11 in the sensor data DB (step S13-1). In FIG. 1, as shown in the registration information group DT, the information processing device 100 associates information indicating the context corresponding to the sensor information SD11 and registers it in the sensor data DB. The information processing device 100 associates the sensor information SD11 with the context information CD11 and registers it in the sensor data DB. In this way, the information processing device 100 registers the context information CD11 indicating that the context at the time of detection corresponding to the sensor information SD11 is context CN11 and the store is store SP11 in the sensor data DB in association with the sensor information SD11.

In other words, the information processing device 100 registers information indicating that the context of user U1 at the time of detection corresponding to the sensor information SD11 is entry into store SP11 in the sensor data DB in association with the sensor information SD11. The information processing device 100 registers history information associating the sensor information SD11 acquired when user U1 enters store SP11 with the store SP11 in the sensor data DB. In this way, the information processing device 100 manages history information associating the sensor information acquired when the user enters and leaves a store with the store. The registered information group DT in the sensor data DB includes the sensor information acquired when the user enters the store.

The information processing device 100 also acquires sensor information SD21 from the terminal device 10-2 used by user U2 (step S11-2). In FIG. 1, the terminal device 10-2 performs sensor detection when user U2 moves on foot through the area corresponding to map MP1. The terminal device 10-2 transmits sensor information SD21 based on the sensor detection to the information processing device 100. The information processing device 100 receives the sensor information SD21 from the terminal device 10-2. In FIG. 1, the information processing device 100 receives sensor information SD21 corresponding to the movement of user U2 from the terminal device 10-2.

Then, the information processing device 100 acquires information indicating the context corresponding to the sensor information SD21 (step S12-2). In FIG. 1, the information processing device 100 acquires information indicating that the context of the user U2 at the time of detection corresponding to the sensor information SD21 is moving on foot. For example, the information processing device 100 acquires context information CD21 including information indicating that the context corresponding to the sensor information SD21 is the context CN21 of moving on foot.

The information processing device 100 may acquire the context information CD21 by any method as long as it is possible to acquire the context information CD21. For example, the information processing device 100 may acquire the context information CD21 from the terminal device 10-2. In this case, the terminal device 10-2 transmits the context information CD21 to the information processing device 100 in response to an operation by the user U2. The information processing device 100 receives the context information CD21 from the terminal device 10-2.

Note that the above is merely an example, and the information processing device 100 may estimate the context information CD21 using various information. For example, the information processing device 100 may estimate that the user U2 is moving on foot at the time of detection corresponding to the sensor information SD21 using various information acquired from the terminal device 10-2. In this case, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD21 is the context CN21 based on the behavior information of the user U2 acquired from the terminal device 10-2, etc. For example, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD21 is the context CN21 based on the behavior information indicating the content posted by the user U2 using the terminal device 10-2. The information processing device 100 may also estimate that the user U2 is moving on foot based on the acceleration information included in the sensor information SD21, etc.

Then, the information processing device 100 registers the sensor information SD21 in the sensor data DB (step S13-2). In FIG. 1, as shown in the registration information group DT, the information processing device 100 associates information indicating the context corresponding to the sensor information SD21 and registers it in the sensor data DB. The information processing device 100 associates the context information CD21 with the sensor information SD21 and registers it in the sensor data DB. In this way, the information processing device 100 registers the context information CD21 indicating that the context at the time of detection corresponding to the sensor information SD21 is context CN21 and that there is no corresponding store in the sensor data DB in association with the sensor information SD21. That is, the information processing device 100 associates information indicating that the context of user U2 at the time of detection corresponding to the sensor information SD21 is moving on foot with the sensor information SD21 and registers it in the sensor data DB.

The information processing device 100 also acquires sensor information SD31 from the terminal device 10-3 used by user U3 (step S11-3). In FIG. 1, the terminal device 10-3 performs sensor detection when user U3 leaves store SP22. The terminal device 10-3 transmits sensor information SD31 based on the sensor detection to the information processing device 100. The information processing device 100 receives the sensor information SD31 from the terminal device 10-3. In FIG. 1, the information processing device 100 receives sensor information SD31 corresponding to the time when user U3 leaves store SP22 from the terminal device 10-3.

Then, the information processing device 100 acquires information indicating the context corresponding to the sensor information SD31 (step S12-3). In FIG. 1, the information processing device 100 acquires information indicating that the context of user U3 at the time of detection corresponding to the sensor information SD31 is exiting store SP22. For example, the information processing device 100 acquires context information CD31 including information indicating that the context corresponding to the sensor information SD31 is the context CN31 of exiting a store and information indicating that the store is store SP22.

The information processing device 100 may acquire the context information CD31 by any method as long as it is possible to acquire the context information CD31. For example, the information processing device 100 may acquire the context information CD31 from the terminal device 10-3. In this case, the terminal device 10-3 transmits the context information CD31 to the information processing device 100 in response to an operation by the user U3. The information processing device 100 receives the context information CD31 from the terminal device 10-3.

Note that the above is merely an example, and the information processing device 100 may estimate the context information CD31 using various information. For example, the information processing device 100 may estimate that the user U3 has left the store SP22 at the time of detection corresponding to the sensor information SD31, using various information acquired from the terminal device 10-3. In this case, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD31 is the context CN31 based on behavioral information of the user U3 acquired from the terminal device 10-3, etc. For example, the information processing device 100 may estimate that the context at the time of detection corresponding to the sensor information SD31 is the context CN31 based on behavioral information indicating electronic settlement (payment) etc. using the terminal device 10-3 of the user U3.

Then, the information processing device 100 registers the sensor information SD31 in the sensor data DB (step S13-3). In FIG. 1, as shown in the registration information group DT, the information processing device 100 associates information indicating the context corresponding to the sensor information SD31 and registers it in the sensor data DB. The information processing device 100 associates the context information CD31 with the sensor information SD31 and registers it in the sensor data DB. In this way, the information processing device 100 registers the context information CD31 indicating that the context at the time of detection corresponding to the sensor information SD31 is context CN31 and that the store is store SP22 in the sensor data DB, associated with the sensor information SD31.

That is, the information processing device 100 registers information indicating that the context of user U3 at the time of detection corresponding to the sensor information SD31 is leaving store SP22 in association with the sensor information SD31 in the sensor data DB. The information processing device 100 registers history information associating the sensor information SD31 acquired when user U3 leaves store SP22 with the store SP22 in the sensor data DB. In this way, the information processing device 100 manages history information associating the sensor information acquired when the user enters and leaves a store with the store. The registered information group DT in the sensor data DB includes the sensor information acquired when the user leaves the store.

Note that while FIG. 1 illustrates three users U1 to U3, the information processing device 100 acquires sensor information from a large number of users (e.g., 1 million users or 10 million users) such as user U4, not limited to users U1 to U3. The information processing device 100 then associates the sensor information acquired for a large number of users with the context at the time of detection by the sensor of the sensor information, stores, etc., and registers the information in the sensor data DB.

In this way, the information processing device 100 registers in the database the sensor information detected by the sensor and the context at the time of detection by the sensor in association with each other. In FIG. 1, the information processing device 100 stores the sensor information in association with information indicating the context corresponding to the sensor information. Furthermore, when there is a store corresponding to the sensor information, the information processing device 100 registers in the database the sensor information in association with information indicating the context corresponding to the sensor information and information indicating the store corresponding to the sensor information. As a result, when new sensor information is acquired, the information processing device 100 can use the database to enable appropriate estimation (identification) of the context and store to which the newly acquired sensor information corresponds. Therefore, the information processing device 100 can enable appropriate management of information detected by the sensor.

[1-3. Information processing for information estimation]
Next, an example of a process in which the information processing device 100 estimates the entrance and exit of a target user to a target store based on sensor information detected by a sensor will be described with reference to Fig. 2. Specifically, in the following, a case will be described in which, when new sensor information is acquired, the information processing device 100 uses the sensor data DB to estimate the entrance and exit of a user to a store corresponding to the newly acquired sensor information. Note that the description of the same points as in Fig. 1 will be omitted as appropriate.

2 shows a case where the information processing device 100 performs estimation processing with user U5 as the target user. The information processing device 100 acquires sensor information SD51 from the terminal device 10-5 used by user U5 (step S21). In FIG. 2, the terminal device 10-5 performs sensor detection when user U5 enters the store SP11. The terminal device 10-5 transmits sensor information SD51 based on the sensor detection to the information processing device 100. The information processing device 100 receives sensor information SD51 from the terminal device 10-5. In FIG. 2, the information processing device 100 receives sensor information SD51 corresponding to the time when user U5 enters the store SP11 from the terminal device 10-5. As a result, the information processing device 100 acquires sensor information SD51 for user U5, who is the target user, as shown in the target information TG. As described above, the sensor information SD51 may be information on various targets such as temperature, air pressure, sound, acceleration, illuminance (brightness), and position.

Then, the information processing device 100 estimates user U5's entry and exit from the store based on the sensor information SD51 (step S22). In FIG. 2, the information processing device 100 estimates user U5's entry and exit from the store using a registered information group DT, which is historical information registered in the sensor data DB. In this way, the information processing device 100 estimates user U5's entry and exit from the store using a registered information group DT that includes sensor information acquired when the user enters the store and sensor information acquired when the user leaves the store.

For example, the information processing device 100 estimates user U5's entry and exit from the store based on a comparison between the registered information group DT in the sensor data DB and the sensor information SD51. The information processing device 100 estimates user U5's entry and exit from the store based on a comparison between each piece of sensor information included in the registered information group DT and the sensor information SD51. For example, the information processing device 100 estimates that the context corresponding to the sensor information similar to the sensor information SD51 among the pieces of sensor information included in the registered information group DT is the context of user U5 at the time the sensor information SD51 was detected.

For example, the information processing device 100 estimates that the context corresponding to the sensor information having the highest similarity to the sensor information SD51 among the sensor information included in the registration information group DT is the context of the user U5 at the time of detection of the sensor information SD51. In FIG. 2, the information processing device 100 compares the registration information group DT in the sensor data DB with the sensor information SD51, and determines that the sensor information SD51 is similar to the sensor information SD11 among the sensor information included in the registration information group DT. Then, the information processing device 100 estimates that the context of the user U5 at the time of detection of the sensor information SD51 is the context associated with the sensor information SD11. For example, the information processing device 100 estimates that the context of the user U5 at the time of detection of the sensor information SD51 is the context CN11 of entering a store, and that the store is store SP11. That is, as shown in the estimation result RS, the information processing device 100 estimates that user U5 has entered store SP11 when sensor information SD51 is detected.

The information processing device 100 uses a database that associates stores with sensor information that may be acquired when entering and leaving the store, and when corresponding sensor information is acquired, it estimates that a person has entered or left the store. For example, the information processing device 100 may estimate whether a person has entered or left a store using a sensor data DB in which sensor information for each action within the store is registered. The sensor data DB may also include sensor information corresponding to each of the entry paths into the store.

When estimating the entrance and exit of user U5 to store SP11 as a target store, the information processing device 100 may perform processing using only the sensor information associated with store SP11 from the information in the sensor data DB. In this case, for example, the information processing device 100 may extract sensor information associated with store SP11 from the registered information group DT in the sensor data DB, and estimate the entrance and exit of user U5 to store SP11 based on a comparison between the extracted information and sensor information SD51.

In addition, when the sensor information SD51 is similar to the sensor information SD31, the information processing device 100 estimates that the user U5 has left the store SP22 at the time the sensor information SD51 is detected. Note that the process of estimating the user's exit from the store is similar to the process of estimating the user's entry into the store described above, and therefore a detailed explanation is omitted.

In this way, the information processing device 100 estimates whether a user will enter or leave a store based on sensor information detected by a sensor. For example, the information processing device 100 compares the sensor information detected by the sensor with history information, and estimates that the context corresponding to the history with similar sensor information is the context at the time the sensor information was detected. The information processing device 100 refers to a database in which sensor information that may be acquired when entering or leaving a store is registered, and estimates whether a user will enter or leave the store based on the acquired sensor information.

Specifically, if the sensor information detected by the sensor is similar to the history detected when the user entered the target store in the past, the information processing device 100 estimates that the target user entered the target store at the time the sensor information was detected. In addition, if the sensor information detected by the sensor is similar to the history detected when the user left the target store in the past, the information processing device 100 estimates that the target user left the target store at the time the sensor information was detected. Therefore, the information processing device 100 can appropriately estimate the user's entry and exit into the store based on the information detected by the sensor.

[1-4. Other processing examples]
The above-described process is merely an example, and the information processing device 100 may perform various processes using various information.

[1-4-1. position〕
For example, when the terminal device 10 detects a location using GPS or the like, if the user enters indoors, the detection accuracy of the location may be low, and it may be difficult to estimate the user's entry and exit from the location alone. For example, when the user enters indoors, the detection result of the location may not indicate a specific point such as a predetermined range. For example, when the user enters indoors, the detection result of the location may be information indicating a range within a predetermined distance (radius of 100 m, etc.) centered on a predetermined point, or a predetermined area, etc. In such cases, it is difficult for the information processing device 100 to appropriately estimate the user's entry and exit from the store based on the location alone.

Therefore, the information processing device 100 estimates the user's entry and exit from a store using sensor information of targets other than the location in addition to the location detection results. In this case, for example, the information processing device 100 extracts target stores based on the location detection results. For example, the information processing device 100 extracts stores located within the range indicated by the location detection results as candidate stores (also called "candidate stores") for estimating entry and exit.

Then, the information processing device 100 performs a process of estimating the entrance and exit of the store using only the sensor information associated with the candidate store from among the information in the sensor data DB. In this case, for example, the information processing device 100 may extract sensor information associated with the candidate store from the registered information group DT in the sensor data DB, and estimate the entrance and exit of the target user to the store based on a comparison between the extracted information and the target sensor information.

In FIG. 2, the information processing device 100 may extract sensor information associated with a candidate store from the registered information group DT in the sensor data DB, and estimate user U5's entry and exit from the store based on a comparison between the extracted information and sensor information SD51. For example, the information processing device 100 may extract sensor information associated with a candidate store from the registered information group DT in the sensor data DB, and estimate which of the candidate stores user U5 entered and exited based on a comparison between the extracted information and sensor information SD51.

1-4-2. Feature quantity
In the above example, the case where sensor information detected by a sensor is used has been described, but the information processing device 100 may perform processing using, for example, feature amounts generated based on the sensor information. For example, the information processing device 100 may perform processing using feature amounts extracted from each piece of sensor information.

For example, the process of generating features from sensor information is performed using various techniques such as feature extraction from sensor information as appropriate, but detailed explanations will be omitted. Note that the features may be generated by any process as long as they can be generated from the sensor information. The process of generating features from the sensor information may be performed by the information processing device 100 or the terminal device 10. Also, when features are used in the above example, the process is the same except that the sensor information is substituted for the features, so detailed explanations will be omitted.

For example, the terminal device 10 generates features contained in the sensor information before and after entering and leaving a store, and transmits them to the information processing device 100. The information processing device 100 links the features with the store and registers them in the sensor data DB. The information processing device 100 may then generate a common feature (common feature) based on the average or commonality of the features for each store. The information processing device 100 may also generate a feature for each action related to a store, such as entering, leaving, and staying.

For example, the terminal device 10 transmits the feature amount of the sensor information detected by the sensor to the information processing device 100. The information processing device 100 estimates the entrance and exit of the store based on the feature amount.

[1-4-3. Examples of various estimates]
For example, the information processing device 100 may estimate whether a customer has entered or left a store depending on a change in atmospheric pressure. For example, the information processing device 100 may estimate a context depending on a payment order, such as deferred payment or advance payment. For example, in the case of a store that accepts deferred payment, the information processing device 100 may estimate that a customer has left the store at the timing when the payment action is made. For example, in the case of a store that accepts advance payment, the information processing device 100 may estimate that a customer has entered the store at the timing when the payment action is made.

The information processing device 100 may estimate various contexts, not limited to contexts related to entering and leaving a store. For example, the information processing device 100 may estimate a context related to a store, such as a context related to behavior in the store, such as eating and drinking in the store. The information processing device 100 may estimate a context related to the use of the store, such as staying in the store. For example, the information processing device 100 may estimate a context related to user movements, such as jumping rope, running, sitting, eating, etc. Also, for example, the information processing device 100 may estimate a context change related to the store based on a change in information registered in the sensor data DB.

[1-4-4. Context switching]
For example, the information processing device 100 may estimate a context change and perform processing according to the estimated context change. For example, the information processing device 100 may estimate a context change related to entering or leaving a store by estimating a context based on sensor information.

When a context change related to entering or leaving a store is estimated, the information processing device 100 may estimate that the user has entered or left the store. For example, the information processing device 100 may detect a change in the estimated context by acquiring sensor information from the user's terminal device 10, estimate the user's context from the sensor information, and estimate that the user has entered or left the store. In this case, the information processing device 100 may register the sensor information before and after entering or leaving the store in association with the store in the sensor data DB.

The information processing device 100 estimates the context based on the sensor information and estimates the user's entry and exit from the store according to the estimated context. The information processing device 100 estimates the user's entry and exit from the store according to the switch from the first context before the context estimation process to the second context estimated by the context estimation process.

For example, when the user's context switches from a first context indicating that the user is located outside the store to a second context indicating that the user is located inside the store, the information processing device 100 presumes that the user has entered the store. In FIG. 2, when the context of user U5 switches from context CN51 indicating that the user is located outside store SP11 to context CN52 indicating that the user is located inside store SP11, the information processing device 100 presumes that user U5 has entered store SP11.

For example, when the user's context switches from a first context indicating that the user is located inside a store to a second context indicating that the user is located outside the store, the information processing device 100 presumes that the user has left the store. In FIG. 2, when the context of user U5 switches from context CN52 indicating that the user is located inside store SP11 to context CN51 indicating that the user is located outside store SP11, the information processing device 100 presumes that user U5 has left store SP11.

In addition, the information processing device 100 may estimate a context switch, and if it estimates that a context switch has occurred, may associate the sensor information with the context and register it in the database.

For example, when the information processing device 100 switches from a first context indicating a location outside a store to a second context indicating a location inside the store, the information processing device 100 registers in the database the second context and the sensor information used to estimate the second context in association with each other. In FIG. 1, when the context of user U1 switches from context CN51 indicating a location outside store SP11 to context CN52 indicating a location inside store SP11, the information processing device 100 registers in the sensor data DB the context CN52 and the sensor information used to estimate the context CN52 in association with each other. In this case, the information processing device 100 may also register in the sensor data DB other sensor information that was used to estimate the previous context CN51 in association with the context CN52.

For example, when the information processing device 100 switches from a first context indicating that the user is located inside a store to a second context indicating that the user is located outside the store, the information processing device 100 registers in the database the second context and the sensor information used to estimate the second context in association with each other. In FIG. 1, when the context of user U1 switches from context CN52 indicating that the user is located inside store SP11 to context CN51 indicating that the user is located outside store SP11, the information processing device 100 registers in the sensor data DB the context CN51 and the sensor information used to estimate the context CN51 in association with each other. In this case, the information processing device 100 may also register in the sensor data DB other sensor information that was used to estimate the previous context CN52 in association with the context CN51.

[1-4-5. Examples of services provided]
The information processing device 100 may provide various services using the various types of information described above. For example, the information processing device 100 may provide information in response to store entry and exit, such as distribution of advertisements or coupons. For example, when the information processing device 100 estimates that a user has entered a store, it distributes a coupon related to the store to the terminal device 10 used by the user. In FIG. 2, when the information processing device 100 estimates that a user U5 has entered a store SP11, it distributes a discount coupon for a product provided by the store SP11 to the terminal device 10-5 used by the user U5.

For example, when the information processing device 100 estimates that a user has left a store, it distributes to the terminal device 10 used by the user coupons for stores located within a predetermined range from the store (for example, within a radius of 100 m). In FIG. 2, when the information processing device 100 estimates that user U5 has left store SP11, it distributes to the terminal device 10-5 used by user U5 discount coupons for products offered by a store located within a predetermined range from store SP11 (for example, store SP22, etc.).

[1-4-6. Example of database update]
The above-mentioned registration (update) of the database (sensor database, etc.) is merely an example, and the information processing device 100 may update the database using various information. For example, the information processing device 100 may register a new association between a store and a context based on reliable data such as purchase information from a payment app. Also, for example, if the detected context is significantly different from any of the existing store data, the information processing device 100 may consider that it may be a new store and request the user to provide information. In this case, the information processing device 100 may associate the detected sensor information and context with the store information provided by the user and register them in the database.

In addition, for example, if a part of the context linked to a store changes discontinuously over a certain period of time, the information processing device 100 may detect this change and update the model to improve future estimation accuracy. For example, if a part of the context linked to a store changes discontinuously over a certain period of time due to a change in air pressure caused by changing ventilation equipment, or a change in illuminance caused by adding a roof, the information processing device 100 may detect this change and update the model to improve future estimation accuracy.

[1-4-7. Other estimated store closures]
In the above example, the processing using the sensor data DB has been described as an example, but the information processing device 100 may perform processing without using the sensor data DB. For example, the information processing device 100 may determine whether the target user has left the store based on whether the reaction value of a sensor corresponding to the target user is close to the reaction value of a sensor that has been identified as having left the store before the target user.

For example, the information processing device 100 may compare sensor data corresponding to the target user with sensor data of other users when they left the store, and if the similarity of the data is equal to or greater than a predetermined threshold, may infer that the target user has left the store. For example, the information processing device 100 may temporarily store the reaction value of a user who previously left the store in local memory using BLE (Bluetooth Low Energy) or the like, and, based on the sensor change data, infer that the target user has left the store if the waveform of the sensor change data becomes similar to that of the sensor change data.

[1-4-8. Example of rule-based processing]
In the above example, the process of estimating the user's entrance and exit based on the change in sensor data has been described as an example, but the information processing device 100 may estimate the user's entrance and exit based on a rule base. For example, the information processing device 100 may estimate the user's entrance and exit using rule information indicating a rule for determining whether the user has entered or left the store. For example, the information processing device 100 may estimate the user's entrance and exit using rule information that defines an arbitrary rule base such as "enter the store when the beacon at the entrance is detected,""leave the store 20 seconds after payment," or "leave the store 15 seconds before reacting to the parking lot sensor." For example, when the sensor data corresponds to a rule included in the rule information, the information processing device 100 may estimate that the user corresponding to the sensor data has performed an action corresponding to the rule.

2. Configuration of information processing device
Next, the configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 4, the information processing device 100 has a communication unit 110, a storage unit 120, and a control unit 130. Note that the information processing device 100 may have an input unit (e.g., a keyboard, a mouse, etc.) that accepts various operations from an administrator of the information processing device 100, and a display unit (e.g., a liquid crystal display, etc.) that displays various information.

(Communication unit 110)
The communication unit 110 is realized by, for example, a network interface card (NIC) etc. The communication unit 110 is connected to a network via a wired or wireless connection, and transmits and receives information to and from the terminal device 10.

(Memory unit 120)
The storage unit 120 is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 4 , the storage unit 120 according to the embodiment includes a user information storage unit 121, a store information storage unit 122, and a registration information storage unit 123.

(User information storage unit 121)
The user information storage unit 121 according to the embodiment stores various information related to a user. For example, the user information storage unit 121 stores various information related to user attributes. Fig. 5 is a diagram illustrating an example of the user information storage unit according to the embodiment. The user information storage unit 121 illustrated in Fig. 5 includes items such as "user ID", "age", "gender", "home", "workplace", "location", and "context".

"User ID" indicates identification information for identifying a user. For example, a user identified by user ID "U1" corresponds to user U1 shown in the example of FIG. 1. "Age" indicates the age of the user. Note that "age" may be the specific age of the user, such as 35 years old. "Gender" indicates the gender of the user.

"Home" indicates the location information of the user's home. In FIG. 5, "Home" is illustrated as an abstract code such as "LC11", but it may be information indicating latitude and longitude, or information indicating an address such as "Z Town, Y City, X Prefecture". It may also be latitude and longitude information. For example, "Home" may also be a region name or an address.

"Workplace" indicates the location information of the user's workplace. In FIG. 5, "workplace" is illustrated as an abstract code such as "LC12", but it may be information indicating latitude and longitude, or information indicating an address such as "Z Town, Y City, X Prefecture". For example, "workplace" may also be a region name or an address.

"Location" indicates the location acquired (detected) for the user. In FIG. 5, "Location" indicates the last location acquired for the user (latest location). Note that "Location" may store multiple locations for the user. For example, "Location" may store a history of locations acquired for the user, that is, information indicating changes in the user's location. Also, in FIG. 5, "Location" is illustrated as an abstract code such as "LC1", but it may also be information indicating a range such as X City, Y Town, A Area, information indicating latitude and longitude, or information indicating an address such as "X Prefecture, Y City, Z Town". For example, "Location" may be information indicating the target area of a store or the like where the user is located.

"Context" indicates the context acquired (estimated) for the user. In FIG. 5, "context" indicates the last context acquired for the user (latest context). Note that multiple contexts may be stored for the user in "context", and for example, "context" may store a history of contexts acquired for the user, i.e., information indicating changes in the user's context. In FIG. 5, "context" is illustrated as an abstract symbol such as "CN11", but concrete information indicating the user's context is stored. For example, "context" stores information such as "entered store SP11", "left store SP12", "traveling on foot", etc.

For example, the age of a user (user U1) identified by user ID "U1" is "20s" and the gender is "male." User U1's home address is "LC11." User U1's workplace is "LC12." User U1's latest location is "LC1." User U1's context is "CN11."

The user information storage unit 121 may store various information according to the purpose, not limited to the above. For example, the user information storage unit 121 may store information on the demographic attributes and psychographic attributes of the user. For example, the user information storage unit 121 may store information such as name, family structure, income, interests, and lifestyle. The user information storage unit 121 may store the date and time when each position was acquired in association with each position. The user information storage unit 121 may store the date and time when each context was acquired in association with each context.

(Store information storage unit 122)
The store information storage unit 122 according to the embodiment stores various information related to stores. Fig. 6 is a diagram illustrating an example of the store information storage unit according to the embodiment. For example, the store information storage unit 122 stores information related to various stores. The store information storage unit 122 illustrated in Fig. 6 includes items such as "store ID", "name", "category", and "store information".

"Store ID" indicates identification information for identifying a store. "Name" indicates the specific name of the store. For example, "Name" may be a combination of the store name, such as "XX Restaurant X Town Branch," and information indicating the store's location. Furthermore, "Category" indicates the category to which the store belongs.

"Store information" indicates various information related to the store (store information). Various information such as the location of the store and the appearance of the store's entrance/exit is stored in "store information". For example, the appearance of the store's entrance/exit includes the location of the entrance/exit, the appearance of the entrance/exit door, the appearance of the entrance/exit stairs, etc. For example, the appearance of the entrance/exit door includes the presence or absence of a door, whether the door is automatic or manual, the weight of the door, etc. For example, the appearance of the entrance/exit stairs includes the number of stairs, the height of the stairs, etc.

In FIG. 6, "store information" is illustrated with abstract symbols such as "store information #11" and "store information #12", but store information #11, store information #12, etc. include various information about each store. For example, store information #11 indicates the location where restaurant A is located. Store information #11 also includes information indicating the appearance of restaurant A's entrance and exit, the appearance of the stairs at the entrance, etc.

For example, in the example of FIG. 6, the store (store SP11) identified by the store ID "SP11" is named "Restaurant A" and belongs to the category "Dining". Also, for example, in the example of FIG. 6, store SP11, which is Restaurant A, has store information #11.

The store information storage unit 122 may store various types of information according to the purpose, not limited to the above. The store information storage unit 122 may store not only store information, but also various types of information about facilities and areas other than stores.

(Registration information storage unit 123)
The registration information storage unit 123 according to the embodiment stores various information related to registration. The registration information storage unit 123 stores various information related to sensing (detection) by a sensor. Fig. 7 is a diagram illustrating an example of the registration information storage unit according to the embodiment. The registration information storage unit 123 illustrated in Fig. 7 includes items such as "registration ID", "date and time", "sensor information", "context", and "store".

"Registration ID" indicates identification information for identifying the acquired sensor information. Furthermore, "date and time" indicates the date and time corresponding to each registration ID. For example, "date and time" indicates the date and time when the sensor information corresponding to each registration ID was acquired. In the example of FIG. 7, "date and time" is illustrated abstractly as "DA11", but a specific date and time such as "April 21, 2022, 16:47:28" may also be stored.

"Sensor information" indicates the detected sensor information. Various information is stored in "sensor information" depending on the type of detected information. For example, "sensor information" stores voice information, acceleration information, temperature information, humidity information, illuminance information, position information indicating the range and position of area A, etc.

"Context" indicates the context at the time when the sensor information is detected. For example, "context" indicates a context estimated from the sensor information. For example, the context detected by the sensor information may be stored as the second context, and the context immediately before that may be stored as the first context, and information indicating a change in context may be stored in the "context."

"Store" indicates the store that corresponds to the context. If there is no store that corresponds to the context, the store field will be left blank ("-" (hyphen)).

In the example of FIG. 7, the registration information (registration information DL11) identified by the registration ID "DL11" indicates that it is information corresponding to sensing (detection) at date and time DA11. The registration information DL11 indicates that the sensor information SD11 was acquired (detected) at date and time DA11, that the context corresponding to the sensor information SD11 is context CN11, and that the store corresponding to the context CN11 is store SP11.

The registration information storage unit 123 may store various types of information according to the purpose, not limited to the above. For example, the registration information storage unit 123 may store information that identifies the terminal device 10 corresponding to each piece of registration information.

(Control unit 130)
Returning to the explanation of Fig. 4, the control unit 130 is a controller, and is realized, for example, by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like, executing various programs (corresponding to an example of an information processing program) stored in a storage device inside the information processing device 100 using a RAM as a working area. The control unit 130 is also a controller, and is realized, for example, by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 4, the control unit 130 has an acquisition unit 131, an estimation unit 132, a registration unit 133, a processing unit 134, and a provision unit 135, and realizes or executes the functions and actions of the information processing described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 4, and may be other configurations as long as they perform the information processing described below.

(Acquisition unit 131)
The acquisition unit 131 acquires various pieces of information. The acquisition unit 131 acquires various pieces of information from the storage unit 120. In addition, the acquisition unit 131 acquires various pieces of information from the user information storage unit 121, the store information storage unit 122, the registration information storage unit 123, and the like.

The acquisition unit 131 acquires various information from external devices. The acquisition unit 131 acquires information from the terminal device 10. The acquisition unit 131 acquires information from the store device 20. The acquisition unit 131 acquires information from the data providing device 50. The acquisition unit 131 acquires information from the store device 20. The acquisition unit 131 receives various information from external information processing devices via the communication unit 110. The acquisition unit 131 receives various information from the terminal device 10, the store device 20, the data providing device 50, etc.

The acquisition unit 131 acquires user location information from the terminal device 10 used by the user. The acquisition unit 131 acquires store information from the store information storage unit 122. The acquisition unit 131 acquires information estimated by the estimation unit 132.

The acquisition unit 131 acquires sensor information detected by a sensor from the terminal device 10 used by the user. The acquisition unit 131 acquires sensor information detected by a sensor when the user enters and leaves a store. The acquisition unit 131 acquires sensor information detected by a sensor when the user enters a store. The acquisition unit 131 acquires sensor information detected by a sensor when the user leaves a store.

The acquisition unit 131 acquires sensor information detected by a sensor from the terminal device 10 used by the target user who is the estimated target user. The acquisition unit 131 acquires history information that associates the sensor information acquired when the user enters and leaves the target store with the target store. The acquisition unit 131 acquires history information including entry sensor information that associates the sensor information acquired when the user enters the target store with the target store. The acquisition unit 131 acquires history information including exit sensor information that associates the sensor information acquired when the user leaves the target store with the target store.

(Estimation unit 132)
The estimation unit 132 executes an estimation process to estimate various pieces of information. The estimation unit 132 stores the estimated information in the storage unit 120. The estimation unit 132 estimates various pieces of information based on information from an external information processing device and information stored in the storage unit 120. The estimation unit 132 estimates various pieces of information from the storage unit 120. The estimation unit 132 estimates various pieces of information from the user information storage unit 121, the store information storage unit 122, and the registration information storage unit 123. The estimation unit 132 identifies various pieces of information. The estimation unit 132 estimates various pieces of information. The estimation unit 132 executes an estimation process based on sensor information acquired by the acquisition unit 131.

The estimation unit 132 executes a context estimation process to estimate a context based on the sensor information acquired by the acquisition unit 131. The estimation unit 132 estimates a context switch based on a first context before the context estimation process and a second context estimated by the context estimation process.

The estimation unit 132 estimates a context switch from a first context corresponding to a context in which the user is located outside the store to a second context corresponding to a context in which the user is located inside the store. The estimation unit 132 estimates a context switch from a first context corresponding to a context in which the user is located inside the store to a second context corresponding to a context in which the user is located outside the store.

The estimation unit 132 estimates the target user's entry and exit from the target store, which is the estimation target store, based on the sensor information acquired by the acquisition unit 131. The estimation unit 132 estimates the target user's entry and exit from the target store based on the history information. The estimation unit 132 estimates the target user's entry and exit from the target store based on a comparison between the history information and the sensor information.

The estimation unit 132 estimates the target user's entry into the target store based on the history information. The estimation unit 132 estimates the target user's entry into the target store based on a comparison between the entry sensor information and the sensor information. The estimation unit 132 estimates the target user's exit from the target store based on the history information. The estimation unit 132 estimates the target user's exit from the target store based on a comparison between the exit sensor information and the sensor information.

The estimation unit 132 estimates the target user's entry and exit from the target store according to the context estimated by a context estimation process that estimates the context based on the sensor information acquired by the acquisition unit 131. The estimation unit 132 estimates the target user's entry and exit from the target store according to the switch from the first context before the context estimation process to the second context estimated by the context estimation process.

The estimation unit 132 estimates the target user's entry into the target store in response to a switch from a first context corresponding to a context in which the target user is located outside the target store to a second context corresponding to a context in which the target user is located inside the target store. The estimation unit 132 estimates the target user's exit from the target store in response to a switch from the first context corresponding to a context in which the target user is located inside the target store to the second context corresponding to a context in which the target user is located outside the target store.

(Registration Unit 133)
The registration unit 133 executes a registration process for registering various pieces of information. The registration unit 133 executes the registration process by storing information in the storage unit 120. The registration unit 133 registers various pieces of information acquired from an external device. For example, the registration unit 133 associates the sensor information with information indicating a context or a store, and registers the information in the registration information storage unit 123.

The registration unit 133 associates the sensor information acquired by the acquisition unit 131 with the context at the time of detection by the sensor of the sensor information, and registers them in the database. The registration unit 133 associates the sensor information acquired when a user enters and leaves a store with the context indicating the entry and exit of the store, and registers them in the database.

The registration unit 133 associates the sensor information acquired when the user enters a store with an entry context indicating entry into the store and registers the associated information in the database. The registration unit 133 associates the sensor information acquired when the user leaves the store with an exit context indicating exit from the store and registers the associated information in the database.

The registration unit 133 registers in the database the sensor information acquired by the acquisition unit 131 and the context estimated by the context estimation process in association with each other. When the estimation unit 132 estimates that a context switch has occurred, the registration unit 133 registers in the database the sensor information acquired by the acquisition unit in association with the second context. The registration unit 133 registers in the database other sensor information detected by the sensor at the time corresponding to the first context in association with the second context.

(Processing Unit 134)
The processing unit 134 executes various processes. The processing unit 134 executes various information based on information from an external information processing device or information stored in the storage unit 120. The processing unit 134 executes various information based on information from other information processing devices such as the terminal device 10, the store device 20, and the data providing device 50. The processing unit 134 executes various information based on information stored in the user information storage unit 121, the store information storage unit 122, and the registration information storage unit 123.

The processing unit 134 executes various information based on the various information acquired by the acquisition unit 131. The processing unit 134 executes various information based on the various information estimated by the estimation unit 132. The processing unit 134 executes various information based on the various information registered by the registration unit 133.

The processing unit 134 determines various pieces of information. The processing unit 134 determines various pieces of information based on the various pieces of information acquired by the acquisition unit 131. The processing unit 134 determines various pieces of information based on the various pieces of information estimated by the estimation unit 132. The processing unit 134 determines various pieces of information based on the various pieces of information registered by the registration unit 133.

The processing unit 134 generates content. The processing unit 134 generates content including a coupon indicating an incentive. For example, the processing unit 134 generates a screen (content) to be provided to the terminal device 10 by appropriately using various technologies such as Java (registered trademark). The processing unit 134 may generate the screen (content) to be provided to the terminal device 10 based on the format of CSS, JavaScript (registered trademark), or HTML. Also, for example, the processing unit 134 may generate the screen (content) in various formats such as JPEG (Joint Photographic Experts Group), GIF (Graphics Interchange Format), and PNG (Portable Network Graphics).

(Providing Unit 135)
The providing unit 135 provides various services. The providing unit 135 provides various information. The providing unit 135 provides various information to an external information processing device. The providing unit 135 transmits various information to the terminal device 10, the store device 20, and the data providing device 50.

The providing unit 135 provides various information based on information from other information processing devices such as the terminal device 10, the store device 20, and the data providing device 50. The providing unit 135 provides various information based on information stored in the storage unit 120. The providing unit 135 provides various information based on information stored in the user information storage unit 121, the store information storage unit 122, and the registration information storage unit 123.

The providing unit 135 transmits various information based on the various information acquired by the acquiring unit 131. The providing unit 135 transmits various information based on the various information estimated by the estimating unit 132. The providing unit 135 transmits various information based on the various information registered by the registering unit 133. The providing unit 135 transmits various information based on the various information executed by the processing unit 134.

The providing unit 135 provides a service using a database. The providing unit 135 provides information to the terminal device 10 used by the target user according to the target user's entry and exit into the target store, which is estimated using the database.

The providing unit 135 provides information to the target user in accordance with the target user's entry into and exit from the target store estimated by the estimation unit 132. The providing unit 135 transmits information to the terminal device 10 used by the target user in accordance with the target user's entry into and exit from the target store estimated by the estimation unit 132.

[3. Information processing flow]
Next, the procedure of information processing by the information processing system 1 according to the embodiment will be described with reference to FIG. 8 and FIG.

First, the process shown in FIG. 8 will be described. FIG. 8 is a flowchart showing an example of information processing according to an embodiment. Specifically, FIG. 8 is a flowchart showing an example of information processing related to the registration of information.

As shown in FIG. 8, the information processing device 100 acquires sensor information detected by a sensor from a terminal device used by a user (step S101). For example, the information processing device 100 receives sensor information detected by a sensor from the terminal device 10 used by the user.

Then, the information processing device 100 associates the sensor information with the context at the time of detection by the sensor of the sensor information and registers them in the database (step S102). For example, the information processing device 100 associates the sensor information received from the terminal device 10 with the context at the time of detection by the sensor of the sensor information and registers them in the registration information storage unit 123.

Next, the process shown in FIG. 9 will be described. FIG. 9 is a flowchart showing an example of information processing according to an embodiment. Specifically, FIG. 9 is a flowchart showing an example of information processing related to information estimation.

As shown in FIG. 9, the information processing device 100 acquires sensor information detected by a sensor from a terminal device used by a target user who is to be the user to be estimated (step S201). For example, the information processing device 100 receives sensor information detected by a sensor from a terminal device 10 used by a target user who is to be the user to be estimated.

Then, the information processing device 100 estimates the target user's entry and exit from the target store, which is the store to be estimated, based on the sensor information (step S202). For example, the information processing device 100 estimates the target user's entry and exit from the target store, which is the store to be estimated, based on the sensor information received from the terminal device 10.

4. Effects
As described above, the information processing device 100 according to the embodiment includes the acquisition unit 131 and the registration unit 133. The acquisition unit 131 acquires sensor information detected by a sensor from the terminal device 10 used by the user. The registration unit 133 associates the sensor information acquired by the acquisition unit 131 with a context at the time of detection of the sensor information by the sensor, and registers the associated information in a database.

In this way, the information processing device 100 according to the embodiment can associate and manage the sensor information and the context at the time of detection by the sensor by registering the associated sensor information in a database. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

In addition, in the information processing device 100 according to the embodiment, the acquisition unit 131 acquires sensor information detected by a sensor when a user enters or leaves a store. The registration unit 133 associates the sensor information acquired when a user enters or leaves a store with a context indicating the user's entry or exit from the store, and registers the association in the database.

In this way, the information processing device 100 according to the embodiment can manage sensor information regarding a user's entry and exit from a store by correlating the sensor information detected by the sensor when the user enters and leaves the store with the context at the time of the sensor detection and registering the information in a database. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

In addition, in the information processing device 100 according to the embodiment, the acquisition unit 131 acquires sensor information detected by a sensor when the user enters a store. The registration unit 133 associates the sensor information acquired when the user enters a store with an entry context indicating entry into the store, and registers the association in the database.

In this way, the information processing device 100 according to the embodiment can manage sensor information related to a user's entry into a store by correlating the sensor information detected by the sensor when the user enters the store with the context at the time of the sensor detection of the sensor information and registering them in a database. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

In addition, in the information processing device 100 according to the embodiment, the acquisition unit 131 acquires sensor information detected by a sensor when the user leaves the store. The registration unit 133 associates the sensor information acquired when the user leaves the store with an exit context indicating the user's exit from the store, and registers the associated information in the database.

In this way, the information processing device 100 according to the embodiment can manage sensor information related to a user's exit from a store by correlating the sensor information detected by the sensor when the user leaves the store with the context at the time of the sensor detection of the sensor information and registering them in a database. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

The information processing device 100 according to the embodiment also includes an estimation unit 132. The estimation unit 132 executes a context estimation process to estimate a context based on the sensor information acquired by the acquisition unit 131. The registration unit 133 associates the sensor information acquired by the acquisition unit 131 with the context estimated by the context estimation process and registers them in a database.

In this way, the information processing device 100 according to the embodiment can associate and manage the sensor information and the context by registering the acquired sensor information and the estimated context in a database. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

In addition, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates a context switch based on a first context before the context estimation process and a second context estimated by the context estimation process. When the estimation unit 132 estimates that a context switch has occurred, the registration unit 133 associates the sensor information acquired by the acquisition unit with the second context and registers them in a database.

In this way, the information processing device 100 according to the embodiment can associate and manage the sensor information and the context when a context switch occurs by registering the associated sensor information and the context in a database. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

In addition, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates a context switch from a first context corresponding to a context in which the user is located outside the store to a second context corresponding to a context in which the user is located inside the store.

In this way, the information processing device 100 according to the embodiment can estimate a context switch in which the user's position switches from outside the store to inside the store, and can manage the context indicating that the user has entered the store in association with the sensor information at the time of entry. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

In addition, in the information processing device 100 according to the embodiment, the estimation unit 132 estimates a context switch from a first context corresponding to a context in which the user is located inside a store to a second context corresponding to a context in which the user is located outside the store.

In this way, the information processing device 100 according to the embodiment can estimate a context switch in which the user's position switches from inside the store to outside the store, and can manage the context indicating that the user has left the store in association with the sensor information at the time of leaving the store. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

In addition, in the information processing device 100 according to the embodiment, the registration unit 133 registers other sensor information detected by the sensor at a time corresponding to the first context in the database in association with the second context.

In this way, the information processing device 100 according to the embodiment can associate other sensor information detected by the sensor at a time corresponding to the first context with the second context and register it in the database, thereby managing the sensor information before and after the context switch in association with the context. Therefore, the information processing device 100 can appropriately manage the information detected by the sensor.

The information processing device 100 according to the embodiment also includes a providing unit 135. The providing unit 135 provides a service using a database.

In this way, the information processing device 100 according to the embodiment can provide a service using a database, by associating sensor information with a context and using the database to provide an appropriate service.

In addition, in the information processing device 100 according to the embodiment, the providing unit 135 provides information to the terminal device 10 used by the target user in accordance with the target user's entry and exit into the target store, which is estimated using the database.

In this way, the information processing device 100 according to the embodiment can provide appropriate information to the target user by providing information to the terminal device 10 used by the target user according to the target user's entry and exit into the target store, which is estimated using the database.

5. Hardware Configuration
The information processing device 100 according to the embodiment described above is realized by a computer 1000 having a configuration as shown in Fig. 10. Fig. 10 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, a HDD (Hard Disk Drive) 1400, a communication interface (I/F) 1500, an input/output interface (I/F) 1600, and a media interface (I/F) 1700.

The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400, and controls each component. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started, and programs that depend on the hardware of the computer 1000, etc.

HDD 1400 stores programs executed by CPU 1100 and data used by such programs. Communication interface 1500 receives data from other devices via network N and sends it to CPU 1100, and transmits data generated by CPU 1100 to other devices via network N.

The CPU 1100 controls output devices such as a display and a printer, and input devices such as a keyboard and a mouse, via the input/output interface 1600. The CPU 1100 acquires data from the input devices via the input/output interface 1600. The CPU 1100 also outputs generated data to the output devices via the input/output interface 1600.

The media interface 1700 reads a program or data stored in the recording medium 1800 and provides it to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700 and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable Disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory.

For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 executes programs loaded onto the RAM 1200 to realize the functions of the control unit 130. The CPU 1100 of the computer 1000 reads and executes these programs from the recording medium 1800, but as another example, the CPU 1100 may obtain these programs from another device via the network N.

Although some of the embodiments and variations of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the lines of the disclosure of the invention.

[6. Other]
Furthermore, among the processes described in the above embodiments and modifications, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

The above-described embodiments and variations can be combined as appropriate to the extent that they do not cause inconsistencies in the processing content.

The above-mentioned "section, module, unit" can be read as "means" or "circuit." For example, an acquisition unit can be read as an acquisition means or an acquisition circuit.

REFERENCE SIGNS LIST 1 Information processing system 100 Information processing device 121 User information storage unit 122 Shop information storage unit 123 Registration information storage unit 130 Control unit 131 Acquisition unit 132 Estimation unit 133 Registration unit 134 Processing unit 135 Providing unit 10 Terminal device 20 Shop device 50 Data providing device N Network

Claims (13)

an acquisition unit that acquires sensor information detected by the sensor from a terminal device used by a user;
a registration unit that registers the sensor information acquired by the acquisition unit and a context of the sensor information at the time of detection by the sensor in a database in association with each other, and if the context at the time of detection is related to a store, registers the sensor information in association with information indicating the store, and if the context at the time of detection is not related to a store, registers information indicating that there is no store corresponding to the sensor information in association with the sensor information;
An information processing device comprising: The acquisition unit is
Acquire the sensor information detected by the sensor when the user enters or leaves the store;
The registration unit is
The information processing device according to claim 1 , wherein the sensor information acquired when the user enters or leaves the store is associated with the context indicating the user's entry or exit from the store and registered in the database. The acquisition unit is
acquiring the sensor information detected by the sensor when the user enters a store;
The registration unit is
The information processing device according to claim 2 , wherein the sensor information acquired when the user enters the store is associated with an entry context indicating the user's entry into the store and is registered in the database. The acquisition unit is
acquiring the sensor information detected by the sensor when the user leaves the store;
The registration unit is
The information processing device according to claim 2 , wherein the sensor information acquired when the user leaves the store is associated with an exit context indicating the user's leaving the store, and the associated information is registered in the database. an estimation unit that executes a context estimation process to estimate the context based on the sensor information acquired by the acquisition unit;
Further equipped with
The registration unit is
The information processing apparatus according to claim 1 , further comprising: registering the sensor information acquired by the acquisition unit and the context estimated by the context estimation process in the database in association with each other. The estimation unit is
Inferring a context switch based on a first context before the context estimation process and a second context estimated by the context estimation process;
The registration unit is
The information processing device according to claim 5 , wherein, when the estimation unit estimates that the context switch has occurred, the sensor information acquired by the acquisition unit and the second context are associated with each other and registered in the database. The estimation unit is
The information processing device according to claim 6 , further comprising: an information processing apparatus that estimates the context switch from the first context corresponding to a context in which the user is located outside the store to the second context corresponding to a context in which the user is located inside the store. The estimation unit is
The information processing device according to claim 6 , further comprising: an information processing apparatus that estimates the context switch from the first context corresponding to a context in which the user is located inside the store to the second context corresponding to a context in which the user is located outside the store. The registration unit is
The information processing apparatus according to claim 6 , further comprising: registering, in the database, other sensor information detected by the sensor at a time point corresponding to the first context in association with the second context. a providing unit that provides a service using the database;
The information processing apparatus according to claim 1 , further comprising: The providing unit is
The information processing device according to claim 10 , further comprising: providing information to a terminal device used by a target user in accordance with the entrance and exit of the target user to a target store estimated using the database. 1. A computer-implemented information processing method, comprising:
an acquisition step of acquiring sensor information detected by the sensor from a terminal device used by a user;
a registration step of registering the sensor information acquired in the acquisition step in a database in association with a context of the sensor information at the time of detection by the sensor , and if the context at the time of detection is related to a store, registering the sensor information in association with information indicating the store, and if the context at the time of detection is not related to a store, registering information indicating that there is no store corresponding to the sensor information in association with the sensor information;
13. An information processing method comprising: An acquisition step of acquiring sensor information detected by the sensor from a terminal device used by a user;
a registration step of registering the sensor information acquired by the acquisition step in a database in association with a context of the sensor information at the time of detection by the sensor , and if the context at the time of detection is related to a store, registering the sensor information in association with information indicating the store, and if the context at the time of detection is not related to a store, registering information indicating that there is no store corresponding to the sensor information in association with the sensor information;
An information processing program characterized by causing a computer to execute the above.

Images