JP7091382B2 - Information processing device, terminal device, information processing system, information processing method, terminal control method, information processing program, and terminal control program - Google Patents

Description

The present invention is an information processing device, a terminal device, an information processing system, an information processing method, a terminal control method, and an information processing program for generating a model for specifying a facility in which a user is staying and specifying the facility using the model. , And terminal control programs.

Conventionally, there is known an information processing device that estimates a store visited by a user based on a radio signal received by a mobile terminal device owned by the user (see, for example, Patent Document 1).
The device described in Patent Document 1 acquires a reception history in which a terminal receives a transmission signal from a transmitter and a usage history of an application executed in the terminal. The reception history is a history of transmission signals received periodically by the terminal, and is, for example, the reception strength of transmission signals from a plurality of transmitters such as a Wi-Fi (registered trademark) access point and a Bluetooth (registered trademark) transmitter. Combinations are included. The usage history includes the execution history of an application for making a payment at a store and an application for using points, coupons, and the like. Then, this device identifies the store used by the user based on the usage history, and has a first stay time width T1 before the time t when the application is executed and a second stay after the time t. The stay time width T including the time width T2 is set. The stay time width T including this time t is a time zone in which the user is expected to stay in the store specified by the usage history. After that, this device inputs a combination of the reception strength of the transmission signal from the transmitter, using the store specified by the usage history of the application and the reception history in the time zone in which the user is expected to stay as teacher data. And generate a judgment model with the output of the store where the user is expected to stay.

Japanese Unexamined Patent Publication No. 2018-55638

However, in the apparatus described in Patent Document 1, the reception history in the first stay time width T1 before the time t and the reception history in the second stay time width T2 after the time t are eventually obtained. Is also the reception history predicted that the user was staying at a facility such as a store. The reception history from the Wi-Fi access point changes depending on the location, and in particular, in shopping malls and shopping districts where many stores are gathered, Wi-Fi access points may be installed for each nearby store. .. Therefore, even if the user moves from the store recorded in the usage history to another store in the time zone before and after the time t when there is a usage history for the store, the combination of the reception strengths of each signal does not change much. In some cases. That is, the reception history of the time zone before and after the time t of Patent Document 1 may not be in the same store as the time t of the user. Therefore, there is a problem that the teacher data at the time of machine learning includes data that does not include the correct answer, and the accuracy of store judgment by the judgment model generated by machine learning is lowered.

An object of the present invention is to provide an information processing device, a terminal device, an information processing system, an information processing method, a terminal control method, an information processing program, and a terminal control program that can specify a facility used by a user with high accuracy. And.

The information processing device according to the present invention specifies a facility that identifies the facility from the terminal device by executing a specific process on the terminal device by a facility use application used to use a predetermined service in the facility. A facility-specific information acquisition unit that acquires information, signal identification information that identifies at least one or more radio signals received by the terminal device at the timing when the specific process is executed by the terminal device, and each of the radios. The signal strength acquisition unit that acquires signal strength information including the signal strength of the signal, the signal identification information, and the radio signal specified by the signal identification information, using the facility identification information and the signal strength information as teacher data. It is provided with a model generation unit that generates a facility-specific model that receives the signal strength of the above as an input and outputs the facility-specific information.
The facility identification information may be a facility name or a facility ID that identifies the facility, and is a processing ID that specifies the processing such as payment when the processing such as payment is performed at the facility. You may. In the case of the processing ID, a facility corresponding to the processing ID may be separately acquired from another server that provides a service such as a payment server.

In the present invention, the information processing device receives the store identification information acquired when a specific process such as payment processing is executed by the facility use application and the timing when the specific process of the facility use application is executed. The signal identification information and signal strength of the radio signal are acquired as teacher data. That is, as the teacher data, the signal strength of the radio signal at the time of using the facility at the facility visited by the actual user is used. Therefore, the teacher data does not include predictive information in which it is unknown whether or not the user is in the facility, and it is possible to generate a facility identification model that can identify the facility used by the user with high accuracy.

The schematic diagram which shows the schematic structure of the information processing system which concerns on one Embodiment of this invention. The block diagram which shows the schematic structure of the terminal apparatus of this embodiment. The block diagram which shows the schematic structure of the server apparatus of this embodiment. The flowchart which shows the operation with the terminal apparatus in the model generation processing of this embodiment. The flowchart which shows the information processing method of the server apparatus of this embodiment. The flowchart which shows the operation with the terminal apparatus in the facility identification processing of this embodiment.

Hereinafter, an embodiment according to the present invention will be described.
[Overview of information processing system]
FIG. 1 is a schematic diagram showing a schematic configuration of the information processing system 1 of the present embodiment.
As shown in FIG. 1, the information processing system 1 of the present embodiment includes a terminal device 10 owned by a user and a server device 20 which is an information processing device of the present invention.

In the information processing system 1 of the present embodiment, when a wireless signal transmitted from an access point 31 installed in a facility or the like is received by the terminal device 10, the terminal device 10 is based on the signal strength of the wireless signal. It is a system that identifies existing facilities (that is, facilities where users are staying).
The facilities described here include stores that purchase goods and services, as well as amusement parks and libraries that provide predetermined services and entertainment. Further, the access point 31 includes a Wi-Fi access point that transmits a Wi-Fi radio signal, a Bluetooth transmission device that transmits a Bluetooth signal, an infrared communication device that transmits an infrared signal, and the like.
Specifically, the terminal device 10 receives one or more radio signals that can be received in the facility. Further, when the user holding the terminal device 10 executes a predetermined application for using the facility in the facility, the terminal device 10 acquires the facility identification information that identifies the facility to which the application is executed. Then, the signal strength information indicating the signal strength of the radio signal received at the timing when the application is executed and the facility identification information are transmitted to the server device 20. The server device 20 uses these facility identification information and signal strength information to generate a facility identification model that identifies the facility from the signal strength of the radio signal.
Further, when the user visits the facility and the user stops, the terminal device 10 transmits the signal strength information to the server device 20. As a result, the server device 20 identifies the facility in which the user is staying by inputting the signal strength information into the generated facility identification model.
Hereinafter, such an information processing system 1 will be described in detail.

[Configuration of terminal device 10]
FIG. 2 is a block diagram showing a schematic configuration of the terminal device 10 of the present embodiment.
The terminal device 10 is a portable computer operated by a user, and examples thereof include smartphones, mobile phones, and tablet terminals.
The terminal device 10 has a basic configuration of a general computer, and includes a terminal communication unit 11, a terminal display unit 12, a sensor module 13, a terminal operation unit 14, a terminal storage unit 15, a terminal processor 16, and the like. It is configured. Further, the terminal device 10 includes a voice input device such as a microphone for inputting voice, a voice output device such as a speaker for outputting voice, a camera for capturing an image, and reading code information such as a bar code. You may be prepared.

The terminal communication unit 11 is connected to the Internet and communicates with other devices on the network such as the server device 20 via the Internet. The communication method by the terminal communication unit 11 is not particularly limited, and examples thereof include Internet communication (mobile data communication) using a line provided by a mobile phone company, Internet communication using a wireless LAN such as Wi-Fi, and the like.
Further, the terminal device 10 may be able to communicate with other connected devices by short-range communication such as Bluetooth or infrared communication. In this case, the terminal communication unit 11 may be configured to include a Bluetooth communication device and an infrared communication device.
Further, the terminal communication unit 11 may include a communication device that communicates with a non-contact IC communication device such as NFC or FeliCa (registered trademark).
The terminal communication unit 11 corresponds to the reception unit of the present disclosure, and communicates with an access point 31 (including a Bluetooth device, an infrared communication device, etc. in addition to a Wi-Fi access point) installed in a facility or the like.

The terminal display unit 12 is a display that displays an image under the control of the terminal processor 16.

The sensor module 13 includes, for example, a 3-axis acceleration sensor, a 3-axis gyro sensor, a positioning sensor, and the like, and detects position fluctuations of the terminal device 10 itself. For example, the 3-axis accelerometer can detect the positional fluctuation of the terminal device 10 by detecting the acceleration related to the movement of the terminal device 10, and the 3-axis gyro sensor can detect the positional fluctuation of the terminal device 10 by detecting the angular velocity of the terminal device 10. .. Further, the positioning sensor can detect the position change of the terminal device 10 by detecting the latitude and longitude of the terminal device 10.

The terminal operation unit 14 is, for example, a touch panel provided integrally with the terminal display unit 12, operation buttons provided on the terminal device 10, a keyboard connected to the terminal device 10 in a communicable manner, and the like, and is operated by the user. By doing so, the operation information corresponding to the input operation is output to the terminal processor 16.

The terminal storage unit 15 is an information recording device configured by, for example, a semiconductor memory, and various information, a terminal control program for controlling the terminal device 10, and the like are recorded. Further, the terminal storage unit 15 may be used as a temporary storage area for temporarily storing the signal strength and the like of the radio signal received by the terminal communication unit 11.
As various information recorded in the terminal storage unit 15, for example, user information for using the information processing system 1 of the present embodiment, facility use application information regarding applications that can be used in each facility, and the like are recorded. ..
The user information includes various information about the user, such as a user ID that identifies the user who operates the terminal device 10. The user information may include application information.

The facility use application information is, for example, information of an application (hereinafter referred to as a facility use application or a facility use application) installed in the terminal device 10 and used to use a predetermined service at the facility. The facility use application includes, for example, a payment application for making electronic payments at a facility (hereinafter abbreviated as a payment application), and a coupon application for using a coupon for receiving a discount at a facility (hereinafter referred to as a coupon application). (Abbreviated), a point application that uses points that can receive benefits by providing services at the facility (hereinafter abbreviated as point application), and the like.

Examples of the payment application include applications for using electronic money such as Paypay (registered trademark), Linepay (registered trademark), and Suica (registered trademark). In such a payment application, the terminal device 10 is held over a dedicated reader (payment communication device) provided in the facility, and code information such as a QR code (registered trademark) or a barcode displayed on the terminal display unit 12 is displayed. Can be electronically settled by reading the information with a dedicated reader (payment reader) installed in the facility or by reading the code information such as the QR code installed in the facility with the terminal device 10. It is an application. As the application information related to the payment application, an amount that can be used at the time of payment (charged amount), a payment history (charge history), a payment history, and the like are recorded. In the payment history, the payment date, the facility identification information that identifies the payment destination facility, the amount paid by the payment, and the like when the payment application is used at the facility are recorded. The facility-specific information may be a facility name, a facility ID that specifies a facility, or a processing ID such as an order number that specifies payment processing at a facility.

The coupon application is, for example, an application that receives and uses a coupon distributed by a facility or a coupon distributor affiliated with the facility. Such a coupon application can be used by reading the coupon displayed on the terminal display unit 12 with a dedicated reader provided in the facility, and can receive benefits (discounts, etc.) according to the type of coupon. can. The application information related to the coupon application includes the delivery date and expiration date of the coupon, the coupon ID indicating the type of coupon, the usage history of the coupon, and the like. The coupon usage history includes information about the use or non-use of the coupon, as well as facility-specific information that identifies the facility used when the coupon is used.

The point application is, for example, an application for point management in which points are added according to a payment amount or the like when a service is provided at a facility. The user can use a predetermined number of points to receive a predetermined privilege, or can redeem a predetermined number of points for payment. Such a point application, for example, communicates with a dedicated reader provided in a facility, or reads code information such as a QR code that identifies a user displayed on the terminal display unit 12 with a dedicated reader. Then, points can be given and used. In addition, points may be awarded when payment is made by the payment application in conjunction with the above-mentioned payment application. The application information related to the point application includes the date of point grant, the number of points granted, facility specific information that identifies the facility that granted the point, the date of use of the point, the number of points used, and facility specific information that identifies the facility that used the point. Etc. are included.

The terminal processor 16 is composed of an arithmetic circuit such as a CPU (Central Processing Unit) and a recording circuit such as a RAM (Random Access Memory). The terminal processor 16 expands the terminal control program recorded in the terminal storage unit 15 into the RAM, and executes various processes in cooperation with the program expanded in the RAM.
Then, by reading and executing the terminal control program, the terminal processor 16 functions as a motion determination unit 161, an application execution unit 162, a signal detection unit 163, and an information transmission unit 164, as shown in FIG.

The motion determination unit 161 determines the motion state of the user who owns the terminal device 10 based on the position change of the terminal device 10 detected by the sensor module 13. For example, the motion determination unit 161 functions as a step counter that counts the user's walking based on the sensor output value from the 3-axis acceleration sensor of the sensor module 13. If the step counter is counted up, the user determines that he / she is in a walking state. Further, the exercise determination unit 161 determines that the user has stopped if the step count counter is not counted up for a predetermined time or longer.
The exercise determination unit 161 may detect that the terminal device 10 is placed on the table by a gyro sensor or the like, regardless of the determination of the exercise state by the step counter as described above. Further, the exercise determination unit 161 may determine the exercise state of the user based on the step count counter and the position (latitude and longitude) measured by the positioning sensor.

The application execution unit 162 reads and executes the target facility use application when an input operation to execute the facility use application is performed by the user operation.
Further, when the facility use application is executed and a specific process (for example, payment process) is executed by communication between the reader installed in the facility and the terminal device 10, the application execution unit 162 causes the reader to execute the device. Obtains processing completion information including facility-specific information that identifies the facility from.

The signal detection unit 163 detects the signal strength of each radio signal received by the terminal communication unit 11.
Further, the signal detection unit 163 may generate signal strength information indicating the signal strength of each received radio signal, add a time stamp indicating the reception date and time, and store the signal in the terminal storage unit 15.
The signal strength information is information indicating one or more radio signals received at the same timing and the signal strength of the radio signal, and is signal identification information for specifying the radio signal (for example, SSID in a Wi-Fi access point). Etc.) and the signal strength of the radio signal identified by the signal identification information.

The information transmission unit 164 transmits information such as facility identification information and signal strength information to the server device 20.
The timing at which the information transmission unit 164 transmits the signal strength information is the timing at which specific processing such as payment processing is executed by the execution of the facility use application by the application execution unit 162 and the facility specific information is acquired (first timing). Further, it is a timing (second timing) when the user is determined to have stopped by the motion determination unit 161. At the first timing, the information transmission unit 164 simultaneously transmits the facility identification information and the signal strength information to the server device 20. At the second timing, the information transmission unit 164 transmits only the signal strength information to the server device 20.

[Configuration of server device 20]
The server device 20 is the information processing device of the present embodiment. FIG. 3 is a block diagram showing a schematic configuration of the server device 20.
The server device 20 is composed of a general computer, and as shown in FIG. 3, includes each part constituting the computer, such as a server communication unit 21, a server storage unit 22, and a server processor 23.
The server communication unit 21 is connected to the Internet and communicates with each device such as the terminal device 10 via the Internet.

The server storage unit 22 records various information and information processing programs for controlling the server device 20.
The server storage unit 22 records user information about the user, facility information about the facility, a facility-specific model, teacher data for generating the facility-specific model, and the like.

The user information is information about each user, and is recorded in a plurality of user databases (user DB), for example.
In each user information, the above-mentioned user ID for identifying a user, detailed user information about the user, and the like are recorded. The user detailed information includes, for example, terminal address information for distributing content such as advertisements, facility use application information indicating facility use applications that can be used by the user on the terminal device and that can be used at the facility, and the like. Further, the user detailed information may include personal information such as the gender of the user and user attribute information indicating the preference of the user.

The facility information is information about a facility that can use a facility use application such as a payment application, a coupon application, and a point application. As the facility information, facility identification information (facility ID, facility name, etc.) that identifies the facility is recorded. The facility information may further include a facility use application or the like supported by the facility.

The facility identification model is generated by machine learning based on teacher data, and inputs the signal identification information of one or more radio signals and the combination of the signal strength of the radio signals (signal strength information), and the facility name and facility ID. It is a model that outputs facility specific information that identifies facilities such as. This facility-specific model is a model generated by a known machine learning algorithm, and can be generated by using, for example, a random forest.

The teacher data is teacher data for generating a facility-specific model, and is recorded in a plurality of teacher databases (teacher DB).
This teacher data is information in which the facility specific information transmitted from the terminal device 10 and the signal strength information are associated with each other, and is acquired at the first timing when the specific process by the facility use application is executed in the terminal device 10. Information. The teacher DB stores and stores teacher data (facility-specific information and signal strength information) transmitted from a large number of users who use the information processing system 1.

The server processor 23 is composed of an arithmetic circuit such as a CPU and a recording circuit such as a RAM. The server processor 23 expands the information processing program recorded in the server storage unit 22 into the RAM, and executes various processes in cooperation with the program expanded in the RAM.
Then, by reading and executing the information processing program, the server processor 23 functions as a facility identification information acquisition unit 231, a signal strength acquisition unit 232, a model generation unit 233, and a facility identification unit 234, as shown in FIG. ..

The facility identification information acquisition unit 231 acquires (receives) the facility identification information from the terminal device 10 at the first timing, and stores it in the server storage unit 22 as teacher data.
The signal strength acquisition unit 232 acquires (receives) signal strength information from the terminal device 10.
Further, when the signal strength information is transmitted together with the facility identification information at the first timing, the signal strength acquisition unit 232 records the signal strength information in the server storage unit 22 as teacher data in association with the simultaneously transmitted facility identification information. do. On the other hand, the signal strength acquisition unit 232 converts the signal strength information that was not transmitted together with the facility identification information into the signal strength information transmitted at the second timing, and outputs the signal strength information to the facility identification unit 234 described later.

The model generation unit 233 generates a facility-specific model based on the teacher data, and updates the facility-specific model stored in the server storage unit 22. The model generation and update timing of the model generation unit 233 may be, for example, every fixed cycle such as every day or every week, and the server administrator who manages the server device 20 commands the generation at an arbitrary timing. May be good. Alternatively, it may be every time a certain number of teacher data are accumulated.

When only the signal strength information is acquired by the signal strength acquisition unit 232, the facility identification unit 234 inputs the signal strength information into the facility identification model, acquires the facility identification information, and specifies the facility.

[Facility identification method by information processing system 1]
Next, the facility identification method in the information processing system 1 including the information processing method in the server device 20 and the terminal control method in the terminal device 10 will be described.
[Facility specific model generation process]
First, the generation process for generating the facility-specific model will be described.
FIG. 4 is a flowchart showing an operation (terminal control method) in the terminal device 10 in the model generation process for generating the facility-specific model of the present embodiment.

In the information processing system 1 of the present embodiment, the user who possesses the terminal device 10 visits the facility, and the user uses a predetermined facility use application to collect teacher data.
First, the application execution unit 162 of the terminal device 10 activates the facility use application (step S1). The facility use application may be activated by a user's input operation. For example, the terminal device 10 is automatically held by a specific reader or receives a specific beacon. The facility use application may be started in.

Next, when a specific process is executed by the facility use application, the application execution unit 162 acquires the facility identification information (step S2).
For example, when the payment process is executed by the payment application, the terminal device 10 communicates with a reader provided in the facility and receives payment completion information indicating that the payment process is completed. Alternatively, the terminal device 10 reads the code information provided in the facility and inputs a predetermined amount, so that the terminal device 10 communicates with the payment management server managed by the provider of the payment application and receives the payment completion information. .. These payment completion information includes facility-specific information such as the date and time when the payment process was performed, the amount of money for the service or product purchased by the user, and the name of the facility where the amount was paid. Therefore, the application execution unit 162 can acquire the facility specific information from the payment completion information.
The same applies to the coupon application and the point application. When the coupon is used, the points are used, and the points are acquired, the terminal device 10 communicates with the reader provided in the facility to use the coupons, use the points, and so on. And, the processing completion information that the processing such as the point acquisition is completed is acquired. These processing completion information includes, for example, a coupon ID for identifying the used coupon, service detailed information indicating the number of points used, the number of points acquired, and facility identification information, and therefore, the application execution unit 162. Can acquire facility specific information from the processing completion information.
As the facility identification information, as described above, not only the facility name and the facility ID but also the processing ID that specifies the processing at the facility may be used. For example, taking a payment application as an example, it may be a processing ID such as an order number for measuring payment processing. In this case, the terminal device 10 or the server device 20 inquires of the payment management server about the facility for the processing ID, and the payment management server inquires about the facility name or facility ID for the processing ID in the terminal device 10 or the inquiring source terminal device 10. Return to the server device 20.

Further, the signal detection unit 163 detects the radio signal received by the terminal communication unit 11 and the signal strength thereof, and acquires the signal strength information (step S3). In FIG. 4, step S3 is executed after step S2, and the step S3 is executed at the timing when the facility use application performs a specific process in step S2.
After that, the information transmission unit 164 simultaneously transmits the facility identification information acquired in step S2 and the signal strength information acquired in step S3 to the server device 20 (step S4). That is, in the model generation process, the signal strength information at the first timing when the specific process is executed by the facility use application and the facility identification information acquired at the first timing are transmitted from the terminal device 10 to the server device 20. Will be done.

The signal detection unit 163 of the terminal device 10 may detect the signal strength of the radio signal at regular intervals and store it in the terminal storage unit 15 as signal strength information. In this case, each signal strength information is time-stamped and recorded together with the date and time when the radio signal was detected. As a result, the information transmission unit 164 can read the signal strength information generated at the same timing as step S2 from the terminal storage unit 15 and transmit it to the server device 20.

FIG. 5 is a flowchart showing an information processing method of the server device 20 of the present embodiment.
The server device 20 receives the information transmitted from the terminal device 10 (step S11: facility specific information acquisition step, signal strength information acquisition step). In step S11, when the facility-specific information is included in the information transmitted from the terminal device 10, the facility-specific information acquisition unit 231 acquires the facility-specific information from the information. Further, the signal strength acquisition unit 232 acquires the signal strength information included in the information transmitted from the terminal device 10.
Then, the server device 20 determines whether or not the received information includes the facility identification information and the signal strength information (step S12). That is, it is determined whether the signal strength information is transmitted at the same time as the facility specific information or only the signal strength information is transmitted.
If YES is determined in step S12, the facility specific information acquisition unit 231 and the signal strength acquisition unit 232 associate the acquired facility specific information and signal strength information, and store the acquired facility specific information and signal strength information in the teacher DB of the server storage unit 22 as teacher data ( Step S13). As a result, the teacher data transmitted from a large number of users is accumulated in the teacher DB.
If NO is determined in step S12, that is, if the signal strength information is transmitted from the terminal device 10 and the facility identification information is not transmitted, the facility identification process is performed. The explanation of the facility identification process will be described later.

After step S13, the model generation unit 233 inputs signal strength information (signal identification information of each radio signal and signal strength of the radio signal) by machine learning using the teacher data stored in the teacher DB. A facility identification model is generated by outputting facility identification information such as a facility name and a facility ID (step S14: model generation step).
The timing for generating the facility-specific model may be, for example, at regular intervals or at any timing specified by the administrator of the server device 20, etc., and every time a predetermined number of teacher data is accumulated. May be.
Further, the teacher data used in step S14 may be all the teacher data recorded in the teacher DB, half of which is used for generating a facility-specific model, and the other half is used for verification and evaluation of the generated facility-specific model. You may. Further, as the teacher data, the teacher data accumulated between the current date and time and a predetermined time (for example, one month or the like) set in advance may be used. As a result, even if a new access point 31 is installed in or around the facility, or if the access point 31 is replaced, a facility identification model with high facility identification accuracy using the latest teacher data is generated. can do. In this case, the old teacher data (teacher data earlier than the predetermined date and time) recorded in the teacher DB may be deleted.
As described above, a known technique can be used for the generation of the facility-specific model by the model generation unit 233, and for example, a random forest or the like can be used.

[Facility identification processing]
Next, the facility identification process will be described.
FIG. 6 is a flowchart showing an operation (terminal control method) in the terminal device 10 in the facility identification process using the facility identification model of the present embodiment.
In the terminal device 10, the sensor module 13 detects the position change of the terminal device 10 by the user holding the terminal device 10 and performing an exercise such as walking, that is, the acceleration, the angular velocity, and the terminal device applied to the terminal device 10. Detects 10 longitudes and latitudes. Then, the motion determination unit 161 determines the motion state of the user who possesses the terminal device 10 based on the sensor value output from the sensor module 13 (step S21: motion determination step).
Then, the exercise determination unit 161 determines whether or not the user has stopped in the exercise state of the user (step S22). For example, in the present embodiment, the motion determination unit 161 functions as a step counter that detects the walking state of the user and counts the number of steps based on the sensor value from the sensor module 13. When the number of steps counted by the step count counter is no longer counted up, that is, the number of steps is counted up by the exercise determination unit 161 for a predetermined first hour or more, and then the count of the number of steps is stopped for a predetermined time. If so, it is determined that the user has stopped.

If NO is determined in step S22, the process returns to step S21 and the determination of the exercise state is continued.
When the user stops and determines YES in step S22, the signal detection unit 163 detects the radio signal received by the terminal communication unit 11 and the signal strength thereof, and acquires the signal strength information (step S23). Then, the information transmission unit 164 transmits the signal strength information acquired in step S23 to the server device 20 (step S24: information transmission step). That is, in the facility identification process, the signal strength information at the second timing when the motion determination unit 161 determines that the user has stopped is transmitted from the terminal device 10 to the server device 20.

On the other hand, the server device 20 receives the information transmitted from the terminal device 10 in the same manner as in step S11 of the model generation process shown in FIG. Determine if it is included.
In the facility determination process, since only the signal strength information is transmitted in step S24, it is determined as NO in step S12.
In this case, the signal strength acquisition unit 232 outputs the acquired signal strength information to the facility identification unit 234. Then, the facility identification unit 234 inputs signal strength information (signal identification information of each radio signal and signal strength of the radio signal specified by the signal identification information) into the facility identification model generated in step S14 (step S31). .. Then, the facility identification unit 234 identifies the facility corresponding to the facility identification information output from the facility identification model as the facility in which the user is staying (step S32).

[Action and effect of this embodiment]
The server device 20 in the information processing system 1 of the present embodiment includes a server storage unit 22 and a server processor 23, and the server processor 23 reads an information processing program stored in the server storage unit 22 to specify a facility. It functions as an information acquisition unit 231, a signal strength acquisition unit 232, and a model generation unit 233. The facility specific information acquisition unit 231 acquires the facility specific information acquired when the facility use application is executed by the terminal device 10 and the specific process is executed in the facility from the terminal device 10. The signal strength acquisition unit 232 is signal identification information that identifies at least one or more radio signals received by the terminal device 10 at the timing when a specific process is executed by the facility use application in the terminal device 10, and the signal strength of the radio signal. Acquires signal strength information including. Then, the model generation unit 233 generates a facility identification model in which the facility identification information and the signal strength information are used as teacher data, the signal strength information is input, and the facility identification information is output.

In such an embodiment, facility-specific information and signal strength information at the timing when the facility-specific information is obtained are used as teacher data for machine learning by the model generation unit 233. The facility-specific information is information that identifies the store when a specific process is performed at the store by the facility use application, and is information that indicates that the user has definitely stayed at the facility. Therefore, the signal strength information used as the teacher data in the present embodiment is the signal strength information detected when the user surely uses the facility. Therefore, for example, the accuracy of facility estimation by the facility-specific model can be improved as compared with the case where the signal strength information at the time when the user is presumed to be in the facility is used for the teacher data of machine learning. By using such a facility identification model, it is possible to identify the facility used by the user with high accuracy based on the signal strength information.

In the present embodiment, the facility use application is either a payment application for making a payment at a facility, a coupon application for using a coupon at a facility, or a point application for using or granting points at a facility. be.
Such a facility use application is an application that executes a specific process by communicating with a dedicated reader installed in the facility, and the user is surely located in the facility at the timing when the specific process is executed. Show that you are doing. Therefore, the signal strength information at the first timing when the specific processing is performed by these facility use applications and the facility identification information of the facility specified by the facility use application are teacher data for generating the facility identification model. It is possible to generate a facility-specific model with high accuracy.

In the server device 20 of the present embodiment, when the facility specific information acquisition unit 231 and the signal strength acquisition unit 232 simultaneously acquire the facility specific information and the signal strength information, the facility specific information and the signal strength information are associated with each other to be a teacher. It is stored in the server storage unit 22 as data.
Further, the server processor 23 of the server device 20 functions as a facility identification unit 234, and the facility identification unit 234 acquires signal strength information by the signal strength acquisition unit 232, but the facility identification information acquisition unit 231 acquires the facility identification information. Is not acquired, the signal strength information is input to the facility identification model to specify the facility identification information.
That is, the server device 20 of the present embodiment uses the facility specific information and the signal strength information as teacher data when the facility specific information and the signal strength information are obtained at the same time, and when only the signal strength information is obtained, the facility specific model. To identify the facility where the user is staying. Thereby, as described above, the facility in which the user is staying can be specified with high accuracy by using the facility identification model.

The terminal device 10 in the information processing system 1 of the present embodiment includes a terminal communication unit 11 that receives at least one or more radio signals, a sensor module 13 that detects its own position fluctuation, a terminal storage unit 15, and a terminal processor. 16 and. Then, the terminal processor 16 functions as the motion determination unit 161 and the information transmission unit 164 by reading the terminal control program stored in the terminal storage unit 15. The motion determination unit 161 determines the motion state of the user based on the position variation of the terminal device 10 detected by the sensor module 13. The information transmission unit 164 transmits signal strength information to the server device 20 when the motion determination unit 161 determines that the user is stationary (stopped) for a predetermined time or longer.
As a result, the terminal device 10 does not need to constantly monitor the radio signal, and may detect the radio signal and transmit the signal strength information to the server device 20 only when the user stops. Therefore, since the detection of unnecessary wireless signals can be suppressed, the power consumption of the terminal device 10 can be reduced, and the load related to wireless detection can also be reduced.
Also, if the user is on the move, it is unclear whether the user has used the facility or just passed the vicinity of the facility. Therefore, even if the signal strength information is acquired by the terminal device 10 of the moving user, it is difficult to determine whether or not the facility specified based on the signal strength information is the facility used by the user. On the other hand, in the present embodiment, the signal strength information detected at the timing when the user stops is used. The timing at which the user stops is more likely to be using the facility than the moving user, and in the present embodiment, the terminal device 10 provides signal strength information for the wireless signal received at such timing. Since it is transmitted to the server device 20, there is a high possibility that the facility actually used by the user can be specified.

In the terminal device 10 of the present embodiment, the motion determination unit 161 counts the number of steps taken by the user during walking, and determines that the user has stopped when the number of steps is not counted for a predetermined time or longer.
Such a step counter is software widely used in general smartphones and the like. By using the step count state by the step counter, the motion determination unit 161 can easily determine whether or not the user has stopped without performing any special processing.

The terminal processor 16 of the terminal device 10 of the present embodiment further functions as an application execution unit 162. This application execution unit 162 executes a facility use application used to use a predetermined service at the facility to execute a specific process, and acquires facility specific information that identifies the facility that executed the facility use application. do. Then, the information transmission unit 164 simultaneously receives the signal strength information of the radio signal received by the terminal communication unit 11 at the timing when the application execution unit 162 executes the specific processing by the facility use application, at the same time as the facility identification information. It is transmitted to the server device 20.
As a result, as described above, the server device 20 can acquire the optimum teacher data for generating the facility-specific model. Further, every time the user performs a specific process of the facility use application such as payment processing, the teacher data is accumulated in the server device 20, and a large number of users use the facility use application to collect more teacher data. Can be collected. That is, a large number of teacher data can be acquired only by using a facility use application that is normally used by a large number of users, and the facility identification accuracy of the facility identification model generated by the server device 20 can be further improved.

[Modification example]
It should be noted that the present invention is not limited to the above-described embodiment, but also includes the modifications shown below to the extent that the object of the present invention can be achieved.

[Modification 1]
In the above embodiment, the payment application, the coupon application, and the point application are exemplified as the facility use application, but the present invention is not limited thereto. The facility use application may be any application as long as it is an application premised on use in the facility. For example, it may be an application that allows you to experience AR by using it in the facility, or it may be an application that is used when lending books at the library, and by using it in the facility premises, predetermined information is displayed. It may be an application to be used.

Further, in the above embodiment, the terminal device 10 acquires the facility specific information by communicating with the dedicated reader installed in the facility, or the code information provided in the facility is read by the terminal device 10. , An example of the terminal device 10 acquiring facility-specific information has been shown, but the present invention is not limited thereto.
For example, as described above, in an application for performing an AR experience in a facility, a predetermined position or tag in the facility, an AR image to be displayed, and facility specific information are associated and stored in the terminal storage unit 15. Then, the camera of the terminal device 10 captures a predetermined position or tag in the facility, and at the timing when the AR image is displayed on the terminal display unit 12 of the terminal device 10, the facility identification information and the signal for specifying the facility are displayed. Get strength information and.
Further, a predetermined position or tag in the facility, an AR image to be displayed, and facility specific information may be associated and stored in a service server that provides AR. In this case, the camera of the terminal device 10 captures a predetermined position or tag in the facility, and the terminal device 10 inquires of the service server whether or not there is an AR image corresponding to the image pickup position or tag. Then, when there is an AR image for the imaging position or the tag, the service server transmits the facility identification information together with the AR image. As a result, the terminal device 10 can acquire the facility specific information.

[Modification 2]
In the above embodiment, the server device 20 acquires the facility specific information and the signal strength information from the terminal device 10, but the server device 20 is not limited to this.
For example, when the terminal device 10 communicates with the reader of the facility, the signal strength information is transmitted to the facility server via the reader provided in the facility, and the facility server sends the facility specific information and the signal to the server device 20. Strength information may be transmitted.
Alternatively, when the terminal device 10 communicates with the reader of the facility, the facility server provided in the facility carries out specific processing such as payment processing by the user ID of the user who used the facility and the facility use application. The date and time and facility specific information are transmitted to the server device 20, and the terminal device 10 transmits the user ID, the date and time when the specific process is performed, and the signal strength information at the date and time to the server device 20. You may. In this case, the server device 20 may associate the facility-specific information with the same user ID and date and time with the signal strength information to obtain teacher data.

[Modification 3]
In the above embodiment, the motion determination unit 161 counts the number of steps of the user based on the sensor value from the sensor module 13, and determines that the user has stopped when the count-up of the number of steps has stopped for a predetermined time.
On the other hand, the exercise state of the user may be determined by a method other than the number of steps. For example, it may be determined whether or not the user has stopped based on the acceleration and moving speed detected by the 3-axis acceleration sensor and the position determined by the positioning sensor. As a result, for example, when a user in a vehicle stops at a facility that provides a drive-through product, the stoppage of the vehicle can be detected by acceleration due to three-axis acceleration, and the vehicle is stopped based on the position detected by the positioning sensor. It can be detected that the stop position is not a signal or a railroad crossing, but a drive-through type facility.
Further, the tilted state of the terminal device 10 based on the sensor value from the gyro sensor or the like may be detected. In this case, the user can determine whether or not the terminal device 10 is placed on a table or the like at a restaurant or the like.
Further, the motion determination unit 161 determines that the signal strength of the radio signal from the access point 31 does not change for a predetermined time, that is, when the amount of change in the signal strength is equal to or less than a predetermined threshold value for a predetermined time. , It may be determined that the user has stopped.

[Modification 4]
In the above embodiment, the terminal device 10 performs specific processing such as payment processing at the first timing of transmitting the facility identification information and the signal strength information which are teacher data to the server device 20, and the facility identification information is acquired. It was said that it was timing, but it is not limited to this.
For example, the terminal device 10 stores facility identification information and signal strength information obtained when a specific process is performed in the terminal storage unit 15, and may be stored at regular intervals (for example, at a preset time). At the timing specified by the user, the facility identification information and the signal strength information to be the teacher data may be transmitted from the terminal device 10 to the server device 20.

1 ... Information processing system, 10 ... Terminal device, 11 ... Terminal communication unit, 13 ... Sensor module, 15 ... Terminal storage unit, 16 ... Terminal processor, 20 ... Server device (information processing device), 21 ... Server communication unit, 22 ... server storage unit, 23 ... server processor, 31 ... access point, 161 ... motion determination unit, 162 ... application execution unit, 163 ... signal detection unit, 164 ... information transmission unit, 231 ... facility specific information acquisition unit, 232 ... signal Strength acquisition unit, 233 ... Model generation unit, 234 ... Facility identification unit.

Claims (11)

A facility-specific information acquisition unit that acquires facility-specific information that identifies the facility from the terminal device by executing a specific process on the terminal device by a facility-use application used to use a predetermined service at the facility. When,
At the timing when the specific process is executed by the terminal device, signal identification information that identifies at least one or more radio signals received by the terminal device and signal strength information including the signal strength of each radio signal are acquired. Signal strength acquisition unit and
A facility identification model in which the facility identification information and the signal strength information are used as teacher data, the signal identification information and the signal strength of the radio signal specified by the signal identification information are input, and the facility identification information is output. The model generator that generates
An information processing device characterized by being equipped with. In the information processing apparatus according to claim 1,
The facility use application is either a payment application for making a payment at the facility, a coupon application for using a coupon at the facility, or a point application for using or granting points at the facility. An information processing device characterized by this. In the information processing apparatus according to claim 1 or 2.
When the facility specific information acquisition unit and the signal strength acquisition unit simultaneously acquire the facility specific information and the signal strength information from the terminal device, the facility specific information acquisition unit and the signal strength information are associated with each other as the teacher data. Accumulate in the memory
When the signal strength information is acquired by the signal strength acquisition unit but the facility identification information is not acquired by the facility identification information acquisition unit, the signal identification information and the signal identification included in the signal strength information are included. An information processing apparatus characterized in that the signal strength of the radio signal specified by information is input to the facility identification model to further include a facility identification unit that identifies the facility in which the terminal device is located. A receiver that receives at least one or more radio signals,
A sensor module that detects its own position movement, and
A motion determination unit that determines a user's motion state based on the position fluctuation detected by the sensor module, and a motion determination unit.
The facility is specified by inputting the signal identification information for specifying each of the radio signals received by the receiving unit and the signal strength information including the signal strength of the radio signal, and the signal identification information and the signal strength of the radio signal as inputs. It is equipped with an information transmission unit that transmits to an information processing device that determines the facility using a facility identification model that outputs facility identification information.
The information transmission unit is a terminal device that transmits the signal strength information to the information processing device when the motion determination unit determines that the user has been stationary for a predetermined time or longer. In the terminal device according to claim 4,
The exercise determination unit counts the number of steps taken by the user during walking, and the exercise determination unit counts the number of steps.
The information transmission unit is a terminal device that transmits the signal strength of the radio signal to the information processing device when the number of steps is not counted by the motion determination unit for the predetermined time or more. In the terminal device according to claim 4 or 5.
Execution of an application that executes a facility use application used to use a predetermined service at the facility to execute a specific process, and acquires the facility specific information that identifies the facility that executed the facility use application. With more parts,
The information transmission unit simultaneously obtains the signal strength information of the radio signal received by the reception unit and the facility identification information at the timing when the specific processing is executed by the application execution unit. A terminal device characterized by sending to. The information processing apparatus according to any one of claims 1 to 3,
The terminal device according to any one of claims 4 to 6,
An information processing system characterized by being equipped with. It is an information processing method that processes information by a computer.
The computer includes a facility specific information acquisition unit, a signal strength acquisition unit, and a model generation unit.
The facility specific information acquisition unit identifies the facility from the terminal device by executing a specific process on the terminal device by the facility use application used to use the predetermined service in the facility. Facility specific information acquisition step to acquire, and
The signal identification information for identifying at least one or more radio signals received by the terminal device at the timing when the signal strength acquisition unit executes the specific process in the terminal device, and the signal strength of each of the radio signals. Signal strength information acquisition step to acquire signal strength information including
The model generation unit uses the facility identification information and the signal strength information as teacher data, inputs the signal identification information, and the signal strength of the radio signal specified by the signal identification information, and inputs the facility identification information. A model generation step to generate a facility-specific model that outputs
An information processing method characterized by carrying out. It is a terminal control method that controls a terminal device by a computer.
The computer includes a receiving unit that receives at least one or more radio signals, a sensor module that detects its own position fluctuation, a motion determination unit, and an information transmitting unit.
A motion determination step in which the motion determination unit determines a user's motion state based on the position variation detected by the sensor module.
The information transmitting unit inputs signal identification information that identifies each radio signal received by the receiving unit and signal strength information including the signal strength of the radio signal, and inputs the signal identification information and the signal strength of the radio signal. Then, the information transmission step of transmitting to the information processing device for determining the facility by using the facility identification model that outputs the facility identification information for specifying the facility is carried out.
The information transmission step is a terminal control method comprising transmitting the signal strength information to the information processing apparatus when it is determined in the motion determination step that the user has been stationary for a predetermined time or longer. An information processing program that can be read and executed by a computer.
An information processing program comprising the computer functioning as the information processing apparatus according to any one of claims 1 to 3. A terminal control program that can be read and executed by a computer.
A terminal control program comprising the computer functioning as the terminal device according to any one of claims 4 to 6.

Images