JP6992592B2 - Content providing device and content providing method - Google Patents

Description

The present invention relates to a content providing device, a content providing method and a program.

In recent years, with the miniaturization and higher accuracy of sensors, various sensors have been built into mobile terminals such as smartphones and tablet terminals. For example, the mobile terminal has a built-in GPS (Global Positioning System) sensor that measures the current latitude, longitude, and altitude of the mobile terminal by receiving a positioning radio wave from a satellite. A method of measuring the altitude of a terminal using a barometric pressure sensor is also known.

There is a demand for a service that accurately identifies the three-dimensional position of a user who owns a mobile terminal and provides high-value-added content according to the position.

Japanese Unexamined Patent Publication No. 2006-145340 Japanese Unexamined Patent Publication No. 2006-317225

An object of the present invention is to provide a content providing device, a content providing method, and a program that provide a user with content according to a user's three-dimensional position.

The content providing device according to the present invention has a storage unit that stores a plurality of content data and position information associated with each content data, and a mobile terminal that performs positioning based on a signal from a satellite. A position information receiving unit that receives position information including latitude, longitude, and altitude, a selection unit that selects content data corresponding to the position information received from the mobile terminal from the plurality of content data, and selected content data. It is provided with a transmission unit for transmitting to the mobile terminal.

In one aspect of the present invention, the plurality of content data correspond to individual stores, and each content data is associated with a store name or a feature amount of appearance, and is received from the mobile terminal. When there is a plurality of content data corresponding to the position information, the instruction unit instructing the mobile terminal to take a picture of the appearance of the store and the store image are received from the mobile terminal, and the store image is used for the store image by image recognition processing. The selection unit further includes an image receiving unit that detects a name or a feature amount, and the selection unit includes position information received from the mobile terminal from the plurality of content data, and a store name or a store name detected from the store image by image recognition processing. Select the content data corresponding to the feature amount.

In one aspect of the present invention, the plurality of content data correspond to individual stores, and each content data corresponds to information contained in ultrasonic waves transmitted from an ultrasonic transmitter installed in the store. When there is a plurality of content data corresponding to the position information received from the mobile terminal, the instruction unit instructing the mobile terminal to collect ultrasonic waves from the ultrasonic transmitter, and the above-mentioned The mobile terminal further includes an ultrasonic information receiving unit that collects and analyzes ultrasonic waves and receives the acquired information from the mobile terminal, and the selection unit is a position received from the mobile terminal from the plurality of content data. Information and content data corresponding to the information received by the ultrasonic information receiving unit are selected.

The content providing method of the present invention has a storage unit that is communicably connected to a mobile terminal that performs positioning based on a signal from a satellite and stores a plurality of content data and position information associated with each content data. A content providing method executed by the server device, the step of receiving position information including the latitude, longitude and altitude of the mobile terminal from the mobile terminal, and the position information received from the mobile terminal from the plurality of content data. It is provided with a step of selecting the content data corresponding to the above and a step of transmitting the selected content data to the mobile terminal.

The program of the present invention includes a step of measuring position information including the latitude, longitude and altitude of the own terminal using a signal from a satellite, and a step of acquiring content data corresponding to the position information from a content providing device. A mobile terminal having a computer executes a step of outputting the acquired content data.

According to the present invention, it is possible to provide a user with contents according to the three-dimensional position of the user.

It is a schematic block diagram of the content providing system which concerns on embodiment of this invention. It is a figure which shows the example of the content provided to a user. (A) and (b) are diagrams showing an example of a store identification method. It is a schematic block diagram of a user terminal. It is a schematic block diagram of a server device. It is a flowchart explaining the content provision method which concerns on the embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

As shown in FIG. 1, the content providing system according to the embodiment of the present invention includes a user terminal 1 and a server device 4 that provides content according to the position of the user terminal 1 to the user terminal 1. The user terminal 1 is a mobile terminal owned by a user such as a smartphone or a tablet terminal, and measures the position (longitude, latitude, altitude) of the own terminal.

The user terminal 1 receives a navigation signal from the GPS satellite 2 and performs positioning. Further, the user terminal 1 shows error correction information (time and orbit of each GPS satellite 2 and ionization layer delay in the positioning area) from the quasi-zenith satellite 3 (such as the satellite "MICHIBIKI" in the QZSS (quasi-zenith satellite system)). (Correction information including error information) is received, and positioning is performed with high accuracy.

A barometric pressure sensor is mounted on the user terminal 1, and the altitude is calculated with high accuracy in consideration of the barometric pressure value measured by the barometric pressure sensor.

The user terminal 1 periodically performs positioning and notifies the server device 4 of the position of its own terminal.

The server device 4 provides content according to the position of the user terminal 1. Here, the server device 4 provides the user terminal 1 with different contents depending on the horizontal position (latitude / longitude) and the vertical position (altitude) of the user terminal 1. The contents to be provided are, for example, coupons, limited (commemorative) images and videos, advertisements, and the like.

For example, as shown in FIG. 2, when there is a user on the first floor of a high-rise building (hereinafter referred to as tower T), the server device 1 waits for the user terminal 1 for a short wait for the day ticket of the Tenbo tour. It will provide an advertisement notifying that it can be purchased in time and that a commemorative photo can be taken at a discounted price on the Tenbo Deck.

When the user is on the restaurant floor 20 meters above the ground of the tower T, the server device 1 provides the user terminal 1 with a discount coupon that can be used at the restaurant on the restaurant floor.

When there is a user on the heavenly deck 350 meters above the ground of Tower T, the server device 1 provides the user terminal 1 with a discount coupon for commemorative photography at the commemorative photography booth. Users can use the commemorative photo service at a discounted price.

When there is a user in the Tembo Corridor 450 meters above the ground of Tower T, the server device 1 provides the user terminal 1 with a free coupon for commemorative photography at the commemorative photography booth. Users can use the commemorative photo service free of charge.

As described above, according to the present embodiment, even if the horizontal position (latitude / longitude) is the same, different contents can be provided to the user terminal 1 according to the vertical position (altitude).

The user terminal 1 can measure the horizontal position (latitude / longitude) with high accuracy by the signals from the GPS satellite 2 and the quasi-zenith satellite 3, but for example, in each restaurant floor where a plurality of restaurants are adjacent or crowded. It can be difficult to identify individual restaurants. When different contents are prepared for each store, it is necessary to accurately identify which store the user carrying the user terminal 1 is in (in front of which store) and provide the corresponding contents.

Therefore, in the present embodiment, when it is not possible to specify in front of which store only by the signals from the GPS satellite 2 and the quasi-zenith satellite 3, and the content to be provided cannot be selected, the store is identified by another method.

For example, as shown in FIG. 3A, a screen instructing the user terminal 1 to photograph the appearance of a signboard or the like of a store is displayed. The user takes a picture of a store sign or the like with the built-in camera of the user terminal 1. The user terminal 1 transmits the captured store image to the server device 4. The server device 4 detects the name of the store and the feature amount of the appearance from the store image, determines which store the user is in, and transmits the content corresponding to this store to the user terminal 1.

Alternatively, the user terminal 1 displays a screen instructing the user terminal 1 to approach the ultrasonic transmitter installed in the store. As shown in FIG. 3B, the user terminal 1 collects ultrasonic waves transmitted from the ultrasonic transmitter U with a microphone, performs analysis (for example, frequency analysis), and acquires information. The ultrasonic transmitter U transmits an ultrasonic signal including information that can identify the store. The user terminal 1 transmits the acquired information to the server device 4. The server device 4 determines which store the user is in from the received information, and transmits the content corresponding to this store to the user terminal 1.

In this way, when the detailed position cannot be specified only by the signal from the satellite, the store image of the signboard or the like and the ultrasonic signal from the ultrasonic transmitter installed in the store are used together to obtain the user terminal 1. Select and provide content according to the location.

FIG. 4 is a schematic configuration diagram of the user terminal 1. The user terminal 1 is a smartphone or tablet terminal including a control unit 10, an antenna 11, a touch panel 12, a camera 13, a storage unit 14, a communication unit 15, a barometric pressure sensor 16, a microphone 17, and the like.

The control unit 10 is a central processing unit (CPU) that controls the entire user terminal 1. The control unit 10 realizes various functions by reading and executing the application program stored in the storage unit 14.

The storage unit 14 is a storage area for storing programs, data, and the like necessary for the control unit 10 to execute various processes, and a semiconductor memory or the like is used.

The antenna 11 receives signals from satellites 2 and 3. The touch panel 12 accepts input from the user and displays the content acquired from the server device 4.

A CCD camera or a CMOS camera is used as the camera 13. The communication unit 15 communicates with the server device 4. The barometric pressure sensor 16 outputs a barometric pressure value according to the altitude as a power value. The microphone 17 collects ambient sounds.

The control unit 10 has the functions of a positioning unit 102, a content acquisition unit 104, a shooting control unit 106, an analysis unit 108, and an output processing unit 110.

The positioning unit 102 receives signals from a plurality of GPS satellites 2 via the antenna 11, and also receives error information of the GPS positioning signal and information necessary for precise positioning from the plurality of quasi-zenith satellites 3, and the own terminal. Measure the position (latitude, longitude and altitude) of. The positioning unit 102 may calculate and correct the altitude of the own terminal based on the barometric pressure value measured by the barometric pressure sensor 16. The positioning process by the positioning unit 102 may be performed autonomously at predetermined time intervals, or may be performed in response to a request from the application.

The content acquisition unit 104 notifies the server device 4 of the position information of the user terminal 1 and acquires the content corresponding to the position. When the content cannot be selected (narrowed down) only by the position information based on the signal from the satellite, another position acquisition method (store identification method) is instructed from the server device 1.

The store identification method includes taking a picture of a store such as a signboard and acquiring an ultrasonic signal from an ultrasonic transmitter installed in the store.

When the server device 1 instructs to shoot a store, the shooting control unit 106 activates the camera 13 and displays the store shooting screen as shown in FIG. 3A on the touch panel 12. When the user photographs the signboard or the like of the store, the store image is transmitted to the server device 1 via the communication unit 15.

When the server device 1 instructs the acquisition of the ultrasonic signal, the microphone 17 is turned on. As shown in FIG. 3B, when the user approaches the ultrasonic transmitter U, ultrasonic waves are collected via the microphone 17. The analysis unit 108 analyzes the ultrasonic signal and acquires the information contained in the ultrasonic signal.

The content acquisition unit 104 acquires the content selected by the position information of the user terminal 1 and the information included in the store image or the ultrasonic signal from the server device 4.

The output processing unit 110 outputs the content acquired by the content acquisition unit 104. For example, an image (still image or moving image) is displayed on the touch panel 12, or audio is output from a speaker (not shown).

FIG. 5 is a schematic configuration diagram of a server device 4 which is a content providing device. The server device 4 may be composed of one computer or a plurality of computers. As shown in FIG. 5, the server device 4 includes a control unit 40, a storage unit 42, and a communication unit 44. The control unit 40 is a central processing unit (CPU) that controls the entire server device 4. The control unit 40 realizes various functions by reading and executing the operating system (OS) and the application program stored in the storage unit 42.

The storage unit 42 is a storage area for storing programs, data, and the like necessary for the control unit 40 to execute various processes, and a hard disk, a semiconductor memory, or the like is used. The storage unit 42 has a content DB (database) in which location information and content data are stored in association with each other. The position information associated with the content data indicates a position in a certain range in consideration of measurement error.

When a plurality of small stores are adjacent to each other and individual contents are prepared for each store, additional information for identifying each store is further associated. The additional information is, for example, the name of the store, the features extracted from the store image, or the information contained in the ultrasonic waves transmitted from the ultrasonic transmitter installed in the store.

The communication unit 44 communicates with the user terminal 1 via a network such as the Internet or a LAN.

The control unit 40 has the functions of a position information receiving unit 401, a content selection unit 402, an identification method instruction unit 403, an image receiving unit 404, an ultrasonic information receiving unit 405, and a content transmitting unit 406.

The position information receiving unit 401 receives the position information from the user terminal 1.

The content selection unit 402 selects the content corresponding to the position information received from the user terminal 1 from the content DB.

When a plurality of small stores are adjacent to each other and individual contents are prepared for each store, the location information received from the user terminal 1 may not be able to narrow down the contents (stores) to one. In this case, the additional information described above is required. The identification method instruction unit 403 instructs the user terminal 1 on an identification method for acquiring additional information. The identification method is taking a store image or collecting ultrasonic waves.

The image receiving unit 404 receives the store image from the user terminal 1 and detects characters and feature quantities from the store image by image recognition processing. The feature amount is not particularly limited, such as an EOH feature amount, a HOG feature amount, an Edgelet feature amount, and a Joint Haar-like feature amount.

The ultrasonic information receiving unit 405 receives the information obtained by the analysis of the ultrasonic signal from the user terminal 1.

The content selection unit 402 selects content data according to the position of the user terminal 1 by using characters and features detected from the store image or information acquired from the ultrasonic signal.

The content transmission unit 406 transmits the content data selected by the content selection unit 402 to the user terminal 1.

Next, the content providing method according to the present embodiment will be described with reference to the flowchart shown in FIG.

The user terminal 1 periodically measures the position of its own terminal (step S1). The user terminal 1 notifies the server device 4 of the measured position information. Location information includes latitude, longitude and altitude.

When there is only one content corresponding to the position of the user terminal 1 (step S2_Yes, S3_Yes), the server device 4 transmits the content data to the user terminal 1 (step S4). The user terminal 1 displays and outputs the content acquired from the server device 4 (step S5).

When there are a plurality of contents corresponding to the positions of the user terminals 1 (steps S2_Yes, S3_No), the server device 4 instructs the user terminals 1 on an identification method for narrowing down the contents (step S6).

When the identification method uses an image, the camera 13 of the user terminal 1 is activated, and the user takes a picture of a signboard or the like of the store (step S7). The user terminal 1 transmits the captured store image to the server device 4. The server device 1 detects characters and feature quantities from the store image by image recognition (step S8), and selects content data (step S9).

When the identification method uses ultrasonic waves, the microphone 17 of the user terminal 1 is activated to collect ultrasonic waves from an ultrasonic transmitter installed in the store (step S10). The user terminal 1 analyzes the collected ultrasonic signal, acquires information, and transmits the acquired information to the server device 4 (step S11). The server device 1 selects content data based on the received information (step S9).

The server device 4 transmits the content data selected in step S9 to the user terminal 1 (step S4). The user terminal 1 displays and outputs the content acquired from the server device 4 (step S5).

As described above, according to the present embodiment, it is possible to provide the user with the content corresponding to the three-dimensional position of the user. Even if the longitude and latitude are the same, different contents can be provided to users at different heights.

In the above embodiment, an example of providing a coupon according to the height has been described, but an electronic stamp of a stamp rally, a complete certificate, or the like may be given.

In the above embodiment, the method for identifying the store is not limited to the photography of the store and the analysis of ultrasonic waves, and may be a method using a beacon signal or the like. For example, the server device 4 instructs the user terminal 1 to receive a beacon signal as an identification method for narrowing down the content. When the user terminal 1 receives the beacon signal from the transmitter installed in the store, the user terminal 1 transmits the identification information included in the signal to the server device 4. The server device 4 selects content data based on the received identification information.

It should be noted that the present invention is not limited to the above embodiment as it is, and at the implementation stage, the components can be modified and embodied within a range that does not deviate from the gist thereof. In addition, various inventions can be formed by an appropriate combination of the plurality of components disclosed in the above-described embodiment. For example, some components may be removed from all the components shown in the embodiments. In addition, components across different embodiments may be combined as appropriate.

1 User terminal 2 GPS satellite 3 Quasi-zenith satellite 4 Server device

Claims (2)

A storage unit that stores a plurality of content data and location information associated with each content data,
A position information receiving unit that receives position information including the latitude, longitude, and altitude of the mobile terminal from a mobile terminal that performs positioning based on a signal from a satellite.
A selection unit that selects content data corresponding to the location information received from the mobile terminal from the plurality of content data, and a selection unit.
A transmitter that sends the selected content data to the mobile terminal, and
It is a content providing device equipped with
The multiple content data correspond to each individual store,
Each content data is associated with the name of the store or the feature amount of the appearance.
When there is a plurality of content data corresponding to the position information received from the mobile terminal, the instruction unit instructing the mobile terminal to take a picture of the appearance of the store and the store image received from the mobile terminal for image recognition. It is equipped with an image receiving unit that detects the store name or feature amount from the store image by processing.
The selection unit is characterized in that it selects content data corresponding to the location information received from the mobile terminal and the store name or feature amount detected from the store image by the image recognition process from the plurality of content data. Content providing device. A content providing method executed by a server device having a storage unit that is communicably connected to a mobile terminal that performs positioning based on a signal from a satellite and stores a plurality of content data and position information associated with each content data. And
A step of receiving position information including the latitude, longitude and altitude of the mobile terminal from the mobile terminal, and
A step of selecting content data corresponding to the location information received from the mobile terminal from the plurality of content data, and
The step of transmitting the selected content data to the mobile terminal and
Equipped with
The multiple content data correspond to each individual store,
Each content data is associated with the name of the store or the feature amount of the appearance.
When there is a plurality of content data corresponding to the position information received from the mobile terminal, the mobile terminal is instructed to take a picture of the appearance of the store, the store image is received from the mobile terminal, and the image recognition process is performed. Detects the store name or feature quantity from the store image and
From the plurality of content data, the position information received from the mobile terminal and the content data corresponding to the store name or feature amount detected from the store image by the image recognition process are selected and transmitted to the mobile terminal. Characteristic content provision method.

Images