JP7596691B2 - Information processing device, information processing method, and program - Google Patents

Description

This disclosure relates to technology for delivering content.

There is technology that uses mobile devices such as smartphones and tablets to provide services based on the user's location information.

Patent document 1 discloses a technology that acquires a user's location information using a global positioning system (GPS) installed in a mobile terminal, and delivers content to the user based on the acquired location information and pre-set user information.

As another document related to obtaining location information, Patent Document 2 discloses that the user's location is identified using image information obtained from a mobile device carried by the user.

JP 2014-241600 A JP 2007-011607 A

In the technology described in Patent Document 1, the user's location information is acquired using only GPS. Therefore, for example, if there are obstacles such as high-rise buildings around the user, the user's location information may not be identified accurately. As a result, when delivering content based on the user's location information, it may not be possible to deliver content suitable for the user.

The technology described in Patent Document 2 simply identifies the user's location, and does not disclose how to determine which content to provide to the user from multiple pieces of content depending on the user's location.

This disclosure has been made in consideration of the above-mentioned problems, and one of its objectives is to provide technology that can deliver content that is accurately suited to users.

An information processing device according to one aspect of the present disclosure includes: an identification means for identifying the position of a photographer who has taken an image using a terminal and the direction in which the photographer is facing, based on a utility pole identification sign that appears in the captured image acquired from the terminal; and a content determination means for determining, from among a plurality of contents, a content to be delivered to the terminal, based on the identified position and direction.

An information processing device according to one aspect of the present disclosure includes: an identification means for identifying the location of a photographer who captured the captured image using the terminal based on a utility pole identification sign that appears in the captured image acquired from the terminal and on location information of the terminal acquired by location information acquisition means possessed by the terminal; and a content determination means for determining which of a plurality of contents to distribute to the terminal based on the identified location.

An information processing method according to one aspect of the present disclosure identifies the position of the photographer who used the terminal to capture the image and the direction in which the photographer is facing based on a utility pole identification sign that appears in the captured image acquired from the terminal, and determines which of multiple pieces of content to distribute to the terminal based on the identified position and direction.

A program according to one aspect of the present disclosure causes a computer to execute a process of identifying the position of a photographer who used a terminal to capture an image and the direction in which the photographer is facing, based on a utility pole identification sign that appears in the captured image acquired from the terminal, and a process of determining which of multiple pieces of content to distribute to the terminal, based on the identified position and direction.

The present disclosure has the effect of enabling content that is accurately suited to the user to be delivered.

1 is a diagram illustrating an example of a configuration of a content distribution system according to a first embodiment; 1 is a block diagram showing an example of a functional configuration of an information processing apparatus according to a first embodiment; 5 is a flowchart illustrating an example of an operation of the information processing device according to the first embodiment. FIG. 11 is a block diagram illustrating an example of a functional configuration of a content distribution system according to a second embodiment. FIG. 13 is a diagram showing an example of a utility pole identification sign according to a second embodiment. FIG. 11 is a sequence diagram illustrating an operation of the content distribution system according to the second embodiment. FIG. 11 is a diagram showing an example of a sign according to a second embodiment. FIG. 11 is a diagram showing another example of a sign according to the second embodiment. FIG. 13 is a block diagram illustrating an example of a functional configuration of a content distribution system according to a third embodiment. FIG. 13 is a block diagram illustrating an example of a functional configuration of a content distribution system according to a fourth embodiment. FIG. 13 is a block diagram illustrating an example of a functional configuration of a content distribution system according to a fifth embodiment. FIG. 13 is a diagram illustrating an example of a captured image according to the fifth embodiment. FIG. 13 is a diagram illustrating an example of a captured image according to the fifth embodiment. FIG. 1 is a block diagram showing an example of a hardware configuration of a computer device that realizes an information processing device in the first, second, third, fourth and fifth embodiments.

Embodiments of the present disclosure are described below with reference to the drawings.

First Embodiment
An information processing apparatus according to a first embodiment will be described.

Fig. 1 is a diagram showing a schematic example of the configuration of a content distribution system 1000 including an information processing device 100 according to a first embodiment. As shown in Fig. 1, the content distribution system 1000 includes an information processing device 100 and a distribution device 200. The information processing device 100 is communicatively connected to the distribution device 200 and a terminal 300 via a network.

The terminal 300 is communicatively connected to the information processing device 100 and the distribution device 200 via a network. The terminal 300 has a function for capturing images of the surroundings and a function for outputting content. The terminal 300 is, for example, a mobile phone, a smartphone, or a tablet, but is not limited to these examples.

In the situation shown in FIG. 1, a user is using the terminal 300 to capture an image of a utility pole identification sign (details of which will be described later) attached to a utility pole. The image captured by the terminal 300 may be a still image or a moving image. In this specification, an image captured by the terminal 300 is referred to as a captured image. Also, in this specification, a user who captures an image using the terminal 300 is also referred to as a photographer. The terminal 300 transmits the captured image to the information processing device 100.

When the information processing device 100 acquires a captured image from the terminal 300, it determines the content to be delivered to the terminal 300 according to the information acquired based on the captured image.

The distribution device 200 distributes the content determined by the information processing device 100 to the terminal 300.

In this way, the content distribution system 1000 according to the first embodiment is a system that distributes content to the terminal 300 in accordance with the captured image acquired from the terminal 300.

Note that in FIG. 1, the information processing device 100 and the distribution device 200 are shown as independent devices, but this is not limited thereto. For example, the information processing device 100 and the distribution device 200 can be realized as an integrated device. Furthermore, the information processing device 100 and the distribution device 200 may each be constructed in an on-premise environment or in a cloud environment.

[Details of information processing device 100]
Next, a description will be given of details of the information processing device 100. Fig. 2 is a block diagram showing an example of a functional configuration of the information processing device 100 according to the first embodiment. As shown in Fig. 2, the information processing device 100 includes an identification unit 110 and a content determination unit 120.

The identification unit 110 identifies the position of the photographer and the direction in which the photographer is facing based on the captured image acquired from the terminal 300. For example, the identification unit 110 reads the characters written on a utility pole identification sign shown in the captured image. Here, a utility pole identification sign is a sign on which information for identifying a utility pole is written. The utility pole identification sign is attached to a utility pole. For example, the utility pole identification sign contains characters indicating the place name where the utility pole is installed and a number that identifies the utility pole. In this specification, such information written on a sign is also referred to as sign information.

The identification unit 110, for example, reads sign information from a utility pole identification sign, and searches the sign database for position information and direction information corresponding to the read sign information. The sign database includes data in which sign information is associated with position information and direction information corresponding to the sign information. Here, the direction information is, for example, the direction opposite to the direction in which the sign faces. That is, the direction information corresponding to the sign information corresponds to, for example, the direction in which the photographer faces when facing the sign information. The sign database may be stored in advance in a storage device (not shown) possessed by the information processing device 100, or may be stored in an external storage device communicably connected to the information processing device 100. The information processing device 100 may also acquire the sign database from an external server device communicably connected. For example, the identification unit 110 searches for position information and direction information corresponding to the read sign information, and when the search is successful, the position and direction indicated by the position information and direction information corresponding to the read sign information are determined to be the position of the photographer and the direction in which the photographer faces.

In this way, the identification unit 110 identifies the position of the photographer who captured the image using the terminal and the direction in which the photographer is facing, based on the utility pole identification sign included in the captured image acquired from the terminal. The identification unit 110 is an example of an identification means.

The content determination unit 120 determines which of the multiple contents is to be delivered to the terminal 300 based on the position and direction identified by the identification unit 110. For example, the content determination unit 120 selects content corresponding to the information indicating the identified position and direction from a content database. Here, the content database includes multiple pieces of data in which information for identifying content (hereinafter also referred to as content identification information) is associated with position information and direction information. The content database may be stored in advance in a storage device (not shown) possessed by the information processing device 100, or may be stored in an external storage device communicably connected to the information processing device 100. The information processing device 100 may also acquire the content database from an external server device communicably connected. The content determination unit 120 then determines the selected content as the content to be delivered to the terminal 300.

Next, the content determination unit 120 transmits, for example, content identification information of the determined content to the distribution device 200. The distribution device 200 distributes the content corresponding to the content identification information received from the information processing device 100 to the terminal 300. The distribution device 200 distributes the content by, for example, transmitting content data indicating the actual data of the content to the terminal 300. Note that the method of distributing the content is not limited to this example. For example, when the content data is stored in a storage device (not shown) owned by the terminal 300, the distribution device 200 may transmit the content identification information to the terminal 300. Then, the terminal 300 may output the content by reading the content corresponding to the received content identification information from the storage device owned by the terminal 300. In this case, instead of the distribution device 200, the content determination unit 120 of the information processing device 100 may transmit the content identification information to the terminal 300.

In this way, the content determination unit 120 determines which of the multiple pieces of content to deliver to the terminal based on the identified position and direction. The content determination unit 120 is an example of a content determination means.

[Operation of information processing device 100]
Next, the operation of the information processing device 100 will be described with reference to Fig. 3. Fig. 3 is a flowchart illustrating the operation of the information processing device 100. In the operation described below, it is assumed that the information processing device 100 acquires a captured image from the terminal 300 in the situation of Fig. 1. Note that in this specification, each step in a flowchart or sequence diagram will be expressed using a number assigned to each step, such as "S101".

The identification unit 110 identifies the position of the photographer and the direction in which the photographer is facing based on the utility pole identification sign included in the captured image acquired from the terminal 300 (S101).

The content determination unit 120 determines the content to be distributed to the terminal based on the identified position and direction (S102). The content determination unit 120 transmits, for example, content identification information indicating the determined content to the distribution device 200.

Then, the distribution device 200 transmits content data corresponding to the content identification information to the terminal 300, whereby the content is distributed to the terminal 300.

As described above, the information processing device 100 according to the first embodiment specifies the position of the photographer who took the image using the terminal and the direction in which the photographer is facing, based on the utility pole identification sign shown in the captured image acquired from the terminal. Then, the information processing device 100 determines the content to be delivered to the terminal from among the multiple contents, based on the specified position and direction. For example, content may be delivered in which the sound output from the terminal is determined according to the user's position, and the volume changes depending on the direction in which the user is facing. In addition, for example, content may be delivered in which the object included in the image output by the terminal is determined according to the user's position, and the appearance of the object changes depending on the direction in which the user is facing. By having the above configuration, the information processing device 100 according to the first embodiment can accurately specify the user's location when delivering content based on the user's location, such as the user's location and the direction in which the user is facing. Therefore, the information processing device 100 according to the first embodiment has the effect of being able to deliver content suitable for the user with high accuracy.

In this embodiment, an example has been described in which a utility pole identification sign is photographed by the terminal 300, but the subject to be photographed is not limited to a utility pole identification sign. For example, instead of a utility pole identification sign, an existing sign whose installation location is uniquely determined, such as a guide sign installed on a road or a railroad crossing identification sign, may be the subject to be photographed. In this case, the information processing device 100 identifies the user's position and the direction in which the user is facing based on the sign shown in the captured image.

Second Embodiment
Next, a content distribution system including an information processing device according to a second embodiment will be described.

Figure 4 is a block diagram showing an example of the configuration of a content distribution system 1001 according to the second embodiment. As shown in Figure 4, the content distribution system 1001 includes an information processing device 101 instead of the information processing device 100 in the first embodiment, and is otherwise similar to the content distribution system 1000 described in the first embodiment. That is, the content distribution system 1001 includes an information processing device 101 and a distribution device 200. Note that a description of the configuration and operation of the content distribution system 1001 shown in Figure 4 that overlaps with the description of the first embodiment will be omitted.

[Details of information processing device 101]
As shown in FIG. 4, the information processing device 101 includes a specification unit 110, a content determination unit 120, and a communication unit 130.

The communication unit 130 transmits and receives data with the distribution device 200 and the terminal 300.

The identification unit 110 has a sign information reading unit 111 and a search unit 112. The sign information reading unit 111 reads sign information from the area of the sign shown in the captured image acquired from the terminal 300 via the communication unit 130. The sign information indicates a character string or a symbol string written on the sign, and is information uniquely determined for each sign. FIG. 5 is a diagram showing an example of a utility pole identification sign. The utility pole identification sign is an example of a sign in this specification. In the example of FIG. 5, the place name "Kawasaki City" is written as the sign name, and "0001" is written as the utility pole number. Such a combination of the sign name and the utility pole number is uniquely determined. In the example of FIG. 5, the sign information indicates the sign name and the utility pole number. Note that the description example of the utility pole identification sign is not limited to the example of FIG. 6. For example, the sign name may use numbers or symbols, and the utility pole number may use letters or symbols other than numbers. In addition, a predetermined character string without character divisions may be used, as in the sign name and utility pole number of FIG. 5.

The sign information reading unit 111, for example, recognizes an area in which the sign name and the pole number of the utility pole identification sign are reflected from the captured image, and reads the sign name and the pole number as sign information. The sign information reading unit 111, for example, uses OCR (Optical Character Reader) technology to recognize the character area of the sign from the captured image and reads characters one by one from the character area. Note that the sign information reading unit 111 may read the sign information using other technology, not limited to OCR technology. For example, the sign information reading unit 111 can read the sign information by using a known machine learning technology. Examples of known machine learning technology include SVM (Support Vector Machine), neural network, random forest, etc. Furthermore, the sign information reading unit 111 may use deep learning technology when reading the sign information.

If the sign information cannot be read, the sign information reading unit 111 may notify the content determination unit 120 that an error has occurred in the reading.

In this way, the sign information reading unit 111 reads the sign information written on the utility pole identification sign from the area in which the utility pole identification sign appears in the captured image. The sign information reading unit 111 is an example of a sign information reading means.

The search unit 112 identifies the user's location based on the sign information read by the sign information reading unit 111. For example, the search unit 112 searches the sign database for position information and direction information corresponding to the read sign information. The sign database includes data in which sign information is associated with position information and direction information corresponding to the sign information. For example, in the case of a utility pole identification sign as shown in the example of FIG. 5, the sign database associates position information indicating the position of the utility pole on which the sign is attached and direction information indicating the direction the sign faces with a combination of the sign name and the utility pole number. The search unit 112 searches the sign database using, for example, the read sign information as a key. If the search is successful, the user's position and the direction the user is facing are identified according to the position information and direction information associated with the sign information that is a search hit. If the search is not successful, the search unit 112 does not need to identify the user's position and the direction the user is facing.

In this way, the search unit 112 searches for position information and direction information corresponding to the read sign information from a database in which sign information is associated with position information and direction information, and if the search is successful, the position and direction of the photographer are identified according to the position information and direction information corresponding to the read sign information. The search unit 112 is an example of a search means.

Here, the sign database is the same as the sign database described in the first embodiment. Note that the information associating the combination of the sign name and the utility pole number with the location information is provided, for example, by the electric power company or the communication company that manages the utility pole. In addition, the location on the utility pole where the utility pole identification sign is attached is often a location that is easy for the employees of the electric power company or the communication company to confirm, such as a location facing a road. Therefore, for example, the direction in which the sign faces can be calculated from the location information indicating the position of the utility pole and the map data. Such calculation of the direction in which the sign faces and the opposite direction and creation of the sign database may be performed by the information processing device 101. The sign database may be stored in advance in a storage device (not shown) possessed by the information processing device 101, or may be stored in an external storage device communicably connected to the information processing device 101. In addition, the information processing device 101 may acquire the sign database from an external server device communicably connected.

The content determination unit 120 determines the content to be delivered to the terminal 300 based on the position and direction identified by the identification unit 110. For example, the content determination unit 120 selects content corresponding to the information indicating the identified position and direction from a content database. This makes it possible to select content according to the user's position and the direction in which the user is facing. The content database is the same as the content database described in the first embodiment. The content database may be stored in advance in a storage device (not shown) possessed by the information processing device 101, or may be stored in an external storage device communicatively connected to the information processing device 101. The information processing device 101 may also acquire the content database from an external server device communicatively connected.

Then, the content determination unit 120 transmits the content identification information of the determined content to the distribution device 200 via the communication unit 130.

When the identification unit 110 does not identify the user's position and the direction the user is facing (i.e., when the search unit 112 does not find a search result), the content determination unit 120 may transmit information indicating that the position and the direction the user is facing to the distribution device 200 via the communication unit 130. When the content determination unit 120 receives a notification from the sign information reading unit 111 indicating that an error has occurred in the reading, the content determination unit 120 may transmit information indicating that an error has occurred in the reading to the distribution device 200 via the communication unit 130.

[Details of distribution device 200]
The distribution device 200 includes a communication unit 210 and a distribution unit 220 .

The communication unit 210 transmits and receives data with the information processing device 101 and the terminal 300.

The distribution unit 220 distributes content to the terminal 300. For example, the distribution unit 220 receives content identification information from the information processing device 101 via the communication unit 210. Then, the distribution unit 220 transmits content data corresponding to the content identification information to the terminal 300.

When information indicating that the user's position and the direction the user is facing have not been identified or information indicating that an error has occurred in reading has been received from the information processing device 101, content data corresponding to the respective information may be transmitted. For example, when the user's position and the direction the user is facing have not been identified, the distribution unit 220 may transmit to the terminal 300 content data of content indicating that the photographed sign is different. Furthermore, when the distribution unit 220 receives information indicating that an error has occurred in reading, it may transmit to the terminal 300 content data of content indicating an instruction to photograph the sign so that it is larger.

[Details of terminal 300]
The terminal 300 includes a communication unit 310 , an image capturing unit 320 , and an output unit 330 .

The communication unit 310 transmits and receives data with the information processing device 101 and the distribution device 200.

The image capturing unit 320 captures an image of a predetermined range and generates a captured image. The image capturing unit 320 captures an image in response to, for example, a user operation. The captured image may include information indicating the time at which the captured image was generated (i.e., the capture time). The image capturing unit 320 transmits the captured image to the information processing device 101 via the communication unit 310.

The output unit 330 acquires content data from the distribution device 200 via the communication unit 310. The output unit 330 then outputs the content based on the acquired content data. If the content includes video, the output unit 330 outputs the video using a display of the terminal, and if the content includes audio, the output unit 330 outputs the audio using a speaker of the terminal.

When content data is stored in a storage device (not shown) of the terminal 300, the output unit 330 may output content according to content identification information acquired from the distribution device 200 or the information processing device 101 via the communication unit 310.

[Operation of Content Distribution System 1001]
Next, the operation of the content distribution system 1001 will be described with reference to Fig. 6. In the operation described below, it is assumed that the user of the terminal 300 photographs an image of a utility pole identification sign. Fig. 6 is a sequence diagram for explaining the operation of the content distribution system 1001.

The photographing unit 320 of the terminal 300 photographs the utility pole identification sign (S201). The photographing unit 320 then transmits the photographed image to the information processing device 101 via the communication unit 310.

The sign information reading unit 111 of the information processing device 101 reads sign information from the area of the utility pole identification sign shown in the captured image received from the terminal 300 (S203). The search unit 112 searches the sign database using the read sign information as a key (S204). If the search returns a hit, the search unit 112 identifies the position and direction of the photographer based on the position information and direction information corresponding to the read sign information (S205). The content determination unit 120 determines the content to be distributed to the terminal 300 based on the identified position and direction (S206). The content determination unit 120 transmits content identification information indicating the determined content to the distribution device 200 (S207).

The distribution unit 220 of the distribution device 200 distributes the content to the terminal 300 according to the content identification information received from the information processing device 101 via the communication unit 210 (S208). More specifically, the distribution unit 220 transmits content data of the content corresponding to the content identification information to the terminal 300.

The output unit 330 of the terminal 300 outputs the content based on the content data acquired via the communication unit 310 (S209).

As described above, the information processing device 101 according to the second embodiment identifies the position of the photographer who captured the image using the terminal and the direction in which the photographer is facing, based on the utility pole identification sign shown in the captured image acquired from the terminal. Then, the information processing device 100 determines the content to be delivered to the terminal from among the multiple contents, based on the identified position and direction. With this configuration, the information processing device 101 according to the second embodiment, like the information processing device 100 according to the first embodiment, can accurately identify the user's location when delivering content based on the user's location, such as the user's location and the direction in which the user is facing. Therefore, the information processing device 100 according to the second embodiment has the effect of being able to deliver content suitable for the user with high accuracy.

In addition, the information processing device 101 does not need to use information obtained from the GPS of the terminal carried by the user to identify the user's location. Therefore, the information processing device 101 can accurately identify the user's location even if there are obstacles such as high-rise buildings around the user. Here, in order to deal with cases where location information cannot be obtained by GPS, for example, a marker such as a QR (Quick Response) code indicating location information may be installed, and the user may read the marker using a terminal to identify the user's location. However, in such a case, costs for installing the marker and for maintaining the installed marker are incurred. In contrast, in the content distribution system 1001 according to the second embodiment, existing signs are used to identify the user's location, so there is no need to newly install a marker indicating location information. In addition, existing signs such as utility pole identification signs are maintained by the power company or communication company that manages the signs. Therefore, in the content distribution system 1001 according to the second embodiment, the cost of maintaining the signs can also be reduced.

[Modification 1]
In the second embodiment, the use of utility pole identification signs to identify the user's location has been mainly described, but signs other than utility pole identification signs may be used. For example, guide signs installed on roads may be used. FIG. 7 is a diagram showing an example of a road guide sign. In this case, for example, the user photographs the guide sign using the terminal 300. The information processing device 101 acquires a photographed image showing the guide sign from the terminal.

The sign information reading unit 111 of the identification unit 110 reads the characters written on the guide sign. For example, if the guide sign shown in FIG. 7 is captured in the captured image, the sign information reading unit 111 reads the characters "Kawasaki 12 km" and "Higashi-Kanagawa 5.3 km" as sign information. The search unit 112 searches the sign database using the read sign information as a key. At this time, the sign database contains data in which the sign information indicating the characters written on the guide sign is associated with position information and direction information.

The sign used in this disclosure may also be an identification sign installed at a railroad crossing. FIG. 8 is a diagram showing an example of an identification sign at a railroad crossing. In this case, for example, a user photographs the identification sign using the terminal 300. The information processing device 101 acquires a photographed image showing the identification sign from the terminal.

The sign information reading unit 111 of the identification unit 110 reads the characters written on the identification sign. For example, if the identification sign shown in FIG. 8 is captured in the captured image, the sign information reading unit 111 reads the characters "Kawasaki No. 1 Crossing" as sign information. The search unit 112 searches the sign database using the read sign information as a key. At this time, the sign database contains data in which the sign information indicating the characters written on the identification sign is associated with position information and direction information.

The signs described above are merely examples, and the signs used in this disclosure are not limited to utility pole identification signs, road guide signs, and railroad crossing identification signs.

[Modification 2]
In the second embodiment, an example has been described in which the identification unit 110 reads written characters from the area of a sign shown in a captured image as sign information, and identifies the user's position and the direction in which the user is facing based on the read sign information. The example of identifying the user's position and the direction in which the user is facing is not limited to this example.

For example, the information processing device 101 may previously hold a feature database in which feature amounts of an image of a sign are associated with information identifying the sign. In this case, the identification unit 110 may extract feature amounts of an area in which a sign appears from a captured image, and identify a sign that matches the feature amount using the feature database. In this case, the identification unit 110 may use information identifying the identified sign as sign information and perform a search in the sign database using the sign information as a key. In this case, the sign database contains data in which information identifying a sign is used as sign information and is associated with position information and direction information.

Note that in variant example 2, the identification unit 110 does not need to include the label information reading unit 111.

[Modification 3]
Furthermore, examples of identifying the user's position and the direction in which the user is facing are not limited to the above examples.

The terminal 300 may acquire the user's voice. For example, when the user speaks words indicating sign information toward the terminal 300, the terminal 300 acquires the information spoken by the user (also referred to as voice information) via a microphone (not shown) included in the terminal 300. Then, the communication unit 310 transmits the voice information to the information processing device 101 during processing of S202.

The identification unit 110 acquires voice information from the terminal 300 via the communication unit 130. The identification unit 110 performs voice recognition using the voice information and converts the voice into text. The identification unit 110 then identifies the converted text information as sign information written on a sign. Such a process of identifying sign information written on a sign using voice information may be performed by the sign information reading unit 111.

The identification unit 110 then searches a sign database using the sign information identified based on the voice information as a key to identify the user's position and the direction in which the user is facing. Note that the process of searching the sign database using the sign information identified based on the voice information as a key may be performed by the search unit 112.

The identification unit 110 can perform voice recognition using known technology. For example, the identification unit 110 can perform voice recognition by analyzing voice information using a voice recognition dictionary created by machine learning, deep learning, or the like.

In this way, the information processing device 101 according to the third modification identifies sign information based on the voice information acquired from the terminal 300, and identifies the user's position and the direction in which the user is facing based on the identified sign information.

The characters written on the sign may be handwritten or may be missing due to aging. In such a case, the process of reading the sign information from the captured image may fail to read the characters. For example, assume that the sign information reading unit 111 fails to read the sign information in the process of S203. In response to this, the information processing device 101 according to the third modification identifies the sign information written on the sign using voice information, for example, after the process of S203. Then, instead of the processes of S204 and S205, the information processing device 101 searches the sign database using the sign information identified based on the voice information as a key to identify the position and direction of the user. In this way, the information processing device 101 according to the third modification can identify the sign information using voice information, and therefore can identify the user's location even if it fails to read the characters.

[Modification 4]
In the second embodiment, an example has been described in which the sign database contains data in which sign information is associated with position information and direction information, but the sign database may contain data in which either position information or direction information is associated with sign information. In this case, the identification unit 110 identifies either the position of the photographer or the direction in which the photographer is facing. Then, the content determination unit 120 determines the content to be delivered to the terminal 300 based on information indicating either the identified position of the photographer or the direction in which the photographer is facing. At this time, the content database may contain data in which content identification information is associated with either position information or direction information.

Third Embodiment
Next, a content distribution system including an information processing device according to a third embodiment will be described.

Figure 9 is a block diagram showing an example of the configuration of a content distribution system 1002 according to the third embodiment. As shown in Figure 9, the content distribution system 1002 includes an information processing device 102 instead of the information processing device 101 in the second embodiment, and is otherwise similar to the content distribution systems 1000 and 1001 described in the first and second embodiments. That is, the content distribution system 1002 includes an information processing device 102 and a distribution device 200. Also, in Figure 9, a terminal 301 is shown instead of the terminal 300 in Figure 4. Note that a description of the configuration and operation of the content distribution system 1002 shown in Figure 9 that overlaps with the description of the first and second embodiments will be omitted.

As shown in FIG. 9, the terminal 301 further includes a location information acquisition unit 340 in addition to the configuration of the terminal 300. The location information acquisition unit 340 acquires location information indicating the location of the terminal 301. For example, the location information acquisition unit 340 may acquire location information by a positioning signal receiving device mounted on the terminal 301. Specifically, for example, the terminal 301 may be configured to receive a signal transmitted from a positioning satellite of the GNSS (Global Navigation Satellite System) such as a GPS satellite, and acquire location information indicating its own location based on the received signal. The location information acquisition unit 340 transmits the acquired location information to the information processing device 102 via the communication unit 310 together with the captured image captured by the capture unit 320. The location information acquisition unit 340 is an example of a location information acquisition means.

[Details of information processing device 102]
9, the information processing device 102 includes an identification unit 140 instead of the identification unit 110 in the configuration of the information processing device 101. The identification unit 140 includes a label information reading unit 141 and a search unit 142. The label information reading unit 141 and the search unit 142 have the following functions in addition to the functions of the label information reading unit 111 and the search unit 112, respectively.

The sign information reading unit 141 obtains the captured image and the location information from the terminal 301 via the communication unit 130. Here, in the case of a utility pole identification sign as shown in FIG. 5, the location in the sign where the sign name indicating the place name and the utility pole number are written is often predetermined. In this case, if the acquired location information includes the place name information indicated by the sign name, the sign information reading unit 141 does not need to read the sign name again. In such a case, for example, in the process of S203 in the sequence diagram shown in FIG. 6, the sign information reading unit 141 may control so that the character reading is not performed for the area where the sign name is written, and the character reading is performed only for the area where the utility pole number is written. In addition, the utility pole number as shown in FIG. 5 may have a hierarchical structure. The hierarchical structure indicates a structure in which an address is determined according to the position and number of characters, such as, for example, if the utility pole number is four digits, the first two digits correspond to the town name and the last two digits correspond to the block number. In such a case, if the acquired location information includes town name information, the sign information reading unit 141 may be controlled to read characters only in a part of the area where the utility pole number is written. Specifically, in the process of S203, the sign information reading unit 141 may be controlled to read characters only in the area where the utility pole number is written, without reading characters in the area where the first two digits are written. Then, the search unit 142 may treat the location information acquired from the terminal 301 and the read utility pole number as sign information, and may search the sign database using the sign information as a key.

That is, the information processing device 102 according to the third embodiment determines the area to be read from within the area of the captured image in which the utility pole identification sign appears, based on the location information of the terminal acquired by a location information acquisition unit possessed by the terminal. This allows the information processing device 102 to reduce the area from which characters are read from, for example, within the captured image, thereby reducing the processing time required for reading characters. Furthermore, since the information processing device 102 can reduce the range in which reading is performed, the occurrence of reading errors can be suppressed and the accuracy of reading characters can be improved.

When searching the sign database using sign information, the search unit 142 may narrow the search range of the data included in the sign database according to the location information acquired from the terminal 301. For example, in S204 of the sequence diagram shown in FIG. 6, the search unit 142 may limit the search range to the sign information of signs that exist in the city or town indicated by the location information acquired from the terminal 301.

In other words, the information processing device 102 according to the third embodiment can determine the range in which to search the database based on the location information of the terminal acquired by the location information acquisition unit of the terminal. This allows the information processing device 102 to narrow the search range, thereby reducing the processing time required for the search.

As described above, the information processing device 102 according to the third embodiment identifies the location of the photographer who captured the captured image using the terminal, based on the utility pole identification sign shown in the captured image acquired from the terminal and the location information of the terminal acquired by the location information acquisition means of the terminal. Then, based on the identified location, the information processing device 102 determines which of multiple contents to deliver to the terminal. In this way, the information processing device 102 according to the third embodiment can suppress an increase in processing time and accurately deliver content suitable for the user.

[Modification 5]
In the third embodiment, an example has been described in which the location information acquisition unit 340 acquires the location information of the terminal 301 based on a signal transmitted from a GNSS positioning satellite. An example in which the location information acquisition unit 340 acquires the location information of the terminal 301 is not limited to this example.

The terminal 301 may acquire the user's voice. For example, when the user speaks words indicating the position at the time of shooting toward the terminal 301, the terminal 301 acquires the information spoken by the user (voice information) via a microphone (not shown) of the terminal 301. Then, during the processing of S202, the communication unit 310 transmits the voice information together with the captured image to the information processing device 102.

The identification unit 140 acquires the captured image and audio information from the terminal 301 via the communication unit 130. The identification unit 140 performs voice recognition using the audio information and converts the audio into text. The identification unit 140 then identifies the user's location from the converted text information. For example, if the user utters "Kawasaki City," the identification unit 140 identifies the user's location as Kawasaki City.

The sign information reading unit 111 determines the area to be read in the captured image based on the user's position identified from the voice information. For example, in the case of a utility pole identification sign as shown in FIG. 5, the sign information reading unit 141 may control the process of S203 so that the area in which the sign name is written is not read, and only the area in which the utility pole number is written is read. In addition, if the acquired voice information includes information such as a town name (if the user also speaks the town name, etc.), the sign information reading unit 141 may read only a part of the area in which the utility pole number is written. Then, the sign information reading unit 111 identifies the sign information of the sign shown in the captured image based on the information converted into text from the voice information and the information of the read text. Note that if the acquired voice information includes all of the sign information (if the user speaks all of the characters written on the sign), the sign information reading unit 141 does not need to read the text. In this case, the sign information is identified based on the information converted into text from the voice information. In this way, the sign information reader 111 uses the audio information acquired from the terminal 301 to identify the sign information of the sign shown in the captured image.

The identification unit 140 can perform voice recognition using known technology. For example, the identification unit 140 can perform voice recognition by analyzing voice information using a voice recognition dictionary created by machine learning, deep learning, or the like.

Then, the search unit 142 searches the sign database using the sign information identified using the voice information as a key. Note that when searching the sign database using the sign information, the search unit 142 may narrow the search range of the data included in the sign database according to the location information of the user identified from the voice information. For example, in S204 of the sequence diagram shown in FIG. 6, the search unit 142 may limit the search range to the sign information of signs that exist in the city or town indicated by the location information acquired from the terminal 301.

In this way, the information processing device 102 according to the fifth modification uses the audio information acquired from the terminal to identify the sign information appearing in the captured image. More specifically, the information processing device 102 determines the area to be read from within the area in which the utility pole identification sign appears in the captured image based on the audio information, and identifies the sign information from the audio information and the read character information. As a result, the information processing device 102 according to the fifth modification can suppress an increase in processing time and accurately deliver content suitable for the user, similar to the information processing device 102 according to the third embodiment.

Fourth Embodiment
Next, a content distribution system including an information processing device according to a fourth embodiment will be described.

Figure 10 is a block diagram showing an example of the configuration of a content distribution system 1003 according to the fourth embodiment. As shown in Figure 10, the content distribution system 1003 includes an information processing device 103 instead of the information processing device 102 in the third embodiment, and is otherwise similar to the content distribution system 1002 described in the third embodiment. That is, the content distribution system 1003 includes an information processing device 103 and a distribution device 200. Note that a description of the configuration and operation of the content distribution system 1003 shown in Figure 10 that overlaps with the description of the first to third embodiments will be omitted.

[Details of information processing device 103]
10, the information processing device 103 includes a content determination unit 121 instead of the content determination unit 120 in the configuration of the information processing device 102. The information processing device 103 also includes a determination unit 150. That is, the information processing device 103 includes a communication unit 130, an identification unit 140, the content determination unit 121, and the determination unit 150. Note that the content determination unit 121 has the functions described below in addition to the functions of the content determination unit 120.

The determination unit 150 determines whether or not the user is in the position identified from the captured image. For example, in the sequence diagram of FIG. 6, after processing of S205, the determination unit 150 compares the position information acquired from the terminal with the position information identified by the identification unit 140. If, as a result of the comparison, the distance between the position information acquired from the terminal and the position information identified by the identification unit 140 is equal to or greater than a predetermined threshold, the determination unit 150 determines that the user is not in the position identified from the captured image. At this time, the determination unit 150 notifies the content determination unit 121 of information indicating that the user is not in the position identified from the captured image.

If, as a result of the comparison, the distance between the location information acquired from the terminal and the location information identified by the identification unit 140 is less than a predetermined threshold, the determination unit 150 determines that the user is in the location identified from the captured image. At this time, the determination unit 150 notifies the content determination unit 121 of information indicating that the user is in the location identified from the captured image.

In this way, the determination unit 150 determines whether or not the photographer is at the position identified by the identification unit, based on the terminal's position information acquired by the terminal's position information acquisition unit. The determination unit 150 is an example of a determination means.

When it is determined that the user is not at the location identified from the captured image, the content determination unit 121 determines specific content as the content to be distributed to the terminal 301, regardless of the location identified from the captured image, instead of the processing of S206 in the sequence diagram of FIG. 6. The specific content is, for example, content that indicates that the content corresponding to the location situation identified from the captured image cannot be distributed. Then, the content determination unit 121 transmits content identification information of the specific content to the distribution device 200.

If it is determined that the user is in the position identified from the captured image, the process of S206 in the sequence diagram of FIG. 6 is performed.

As described above, the information processing device 103 according to the fourth embodiment determines whether or not the photographer is at a location identified by the identification unit and the location information of the terminal acquired by the location information acquisition unit of the terminal. In the content distribution system of the present disclosure, there are cases where a user does not take a photo, but instead attempts to acquire content using an image acquired by other means. The information processing device 103 according to the fourth embodiment has the above configuration and is therefore able to prevent such fraudulent behavior by users.

Fifth embodiment
Next, a content distribution system including an information processing device according to the fifth embodiment will be described.

Fig. 11 is a block diagram showing an example of the configuration of a content distribution system 1004 according to the fifth embodiment. As shown in Fig. 11, the content distribution system 1004 includes an information processing device 104 instead of the information processing device 103 in the fourth embodiment, and is otherwise similar to the content distribution system 1003 described in the fourth embodiment. That is, the content distribution system 1004 includes the information processing device 104 and a distribution device 200. Note that a description of the configuration and operation of the content distribution system 1004 shown in Fig. 11 that overlaps with the description of the first to fourth embodiments will be omitted.

Note that although FIG. 11 does not show the determination unit 150 described in the fourth embodiment, it is possible to configure the information processing device 104 to include the determination unit 150.

[Details of information processing device 104]
11, the information processing device 104 includes a communication unit 130, an identification unit 160, and a content determination unit 122. In addition to the functions of the content determination units 120 and 121, the content determination unit 122 has the following functions.

The identification unit 160 includes a sign information reading unit 141, a search unit 142, and an age estimation unit 161. The age estimation unit 161 estimates the age of the photographer based on the area of the sign that appears in the captured image. Here, a method for estimating age from a captured image will be described.

Figures 12A and 12B are examples of captured images. Both Figures 12A and 12B are images of a utility pole identification sign. In the captured image of Figure 12A, the utility pole identification sign appears as a rectangle. If the utility pole identification sign is rectangular, it can be seen that the captured image of Figure 12A was captured almost from the front of the utility pole identification sign. On the other hand, in the captured image of Figure 12B, the utility pole identification sign and the utility pole appear as a trapezoid whose bottom base is longer than its top base. Furthermore, the utility pole identification sign in the captured image of Figure 12B is smaller than the utility pole identification sign in the captured image of Figure 12A. In other words, it can be seen that the image of Figure 12B was captured from below the utility pole identification sign. In this way, the shape of the sign in the captured image changes depending on the angle and distance at which the sign is captured. In other words, the shape of the sign in the captured image allows one to roughly estimate the height at which the photographer took the photo, and further allows one to roughly estimate the photographer's height. The age estimation unit 161 estimates the approximate age of the photographer based on this estimated height information. For example, the age estimation unit 161 estimates whether the photographer is an adult or a child.

In this way, the age estimation unit 161 estimates the age of the photographer based on the shape of the utility pole identification sign that appears in the captured image. The age estimation unit 161 is an example of an age estimation means.

The age estimation unit 161 performs the above-mentioned processing, for example, at any timing between the processing of S203 to S205 in the sequence diagram of FIG. 6.

For example, instead of the process of S206 in the sequence diagram of FIG. 6, the content determination unit 122 determines the content to be delivered to the terminal 301 based on the user's position identified from the captured image, the direction the user is facing, and the estimated age. At this time, the content database stores data in which the content identification information is associated with position information, direction information, and age.

As described above, the information processing device 104 according to the fifth embodiment estimates the age of the photographer based on the shape of the utility pole identification sign shown in the captured image, and determines the content to be delivered to the terminal based on the identified position and direction and the estimated age. With this configuration, the information processing device 104 according to the fifth embodiment can determine content according to not only the user's position and the direction the user is facing, but also the user's age, using information obtained from the captured image. In other words, the information processing device 104 according to the fifth embodiment can deliver content that is more suitable for the user.

The information processing device of this disclosure has been described above in the first, second, third, fourth, and fifth embodiments, but the above-mentioned first, second, third, fourth, and fifth embodiments can be realized in appropriate combinations.

<Example of hardware configuration of information processing device>
The hardware constituting the information processing device according to the first, second, third, fourth and fifth embodiments will be described. Fig. 13 is a block diagram showing an example of the hardware configuration of a computer device that realizes the information processing device in each embodiment. Each block shown in Fig. 13 can be realized by a combination of a computer device 10 that realizes the information processing device and information processing method in each embodiment and software.

As shown in FIG. 13, the computer device 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a storage device 14, an input/output interface 15, a bus 16, and a drive device 17.

The storage device 14 stores a program (computer program) 18. The processor 11 executes the program 18 for the information processing device using the RAM 12. Specifically, for example, the program 18 includes a program that causes a computer to execute the processing of the information processing device described in the first to fifth embodiments. As the processor 11 executes the program 18, the functions of each component of the information processing device (such as the above-mentioned identification units 110, 140, 160, content determination units 120, 121, 122, and judgment unit 150) are realized. The program 18 may be stored in the ROM 13. The program 18 may also be recorded in the storage medium 20 and read out using the drive device 17, or may be transmitted to the computer device 10 from an external device (not shown) via a network (not shown).

The input/output interface 15 exchanges data with peripheral devices 19 (such as a keyboard, mouse, or display device). The input/output interface 15 functions as a means for acquiring or outputting data. The bus 16 connects each component.

There are various variations in the way an information processing device can be realized. For example, an information processing device can be realized as a dedicated device. Also, an information processing device can be realized by combining multiple devices.

The scope of each embodiment also includes a processing method in which a program for realizing each component in the function of each embodiment is recorded on a storage medium, the program recorded on the storage medium is read as code, and executed on a computer. In other words, a computer-readable storage medium is also included in the scope of each embodiment. In addition, the storage medium on which the above-mentioned program is recorded and the program itself are also included in each embodiment.

The storage medium may be, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disc)-ROM, a magnetic tape, a non-volatile memory card, or a ROM, but is not limited to these examples. In addition, the programs recorded on the storage medium are not limited to programs that execute processes on their own, but also include programs that operate on an OS (Operating System) and execute processes in cooperation with other software and the functions of an expansion board, which are included in the scope of each embodiment.

The present disclosure has been described above with reference to the above-mentioned embodiment. However, the present disclosure is not limited to the above-mentioned embodiment. In other words, the present disclosure can be applied in various aspects that a person skilled in the art can understand, such as various combinations or selections of the various disclosed elements described above, within the scope of the present disclosure.

Some or all of the above embodiments may be described as follows, but are not limited to the following:

<Additional Notes>
[Appendix 1]
A means for identifying a position of a photographer who has taken an image using a terminal and a direction in which the photographer is facing, based on a utility pole identification sign shown in the image acquired from the terminal;
and a content determination means for determining, from among a plurality of contents, a content to be delivered to the terminal based on the specified position and direction.
Information processing device.

[Appendix 2]
The identification means includes a label information reading means and a search means,
The sign information reading means reads sign information written on the utility pole identification sign from an area in which the utility pole identification sign is captured in the photographed image,
the search means searches for position information and direction information corresponding to the read sign information from a database in which the sign information is associated with position information and direction information, and when the search is successful, specifies the position and direction of the photographer according to the position information and direction information corresponding to the read sign information.
2. The information processing device according to claim 1.

[Appendix 3]
The sign information reading means determines an area to be read from among the area in which the utility pole identification sign is shown in the captured image based on the location information of the terminal acquired by the location information acquisition means of the terminal.
3. The information processing device according to claim 2.

[Appendix 4]
The sign information reading means identifies the sign information appearing in the captured image by using the voice information acquired from the terminal,
The information processing apparatus according to claim 2 , wherein the search means searches the database for position information and direction information corresponding to the sign information identified using the voice information.

[Appendix 5]
the identifying means identifies the sign information based on the voice information when the sign information reading means fails to read the sign information.
5. The information processing device according to claim 4.

[Appendix 6]
The sign information reading means determines an area to be read out of the area in which the utility pole identification sign is captured in the photographed image based on the voice information.
5. The information processing device according to claim 4.

[Appendix 7]
a determination unit that determines whether or not the photographer is at the location based on the location identified by the identification unit and location information of the terminal acquired by a location information acquisition unit included in the terminal;
7. The information processing device according to claim 1 .

[Appendix 8]
The identification means includes an age estimation means for estimating the age of the photographer based on a shape of the utility pole identification sign shown in the photographed image,
the content determination means determines content to be delivered to the terminal based on the specified location and direction and the estimated age.
8. The information processing device according to claim 1 .

[Appendix 9]
Instead of the utility pole identification sign, a road guide sign or a railroad crossing identification sign is used.
8. The information processing device according to claim 1 .

[Appendix 10]
An identification means for identifying the location of a photographer who captured the image using the terminal based on a utility pole identification sign shown in the captured image acquired from the terminal and location information of the terminal acquired by a location information acquisition means included in the terminal;
and a content determination means for determining, based on the identified location, a content to be delivered to the terminal from among a plurality of contents.
Information processing device.

[Appendix 11]
Identifying a position of a photographer who took the photographed image using the terminal and a direction in which the photographer is facing based on a utility pole identification sign shown in the photographed image acquired from the terminal;
determining a content to be delivered to the terminal from among a plurality of contents based on the identified position and direction;
Information processing methods.

[Appendix 12]
reading sign information written on the utility pole identification sign from an area in which the utility pole identification sign is captured in the photographed image;
a database in which the sign information is associated with position information and direction information is searched for position information and direction information corresponding to the read sign information, and if the search is successful, the position and direction of the photographer are specified according to the position information and direction information corresponding to the read sign information;
12. The information processing method according to claim 11.

[Appendix 13]
determining an area to be read out of the area in which the utility pole identification sign is captured in the captured image based on the location information of the terminal acquired by a location information acquisition means included in the terminal;
13. The information processing method according to claim 12.

[Appendix 14]
Identifying the sign information appearing in the captured image using audio information acquired from the terminal;
The information processing method according to claim 12 or 13, further comprising searching the database for position information and direction information corresponding to the sign information identified using the voice information.

[Appendix 15]
When the reading of the sign information has failed, the sign information is identified based on the voice information.
15. The information processing method according to claim 14.

[Appendix 16]
determining an area to be read out of the area in which the utility pole identification sign is captured in the photographed image based on the voice information;
15. The information processing device according to claim 14.

[Appendix 17]
a determination unit that determines whether or not the photographer is at the location based on the specified location and location information of the terminal acquired by a location information acquisition unit of the terminal;
17. An information processing method according to any one of appendixes 11 to 16.

[Appendix 18]
Estimating the age of the photographer based on the shape of the utility pole identification sign shown in the photographed image;
determining content to be delivered to the terminal based on the identified location and direction and the estimated age;
18. An information processing method according to any one of appendixes 11 to 17.

[Appendix 19]
Instead of the utility pole identification sign, a road guide sign or a railroad crossing identification sign is used.
19. An information processing method according to any one of appendixes 11 to 18.

[Appendix 20]
A process of identifying a position of a photographer who captured an image using a terminal and a direction in which the photographer is facing, based on a utility pole identification sign shown in the captured image acquired from the terminal;
determining a content to be delivered to the terminal from among a plurality of contents based on the specified position and direction;
program.

[Appendix 21]
In the identifying process,
reading sign information written on the utility pole identification sign from an area in which the utility pole identification sign is captured in the photographed image;
a database in which the sign information is associated with position information and direction information is searched for position information and direction information corresponding to the read sign information, and if the search is successful, the position and direction of the photographer are specified according to the position information and direction information corresponding to the read sign information;
21. The program according to claim 20.

[Appendix 22]
In the identifying process,
determining an area to be read out of the area in which the utility pole identification sign is captured in the captured image based on the location information of the terminal acquired by a location information acquisition means included in the terminal;
22. The program according to claim 21.

[Appendix 23]
In the identifying process,
Identifying the sign information appearing in the captured image using audio information acquired from the terminal;
searching the database for position information and direction information corresponding to the sign information identified using the voice information;
23. The program according to claim 21 or 22.

[Appendix 24]
In the identifying process, when reading of the sign information fails, the sign information is identified based on the voice information.
24. The program according to claim 23.

[Appendix 25]
In the process of specifying, a region to be read is determined from the region in which the utility pole identification sign is captured in the photographed image based on the voice information.
24. The program according to claim 23.

[Appendix 26]
and further causing the computer to execute a process of determining whether or not the photographer is at the specified position based on the specified position and position information of the terminal acquired by a position information acquisition means of the terminal.
26. The program according to any one of appendixes 20 to 25.

[Appendix 27]
In the identification process, an age of the photographer is estimated based on a shape of the utility pole identification sign shown in the photographed image;
In the process of determining the content, the content to be delivered to the terminal is determined based on the specified position and direction and the estimated age.
27. The program according to any one of appendixes 20 to 26.

[Appendix 28]
Instead of the utility pole identification sign, a road guide sign or a railroad crossing identification sign is used.
28. The program according to any one of appendixes 20 to 27.

10 Computer device 11 Processor 12 RAM
13 ROM
REFERENCE SIGNS LIST 14 Storage device 15 Input/output interface 16 Bus 17 Drive device 18 Program 19 Peripheral device 20 Storage medium 100, 101, 102, 103, 104 Information processing device 110, 140, 160 Identification unit 111, 141 Label information reading unit 112, 142 Search unit 120, 121, 122 Content determination unit 150 Determination unit 161 Age estimation unit

Claims (10)

an identification means for identifying a position of a photographer who captured an image using a terminal at the time the image was captured , and a direction in which the photographer was facing at the time the image was captured , based on a utility pole identification sign shown in the image captured by the terminal;
and a content determination means for determining, from among a plurality of contents, a content to be delivered to the terminal based on the specified position and direction.
Information processing device. The identification means includes a label information reading means and a search means,
The sign information reading means reads sign information written on the utility pole identification sign from an area in which the utility pole identification sign is captured in the photographed image,
the search means searches for position information and direction information corresponding to the read sign information from a database in which the sign information is associated with position information and direction information, and when the search is successful, specifies the position and direction of the photographer according to the position information and direction information corresponding to the read sign information.
The information processing device according to claim 1 . The sign information reading means determines an area to be read from among the area in which the utility pole identification sign is shown in the captured image based on the location information of the terminal acquired by the location information acquisition means of the terminal.
The information processing device according to claim 2 . The sign information reading means identifies the sign information appearing in the captured image by using the voice information acquired from the terminal,
The information processing apparatus according to claim 2 , wherein the search means searches the database for position information and direction information corresponding to the sign information identified using the voice information. a determination unit that determines whether or not the photographer is at the location based on the location identified by the identification unit and location information of the terminal acquired by a location information acquisition unit included in the terminal;
The information processing device according to claim 1 . The identification means includes an age estimation means for estimating the age of the photographer based on a shape of the utility pole identification sign shown in the photographed image,
the content determination means determines content to be delivered to the terminal based on the specified location and direction and the estimated age.
The information processing device according to claim 1 . Instead of the utility pole identification sign, a road guide sign or a railroad crossing identification sign is used.
The information processing device according to claim 1 . An identification means for identifying the location of a photographer who took the photographed image using the terminal at the time the photographed image was taken, based on a utility pole identification sign shown in the photographed image acquired from the terminal and location information of the terminal acquired by a location information acquisition means included in the terminal ;
and a content determination means for determining, based on the identified location, a content to be delivered to the terminal from among a plurality of contents.
Information processing device. Based on the utility pole identification sign shown in the photographed image acquired from the terminal, a position of a photographer who took the photographed image using the terminal at the time when the photographed image was taken and a direction in which the photographer was facing at the time when the photographed image was taken are identified;
determining a content to be delivered to the terminal from among a plurality of contents based on the identified position and direction;
Information processing methods. A process for identifying a position of a photographer who captured an image using a terminal at the time the image was captured, and a direction in which the photographer was facing at the time the image was captured, based on a utility pole identification sign shown in the captured image obtained from the terminal ;
determining a content to be delivered to the terminal from among a plurality of contents based on the specified position and direction;
program.

Images