JP6206537B2 - Mobile terminal, information processing apparatus, and program - Google Patents

Description

  The present disclosure relates to a voice control device, a voice control method, and a program.

  With the spread of mobile terminals equipped with imaging devices and displays, applications using AR (Augmented Reality) technology are attracting attention. For example, as an application using the AR technology, an AR application that adds tag information such as a photograph / text / sound to a captured image in a real space based on the position of a mobile device can be cited.

  With such an AR application, the user can browse and operate tag information added to the real space. However, when the number of tag information added to the real space increases, the visibility of the screen decreases, and it becomes difficult for the user to find desired information. In this regard, Patent Literature 1 discloses an acoustic control device for performing voice guidance to a user according to the relationship between a mobile terminal and a target position.

JP 2010-49158 A

  However, when the tag information associated with the periphery of the mobile terminal is sequentially output by voice, if the number of tag information increases, the time until the tag information that the user is interested in is prolonged. It is difficult for the user to extract desired tag information.

  Therefore, the present disclosure proposes a new and improved voice control device, voice control method, and program capable of supporting quick information extraction from a plurality of pieces of information output as voice.

  According to the present disclosure, an information acquisition unit that acquires information associated with a surrounding position, and when a plurality of pieces of information are acquired by the information acquisition unit, a sound is output so that the plurality of pieces of information are output simultaneously. An audio control device including an audio control unit that performs control is provided.

  Further, according to the present disclosure, a step of acquiring information associated with a surrounding position, and a step of performing voice control so that the plurality of information are simultaneously output when a plurality of pieces of information are acquired; A voice control method is provided.

  In addition, according to the present disclosure, when a plurality of information is acquired by the information acquisition unit that acquires information associated with a surrounding position and the information acquisition unit, the plurality of information is output simultaneously. As described above, a program for functioning as a voice control unit that performs voice control is provided.

  As described above, according to the present disclosure, it is possible to support rapid information extraction from a plurality of pieces of information that are output as audio.

It is explanatory drawing which showed the structure of the audio | voice control system by embodiment of this indication. It is explanatory drawing which showed the captured image of the real space to which tag information was added. It is explanatory drawing which showed the specific example of the utilization form of the portable terminal by 1st Embodiment. 3 is a functional block diagram illustrating a configuration of a mobile terminal according to the first embodiment of the present disclosure. FIG. It is explanatory drawing which showed the specific example of the target area | region set by the area | region setting part. It is explanatory drawing which showed the specific example of the object area | region in case the density of tag information around a portable terminal is high. It is explanatory drawing which showed the specific example of the object area | region in case the density of tag information around a portable terminal is low. It is explanatory drawing which showed the reconstruction of tag information. It is explanatory drawing which showed the specific example of the audio | voice control by an audio | voice control part. It is explanatory drawing which showed the specific example of the list of tag information. 5 is a flowchart illustrating an operation of the mobile terminal according to the first embodiment of the present disclosure. It is explanatory drawing which showed the portable terminal and audio | voice output apparatus by 2nd Embodiment of this indication. It is the functional block diagram which showed the structure of the portable terminal by 2nd Embodiment. It is explanatory drawing which showed the example of display control by 2nd Embodiment. It is explanatory drawing which showed the hardware constitutions of the portable terminal.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  In the present specification and drawings, a plurality of components having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numeral. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given.

Moreover, this indication is demonstrated according to the item order shown below.
1. 1. Basic configuration of voice control system First embodiment 2-1. Overview of First Embodiment 2-2. Configuration of mobile terminal according to first embodiment 2-3. 2. Operation of portable terminal according to first embodiment Second Embodiment 4. 4. Hardware configuration of portable terminal Conclusion

<< 1. Basic configuration of voice control system >>
The technology according to the present disclosure can be implemented in various forms as described in detail in “2. First Embodiment” to “3. Second Embodiment” as an example. In addition, the voice control device (mobile terminal 20) according to each embodiment is
A. An information acquisition unit (communication unit 228, information analysis unit 236) for acquiring information associated with a surrounding position;
B. When a plurality of information is acquired by the information acquisition unit, a voice control unit (240) that performs voice control so that the plurality of information is output simultaneously;
Is provided.

  In the following, first, a basic configuration of a voice control system common to each of such embodiments will be described with reference to FIG.

  FIG. 1 is an explanatory diagram illustrating a configuration of a voice control system according to an embodiment of the present disclosure. As shown in FIG. 1, the voice control system according to the embodiment of the present disclosure includes an AR server 10 and a mobile terminal 20.

  The AR server 10 and the mobile terminal 20 are connected via a communication network 12 and can communicate various information via the communication network 12. The communication network 12 is a wired or wireless transmission path for information transmitted from a device connected to the communication network 12. For example, the communication network 12 may include a public line network such as the Internet, a telephone line network, a satellite communication network, various local area networks (LANs) including the Ethernet (registered trademark), a wide area network (WAN), and the like. . Further, the communication network 12 may include a dedicated line network such as an IP-VPN (Internet Protocol-Virtual Private Network).

  The AR server 10 stores position information and tag information in association with each other, and transmits the position information and tag information to the mobile terminal 20 via the communication network 12. For example, when the AR server 10 receives position information indicating the current position of the mobile terminal 20 from the mobile terminal 20, the AR server 10 transmits position information and tag information indicating positions around the mobile terminal 20 to the mobile terminal 20. Furthermore, when the AR server 10 also receives direction information indicating the direction in which the specific part of the mobile terminal 20 is directed from the mobile terminal 20, the AR server 10 determines the position on the direction side indicated by the direction information from the current position of the mobile terminal 20. The indicated position information and tag information may be transmitted to the mobile terminal 20.

  In addition, as tag information, for example, image information such as photographs and moving images, text information, audio information, and the like are assumed. Further, the tag information may be advertisement information related to the position indicated by the associated position information, or may be provided information from a general user uploaded regarding the position indicated by the associated position information. Good.

  The portable terminal 20 acquires position information and tag information about the current position, and provides the tag information to the user. For example, the mobile terminal 20 transmits position information indicating the current position to the AR server 10, acquires tag information and position information related to the periphery of the current position from the AR server 10, and adds the tag information to the captured image in the real space. Can be displayed on the touch panel 22.

  The mobile terminal 20 includes a speaker 24 that is an example of a sound output unit that outputs sound, and a microphone 26 that is an example of a sound input unit that collects sound. In this specification, the end of the mobile terminal 20 on the side where the speaker 24 is disposed is referred to as an upper end US (Upper Side), and the end on the side where the microphone 26 is disposed is the lower end LS (Lower Side). ).

  In addition, although the smart phone is shown as an example of the portable terminal 20 in FIG. 1, the portable terminal 20 is not limited to a smart phone. For example, the portable terminal 20 may be a PDA (Personal Digital Assistant), a cellular phone, a portable music playback device, a portable video processing device, or a portable game device.

(Background of this embodiment)
With the widespread use of mobile terminals such as smartphones, as described above, applications that add tag information such as photographs / texts / sounds to captured images in real space are attracting attention. According to this application, for example, the captured image of the real space with the tag information as shown in FIG. 2 is displayed, so that the user can browse and manipulate the tag information that cannot be obtained from the real space. Is possible.

  However, when the number of tag information added to the real space increases, the visibility of the screen decreases, and it becomes difficult for the user to find desired information. Although it is possible to output tag information by voice, when tag information associated with the periphery of the mobile terminal is sequentially output by voice, if the number of tag information increases, the tag that the user is interested in Since the time until the information is output is prolonged, it is difficult for the user to extract desired tag information.

  Therefore, the present embodiment has been created with the above circumstances taken into consideration. According to the present embodiment, it is possible to support rapid information extraction from a plurality of tag information output as audio. Hereinafter, the first embodiment and the second embodiment of the present disclosure having such effects will be described in detail.

<< 2. First Embodiment >>
<2-1. Overview of First Embodiment>
It is known that a user can naturally distinguish a word or conversation that he is interested in even in the presence of various noises (cocktail party effect). The mobile terminal 20-1 according to the first embodiment of the present disclosure uses this cocktail party effect to quickly extract tag information that the user is interested in when providing tag information to the user by voice output. It is possible to do. Hereinafter, with reference to FIG. 3, the specific example of the utilization form of the portable terminal 20-1 by 1st Embodiment is demonstrated.

  FIG. 3 is an explanatory diagram showing a specific example of a usage pattern of the portable terminal 20-1 according to the first embodiment. As illustrated in FIG. 3, when the user holds the speaker 24 of the mobile terminal 20-1 over the ear, the mobile terminal 20-1 simultaneously outputs the tag information associated with the surrounding position by voice. Specifically, the mobile terminal 20-1 sets a target area based on a direction in which the lower end LS is directed as a specific part of the mobile terminal 20-1, and positions P1 to P3 in the target area The associated tag information TA to TC is output simultaneously. That is, the mobile terminal 20-1 simultaneously outputs the tag information TA “KKK's album best!”, Tag information TB “FFF Cafe cake delicious!”, And tag information TC “BBB found actress A!”.

  Thereby, for example, when the user is interested in the actress A, the tag information regarding the actress A is quickly heard based on the cocktail party effect, and the actress A is directed to the lower end LS of the portable terminal 20-1. You can know what was found in the direction. Note that the mobile terminal 20-1 may output the tag information with a smaller volume as the distance between the position where the tag information is associated and the current position is longer. In this case, the user can also grasp the sense of distance between the position where the desired tag information is associated and the current position.

<2-2. Configuration of portable terminal according to first embodiment>
The overview of the first embodiment of the present disclosure has been described above. Next, the configuration of the mobile terminal 20-1 according to the first embodiment of the present disclosure will be described in detail.

  FIG. 4 is a functional block diagram illustrating a configuration of the mobile terminal 20-1 according to the first embodiment of the present disclosure. As illustrated in FIG. 4, the mobile terminal 20-1 according to the first embodiment of the present disclosure includes a touch panel 22, a speaker 24, a GPS 220, an acceleration sensor 224, a communication unit 228, and a region setting unit 232. , An information analysis unit 236, a voice control unit 240, and a display control unit 244.

(GPS)
A GPS (Global Positioning System) 220 receives a navigation message transmitted from an artificial satellite, and acquires the current position of the portable terminal 20-1 based on the reception result of the navigation message. Note that the GPS 220 is merely an example of a configuration for acquiring the current position of the mobile terminal 20-1, and it is also possible to acquire the current position of the mobile terminal 20-1 with another configuration. For example, the mobile terminal 20-1 may estimate the current position based on the reception intensity of Wi-Fi radio waves transmitted from surrounding wireless communication devices, or may acquire the current position based on user input. Good.

(Acceleration sensor)
The acceleration sensor 224 measures the acceleration of the mobile terminal 20-1. Based on the measurement result by the acceleration sensor 224, the direction of the portable terminal 20-1, for example, the direction in which the lower end LS of the portable terminal 20-1 is facing can be estimated.

(Communication Department)
The communication unit 228 is an interface with the AR server 10 and transmits / receives various information to / from the AR server 10. For example, the communication unit 228 transmits the position information of the mobile terminal 20-1 acquired by the GPS 220 to the AR server 10, and tag information associated with the surroundings of the mobile terminal 20-1 together with the position information is transmitted to the AR server 10. Receive from. The communication unit 228 may also transmit the measurement result by the acceleration sensor 224 to the AR server 10 in addition to the position information of the mobile terminal 20-1. In this case, the tag information associated with the position in the direction in which the lower end LS of the mobile terminal 20-1 is facing can be received from the AR server 10. As described above, the communication unit 228 or the information analysis unit 236 described later functions as an information acquisition unit that acquires tag information for outputting sound.

  In the present embodiment, an example in which the mobile terminal 20-1 acquires tag information from the AR server 10 will be described, but the present embodiment is not limited to such an example. For example, the mobile terminal 20-1 may have a database in which position information and tag information are associated, and may acquire tag information associated with the periphery of the mobile terminal 20-1 from the database.

(Area setting part)
The region setting unit 232 sets a target region related to the sound output of the tag information based on the position information of the mobile terminal 20-1 supplied from the GPS 220 and the measurement result obtained from the acceleration sensor 224. The tag information associated with the position information in the target area set by the area setting unit 232 is the target of audio output. Here, the target area set by the area setting unit 232 will be specifically described with reference to FIG.

  FIG. 5 is an explanatory diagram showing a specific example of the target area set by the area setting unit 232. As an example, the region setting unit 232 may set, as an object region, a fan-shaped region represented by a radius r and an angle θ with reference to the direction in which the lower end LS of the mobile terminal 20-1 is directed.

  Here, if there is too much tag information to be output simultaneously, the cocktail party effect will be weakened, and it will be difficult for the user to distinguish the tag information of interest. On the other hand, if there is too little tag information that is voice-output at the same time, it is less likely that tag information that the user is interested in will be voice-output, resulting in poor information extraction efficiency.

  Therefore, the area setting unit 232 may change the size of the target area according to the degree of congestion of surrounding tag information. For example, the region setting unit 232 may set the target region so that the number of tag information associated with the position information in the target region is greater than or equal to the lower limit value, less than the upper limit value, or a predetermined number. Hereinafter, this point will be described more specifically with reference to FIG. 6 and FIG.

  FIG. 6 is an explanatory diagram showing a specific example of a target area when the density of tag information around the mobile terminal 20-1 is high. FIG. 7 is an explanatory diagram showing a specific example of the target area when the density of tag information around the portable terminal 20-1 is low. As illustrated in FIG. 6, the region setting unit 232 may narrow the target region by reducing the radius r and the angle θ when the density of surrounding tag information is high. On the other hand, as shown in FIG. 7, the region setting unit 232 may widen the target region by increasing the radius r and the angle θ when the density of surrounding tag information is low.

  With such a configuration, it is possible to ensure ease of identification of tag information by a user and information extraction efficiency.

(Information Analysis Department)
The information analysis unit 236 extracts tag information associated with the position information in the target area set by the area setting unit 232 from the surrounding tag information received by the communication unit 228. In addition, the information analysis unit 236 analyzes the distance and angle between the position where the extracted tag information is associated and the mobile terminal 20-1, and supplies the analysis result to the voice control unit 240.

(Voice control unit)
The voice control unit 240 controls the voice output from the speaker 24 of the tag information extracted by the information analysis unit 236. Specifically, the voice control unit 240 performs voice control so that the tag information extracted by the information analysis unit 236 is simultaneously output from the speaker 24 (first control mode). With this configuration, the user can efficiently distinguish the tag information of interest from a plurality of tag information output at the same time based on the cocktail party effect. In addition, the voice control unit 240 may perform the following control examples A to E when outputting tag information voice.

-Control example A
The voice control unit 240 controls the volume of the tag information according to the distance between the position where the tag information is associated and the mobile terminal 20-1. For example, the voice control unit 240 may decrease the volume of the tag information as the distance between the position associated with the tag information and the mobile terminal 20-1 increases. With this configuration, the user can grasp the sense of distance between the position where the tag information is associated and the current position.

-Control example B
The voice control unit 240 performs voice control so that each of the plurality of tag information is output with different sound characteristics. For example, the voice control unit 240 may perform voice control such that each of the plurality of tag information is output with a different fundamental frequency or sound quality. Such a configuration makes it possible to achieve a cocktail party effect more reliably.

-Control example C
If the tag information is not voice information, the voice control unit 240 generates voice information from the tag information. For example, when the tag information is text information, the voice control unit 240 may generate voice information corresponding to the text information. In addition, when the tag information is a photo tag, the audio control unit 240 may generate audio information corresponding to a comment added to the photo tag. With this configuration, a larger number of tag information can be targeted for audio output.

-Control example D
The voice control unit 240 extracts a keyword from each tag information, and performs voice control so that the output timing of the keyword of each tag information is dispersed. For example, the keyword of the tag information TA “KKK's album best!” Is “KKK”, the keyword of the tag information TB “FFF Cafe's cake is delicious!” Is “FFF Cafe”, and the tag information TC “Actress A at BBB” It is assumed that the keyword “discovered!” Is “actress A”. In this case, if the tag information is output as it is, the keyword “KKK” of the tag information TA and the keyword “FFF Cafe” of the tag information TB are simultaneously output. Therefore, as shown in FIG. 8, the voice control unit 240 reconfigures the contents of the tag information TB so that the output timing of the keyword “KKK” of the tag information TA and the keyword of the tag information TB is “FFF Cafe” is shifted. May be. With this configuration, it is possible to make it easier to distinguish the keywords of each tag information.

-Control example E
The voice control unit 240 may reconfigure the contents of the tag information based on the user's preference so that the output timing of the word considered that the user is interested is advanced. For example, when the user is interested in “actress A”, the voice control unit 240 causes the output timing of “actress A” to be earlier, such as “discovered in actress A, BBB”, as the content of tag information TC. It may be reconfigured so that With this configuration, the user can extract tag information of his / her interest at an early stage.

  In addition, the voice control unit 240 performs the control so that the tag information extracted by the information analysis unit 236 is sequentially output based on a predetermined user operation such as a tap operation. Switch control. At this time, the user can select the tag information by performing the first user operation when the desired tag information is output as audio. In addition, the voice control unit 240 may switch tag information to be voice output in response to a second user operation such as a flick operation. Hereinafter, such a series of operations will be described more specifically with reference to FIG.

  FIG. 9 is an explanatory diagram showing a specific example of voice control by the voice control unit 240. As illustrated in FIG. 9, when a user performs a tap operation in a state where a plurality of tag information is output at the same time, the sound control unit 240 switches the sound control to a form in which the plurality of tag information is sequentially output. . Here, the voice control unit 240 may perform voice control so that the tag information associated with the vicinity of the mobile terminal 20-1 is sequentially output. Note that the size of characters in the figure corresponds to the volume.

  Thereafter, the desired tag information can be selected by performing a shake operation of shaking the portable terminal 20-1 when the desired tag information is output as a sound. For example, when the user performs a shake operation when outputting the tag information TB, the display control unit 244 causes the touch panel 22 to display the position associated with the tag information TB.

  In this way, the user first narrows down the population including the tag information of interest based on the cocktail party effect, then identifies the tag information of interest from the population, and provides detailed information on the tag information of interest. Can be obtained.

(Display control unit)
The display control unit 244 generates various display screens and displays the generated display screen on the touch panel 22. In particular, when a user operation such as a shake operation is performed in the second mode in which a plurality of tag information is sequentially output, the display control unit 244 according to the present embodiment outputs a sound when the shake operation is performed. The display indicating the position associated with the tag information is controlled (FIG. 9).

  In addition, although the 2nd form which outputs several tag information sequentially as a method for specifying the tag information which a user is interested from the population of tag information was demonstrated above, the tag information which a user is interested in Is not limited to such an example. For example, when a predetermined user operation is performed in the first form in which a plurality of tag information is output simultaneously, the display control unit 244 fixes the plurality of tag information at the time when the user operation is performed. As shown in FIG. 10, a list of a plurality of fixed tag information may be displayed on the touch panel 22. With this configuration, the user can specify desired tag information from the list of tag information.

<2-3. Operation of portable terminal according to first embodiment>
The configuration of the mobile terminal 20-1 according to the first embodiment of the present disclosure has been described above. Subsequently, with reference to FIG. 11, an operation of the mobile terminal 20-1 according to the first embodiment of the present disclosure will be described.

  FIG. 11 is a flowchart illustrating an operation of the mobile terminal 20-1 according to the first embodiment of the present disclosure. As shown in FIG. 11, first, the GPS 220 of the mobile terminal 20-1 measures the current position of the mobile terminal 20-1, and the acceleration sensor 224 measures the orientation of the lower end LS of the mobile terminal 20-1 (S304). ). And the communication part 228 acquires the tag information matched with the circumference | surroundings of the portable terminal 20-1 from the AR server 10 by transmitting the positional information on the portable terminal 20-1 to the AR server 10 (S308). .

  On the other hand, the region setting unit 232 sets a target region related to the sound output of the tag information based on the position information of the mobile terminal 20-1 supplied from the GPS 220 and the measurement result obtained from the acceleration sensor 224. Thereafter, the information analysis unit 236 extracts tag information in the target area from the tag information associated with the periphery of the mobile terminal 20-1 (S316). Then, the sound control unit 240 performs sound control so that the tag information in the target area is simultaneously output from the speaker 24 (S320).

  Thereafter, when the user performs a tap operation on the touch panel 22 (S324), the voice control unit 240 switches the voice control mode so that the tag information in the target area is sequentially output (S328). Then, when the user performs a shake operation (S332), the display control unit 244 causes the touch panel 22 to display a display screen indicating the position associated with the tag information output by voice during the shake operation (S336). ).

  As described above, according to the first embodiment of the present disclosure, by simultaneously outputting a plurality of tag information, the user can quickly select a population including tag information of interest based on the cocktail party effect. It becomes possible to narrow down.

<< 3. Second Embodiment >>
Subsequently, a second embodiment of the present disclosure will be described. The second embodiment of the present disclosure is different from the first embodiment in that sound output is performed from a wearable sound output device instead of the speaker 24. Hereinafter, the second embodiment of the present disclosure will be described in detail.

  FIG. 12 is an explanatory diagram illustrating the mobile terminal 20-2 and the audio output device 30 according to the second embodiment of the present disclosure. As illustrated in FIG. 12, the mobile terminal 20-2 according to the second embodiment transmits an audio signal to the audio output device 30, and the audio signal received by the audio output device 30 from the mobile terminal 20-2 is stereo. Output by voice.

  Although FIG. 12 shows an example in which the mobile terminal 20-2 and the audio output device 30 are connected by proximity wireless communication, the mobile terminal 20-2 and the audio output device 30 may be connected by wire. In FIG. 12, headphones are shown as an example of the wearable audio output device 30, but the audio output device 30 is not limited to headphones, and may be earphones, for example.

(Configuration of portable terminal according to the second embodiment)
Next, the configuration of the mobile terminal 20-2 according to the second embodiment will be described with reference to FIG. FIG. 13 is a functional block diagram showing the configuration of the mobile terminal 20-2 according to the second embodiment. As illustrated in FIG. 13, the mobile terminal 20-2 according to the second embodiment includes a touch panel 22, a GPS 220, an acceleration sensor 224, a communication unit 228, a region setting unit 234, an information analysis unit 236, An audio control unit 240, a display control unit 246, a sound source setting unit 248, and an audio processing unit 252 are provided. Since the touch panel 22, the GPS 220, the acceleration sensor 224, the communication unit 228, the voice control unit 240, and the like have many common parts with the first embodiment, a detailed description thereof is omitted here.

  The area setting unit 234 sets a target area related to audio output of tag information based on the position information of the mobile terminal 20-1 supplied from the GPS 220 and the measurement result obtained from the acceleration sensor 224. Here, unlike the first embodiment, since the user does not have to hold the speaker 24 over the ear, the region setting unit 234 is directed to, for example, the upper end US instead of the lower end LS of the mobile terminal 20-2. The target area is set based on the current direction.

  The sound source setting unit 248 sets a virtual sound source position (hereinafter, virtual sound source position) for each of the plurality of tag information extracted by the information analysis unit 236. For example, the sound source setting unit 248 may set the position associated with each of the plurality of tag information as the virtual sound source position. The sound source setting unit 248 may set a position different from the position associated with the tag information as the virtual sound source position of each of the plurality of tag information. As described above, it is expected that the cocktail party effect is further enhanced by setting different virtual sound source positions for each of the plurality of tag information.

  The sound processing unit 252 performs sound processing on each of the plurality of tag information so that the virtual sound source position set by the sound source setting unit 248 is perceived by the user as the sound source position. Since this process is performed according to the orientation of the user, the user may wear a sensor for detecting the orientation of the user, or treat the orientation of the upper end US of the mobile terminal 20-2 as the orientation of the user. Also good.

  The near field communication unit 256 transmits the audio signal processed by the audio processing unit 252 to the audio output device 30. Then, the audio output device 30 outputs the audio signal received from the proximity communication unit 256 as stereo audio.

  The display control unit 246 displays each tag information on the touch panel 22 while a plurality of tag information is simultaneously output from the audio output device 30. Here, the display control unit 246 performs display control so that each tag information is displayed at the virtual sound source position set by the sound source setting unit 248 based on the current position, as shown in FIG. Also good. With this configuration, the user can perceive the position of the tag information perceived by hearing through vision.

<< 4. Hardware configuration of mobile terminal >>
The embodiments of the present disclosure have been described in detail above. Information processing by the mobile terminal 20 according to the embodiment of the present disclosure described above is realized by cooperation of software and hardware of the mobile terminal 20. Hereinafter, the hardware configuration of the portable terminal 20 will be described with reference to FIG.

  FIG. 15 is an explanatory diagram showing a hardware configuration of the mobile terminal 20. As shown in FIG. 15, the mobile terminal 20 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an input device 208, an output device 210, A storage device 211, a drive 212, an imaging device 213, and a communication device 215 are provided.

  The CPU 201 functions as an arithmetic processing device and a control device, and controls the overall operation in the portable terminal 20 according to various programs. Further, the CPU 201 may be a microprocessor. The ROM 202 stores programs used by the CPU 201, calculation parameters, and the like. The RAM 203 temporarily stores programs used in the execution of the CPU 201, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus including a CPU bus.

  The input device 208 includes input means for a user to input information, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever, and an input control circuit that generates an input signal based on the input by the user and outputs the input signal to the CPU 201. Etc. The user of the mobile terminal 20 can input various data and instruct processing operations to the mobile terminal 20 by operating the input device 208.

  The output device 210 includes a display device such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp. Furthermore, the output device 210 includes an audio output device such as a speaker and headphones. For example, the display device displays a captured image or a generated image. On the other hand, the audio output device converts audio data or the like into audio and outputs it.

  The storage device 211 is a data storage device configured as an example of a storage unit of the mobile terminal 20 according to the present embodiment. The storage device 211 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 211 stores programs executed by the CPU 201 and various data.

  The drive 212 is a storage medium reader / writer, and is built in or externally attached to the portable terminal 20. The drive 212 reads information recorded on a removable storage medium 23 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 203. The drive 212 can also write information to the removable storage medium 23.

  The imaging device 213 includes an imaging optical system such as a photographing lens and a zoom lens that collects light, and a signal conversion element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The imaging optical system collects light emitted from the subject and forms a subject image in the signal conversion unit, and the signal conversion element converts the formed subject image into an electrical image signal.

  The communication device 215 is a communication interface configured with, for example, a communication device for connecting to the communication network 12. The communication device 215 may be a wireless LAN (Local Area Network) compatible communication device, an LTE (Long Term Evolution) compatible communication device, or a wire communication device that performs wired communication.

<< 5. Conclusion >>
As described above, according to the embodiment of the present disclosure, by simultaneously outputting a plurality of tag information, the user can quickly narrow down a population including tag information of interest based on the cocktail party effect. It becomes possible. Thereafter, the user can specify the tag information of interest through visual or auditory sense from the population, and obtain detailed information of the tag information of interest.

  Further, according to the present disclosure, when the tag information is information provided in association with the current position by the general user, the user grasps the sense of distance from the general user based on the volume at which the tag information is output. can do. In addition, if the tag information of the present disclosure is applied to mail or chat associated with the position information of the other party, it is possible to grasp the direction and distance of the other party.

  In addition, although preferred embodiment of this indication was described in detail, referring an accompanying drawing, the technical scope of this indication is not limited to this example. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

  For example, each step in the processing of the portable terminal 20 in this specification does not necessarily have to be processed in time series in the order described as a flowchart. For example, each step in the processing of the mobile terminal 20 may be processed in an order different from the order described as the flowchart, or may be processed in parallel.

  In addition, it is possible to create a computer program for causing hardware such as the CPU 201, the ROM 202, and the RAM 203 built in the mobile terminal 20 to perform the same functions as the components of the mobile terminal 20 described above. A storage medium storing the computer program is also provided.

The following configurations also belong to the technical scope of the present disclosure.
(1)
An information acquisition unit for acquiring information associated with surrounding positions;
When a plurality of information is acquired by the information acquisition unit, a voice control unit that performs voice control so that the plurality of information is output simultaneously;
A voice control device.
(2)
The voice control device according to (1), wherein the voice control unit performs voice control so that the plurality of pieces of information are output with different sound characteristics.
(3)
The voice control unit includes a first form that performs voice control so that the plurality of pieces of information are output simultaneously, and a second form that performs control so that each of the plurality of pieces of information is sequentially output. The voice control device according to (1) or (2), wherein voice control is switched.
(4)
When a first user operation is performed in the second form, a display control unit that controls a display indicating a position associated with information output by voice when the first user operation is performed; ,
The voice control device according to (3), further including:
(5)
The voice control device according to (3) or (4), wherein the voice control unit switches target information for voice output according to a second user operation in the second mode.
(6)
The voice control unit according to (2), wherein the voice control unit performs voice control so that information associated with a position closer to the voice control device among the plurality of pieces of information is output at a higher volume. Control device.
(7)
The voice control device according to (2) or (6), wherein the voice control unit controls a voice output of each of the plurality of pieces of information with a different frequency or sound quality.
(8)
Any of (1) to (7), wherein the information acquisition unit acquires information associated with a position in an area based on a direction in which a specific part of the voice control device is directed. The voice control device according to one item.
(9)
The audio according to (8), further including an area setting unit that sets the area so that the number of pieces of information associated with positions in the area is equal to or greater than a lower limit value, less than an upper limit value, or a predetermined number. Control device.
(10)
The voice control device according to any one of (1) to (9), wherein the voice control unit performs voice control so that output timings of keywords included in the plurality of pieces of information are dispersed.
(11)
The audio control unit controls audio output from a wearable audio output device that outputs stereo audio,
The voice control device
A sound source setting unit for setting a virtual sound source position for each of the plurality of pieces of information;
For each of the plurality of information, an audio processing unit that performs audio processing so that a virtual sound source position set by the sound source setting unit is perceived by a user as a sound source position;
The voice control device according to any one of (1) to (10), further including:
(12)
The sound control device according to (11), wherein the sound source setting unit sets a position associated with each of the plurality of pieces of information as a virtual sound source position of each of the plurality of pieces of information.
(13)
The sound control device according to (11), wherein the sound source setting unit sets each virtual sound source position of the plurality of pieces of information to a different position.
(14)
(11) to (11) further including a display control unit that controls display so that each display of the plurality of information is arranged at a position corresponding to the virtual sound source position set by the sound source setting unit on the display screen. The voice control device according to any one of (13).
(15)
Obtaining information associated with surrounding positions;
When a plurality of information is acquired, performing voice control so that the plurality of information is output simultaneously;
Including a voice control method.
(16)
Computer
An information acquisition unit for acquiring information associated with surrounding positions;
When a plurality of information is acquired by the information acquisition unit, a voice control unit that performs voice control so that the plurality of information is output simultaneously,
Program to function as

10 AR server 20 Mobile terminal 22 Touch panel 24 Speaker 26 Microphone 30 Audio output device 220 GPS
224 Acceleration sensor 228 Communication unit 232, 234 Area setting unit 236 Information analysis unit 240 Audio control unit 244, 246 Display control unit 248 Sound source setting unit 252 Audio processing unit 256 Proximity communication unit

Claims (14)

A portable terminal that can be connected to a server via a communication network,
A communication unit that receives a plurality of tag information associated with each position in the target area from the server via the communication network;
A speaker that simultaneously outputs a plurality of audio information corresponding to each of the plurality of tag information so that at least a part of the one audio information overlaps at least a part of the other audio information;
A display control unit that controls display of a plurality of positions associated with each of the plurality of tag information on the basis of the current position in the display unit;
With
The target area is set based on position information of the mobile terminal, and the size of the target area is changed according to the degree of congestion of the tag information around the mobile terminal.
Mobile device.   The mobile terminal according to claim 1, wherein a keyword included in the tag information is displayed so as to correspond to the position associated with the tag information.   The mobile terminal according to claim 1, wherein the audio information is output in the form of stereo audio. A portable terminal that can be connected to a server via a communication network,
A communication unit that receives a plurality of tag information associated with each position in the target area from the server via the communication network;
A speaker that simultaneously outputs a plurality of audio information corresponding to each of the plurality of tag information so that at least a part of the one audio information overlaps at least a part of the other audio information;
A display control unit that controls display of a plurality of positions associated with each of the plurality of tag information on the basis of the current position in the display unit;
With
The display unit is a touch panel display,
When the speaker simultaneously outputs the plurality of audio information, and a user operation is performed at the time of the audio output, the list of the plurality of tag information corresponding to the plurality of audio information output by audio is the list. Displayed on the touch panel display,
The operation by the user includes a tap operation on the mobile terminal.
Mobile device. A portable terminal that can be connected to a server via a communication network,
A communication unit that receives a plurality of tag information associated with each position in the target area from the server via the communication network;
A speaker that simultaneously outputs a plurality of audio information corresponding to each of the plurality of tag information so that at least a part of the one audio information overlaps at least a part of the other audio information;
A display control unit that controls display of a plurality of positions associated with each of the plurality of tag information on the basis of the current position in the display unit;
With
When the speaker outputs the plurality of sound information at the same time and an operation by the user is performed at the time of the sound output, the plurality of sound information is sequentially output.
Portable terminal. The mobile terminal according to claim 5 , wherein the operation by the user includes a tap operation on the mobile terminal. When the speaker outputs the plurality of sound information simultaneously and the plurality of tag information is displayed on the display unit, the plurality of tag information is a virtual sound source position based on the position of the mobile terminal. Displayed on each
The mobile terminal according to claim 1. A portable terminal that can be connected to a server via a communication network,
A communication unit that receives a plurality of tag information associated with each position in the target area from the server via the communication network;
A speaker that simultaneously outputs a plurality of audio information corresponding to each of the plurality of tag information so that at least a part of the one audio information overlaps at least a part of the other audio information;
A display control unit that controls display of a plurality of positions associated with each of the plurality of tag information on the basis of the current position in the display unit;
With
According to the orientation of the user of the mobile terminal, the plurality of audio information is respectively output at a virtual sound source position,
The orientation of the user is detected by a sensor attached to the user.
Mobile device. The mobile terminal according to claim 8 , wherein the orientation of the user is an orientation of a predetermined part of the mobile terminal.   The tag information is reconstructed so that a keyword considered to be of interest to a user of the mobile terminal is output as the voice information earlier than other keywords included in the tag information. The portable terminal as described in.   The mobile terminal according to claim 1, wherein the voice information includes at least one keyword included in the tag information. A storage unit for storing a database including a plurality of tag information and position information in a target area associated with each of the tag information;
A plurality of audio information corresponding to each of the plurality of tag information, an audio output device that outputs audio simultaneously so that at least a part of the one audio information overlaps at least a part of the other audio information;
A display control unit that controls display of a plurality of positions associated with each of the plurality of tag information on the basis of the current position in the display unit;
With
The plurality of audio information is output as audio with different sound characteristics ,
When the voice output device outputs the plurality of voice information at the same time and an operation by the user is performed at the time of the voice output, the plurality of voice information is sequentially output.
Mobile device. An information processing method in a mobile terminal that can be connected to a server via a communication network,
Receiving a plurality of tag information associated with each position in the target area from the server via the communication network;
Outputting a plurality of audio information corresponding to each of the plurality of tag information simultaneously so that at least a part of the one audio information overlaps at least a part of the other audio information;
Controlling the display of a plurality of positions associated with each of the plurality of tag information based on the current position;
Look at including it,
The target area is set based on the position information of the mobile terminal, and the area of the target area is changed according to the degree of congestion of the tag information around the mobile terminal.
Information processing method . Computer
A communication unit that receives a plurality of tag information associated with each position in the target area from a server via a communication network;
Voice control for controlling a plurality of voice information corresponding to each of the plurality of tag information to be outputted simultaneously so that at least a part of one of the voice information overlaps at least a part of the other voice information And
A display control unit that controls display of a plurality of positions associated with each of the plurality of tag information based on a current position;
To function ,
The target area is set based on the position information of the user, and the size of the target area is changed according to the degree of congestion of the tag information around the user.
program.

Images