JP7704633B2 - Public address system for improving the public address experience - Google Patents

Description

The present invention relates to a sound reinforcement system that improves the sound reinforcement experience in a sound reinforcement space.

Conventionally, there are public address systems that deliver audio information to people staying or passing through a specific space. Public address systems include one or more public address devices such as audio amplifiers and speakers, and output and amplify audio in the space in which the public address devices are installed (public address space). Public address systems are installed in a variety of spaces visited by an unspecified or specified number of people, such as city streets, public transportation stations, public facilities such as parks, shops, office buildings, factories, etc., and are also called public address systems.

A public address system is generally operated by storing audio data related to a predetermined sound source such as background music and reproducing the audio data according to a schedule (fixed-time broadcasting) or reproducing and broadcasting audio data related to a speaker's voice input from a microphone. Examples of public address systems are disclosed in Patent Documents 1 to 3. In such public address systems, it is common to transmit analog audio signals via a speaker line also called a 100V line, but it is also becoming common to transmit digitalized audio signals via an Ethernet cable (LAN cable) conforming to the IEEE 802 standard. In a public address system using an Ethernet cable, more detailed public address broadcasting can be performed using IP speakers that can be individually identified by IP addresses.
JP 2009-071775 A JP 2009-055282 A JP 2007-067465 A

The present invention aims to provide a public address system that can provide listeners in a public address space with a more pleasant public address experience.

The acoustic test system is a loudspeaker system having an input system, a processing system, and an output system. During loudspeaker broadcasting, the acoustic test system detects the current value on the transmission path from the input system through the processing system to the output system, restores the detected current value as an audio signal in a server connected to the loudspeaker system via an Internet network, and provides the restored audio signal to an external client connected to the server via the Internet network.

With this invention,

FIG. 1 is a diagram showing a public address system according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of the configuration of a loudspeaker device in a loudspeaker system. FIG. 3 is a diagram showing an example of the configuration of a loudspeaker device in a loudspeaker system. FIG. 4 is a flowchart showing an example of an operation flow for a data management server in a public address system to provide public address broadcasting status to a client. FIG. 5 is a diagram showing an example of the configuration of a loudspeaker device in a loudspeaker system. FIG. 6 is a diagram showing an example of a log held by a data management server in the public address system. FIG. 7 is a diagram showing an example of a broadcast log among the logs held by the data management server. FIG. 8 is a diagram showing an example of a GUI that the data management server provides to a client. FIG. 9 is a flowchart showing an example of an operational flow for the data management server to provide various information collected from cameras, microphones, and mobile communication terminals in the loudspeaker space to clients. FIG. 10 is a diagram showing an example of a loudspeaker broadcast period and a response expected period set corresponding to the loudspeaker broadcast period. FIG. 11 is a diagram showing an example of a database for managing the public address systems, cameras, microphones, and mobile communication terminals in a public address space. FIG. 12 is a diagram showing an example of the configuration of a public address device, a camera, a microphone, and a portable communication terminal in a public address system. FIG. 13 is a flowchart showing an example of an operational flow in which the data management server performs statistical processing on logs to generate improvement proposals regarding the operation of the loudspeaker system. FIG. 14 is a flowchart illustrating an example of an anomaly detection service. FIG. 15 is a diagram showing an example of the configuration of a loudspeaker in a loudspeaker system. FIG. 16 is a diagram showing an example in which a data management server in a public address system holds multiple sound sources and history information. FIG. 17 is a diagram showing an example of a history stored in the data management server. FIG. 18 is a flow chart showing an example of an operational flow for performing personalized broadcasting in a public address system. FIG. 19 is a diagram showing an example in which a data management server in a public address system holds an inspection sound source. FIG. 20 is a flowchart showing an example of an operational flow relating to an inspection service for a loudspeaker device in a loudspeaker system. FIG. 21 is a diagram showing an example of an embodiment of a public address system 1 including multiple server elements according to the functions of the services to be provided.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows a public address system 1 according to the embodiment. The public address system 1 includes one or more audio devices 11 provided in a public address space 10. Each public address device 11 includes an audio amplifier and a speaker, and amplifies the sound obtained by reproducing audio data and outputs it from the speaker. As an example, the public address device 11 uses audio data stored in a recording medium such as a CD (Compact Disc), an SD card, a HDD (Hard Disk Drive), or an SSD (Solid State Drive) as a sound source and reproduces the audio data. As an example, the public address device 11 has a microphone, and uses the voice of a speaker input from the microphone as a sound source, generates audio data from the voice, and reproduces it. The public address space 10 is an area having a certain size in which the public address device 11 is installed and amplified by the public address device 11. Examples of loudspeaker space 10 include designated outdoor areas in town (e.g., parks, squares, intersections, etc.), designated indoor and outdoor areas managed by designated administrators (stadiums, each floor of a shopping mall, each floor of an office building, schools, research institutes, government buildings, factories, etc.), etc.

The loudspeaker space 10 includes one or more cameras 12 for acquiring the situation of the loudspeaker space 10 as video data. An example of the camera 12 is a surveillance camera installed in the loudspeaker space 10 together with the loudspeaker device 11. An example of the camera 12 is a camera mounted on an unmanned flying object such as a UAV (Unmanned Aerial Vehicle) or a drone programmed to fly in the loudspeaker space 10. For example, when the loudspeaker space 10 is an intersection, the camera 12 may be a surveillance camera installed on a pole or the like on the road to monitor the intersection. For example, when the loudspeaker space 10 is inside a building such as a shopping mall, the camera 12 may be a surveillance camera installed on the ceiling of the building. The cameras 12 are driven individually for shooting, such as panning, tilting, and zooming, and can shoot a subject in the loudspeaker space 10 to generate video data, which can be stored in an internal recording medium or transmitted to the outside. The camera 12, in conjunction with the loudspeaker operation of the loudspeaker device 11, performs operations for photographing, such as panning, tilting, and zooming, and can photograph a subject and generate video data that can be stored in an internal recording medium or transmitted externally.

The loudspeaker space 10 includes one or more microphones 13 for acquiring the situation in the loudspeaker space 10 as audio data. An example of the microphone 13 is a microphone installed in the loudspeaker space 10 together with the loudspeaker device 11. For example, when the loudspeaker space 10 is outdoors, such as a park or an intersection, the microphone 13 may be installed on a support such as a utility pole. For example, when the loudspeaker space 10 is inside a building such as a shopping mall, the microphone 13 may be installed on a structure such as a wall, pillar, or ceiling of the building. The microphone 13 has a sound pickup direction facing inside the loudspeaker space 10, picks up sound in the loudspeaker space 10, generates audio data, and can store the data in an internal storage medium or transmit it to the outside. The microphone 13 picks up sound in conjunction with the loudspeaker broadcast operation of the loudspeaker device 11, generates audio data, and can store the data in an internal storage medium or transmit it to the outside.

The loudspeaker space 10 includes a mobile communication terminal 15 carried by a person 14 (user 14) who is a person in the loudspeaker space 10 and is a listener who listens to the loudspeaker broadcast from the loudspeaker device 11. An example of the mobile communication terminal 15 is a terminal such as a mobile phone or smartphone that can connect to an Internet network via cellular communication such as LTE (Long Term Evolution) or 5G, or LAN (LAN Area Network) communication such as Wi-Fi.

The public address system 1 includes a data management server 20 that can be accessed from a client via the Internet network. The public address devices 11, the cameras 12, the microphones 13, and the mobile communication terminals 15 can each access the data management server 20 via the Internet network. As shown in FIG. 1, the public address system 1 has multiple public address spaces 10, and the data management server 20 is interconnected with the public address devices 11, the cameras 12, the microphones 13, and the mobile communication terminals 15 in each public address space 10 via the Internet network.

Figure 2 shows an example of the configuration of the loudspeaker 11. The loudspeaker 11 includes an input system 110, a processing system 111, an output system 112, and a communication system 113. The processing system 111 is interconnected with the input system 110, the output system 112, and the communication system 113 using a wired interface such as a cable or a wireless interface. The input system 110 is a subsystem that accepts input of audio to be amplified from the loudspeaker 11. The input system 110 includes, for example, a microphone 110a and a BGM device 110b. The microphone 110a includes microphone elements such as a dynamic microphone or a condenser microphone, and outputs the speaker's voice as an audio signal. The BGM device 110b plays back a sound source (audio data) recorded on a recording medium such as a CD, an SD card, an HDD, or an SSD, and outputs it as an audio signal.

The processing system 111 is a subsystem that receives an audio signal from the input system 110, processes the audio signal by changing the frequency characteristics and amplifying it, etc., to generate a broadcast signal for loudspeaker broadcasting, and outputs it to the output system 111. The processing system 111 includes an equalizer 111a that changes the frequency characteristics of the audio signal according to the settings for each frequency band, and an audio power amplifier 111b that amplifies the audio signal according to the volume setting.

The output system 112 is a subsystem that receives a broadcast signal (audio signal) from the processing system 111 and outputs the broadcast signal. The output system 112 includes one or more speakers 112a positioned at various locations within the loudspeaker space 10, and each speaker 112a outputs a broadcast signal.

When the output system 112 includes multiple speakers 112a, the processing system 111 can perform routing settings for the broadcast signal to determine from which speaker 112a the broadcast signal is to be output. The processing system 111 performs routing settings and outputs the broadcast signal to the broadcast signal 112a from one or more specified speakers 112a. For example, each speaker 112a is assigned identification information (e.g., an IP address) that uniquely identifies it, and the processing system 111 specifies the identification information of one or more speakers 112a to be broadcast in the routing settings.

The communication system 113 transmits and receives data to and from the data management server 20 via the Internet network. The communication system 113 is connected to the processing system 111, accepts information relating to the processing performed by the processing system 111, and transmits it to the data management server 20 via the Internet network, while receiving information relating to the processing of the processing system 111 from the data management server 20 and passing that information to the processing system 111. The loudspeaker 11 has identification information (loudspeaker identification information) that uniquely identifies it, and the communication system 113 transmits data to the data management server 20 with that identification information attached. For example, the loudspeaker identification information is an IP address assigned to the loudspeaker 11. For example, the loudspeaker 11 includes a positioning system using a Global Navigation Satellite System (GNSS) such as a Global Positioning System (GPS), and the loudspeaker identification information is location information such as longitude and latitude acquired by the positioning system. For example, the loudspeaker 11 includes an indoor positioning system using a beacon signal using Bluetooth or the like, an RFID (Radio Frequency IDentification), an ultrasonic wave, a geomagnetism, an UWB (Ultra Wide Band) signal, or the like, and the loudspeaker identification information is indoor location information acquired by the indoor positioning system. For example, the loudspeaker 11 has a SIM (Subscriber Identity Module) and performs cellular communication using LTE or the like, and the loudspeaker identification information is identification information such as an ICCID (Integrated Circuit Card ID) that identifies the SIM, an IMSI (International Mobile Subscriber Identity) registered in the SIM, or an IMEI (International Mobile Equipment Identity) registered in the SIM. The communication system 113 transmits data to the data management server 20 with the loudspeaker identification information attached.

When multiple loudspeaker devices 11 are installed in the same loudspeaker space 10, the communication system 113 may be separated from the loudspeaker devices 11, and all the loudspeaker devices 111 may be connected to a common communication system 113. In this case, as shown in FIG. 3, multiple loudspeaker devices 11 are connected to a common communication system 113 in the loudspeaker space 10. The communication system 113 exists as a communication device having an independent housing as hardware separate from the loudspeaker devices 11. The communication system 113 is connected to each loudspeaker device 11 via a communication interface such as a LAN cable. The communication system 113 communicates with the processing system 111 of each loudspeaker device 11, transmits data received from the processing system 111 to the data management server 20, and passes data received from the data management server 20 to the processing system 111. The communication system 113 receives the loudspeaker identification information from each loudspeaker 11, and transmits the data to the data management server 20 with the loudspeaker identification information attached thereto, thereby identifying which loudspeaker 11 in the loudspeaker space 10 the data belongs to, and transmitting the data to the data management server 20. As shown in FIG. 3, all the loudspeakers 11 are collected and connected to a common communication system 113, so that the communication system 113 has a one-to-one relationship with the loudspeaker space 10, and identifying the communication system 113 identifies the loudspeaker space 10. For this reason, the communication system 113 has identification information (communication system identification information) that uniquely identifies itself, and transmits data to the data management server 20 with the communication system identification information attached thereto, thereby identifying which loudspeaker space 10 the data belongs to, and transmitting the data to the data management server 20. For example, the communication system identification information is an IP address assigned to the communication system 113. For example, the communication system 113 is equipped with a positioning system using GNSS such as GPS, and the communication system identification information is location information such as longitude and latitude acquired by the positioning system. For example, the communication system 113 includes an indoor positioning system that uses a beacon signal using Bluetooth or the like, an RFID, an ultrasonic wave, a geomagnetic signal, an UWB signal, or the like, and the communication system identification information is indoor position information acquired by the indoor positioning system. For example, the communication system 113 is a cellular router that has a SIM and performs cellular communication using LTE or the like, and the communication system identification information is identification information such as an ICCID that identifies the SIM, an IMSI registered in the SIM, or an IMEI registered in the SIM.

The camera 12 is an imaging device that includes an imaging element such as a CCD image sensor or a CMOS image sensor, and the imaging direction is directed in a direction that captures part or all of the loudspeaker space 10 in which the camera 12 is installed, outside the housing of the camera 12. The camera 12 connects to the Internet network via a LAN such as Wi-Fi or via cellular communication, and communicates data with the data management server 20. The camera 12 transmits video data of the captured image to the data management server 20, and at the same time performs control based on the data received from the data management server 20.

The microphone 13 is equipped with a microphone element such as a dynamic microphone or a condenser microphone, and is oriented in a direction that is outside the housing of the microphone 13 and that allows it to pick up sound from within the loudspeaker space 10 in which the microphone 13 is installed. The microphone 13 is connected to the Internet network via a LAN such as Wi-Fi or via cellular communication, and communicates data with the data management server 20. The microphone 13 transmits audio data of the picked-up sound to the data management server 20, while at the same time performing control based on the data received from the data management server 20.

The mobile communication terminal 15 has an OS (Operating System) and applications installed. The applications include, for example, a web browser. The mobile communication terminal 15 has a display unit including an LCD (Liquid Crystal Display) or an organic EL display. The mobile communication terminal 15 has an input unit including a keypad, a keyboard, a mouse, and the like. The mobile communication terminal 15 may have a touch screen in which the display unit and the input unit are integrated to display information and accept touch input operations. The mobile communication terminal 15 connects to the Internet network through a LAN such as Wi-Fi or through cellular communication, and communicates data with the data management server 20. The mobile communication terminal 15 transmits information related to user operations received from the input unit to the data management server 20 through the application, and performs control based on the data received from the data management server 20.

The data management server 20 is a web server that provides web services to clients by performing data communication with the clients via the Internet. The clients include a loudspeaker 11, a camera 12, a microphone 13, and a mobile communication terminal 15.

(Web service: monitoring service for public address system 11)
An example of the Web service is a monitoring service for the loudspeaker 11. FIG. 4 is a flow chart showing an example of the monitoring service. The loudspeaker 11 constantly transmits information on the state of loudspeaker broadcasting (loudspeaker status information) to the data management server 20 via the communication system 113 at a predetermined time interval (S10). The data management server 20 receives the loudspeaker status information from the loudspeaker 11 at any time (S11), accumulates it (S12), and provides it to an external client (S13). This makes it possible to visualize the loudspeaker status of the loudspeaker 11. The loudspeaker status information transmitted by the loudspeaker 11 in S11 is, for example, setting information set by the processing system 111. For example, the loudspeaker status information is setting information for the equalizer 111a to change the frequency characteristics of the audio signal, and volume setting information for the audio power amplifier 111b to amplify the audio signal. As shown in Fig. 5, the loudspeaker 11 may include a monitoring unit (sensor) for monitoring the operation status of the loudspeaker 11 and the status inside the loudspeaker 11, and the loudspeaker status information may include a measurement value acquired by the sensor. As shown in Fig. 5, the loudspeaker 11 may include a temperature sensor 120 for constantly measuring the temperature inside the loudspeaker 11, particularly the temperature of the processing system 111, at predetermined time intervals. As an example, the loudspeaker 11 may include an ammeter 121 for detecting a broadcast signal (audio signal) as a current value. The ammeter 121 is provided on a transmission path for transmitting a broadcast signal from the input system 110 through the processing system 111 to the output system 112, and measures the current value of the broadcast signal flowing through this transmission path. One example of the ammeter 121 is a current clamp provided on the outside of a cable for transmitting a broadcast signal from the input system 110 through the processing system 111 to the output system 112. In the example shown in FIG. 5, the ammeter 121 is provided on a transmission path connecting the amplifier 111b of the processing system 111 and the speaker 112a of the output system 112. The ammeter 121 continuously measures the current value at a predetermined time interval, and the continuous current value obtained thereby corresponds to the waveform of the broadcast signal. The loudspeaker status information may also include sound source information indicating the sound source when the loudspeaker broadcast was performed. For example, the sound source information is information indicating which sound source (e.g., the microphone 110a or the BGM device 110b) in the input system 110 was broadcast, that is, information indicating which sound source processed the processing system 111 and output the audio output to the output system 112. For example, as shown in FIG. 5, the loudspeaker device 11 includes a character conversion (Speech to Text) unit 122 that converts the input voice of the microphone 110a into text using a voice recognition technology, and the character information is the text information generated by the character conversion unit 122. The character conversion unit 122 converts the voice signal input from the microphone 110a into voice data, and performs voice recognition to generate a character string corresponding to the voice.

The data management server 20 is provided with a recording medium such as an HDD or SSD, and in S12, the received amplification status information is stored in the recording medium. As an example, the data management server 20 stores the amplification status information received sequentially in the form of a log in its own history. FIG. 6 shows an example of a log 21 held by the data management server 20. As shown in FIG. 6(a), the log 21 includes a temperature log 21a, a setting log 21b, and a broadcast log 21c. The temperature log 21a is a log of the measurement value (temperature) continuously received from the temperature sensor 120 at a predetermined time interval. The setting log 21b is a log of the setting information of the equalizer 111a and the audio power amplifier 111b. The broadcast log 21c is a log while the loudspeaker 11 is performing loudspeaker broadcasting, and is a log including the measurement value output by the ammeter 121 based on the input voice of the input system 111 and the character information generated by the character conversion unit 122. As shown in FIG. 6(b), the temperature log 21a and the setting log 21b may be generated and stored continuously regardless of whether the loudspeaker device 11 is broadcasting loudspeakers or not, and the broadcast log 21c may be generated and stored while loudspeaker broadcasting is being performed.

7(a) and (b) show an example of the broadcast log 21c. For example, when the loudspeaker 11 loudspeaks the sound input from the microphone 110a, the loudspeaker 11 transmits to the data management server 20, as loudspeaker status information, time information indicating the time from the start of the broadcast to the end, sound source type information indicating that the broadcast sound source is a microphone, text information generated by the character conversion unit 122 based on the sound input to the microphone 110a from the start of the broadcast to the end, and information on the continuous current value output by the ammeter 121 from the start of the broadcast to the end. In this case, as shown in FIG. 7(a), the log 21c includes the broadcast time indicated by the time information, the sound source type indicated by the sound source type information, the broadcast content indicated by the text information, and the sound waveform indicated by the continuous current value. For example, when the loudspeaker 11 loudly broadcasts audio reproduced by the BGM device 110b, the loudspeaker 11 transmits to the data management server 20, as loudspeaker status information, time information indicating the time from the start to the end of the broadcast, sound source type information indicating that the broadcast sound source is a BGM device, name information indicating the name of the sound source reproduced by the BGM device 110b from the start to the end of the broadcast (e.g., the file name of the reproduced sound file), and information on the continuous current value output by the ammeter 121 from the start to the end of the broadcast. In this case, as shown in FIG. 7(b), the log 21c includes the broadcast time indicated by the time information, the sound source type indicated by the sound source type information, the sound source name indicated by the name information, and the audio waveform indicated by the continuous current value.

In S13, the data management server 20 accepts access from a client via the Internet network and provides the client with a log 21 that can be played back on the client side. For example, the data management server 20 generates an HTML (HyperText Markup Language) file for displaying the log 21, transmits the HTML file to the client, and enables the client to open the HTML file in a browser to display the log 21c.

The loudspeaker device 11 holds location information indicating the location or position where the device is installed, and transmits the location information together with the loudspeaker status information to the data management server 20. The location information may be added to the loudspeaker status information and transmitted simultaneously, or may be transmitted separately from the loudspeaker status information. The data management server 20 receives the loudspeaker status information and location information from multiple loudspeaker devices 11 (S11), and generates and accumulates a log 21 for each loudspeaker device 11 in association with the location information (S12). The data management server 20 generates an HTML file that displays the location of the loudspeaker device 11 as a GUI according to the location information of each loudspeaker device 11, and transmits the HTML file to the client (S13). An example of the GUI is a GUI in which, as shown in FIG. 8, an icon 22 of each loudspeaker device 11 is arranged at a corresponding position on a map of an area including the location of the loudspeaker device 11 based on the location information of each loudspeaker device 11. The data management server 20 accepts the selection of any icon 22 from the client and transmits to the client an HTML file for displaying the log 21 of the loudspeaker device 11 corresponding to the selected icon 22 (S13).

In addition, in S13, the data management server 20 may provide the client with an audio waveform included in the log 21c as an audio stream so that the client can hear the audio. In this case, the data management server 20 generates audio data by encoding the audio waveform, which is a continuous current value, and generates an audio stream using a streaming protocol such as HLS (HTTP Live Streaming), DASH (Dynamic Adaptive Streaming over HTTP), or RTSP (Real Time Streaming Protocol) and transmits the audio stream to the client (S13). The client plays and outputs the audio stream on an application such as a browser that supports the streaming protocol. When the data management server 20 accepts the selection of the loudspeaker 11 on the GUI as shown in FIG. 8, it is preferable that the data management server 20 transmits to the client an audio stream related to the audio waveform included in the log 21c of the loudspeaker 11 corresponding to the selected icon 22. The audio waveform included in log 21c is the waveform of the audio broadcast by loudspeaker 11, and is the waveform of the audio signal that actually traveled along the transmission path from input system 110 to output system 112. Therefore, by playing back the audio related to this audio waveform, the client can listen to and confirm the audio that would have actually been amplified from loudspeaker 11 into loudspeaker space 10.

As described above, the data management server 20 accumulates the status of the loudspeaker 11 as a log, and the status of the loudspeaker 11 can be monitored via a client that can access the data management server 20. In this way, being able to monitor the status of the loudspeaker 11 allows the user (the operation manager of the loudspeaker 11) to review the various settings and operation methods of the loudspeaker 11 while checking the status, and a more favorable loudspeaker experience can be provided to listeners in the loudspeaker space.

(Web service: Measuring the effectiveness of loudspeaker broadcasting)
As an example of a Web service, the data management server 20 provides visualization of the effect of loudspeaker broadcasting, that is, what effect has occurred as a result of the loudspeaker broadcasting performed by the loudspeaker device 11 in the loudspeaker area 10, in addition to monitoring the status of the loudspeaker device 11. FIG. 9 is a flowchart showing an example of a service for visualizing the effect of loudspeaker broadcasting. The camera 12 transmits video data of the captured video to the data management server 20 at least during a period (reaction expected period) during which listeners in the loudspeaker space 10 are expected to react to the loudspeaker broadcast performed by the loudspeaker device 11. The microphone 13 transmits video data of the input voice to the data management server 20 at least during a period (reaction expected period) during which listeners in the loudspeaker space 10 are expected to react to the loudspeaker broadcast performed by the loudspeaker device 11. The portable communication terminal 15 transmits to the data management server 20 predetermined data input by the user from the input unit of the portable communication terminal 15 at least during the period during which it is expected that listeners in the loudspeaker space 10 will respond to the loudspeaker broadcast made by the loudspeaker device 11 (response expected period) (S22). The data management server 20 receives the video data, audio data, and predetermined data from the camera 12, microphone 13, and portable communication terminal 15, respectively (S23), and accumulates these data as loudspeaker response information (S24). The data management server 20 provides the accumulated data to external clients (S25).

The reaction expectation period in S20 to S22 is a period during which it is expected that a reaction will occur if a listener in the loudspeaker space 10 reacts to the loudspeaker broadcast from the loudspeaker device 11, in other words, a period during which it is possible to determine whether there is a listener to the loudspeaker broadcast. An example of the reaction expectation period is a period that includes the loudspeaker broadcast period during which the loudspeaker device 11 is broadcasting a loudspeaker broadcast and a certain time T1 after the loudspeaker broadcast ends, as shown in FIG. 10(a). This is based on the idea that the listener's reaction will begin some time after the loudspeaker broadcast begins, and the listener will continue to react for a certain period of time after the loudspeaker broadcast ends. An example of the reaction expectation period is a period that does not include the loudspeaker broadcast period during which the loudspeaker device 11 is broadcasting a loudspeaker broadcast, and a certain period of time T1 after the loudspeaker broadcast ends, as shown in FIG. 10(b). This is based on the idea that the listener's reaction will begin after the loudspeaker broadcast series ends, and the listener will continue to react for a certain period of time.

In S20, the camera 12 may constantly transmit video data of the video being shot to the data management server 20 at a predetermined time interval. The data management server 20 may store, among the video data constantly received, the video data received at the expected reaction time as amplified response information (S24). Alternatively, the camera 12 may be configured to transmit video data to the data management server 20 in response to a request from the data management server 20. In this case, the data management server 20 transmits a request message to the camera 12 requesting video when the expected reaction time arrives, and transmits a message to the camera 12 to stop transmitting video when the expected reaction time ends. In response to the request message, the camera 12 transmits video data of the video being shot at the expected reaction time to the data management server 20 (S20), and the data management server 20 may store the received video data as amplified response information (S24).

In S21, the microphone 13 may constantly transmit audio data of the input voice to the data management server 20 at a predetermined time interval. The data management server 20 may store, among the constantly received audio data, the audio data received at the expected reaction time as amplified response information (S24). Alternatively, the microphone 13 may be configured to transmit audio data to the data management server 20 in response to a request from the data management server 20. In this case, the data management server 20 transmits a request message to the microphone 13 requesting audio when the expected reaction time arrives, and transmits a message to the microphone 13 to stop transmitting audio when the expected reaction time ends. In response to the request message, the microphone 13 transmits audio data of the voice input during the expected reaction time to the data management server 20 (S21), and the data management server 20 may store the received audio data as amplified response information (S24).

In S22, the mobile communication terminal 15 may constantly transmit the predetermined data input by the user from the input unit to the data management server 20 in response to the input. The data management server 20 may store the data received during the expected reaction time, among the data constantly received, as loudspeaker reaction information (S24). Alternatively, the mobile communication terminal 15 may be configured to transmit the predetermined data to the data management server 20 in response to a request from the data management server 20. In this case, the data management server 20 transmits a request message to the mobile communication terminal 15 requesting the predetermined data when the expected reaction time arrives, and transmits a message to the mobile communication terminal 15 to stop transmitting data when the expected reaction time ends. In response to the request message, the mobile communication terminal 15 transmits the predetermined data input by the user from the input unit within the expected reaction time to the data management server 20 (S22), and the data management server 20 may store the received data as loudspeaker reaction information (S24).

In S22, an example of the predetermined data transmitted by mobile communication terminal 15 is character data input through an application of mobile communication terminal 15. For example, mobile communication terminal 15 may have a browser as an application for performing a web search and displaying a desired web page, and the character data may be character data of characters input from an input unit for a web search through the browser. For example, mobile communication terminal 15 may have an application for a social networking service (SNS), and the character data may be character data of characters input from an input unit for posting on the SNS through the application.

In S24, the data management server 20 may store the loudspeaker response information for each loudspeaker device 11 in association with the log 21 stored for each loudspeaker device 11 (S24). In particular, since the loudspeaker response information is information regarding the response to the loudspeaker broadcast among the logs 21, it may be stored in association with the log 21c related to the loudspeaker broadcast (S24). In this case, the data management server 20 stores the log 21c generated during the loudspeaker broadcast period of a certain loudspeaker device 11 in association with the loudspeaker response information of the same loudspeaker device 11 during the expected response time corresponding to the loudspeaker broadcast period (S24). For example, in the case of the example shown in FIG. 10(a), when a certain loudspeaker device 11 starts a loudspeaker broadcast and enters the loudspeaker broadcast period, the data management server 20 sets the start of the expected response time to a time after a predetermined time has elapsed from the start of the loudspeaker broadcast, and sets the end of the expected response time to a time T1 after the loudspeaker device 11 ends the loudspeaker broadcast and the loudspeaker broadcast period ends. The data management server 20 receives time information, sound source type information, character information, sound source name information, voice waveform information, etc. from the loudspeaker device 11 during the loudspeaker broadcast period (S11) and generates a log 21c (S12), and also receives various data from the camera 12, microphone 13, and mobile communication terminal 15 in the loudspeaker space 10 in which the loudspeaker device 11 exists within an expected reaction time (S23), generates loudspeaker response information, and associates it with the log 21c (S24). For example, in the example shown in Fig. 10(b), when a certain loudspeaker device 11 performs a loudspeaker broadcast and the loudspeaker broadcast period ends, the data management server 20 sets an expected reaction time T1 that starts at the time T1 has elapsed since the end of the loudspeaker broadcast. The data management server 20 receives time information, sound source type information, text information, sound source name information, audio waveform information, etc. from the loudspeaker device 11 during the loudspeaker broadcast period (S11) and generates a log 21c (S12). It also receives various data from the camera 12, microphone 13, and mobile communication terminal 15 in the loudspeaker space 10 in which the loudspeaker device 11 is located within the expected response time T1 (S23), generates loudspeaker response information, and associates it with the log 21c (S24).

The data management server 20 manages the loudspeaker devices 11, cameras 12, microphones 13, and mobile communication terminals 15 that exist within the same loudspeaker space 10. For example, as shown in FIG. 11, for each loudspeaker space 10, a database 23 is held that manages the loudspeaker devices 11, cameras 12, microphones 13, and mobile communication terminals 15 that exist within the space. In the example of Figure 11, the database 23 indicates that one loudspeaker 11 (11-1), two cameras 12 (12-1, 12-2), one microphone 13 (13-1), and three mobile communication terminals 15 (15-1, 15-2, 15-3) exist in the loudspeaker space 10-1, and two loudspeakers 11 (11-3, 11-4), one camera 12 (12-3), two microphones 13 (13-3, 13-4), and two mobile communication terminals 15 (15-4, 15-5) exist in the loudspeaker space 10-2. The data management server 20 may generate the database 23 according to the position information of each loudspeaker 11, the position information of each camera 12, the position information of each microphone 13, and the position information of each mobile communication terminal 15. For example, when the loudspeaker space 10 is formed by a LAN, in other words, when an area where one or more loudspeakers 11 connected to one LAN broadcast loudspeakers is one loudspeaker space 10, the loudspeaker 11, the camera 12, the microphone 13, and the mobile communication terminal 15 connected to the same LAN are registered in the database 23 as existing in the same loudspeaker space 10. For example, for each identifier (e.g., IP address) of a LAN router, the loudspeaker 11, the camera 12, the microphone 13, and the mobile communication terminal 15 connected to a LAN router having the same identifier are registered in the database 23 as existing in the same loudspeaker space 10. Also, for example, as described based on Fig. 3, when the output system 113 is independent from the loudspeaker 11, the camera 12, the microphone 13, and the mobile communication terminal 15 are also connected to the output system 113 as shown in Fig. 11, and it is preferable that the loudspeaker 11, the camera 12, the microphone 13, and the mobile communication terminal 15 all communicate with the data management server 20 via the output system 113. In this case, the data management server 20 registers in the database 23 the loudspeaker 11, camera 12, microphone 13, and mobile communication terminal 15 connected to the output system 113 having the same identification information (e.g., ICCID, IMSI, IMEI, etc.) for each communication system identification information of the output system 113 as existing in the same loudspeaker space 10. Furthermore, for example, the loudspeaker 11, camera 12, microphone 13, and mobile communication terminal 15 are configured to obtain their own position information using GNSS, an indoor positioning system, etc., and transmit it to the data management server 20, and the data management server 20 refers to the received position information and registers in the database 23 the loudspeaker 11, camera 12, microphone 13, and mobile communication terminal 15 having the same or similar position information within a predetermined range as existing in the same loudspeaker space 10.

In S24 described above, the data management server 20 refers to the database 23 to identify the camera 12, microphone 13, and mobile communication terminal 15 that are present in the same loudspeaker space 10 as the loudspeaker device 11 that is the sender of the time information, sound source type information, text information, sound source name information, audio waveform information, etc., and receives various data from the camera 12, microphone 13, and mobile communication terminal 15 to generate loudspeaker response information that corresponds to the log 21c.

In S25, the data management server 20 accepts access from a client via the Internet network and provides the client with loudspeaker response information that can be reproduced on the client side (S25). For example, the data management server 20 generates an HTML file for displaying the loudspeaker response information and transmits the HTML file to the client so that the client can open the HTML file in a browser to display the loudspeaker response information (S25). In S25, the data management server 20 may generate an HTML file for displaying the log 21c and the loudspeaker response information corresponding to the log 21c and transmit it to the client, so that the client side can check the loudspeaker broadcast status and the listener's response to the loudspeaker broadcast. When the data management server 20 accepts the selection of a loudspeaker device 11 on the GUI as shown in FIG. 8, it may generate an HTML file for displaying the log 21c of the loudspeaker device 11 corresponding to the selected icon 22 and the loudspeaker response information corresponding to the log 21c, and transmit it to the client.

As described above, the data management server 20 measures the effectiveness of loudspeaker broadcasts made by the loudspeaker device 11, and thereby the effectiveness of the loudspeaker broadcasts made by the loudspeaker device 11 can be confirmed through a client that can access the data management server 20. In this way, by measuring the effectiveness of loudspeaker broadcasts, the user (the operation manager of the loudspeaker device 11) can evaluate the effectiveness and improve the various settings and operation methods of the loudspeaker device 11, thereby providing listeners in the loudspeaker space with a more favorable loudspeaker experience.

(Web service: Proposal for improving public address broadcasting)
As an example of a Web service, the data management server 20 provides improvement proposals for loudspeaker broadcasting for each loudspeaker device 11 (for each loudspeaker space 10) based on the log 21 and loudspeaker response information. Fig. 12 is a flowchart showing an example of a service that provides improvement proposals for the loudspeaker device 11 (loudspeaker space 10). The data management server 20 statistically processes (S30) the log 21 and loudspeaker response information that have been accumulated (S12, S24), and creates improvement proposals that lead to improvements in loudspeaker broadcasting (S31). The data management server 20 provides the created improvement proposals to the client (S32).

As an example of the statistical processing in S30, the data management server 20 performs statistical processing on the log 21 accumulated in chronological order, and creates a proposal to improve the operation of the loudspeaker 11. For example, the temperature log 21a is statistically processed to identify time periods during which high temperatures continue for a predetermined period of time or more, and an improvement proposal is created such as increasing the air conditioning in the loudspeaker space 10 during these time periods. For example, the setting information log 21b is statistically processed, and if it is found that the frequency setting of the equalizer 111a or the volume setting of the audio power amplifier 111b is inappropriate, an improvement proposal is created that encourages appropriate frequency setting or volume setting.

As an example of the statistical processing in S30, the data management server 20 performs statistical processing on the relationships between at least two of the temperature log 21a, the setting information log 21b, and the broadcast log 21c, and creates a proposal to improve the operation of the loudspeaker 11 based on the relationships between multiple elements. For example, from the temperature log 21a and the setting information log 21b, a time period during which the volume setting should be lowered is identified based on the relationship between temperature and the volume setting of the audio power amplifier 111b, and an improvement proposal is created that encourages the adjustment of the volume setting.

In S30, the data management server 20 processes the loudspeaker response information, judges whether or not the corresponding loudspeaker is effective and the degree of effectiveness, and creates a proposal to improve the operation of the loudspeaker device 11 based on the loudspeaker effect. For example, the video data captured by the camera 12 included in the loudspeaker response information is statistically processed to identify the actions taken by listeners in the loudspeaker space 10 after the loudspeaker is broadcast, and the effectiveness of the loudspeaker is judged. For example, when the corresponding loudspeaker is a broadcast encouraging listeners to move (for example, an evacuation guidance broadcast in the event of a disaster), if the statistical processing of the captured video data identifies that multiple listeners began to move in one direction after the loudspeaker is broadcast, it can be determined that the loudspeaker is effective (the degree of effectiveness is high). For example, when the corresponding loudspeaker is an advertising broadcast advertising a specific product broadcast in the loudspeaker space 10, which is a store such as a supermarket, if the statistical processing of the captured video data identifies that listeners began to move to the sales floor of the product after the loudspeaker is broadcast, it can be determined that the loudspeaker is effective (the degree of effectiveness is high). Also, for example, the collected voice data of the microphone 13 included in the loudspeaker response information is statistically processed to identify the conversations that listeners in the loudspeaker space 10 had after the loudspeaker broadcast, and the effectiveness of the loudspeaker broadcast is judged. For example, when the corresponding loudspeaker broadcast is an advertising broadcast promoting a specific product, etc., if the statistical processing of the collected voice data identifies that listeners had a conversation related to the product, etc. after the loudspeaker broadcast, it can be judged that the loudspeaker method was effective (the degree of effectiveness is high). Furthermore, for example, the character data (character data entered through an application of the mobile communication terminal 15) included in the loudspeaker response information is statistically processed to identify the contents of web searches and SNS posts made by listeners in the loudspeaker space 10 after the loudspeaker broadcast, and the effectiveness of the loudspeaker broadcast is judged. For example, when the corresponding loudspeaker broadcast is an advertising broadcast promoting a specific product, etc., if the statistical processing of the collected voice data identifies that listeners had a web search or SNS posts related to the product, etc. after the loudspeaker broadcast, it can be judged that the loudspeaker method was effective (the degree of effectiveness is high). In S31, if the effectiveness of the loudspeaker broadcast determined in S30 is low, the data management server 20 creates an improvement proposal to review the loudspeaker sound source, volume setting, and frequency setting of the equalizer 111b.

As an example of the statistical processing in S30, the data management server 20 processes the loudspeaker response information as described above to determine the presence or absence and the degree of loudspeaker effect, and by referring to the log 21 corresponding to the loudspeaker, creates a proposal to improve the operation of the loudspeaker device 11 based on the relationship between the loudspeaker effect and the log 21. For example, by referring to the setting information log 21b, the relationship between the volume setting of the audio power amplifier 111b or the frequency setting of the equalizer 111a and the loudspeaker effect (for example, the volume setting or frequency setting when the loudspeaker effect was high) is identified, and an improvement proposal is created recommending the volume setting or frequency setting when the loudspeaker effect was high (S31).

In S30, the data management server 20 processes the loudspeaker response information and the corresponding log 21, judges the loudspeaker broadcasting effect based on the relationship between the multiple elements contained in both (S30), and creates a proposal to improve the operation of the loudspeaker device 11 based on the loudspeaker broadcasting effect. For example, the broadcast log 21c and the captured video data of the camera 12 contained in the loudspeaker response information are processed, the broadcast content contained in the broadcast log 21c and the behavior of the listeners in the loudspeaker space 10 after the loudspeaker broadcast are identified, and the loudspeaker broadcasting effect is judged based on the relationship between the two (S30). In this case, for example, the broadcast content (text data) of the broadcast log 21c is first analyzed to estimate the intention of the loudspeaker broadcast (the behavior that the listeners are encouraged to take by the loudspeaker broadcast), and then the captured video data is analyzed to judge whether the multiple listeners took the behavior intended by the loudspeaker broadcast after the loudspeaker broadcast (whether the listeners took the behavior that the loudspeaker broadcast encouraged them to take) to judge the loudspeaker broadcasting effect. In other words, if multiple listeners took the behavior intended by the loudspeaker broadcast after the loudspeaker broadcast, it can be judged that the loudspeaker broadcasting effect is high. As an example, when the broadcast contents of the broadcast log 21c are analyzed and characters indicating a location (e.g., an exit of a building, etc.) are recognized, and it is estimated that the broadcast is a broadcast encouraging people to move to the location (e.g., an evacuation guidance broadcast), the captured video data is then analyzed to determine whether the listeners have moved toward the location (S30). As an example, when the broadcast contents of the broadcast log 21c are analyzed and characters indicating that people should stay at the location (e.g., "Please wait," "Please do not move," etc.) are recognized, and it is estimated that the broadcast is a broadcast encouraging people not to move, the captured video data is then analyzed to determine whether the listeners have stayed at the location (S30). As an example, when the loudspeaker broadcast is an advertising broadcast advertising a specific product broadcast in the loudspeaker space 10, which is a store such as a supermarket, the broadcast contents of the broadcast log 21c are analyzed and the name of the advertised product is estimated, and the captured video data is then analyzed to determine whether the listeners have started to move to the sales floor of the product (S30). In S31, if the effectiveness of the loudspeaker broadcast determined in S30 was low, the data management server 20 creates an improvement proposal to reconsider the content of the loudspeaker broadcast (the content spoken by the speaker into the microphone 110).

In S30, the data management server 20 processes the loudspeaker response information and the corresponding log 21, judges the loudspeaker broadcasting effect based on the relationship between the multiple elements contained in both (S30), and creates a proposal to improve the operation of the loudspeaker device 11 based on the loudspeaker broadcasting effect. For example, the data management server 20 processes the broadcast log 21c and the collected voice data of the microphone 13 contained in the loudspeaker response information, identifies the broadcast content contained in the broadcast log 21c and the conversation content of the listeners in the loudspeaker space 10 after the loudspeaker broadcast, and judges the loudspeaker broadcasting effect based on the relationship between the two (S30). In this case, for example, first, the broadcast content (text data) of the broadcast log 21c is analyzed to estimate the intention of the loudspeaker broadcast (the message to be conveyed by the loudspeaker broadcast), and then the collected voice data is analyzed to determine the conversation content of the listeners after the loudspeaker broadcast, thereby judging the loudspeaker broadcasting effect. In other words, if multiple listeners are talking according to the intention of the loudspeaker broadcast after the loudspeaker broadcast, it can be judged that the loudspeaker broadcasting effect is high. As an example, when the loudspeaker broadcast is an advertising broadcast for a specific product broadcast in loudspeaker space 10, which is a store such as a supermarket, the name of the product being advertised is estimated as a result of analyzing the broadcast content in broadcast log 21c, and then the picked-up audio data included in the loudspeaker response information is analyzed to determine whether or not the listener used the product name in the conversation (S30). In S31, if the effectiveness of the loudspeaker broadcast determined in S30 was low, the data management server 20 creates an improvement proposal to reconsider the content of the loudspeaker broadcast (the content spoken by the speaker into microphone 110).

In S30, the data management server 20 processes the loudspeaker response information and the corresponding log 21, judges the loudspeaker broadcasting effect based on the relationship between the multiple elements contained in both (S30), and creates a proposal to improve the operation of the loudspeaker device 11 based on the loudspeaker broadcasting effect. For example, the data management server 20 processes the broadcast log 21c and the character data (characters from web searches and SNS posts on the mobile communication terminal 15) contained in the loudspeaker response information, identifies the broadcast content contained in the broadcast log 21c and the actions taken by listeners in the loudspeaker space 10 after the loudspeaker broadcast, and judges the loudspeaker broadcasting effect based on the relationship between the two (S30). In this case, for example, first, the broadcast content (character data) of the broadcast log 21c is analyzed to estimate the intention of the loudspeaker broadcast (the message to be conveyed by the loudspeaker broadcast), and then the character data is analyzed to determine the web search content and SNS post content made by the listener through the mobile communication terminal 15 after the loudspeaker broadcast, thereby judging the loudspeaker broadcasting effect. That is, if multiple listeners perform web searches or post on social media as intended by the loudspeaker broadcast after the loudspeaker broadcast, it can be determined that the loudspeaker broadcast effect is high. As an example, when the loudspeaker broadcast is an advertising broadcast advertising a specific product broadcast in loudspeaker space 10, which is a store such as a supermarket, the broadcast content in broadcast log 21c is analyzed to estimate the name of the product being advertised, and then the text data included in the loudspeaker response information is analyzed to determine whether or not listeners performed web searches or posted on social media using the product name (S30). In S31, if the loudspeaker broadcast effect determined in S30 is low, the data management server 20 creates an improvement proposal to reconsider the content of the loudspeaker broadcast (the content spoken by the speaker into microphone 110).

The improvement proposal includes text and images describing the improvement content. In S32, the data management server 20 accepts access from the client via the Internet network and provides the client with the improvement proposal in a manner that allows the client to play it back on the client side. For example, the data management server 20 generates an HTML file for displaying the improvement proposal and transmits the HTML file to the client so that the client can open the HTML file in a browser to display the improvement proposal. When the data management server 20 accepts the selection of a loudspeaker 11 on a GUI such as that shown in FIG. 8, it is preferable that the data management server 20 generates an HTML file for displaying the selected icon 22 and the improvement proposal for the loudspeaker 11 corresponding to the selected icon 22 and transmits the file to the client.

As described above, the data management server 20 creates improvement proposals regarding the settings and operation of the loudspeaker 11, and the improvement proposals can be confirmed via a client that can access the data management server 20. In this way, by making improvement proposals for loudspeaker broadcasting, the user (the operation manager of the loudspeaker 11) can improve the various settings and operation methods of the loudspeaker 11 based on the improvement proposals, and a more favorable loudspeaker experience can be provided to listeners in the loudspeaker space.

(Web service: Anomaly detection in public address broadcasting)
An example of a Web service is an abnormality detection service for the loudspeaker 11. Fig. 14 is a flow chart showing an example of the abnormality detection service. The loudspeaker 11 constantly judges at a predetermined time interval whether the input system 110, the processing system 111, and the output system 112 are operating normally (S40), and transmits the judgment result to the data management server 20 via the communication system 113 (S41). The data management server 20 receives the judgment result from the loudspeaker 11 (S42), accumulates the judgment result (S43), and provides it to an external client (S44). This makes it possible to visualize whether the loudspeaker 11 is operating normally or an abnormality has occurred.

As shown in FIG. 15, the loudspeaker 11 includes a judgment unit 114. The judgment unit 114 is connected to the input system 110, the processing system 111, and the output system 112, and monitors the operating status of each of the systems 110 to 112 at a predetermined time interval to judge whether or not they are operating normally (S40). As an example, the judgment unit 114 includes a temperature sensor that measures temperature at a predetermined time interval, measures the temperatures of the input system 110, the processing system 111, and the output system 112, and judges whether or not the temperature is normal for each system (S40). For example, if the measured temperature value is within a predetermined temperature range, it is judged to be normal, and if it is outside the predetermined temperature range, it is judged to be abnormal. As an example, the judgment unit 114 includes a current sensor that measures current, and measures the current flowing on the electric circuit board (electronic circuit board) of each of the input system 110, the processing system 111, and the output system 112, and judges whether or not each system is operating normally (S40). For example, if the measured current value is within a predetermined range, it is determined to be normal, and if it is outside the range, it is determined to be abnormal.

In S41, the loudspeaker device 11 transmits the judgment result for each system judged by the judgment unit 114 to the data management server 20. The judgment result includes information indicating whether each system is normal or abnormal.

In S44, the data management server 20 accepts access from the client via the Internet network and provides the received judgment result to the client in a manner that allows the client to reproduce the judgment result. For example, the data management server 20 generates an HTML file for displaying the judgment result and transmits the HTML file to the client so that the client can open the HTML file in a browser to display the judgment result.

As described above, the data management server 20 collects the judgment results indicating whether the loudspeaker 11 is operating normally or not, and the judgment results can be confirmed through a client that can access the data management server 20. The user (the operation manager of the loudspeaker 11) can repair or replace the loudspeaker 11 based on the judgment results, improving maintainability and enabling the loudspeaker 11 to provide a more favorable loudspeaker experience.

(Web service: personalized broadcasting)
An example of the Web service is a service in which the loudspeaker 11 provides a personalized broadcast optimized for the user 14 in the loudspeaker space 10. In this example, the user 14 can use the mobile communication terminal 15 to select a sound source to be loudspeaked from the loudspeaker 11 and to set (volume, etc.) for loudspeaker broadcasting, and the data management server 20 issues loudspeaker broadcast instructions to the loudspeaker 11 in accordance with these selections and settings. As shown in FIG. 16, in this example, the data management server 20 holds a plurality of sound sources 25 and history information 26. Each of the plurality of sound sources 25 is a sound source that can be reproduced and loudspeaked by the loudspeaker 11. Each sound source 25 is, for example, audio data related to a certain song or BGM, and is, for example, audio data generated in a file format such as MP3 (MPEG Audio Layer 3) or AAC (Advanced Audio Coding). The history 26 is information including history regarding settings (volume settings, etc.) for loudspeaker broadcasting from the loudspeaker device 11 and selection of sound sources, and includes history for each user 14 who made the settings and selections.

Figure 17 shows an example of the history 26. The history 26 includes a past history of the user 14 accessing the data management server 20 using the mobile communication terminal 15 and selecting the sound source 25 from the mobile communication terminal 15, and a past history of the user 14 setting the volume and other loudness from the mobile terminal 15. The history 26 records the history of the selection of the sound source 25 and the loudness setting such as the volume from the mobile communication terminal 15 for each identification information (e.g., IP address, or if the mobile communication terminal 15 has a SIM, ICCID, IMSI, IMEI, or ID for logging in to the data management server 20) of the mobile communication terminal 15 (user 14) that accessed the data management server 20 and selected the sound source 25 and set the volume and other settings. In the history 26, each time the selection of the sound source 25 or the loudness setting such as the volume is performed, the history of the selection or setting is recorded in association with the date and time of the selection. In the example shown in Figure 17, the history 26 includes the selection history of the sound source 25 and the setting history of the volume. For example, history 26 has a history in which music 001 (sound source 25) was selected at 9:10 on March 1, and the volume for broadcasting music 001 was set to 31 dB.

Figure 18 is a flowchart showing an example of an operation flow for performing personalized broadcasting in this example. The database server 20 accepts access from a client via the Internet network (S50, S51). In S50, the client transmits identification information for identifying the mobile communication terminal 15 (user 14), such as an IP address, ICCID, IMSI, IMEI, or login ID (S50), and the data management server 20 authenticates the received identification information and accepts the access (S51). The data management server 20 refers to the history 26 and determines whether there is a history associated with the identification information of the mobile communication terminal 15 (user 14) authenticated in S51 (S52). If there is a history (S52: Yes), the data management server 20 selects a sound source 25 and a loudspeaker setting such as volume based on the history, and instructs the loudspeaker device 11 to play the selected sound source 25 with the selected loudspeaker setting (S53). In S53, the data management server 20 transmits the selected sound source 25 (audio data) to the loudspeaker 11 and transmits a setting message indicating the selected loudspeaker setting. In S53, the data management server 20 estimates the sound source 25 that the user 14 is most likely to want to play from the loudspeaker 11 at the time when the mobile communication terminal 15 accesses the data management server 20 in S50 based on one or more histories, estimates the loudspeaker setting that the user 14 is most likely to want to set, and selects them. Specifically, for example, the data management server 20 may refer to one or more histories and select the sound source 25 that was most frequently played in the past and the loudspeaker setting that was most frequently set. Also, for example, the data management server 20 may select the sound source 25 that was previously played or the loudspeaker setting that was set at the time closest to the time when the access was accepted in S51, or select the sound source 25 that was previously played or the loudspeaker setting that was set most frequently in the time period when the access was accepted in S51. This automatically selects the optimal sound source 25 and loudspeaker settings, and the sound source 25 is played back and loudspeaker-broadcast from the loudspeaker device 11 with the selected loudspeaker settings.

If there is no history in the history 26 (S52: No), the data management server 20 accepts the selection of the sound source 25 and the specification of the loudspeaker settings input from the client (S54) (S55). For example, the data management server 20 provides the client with a UI for inputting the selection of the sound source 25 and the specification of the loudspeaker settings, and accepts the selection of the sound source 25 and the specification of the loudspeaker settings input through the UI (S55). For example, the data management server 20 generates an HTML file for displaying the UI, sends the HTML file to the client, and enables the client to open the HTML file in a browser to display the UI.

The data management server 20 reads out the sound source 25 selected in S55 (S56) and instructs the loudspeaker 11 to play the sound source 25 with the loudspeaker setting selected in S56 (S57). In S57, the data management server 20 transmits to the loudspeaker 11 the sound source 25 read out in S56 and a setting message indicating the loudspeaker setting selected in S55. The data management server 20 records the selection of the sound source 25 and the selection of the loudspeaker setting received in S55 as new history in the history 26 in association with time information indicating the time received in S55 (S61).

The loudspeaker 11 receives the sound source 25 and the setting message sent from the data management server 20 in S53 or S57 (S58). The loudspeaker 11 holds the received sound source 25 and sets the input system 110, the processing system 111, or the output system 112 in accordance with the received setting message (S59). For example, if the setting message is a message indicating a volume setting, the loudspeaker 11 adjusts the volume of the audio power amplifier 111b of the processing system 111 in accordance with the volume setting indicated in the setting message (S59). The loudspeaker 11 plays the sound source 25 received and held in S58 and broadcasts it (S60).

As described above, the data management server 20 records the history of the type of amplification experience that each user 14 preferred in the past, and this history can be used to automatically provide the optimal amplification experience for each user 14.

(Web service: Sound inspection of public address system 11)
An example of the Web service is an inspection service that checks whether the loudspeaker 11 operates normally. That is, if a malfunction occurs in the input system 110, the processing system 111, or the output system 112 of the loudspeaker 11, loudspeaker broadcasting may not be performed normally when desired (or even if loudspeaker broadcasting is intended), which is a problem in terms of the operation of the loudspeaker 11. In particular, if loudspeaker broadcasting of high public interest such as evacuation guidance broadcasting during a disaster cannot be performed normally, it may be dangerous as it may affect people's lives. For this reason, the data management server 20 checks whether the loudspeaker 11 operates normally on a regular or irregular basis. In this example, as shown in FIG. 19, the data management server 20 holds an inspection sound source 27. The inspection sound source 27 is audio data prepared for inspecting the loudspeaker 11, and is, for example, audio data related to a sound that continues for several seconds.

Figure 20 is a flowchart showing an example of an operation flow relating to the inspection service of the loudspeaker 11. The data management server 20 instructs the loudspeaker 11 to perform a test amplification in order to inspect the loudspeaker 11 (S70). As an example, the data management server 20 may hold an inspection schedule in advance and execute S70 according to the schedule. As an example, the data management server 20 may execute S70 periodically (e.g., once a month, on the first day of each month, etc.). As an example, the data management server 20 may execute S70 irregularly during a time period when the loudspeaker 11 is not broadcasting loudspeakers. In S70, the data management server 20 transmits the inspection sound source 27 to the loudspeaker 11 while also transmitting a message instructing the loudspeaker 11 to perform a test amplification.

When the loudspeaker 11 receives the inspection sound source 27 and the message (S71), it responds by making a test loudspeaker broadcast (S72). In S72, the loudspeaker 11 holds the received inspection sound source 27 and plays the inspection sound source 27 to make a loudspeaker broadcast.

In parallel with instructing the loudspeaker 11 to perform the test amplification in S70, the data management server 20 instructs the microphone 30 in the same loudspeaker space 10 as the loudspeaker 11 to collect sound (S73). In S73, the data management server 20 refers to the database 23 to identify the microphone 30 in the same loudspeaker space 10 as the loudspeaker 11 instructed in S70, and sends a sound collection instruction to the microphone 30. In S73, the data management server 20 sends a message instructing the microphone 30 to collect sound. As an example, the data management server 20 may execute S70 and S73 at the same time. As an example, the data management server 20 may execute S73 a predetermined time (e.g., several seconds) after executing S70 and taking into account the time lag until the loudspeaker 11 starts the loudspeaker broadcast.

When the microphone 30 receives the message instructing it to collect sound (S74), it starts collecting sound, generates audio data of the collected sound, and transmits it to the data management server 20 (S75). In S75, the microphone 30 continues collecting sound for a predetermined time after receiving the message in S74, generates audio data of the sound collected during this time, transmits it to the data management server 20, and then automatically ends collecting sound.

After executing S73, the data management server 20 waits to receive audio data of the collected voice from the microphone 30. When the data management server 20 receives the audio data of the collected voice from the microphone 30, it inspects the loudspeaker 11 based on the audio data (S76). As an example, in S76, the data management server 20 determines that the loudspeaker 11 is normal because it was able to receive the audio data in S76, and determines that the loudspeaker 11 is abnormal if it cannot receive the audio data even after waiting for a predetermined time. As an example, in S76, the data management server 20 compares the received audio data with the inspection sound source 27 and determines whether the loudspeaker 11 is normal or abnormal depending on the degree of match. For example, if the received audio data and the inspection sound source 27 match within a predetermined range, it may be determined that the loudspeaker 11 is normal, and if they do not match within the predetermined range, it may be determined that the loudspeaker 11 is abnormal. For example, the received audio data can be played back to obtain an audio signal (audio waveform), which can then be compared with the audio signal related to the audio data from the inspection sound source 27. If they match within a specified range, it can be determined that the signal is normal, and if they do not match within the specified range, it can be determined that the signal is abnormal.

The data management server 20 accumulates the judgment results (inspection results) from S76 (S77) and provides them to the client (S78). In S78, the data management server 20 accepts access from the client via the Internet network and provides the client with the inspection results so that they can be reproduced on the client side. For example, the data management server 20 generates an HTML file for displaying the inspection results and sends the HTML file to the client so that the client can open the HTML file in a browser to display the inspection results.

As described above, the data management server 20 inspects the loudspeaker 11, and the results of the inspection can be confirmed through a client that can access the data management server 20. The user (the operation manager of the loudspeaker 11) can repair or replace the loudspeaker 11 based on the inspection results, improving maintainability and enabling the loudspeaker 11 to provide a more pleasant loudspeaker experience.

(supplement)
The loudspeaker 11 includes a processing unit including a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and a memory that stores computer programs executable by the processing unit. The processing unit executes the computer programs stored in the memory to realize various functions of the loudspeaker 11. The computer programs stored in the memory include program instructions for executing the various processes executed by the loudspeaker 11 described above, such as S10, S40 to S41, S58 to S60, and S71 to S72.

The data management server 20 comprises a processing unit including a CPU, an MPU, etc., and a memory that stores computer programs executable by the processing unit. The various functions of the data management server 20 are realized by the processing unit executing the computer programs stored in the memory. The computer programs stored in the memory include program instructions that execute the various processes executed by the data management server 20 described above, such as S11 to S13, S23 to S25, S30 to S32, S42 to S44, S51 to S61, S70 to S78, etc.

Camera 12 includes a processing unit including a CPU, an MPU, etc., and a memory that stores computer programs that can be executed by the processing unit. The various functions of camera 12 are realized by the processing unit executing the computer programs stored in the memory. The computer programs stored in the memory include program instructions such as S20 that execute the various processes executed by camera 12 described above.

The microphone 13 includes a processing unit including a CPU, an MPU, etc., and a memory that stores a computer program that can be executed by the processing unit. The various functions of the microphone 13 are realized by the processing unit executing the computer program stored in the memory. The computer program stored in the memory includes program instructions for executing the various processes executed by the camera 12 described above, such as S21, S74 to S75, etc.

The mobile communication terminal 15 comprises a processing unit including a CPU, an MPU, etc., and a memory that holds computer programs executable by the processing unit. The various functions of the mobile communication terminal 15 are realized by the processing unit executing the computer programs held in the memory. The computer programs held in the memory include program instructions that execute the various processes executed by the mobile communication terminal 15 described above, such as S22, S50, S54, etc. When the mobile communication terminal 15 is a client that receives the services provided by the data management server 20 at S13, S25, S32, S43, and S77, the computer programs held in the memory include program instructions that execute the processes for those services.

Figure 21 shows an example of an embodiment of the public address system 1. In the public address system 1, the data management server 20 includes multiple server elements 20a to 20g according to the functions of the services provided. The content server 20a is a server that provides content to the public address device 11, and has the functions of, for example, holding the above-mentioned sound source 25 and inspection sound source 27 and transmitting them to the public address device 11 (S53, S57, S70). The device management server 20b is a server that manages devices such as the public address device 11 in the public address space 10, and has the functions of, for example, storing public address information (S12), storing various information (S24), storing judgment information (S43), and storing inspection results (S77), and also has the functions of storing logs 21, databases 23, history 26, etc. The portal server 20c is a server that serves as a contact point with clients, and has the functions of, for example, performing S13, S25, S32, S43, and S77. The analysis server 20d is a server that performs data analysis and statistical processing, and has the function of executing, for example, S30, S31, and S76. The end-user server 20e is a server that is a contact point with the mobile communication terminal 15 carried by the user 14, and has the function of executing, for example, S51 and S53. The space assessment server 20f is a server that assesses the situation in the loudspeaker space 10, and is a server that is a contact point with the camera 12 and microphone 13, and has the function of executing, for example, S23 and S76. The diagnosis server 20g is a server that is a contact point with the client for diagnosing the loudspeaker device 11, and has the function of executing, for example, S13, S25, S32, S43, and S77.

Reference Signs List 1 Public address system 10 Public address space 11 Public address device 12 Camera 13 Microphone 20 Data management server

Claims (2)

In a loudspeaker device having an input system, a processing system, and an output system, a current value on a transmission path from the input system through the processing system to the output system is detected during loudspeaker broadcasting;
An acoustic testing system in which a server connected to the loudspeaker system via an Internet network restores the detected current value as an audio signal, and provides the restored audio signal to an external client connected to the server via the Internet network. 2. An acoustic testing system as claimed in claim 1 , comprising:
The server is connected to a plurality of the loudspeakers;
The server receives, from each of the loudspeaker devices, location information indicating a location of the loudspeaker device together with the current value;
The server provides the external client with a GUI indicating the position of each loudspeaker based on the location information, and provides an audio signal restored from a current value received from the loudspeaker corresponding to the position specified by the external client through the GUI.

Images