AU2016378005B2

AU2016378005B2 - Terminal device, diagnosis system, diagnosis method, and program

Info

Publication number: AU2016378005B2
Application number: AU2016378005A
Authority: AU
Inventors: Tomoyuki Mitsuhashi; Tsutomu Udaka
Original assignee: Fujifilm Business Innovation Corp
Current assignee: Fujifilm Business Innovation Corp
Priority date: 2015-12-25
Filing date: 2016-05-06
Publication date: 2019-12-05
Anticipated expiration: 2036-05-06
Also published as: WO2017110111A1; AU2016378005A1; CN108292509B; JP2017116473A; JP5939480B1; CN108292509A

Abstract

According to the present invention, a sound acquisition part (31) receives as input an abnormal sound that has occurred at an image formation device (20) that is an analysis target device and thereby acquires sound information. A position reception part (38) receives, from a user, sound-recording position information that is for acquiring sound information. A frequency analysis part (32) performs a short-time Fourier transform (STFT) on the sound information acquired by the sound acquisition part (31) and generates frequency spectrum waveform data. A control part (33) receives a spectrum waveform that, from among a plurality of frequency spectrum waveforms at a server device (50), resembles the generated frequency spectrum waveform and has been selected on the basis of the received sound-recording position information.

Description

SPECIFICATION

TITLE OF INVENTION:

TERMINAL DEVICE, DIAGNOSTIC SYSTEM, DIAGNOSTIC METHOD AND PROGRAM

TECHNICAL FIELD [0001] The present invention relates to a terminal device, a diagnostic system, a diagnostic method, and a program.

BACKGROUND ART [0001A] Any discussion of the prior art throughout the specification should in no way be considered as an admission that such prior art is widely known or forms part of common general knowledge in the field.

[0002] Patent Document 1 discloses a system including a RAM (Random Access Memory) or a ROM (Read Only Memory) in which an operating sound upon normal operation of an image forming apparatus is stored, and a microphone configured to detect an operating sound to be generated from the image forming apparatus. The system is configured to specify an abnormal place of the image forming apparatus, based on first sound information stored in the RAM or the ROM, second sound information detected by the microphone, and operation information of the image forming apparatus.

[0003] Patent Document 2 discloses an image processing apparatus including an image forming unit configured to form an image on a printing sheet and a conveyor unit

2016378005 30 Oct 2019 configured to convey the printing sheet. The image processing apparatus further includes a sound conversion unit configured to convert a sound in the apparatus into an electric signal, a sound analysis unit configured to analyze the electric signal converted by the sound conversion unit and to obtain a component for each frequency, and an output unit configured to output the component for each frequency obtained by the sound analysis unit.

Prior Art Documents

Patent Documents [0004] Patent Document 1: JP-A-2007-079263

Patent Document 2: JP-A-2008-290288

SUMMARY OF THE INVENTION [0004A] It is an object of the present invention to overcome or ameliorate at least one of the disadvantages of the prior art, or to provide a useful alternative.

[0005] There is a case where when an abnormal sound (unusual sound) is generated in an apparatus, sound information acquired by inputting a sound generated in an analysis target apparatus and sound information of an abnormal sound previously generated in an apparatus equivalent to the analysis target apparatus are compared to clarify a cause of the abnormal sound.

[0006] In this case, when there exists plural waveforms similar to a frequency analysis result waveform of the acquired sound information, it is difficult to specify a cause of the abnormal sound.

[0007] At least one exemplary embodiment of the present invention is to easily specify

2016378005 30 Oct 2019 a cause of an abnormal sound, as compared to a case where a frequency analysis is performed without specifying a position at which sound information is to be acquired.

[0008] [Terminal device] [1] One exemplary embodiment of the present invention is a terminal device comprising an acquisition unit configured to acquire sound information, a reception unit configured to receive position information related to a position at which the sound information is to be acquired, and a display configured to display at least one of an analysis result selected from plural analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition unit and the position information received by the reception unit, and information associated with the selected analysis result.

[0009] [2] The terminal device of [1] may further comprise a frequency analysis unit configured to perform a time-frequency analysis on the sound information acquired by the acquisition unit and to generate an analysis result indicative of a temporal change of an intensity distribution for each frequency, a transmission unit configured to transmit information obtained from the analysis result generated by the frequency analysis unit, the position information received by the reception unit and apparatus information related to a measurement target apparatus to an external apparatus, and a receiving unit configured to receive an analysis result, which is selected based on the position information received by the reception unit from plural analysis results obtained by a frequency analysis on a sound signal, of analysis results similar to the analysis result generated by the frequency analysis unit from the external apparatus. The display may

2016378005 30 Oct 2019 be configured to display the analysis result generated by the frequency analysis unit and the analysis result received by the receiving unit.

[0010] [3] In the terminal device of [1] or [2], the display may be configured to display a different analysis result in correspondence to the position information received by the reception unit.

[0011] [4] In the terminal device of any one of [1] to [3], when displaying plural analysis results, the display may change an order of the analysis results to be displayed, in correspondence to the position information received by the reception unit.

[0012] [5] In the terminal device of any one of [1] to [4], the display may be configured to display an outer appearance of a target apparatus, which is a measurement target, and the reception unit may be configured to receive position information of the target apparatus to be displayed on the display.

[0013] [6] In the terminal device of [5], the display may be configured to display an outer appearance of a direction different from the outer appearance of the target apparatus, and the reception unit may be configured to receive the position information of the target apparatus to be displayed on the display, for each outer appearance of the different direction.

[0014] [Diagnostic system] [7] One exemplary embodiment of the present invention is a diagnostic system comprising a terminal device comprising an acquisition unit configured to acquire sound information, a reception unit configured to receive position information related to a position at which the sound information is to be acquired, and a display configured to display at least one of an analysis result selected from plural analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an

2016378005 30 Oct 2019 analysis result obtained by a frequency analysis on the sound information acquired by the acquisition unit and the position information received by the reception unit, and information associated with the selected analysis result, and a server apparatus comprising a storage configured to store plural analysis results obtained by performing a frequency analysis on a sound signal and generation position information of a sound, and a transmission unit that, when information obtained from an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition unit is received from the terminal device, together with the position information received by the reception unit, transmits at least one of an analysis result selected from the plural analysis results stored in the storage, the analysis result being selected based on the received analysis result and the position information received by the reception unit, and information associated with the selected analysis result to the terminal device.

[0015] [Diagnostic method] [8] One exemplary embodiment of the present invention is a diagnostic method comprising an acquisition step of acquiring sound information; a reception step of receiving position information related to a position at which the sound information is to be acquired, and a display step of displaying at least one of an analysis result selected from plural analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition step and the position information received by the reception step, and information associated with the selected analysis result.

[0016] [Program] [9] One exemplary embodiment of the present invention is a program

2016378005 30 Oct 2019 configured to enable a computer to execute: an acquisition step of acquiring sound information; a reception step of receiving position information related to a position at which the sound information is to be acquired, and a display step of displaying at least one of an analysis result selected from plural analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition step and the position information received by the reception step, and information associated with the selected analysis result.

[00016A] A further exemplary embodiment of the present invention is a terminal device comprising: an acquisition unit that acquires sound information; a reception unit that receives position information related to a position at which the sound information is to be acquired, a display that displays at least one of an analysis result selected from a plurality of analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition unit and the position information received by the reception unit, and information associated with the selected analysis result, a frequency analysis unit that performs a time-frequency analysis on the sound information acquired by the acquisition unit and generates an analysis result indicative of a temporal change of an intensity distribution for each frequency, a transmission unit that transmits information obtained from the analysis result generated by the frequency analysis unit, the position information received by the reception unit and apparatus information related to a measurement target apparatus to an external apparatus, and a receiving unit that receives an analysis result, which is selected based on the position information received by the reception unit from a plurality of analysis

2016378005 30 Oct 2019 results obtained by a frequency analysis on a sound signal, of analysis results similar to the analysis results generated by the frequency analysis unit from the external apparatus, wherein the display displays the analysis result generated by the frequency analysis unit and the analysis result received by the receiving unit.

[00016B] A further exemplary embodiment of the present invention is a diagnostic method comprising: an acquisition step of acquiring sound information;

a reception step of receiving position information related to a position at which the sound information is to be acquired, and a display step of displaying at least one of an analysis result selected from a plurality of analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition step and the position information received by the reception step, and information associated with the selected analysis result, a frequency analysis step of performing a time-frequency analysis on the sound information acquired at the acquisition step and generating an analysis result indicative of a temporal change of an intensity distribution for each frequency, a transmission step of transmitting information obtained from the analysis result generated at the frequency analysis step, the position information received at the reception step and apparatus information related to a measurement target apparatus to an external apparatus, and a second reception step of receiving, at a reception unit, an analysis result, which is selected based on the position information received by the reception unit from a plurality of analysis results obtained by a frequency analysis on a sound signal, of analysis results similar to the analysis results generated at the frequency analysis step from the external apparatus, wherein the display step includes displaying the analysis result generated at the frequency analysis

2016378005 30 Oct 2019 step and the analysis result received by the receiving unit.

[00016C] A further exemplary embodiment of the present invention is a diagnostic system comprising: a terminal device comprising: an acquisition unit that acquires sound information; a reception unit that receives position information related to a position at which the sound information is to be acquired, a display that displays at least one of an analysis result selected from a plurality of analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition unit and the position information received by the reception unit, and information associated with the selected analysis result, and a server apparatus comprising: a storage that stores a plurality of analysis results obtained by performing a frequency analysis on a sound signal and generation position information of a sound, wherein generation position information is position information at which the sound was generated, and a transmission unit that, when information obtained from an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition unit is received from the terminal device, together with the position information received by the reception unit, transmits at least one of an analysis result selected from the plurality of analysis results stored in the storage, the analysis result being selected based on the received analysis result and the position information received by the reception unit, and information associated with the selected analysis result to the terminal device, and a frequency analysis unit that performs a timefrequency analysis on the sound information acquired by the acquisition unit and generates an analysis result indicative of a temporal change of an intensity distribution for each frequency, a transmission unit that transmits information obtained from the

2016378005 30 Oct 2019 analysis result generated by the frequency analysis unit, the position information received by the reception unit and apparatus information related to a measurement target apparatus to an external apparatus, and a receiving unit that receives an analysis result, which is selected based on the position information received by the reception unit from a plurality of analysis results obtained by a frequency analysis on a sound signal, of analysis results similar to the analysis results generated by the frequency analysis unit from the external apparatus, wherein the display displays the analysis result generated by the frequency analysis unit and the analysis result received by the receiving unit.

[00016D] A further exemplary embodiment of the present invention is a program that enables a computer to execute: an acquisition step of acquiring sound information;

a reception step of receiving position information related to a position at which the sound information is to be acquired, and a display step of displaying at least one of an analysis result selected from a plurality of analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition step and the position information received by the reception step, and information associated with the selected analysis result a frequency analysis step of performing a time-frequency analysis on the sound information acquired at the acquisition step and generating an analysis result indicative of a temporal change of an intensity distribution for each frequency, a transmission step of transmitting information obtained from the analysis result generated at the frequency analysis step, the position information received at the reception step and apparatus information related to a measurement target apparatus to an external apparatus, and a second reception step of receiving, at a reception unit, an analysis result, which is selected based on the position information

2016378005 30 Oct 2019 received by the reception unit from a plurality of analysis results obtained by a frequency analysis on a sound signal, of analysis results similar to the analysis results generated at the frequency analysis step from the external apparatus, wherein the display step includes displaying the analysis result generated at the frequency analysis step and the analysis result received by the receiving unit.

[0016E] Unless the context clearly requires otherwise, throughout the description and the claims, the words “comprise”, “comprising”, and the like are to be construed in an inclusive sense as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to”.

Effects of the Invention [0017] According to the terminal device of [1], it is possible to easily specify a cause of the abnormal sound, as compared to a case where the frequency analysis is performed without specifying the position at which the sound information is to be acquired.

[0018] According to the terminal device of [2], it is possible to specify the cause of the abnormal sound by comparing the two displayed analysis results.

[0019] According to the terminal device of [3], it is possible to easily specify the cause of the abnormal sound, based on the analysis result selected in correspondence to the position information.

[0020] According to the terminal device of [4], it is possible to display the analysis results from an analysis result having a high possibility of the cause of the abnormal sound, as compared to a case where an order of the analysis results is not changed.

[0021] According to the terminal device of [5], it is possible to be displayed as the user

2016378005 30 Oct 2019 can more easily understand, as compared to a case where the position information is received without displaying the outer appearance of the target apparatus.

[0022] According to the terminal device of [6], it is possible to more accurately specify the cause of the abnormal sound based on the position information, as compared to a case where the position information is received without displaying the outer appearance of the target apparatus of the different direction.

[0023] According to the diagnostic system of [7], it is possible to easily specify the cause of the abnormal sound, as compared to a case where the frequency analysis is performed without specifying the position at which the sound information is to be acquired.

[0024] According to the diagnostic method of [8], it is possible to easily specify the cause of the abnormal sound, as compared to a case where the frequency analysis is performed without specifying the position at which the sound information is to be acquired.

[0025] According to the program of [9], it is possible to easily specify the cause of the abnormal sound, as compared to a case where the frequency analysis is performed without specifying the position at which the sound information is to be acquired.

BRIEF DESCRIPTION OF THE DRAWINGS [0026] Fig. 1 is a system view depicting a configuration of an abnormal sound diagnostic system of an exemplary embodiment of the present invention.

Fig. 2 is a block diagram depicting a hardware configuration of a terminal device 10 of the exemplary embodiment of the present invention.

Fig. 3 is a block diagram depicting a functional configuration of the terminal

2016378005 30 Oct 2019 device 10 of the exemplary embodiment of the present invention.

Fig. 4 is a block diagram depicting a functional configuration of a server apparatus 50 of the exemplary embodiment of the present invention.

Fig. 5 depicts an example of information that is to be stored in a waveform data storage 53 in Fig. 4.

Fig. 6 is a sequence chart for illustrating an operation of the abnormal sound diagnostic system of the exemplary embodiment of the present invention.

Fig. 7 depicts an example of a display screen of the terminal device 10 when inputting a variety of information such as a model name, a serial number, an operating state and the like.

Fig. 8 depicts an example of a display screen when inputting a recording position of the terminal device 10 relative to image forming apparatus 20 by a user.

Fig. 9 depicts an example of the display screen when inputting the recording position of the terminal device 10 relative to image forming apparatus 20 by the user.

Fig. 10 depicts an example of a display screen for enabling the user to confirm the recording position.

Fig. 11 illustrates a concept of an STFT.

Fig. 12 depicts an example of an image of a frequency spectrum waveform based on an analysis result obtained by the STFT.

Fig. 13 depicts an example of a case of displaying for urging a user to designate a region estimated as an abnormal sound when presenting a frequency spectrum waveform to the user.

Fig. 14 depicts an example of a selected region 80 selected by the user in the image example of the frequency spectrum waveform in Fig. 13.

2016378005 30 Oct 2019

Fig. 15 depicts an analysis result example of fast Fourier transform.

Fig. 16 is a flowchart for explaining a detailed operation of step SI 07 in Fig. 6.

Fig. 17 depicts an example of an operation of displaying an analysis result selected based on the position information, in which (a) depicts an extraction list of waveform data determined as similar, and (b) depicts an extraction list in which waveform data, for which it is determined that the position information is the same, of the waveform data of the extraction list of (a) is preferentially shown.

Fig. 18 depicts a screen example of the terminal device 10 in which two frequency spectrum waveforms are displayed.

Fig. 19 depicts a screen example where a separate frequency spectrum waveform having a different abnormal sound cause is displayed with respect to the screen example shown in Fig. 18.

Fig. 20 depicts another example of a display screen for displaying an abnormal sound cause with respect to the screen examples shown in Figs. 18 and 19.

EMBODIMENTS FOR CARRYING OUT THE INVENTION [0027] Hereinafter, an exemplary embodiment of the present invention will be described in detail with reference to the drawings.

[0028] Fig. 1 is a system view depicting a configuration of an abnormal sound diagnostic system of an exemplary embodiment of the present invention.

[0029] As shown in Fig. 1, the abnormal sound diagnostic system of the exemplary embodiment of the present invention comprises a portable terminal device 10 such as a personal computer, a smart phone, a tablet terminal device and the like, and a server apparatus 50.

2016378005 30 Oct 2019 [0030] In the meantime, the present invention can be applied to any device, as the terminal device 10, inasmuch as the device can be connected to the server apparatus 50 via a communication network. However, in the exemplary embodiment, a case where the terminal device 10 is a tablet terminal device comprising a device such as a microphone capable of acquiring sound information and a touch panel by which a touch input can be performed is described.

[0031] The terminal device 10 is carried by a service man (maintenance personnel) who manages and repairs an image forming apparatus 20 such as a printer, which is used by an end user, for example. The terminal device 10 is used to acquire an abnormal sound (unusual sound) signal generated in the image forming apparatus 20, to perform a frequency analysis on the acquired abnormal sound signal, and to display a frequency analysis result waveform of a past abnormal sound signal acquired from the server apparatus 50 and a frequency analysis result waveform of the acquired abnormal sound signal.

[0032] The terminal device 10 and the server apparatus 50 are connected to each other via a wireless LAN terminal 30 such as a Wi-Fi router and an Internet communication network 40 and are configured to transmit and receive information.

[0033] In the meantime, when the terminal device 10 is a portable phone device, a smart phone or the like, the terminal device 10 and the server apparatus 50 may be connected to each other via a portable phone network and configured to transmit and receive trouble information.

[0034] In the abnormal sound diagnostic system of the exemplary embodiment, when an abnormal sound is generated in the image forming apparatus 20, which is a target electronic device provided at a place of the end user, the service man goes to the place

2016378005 30 Oct 2019 of the image forming apparatus 20 with carrying the terminal device 10. Then, the service man performs an abnormal sound diagnosis of recording the generated abnormal sound to acquire an abnormal sound signal by using the terminal device 10 and specifying a cause of the abnormal sound.

[0035] In the meantime, it is technically viable to provide the image forming apparatus 20 with a microphone and the like for a recording function and to record the abnormal sound by the recording function when the abnormal sound is generated. However, when the image forming apparatus 20 is provided in an office or the like of the end user, it is difficult to provide the image forming apparatus 20 with a sound recording function due to security reasons.

[0036] Fig. 2 depicts a hardware configuration of the terminal device 10 of the abnormal sound diagnostic system of the exemplary embodiment.

[0037] As shown in Fig. 2, the terminal device 10 comprises a CPU 11, a memory 12 that can temporarily store data, a storage device 13 such as a flash memory, a wireless LAN interface (IF) 14 configured to transmit and receive data through wireless communication with the wireless LAN terminal 30, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. The constitutional elements are connected to each other via a control bus 18.

[0038] The terminal device 10 of the exemplary embodiment is provided with a touch panel in which a touch sensor for detecting a touch position is provided as the input device 15 on the display device 16. A display and an input from a user are performed through the touch panel.

[0039] The CPU 11 is configured to execute predetermined processing based on a control program stored in the memory 12 or the storage device 13, thereby controlling

2016378005 30 Oct 2019 an operation of the terminal device 10. In the meantime, the control program may be downloaded and provided to the CPU 11 through the Internet communication network 40 or portable phone network. Alternatively, the program may be provided to the CPU 11 with being stored in a storage medium such as a CD-ROM.

[0040] The above control program is executed, so that the terminal device 10 of the exemplary embodiment performs operations as described later, thereby helping the service man to specify the cause of the abnormal sound.

[0041] Fig. 3 is a block diagram depicting a functional configuration of the terminal device 10 that is implemented as the above control program is executed.

[0042] As shown in Fig. 3, the terminal device 10 of the exemplary embodiment comprises a sound acquisition unit 31, a frequency analysis unit 32, a controller 33, a sound data storage 34, a display 35, a communication unit 36, a sound playback unit 37, and a position reception unit 38.

[0043] The display 35 is configured to display a variety of data under control of the controller 33. The communication unit 36 is configured to perform communication with the server apparatus 50, which is an external apparatus. The sound playback unit 37 is configured to play back recorded sound data and the like and to convert into sound information under control of the controller 33.

[0044] The position reception unit 38 is configured to receive recording position information as position information, which is a position at which a sound of an abnormal sound generated in the image forming apparatus 20, which is an analysis target apparatus, is to be recorded (acquired).

[0045] The sound acquisition unit 31 is configured to input the abnormal sound generated in the image forming apparatus 20, which is an analysis target apparatus, and

2016378005 30 Oct 2019 to acquire the sound information.

[0046] The frequency analysis unit 32 is configured to perform a time-frequency analysis (time-dependent frequency analysis) on the sound information acquired by the sound acquisition unit 31 and to generate frequency spectrum waveform (frequency analysis result waveform) data indicative of a temporal change of a signal intensity distribution for each frequency of the acquired abnormal sound signal.

[0047] Specifically, the frequency analysis unit 32 is configured to perform STFT (Short time Fourier transform: Short time Fourier transform) on the sound information acquired by the sound acquisition unit 31 and to generate frequency spectrum waveform data. The STFT will be described later.

[0048] The controller 33 is configured to store the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the sound data storage 34, together with the sound data. Then, the controller 33 is configured to control so as to display a frequency spectrum waveform obtained by a result of the STFT on the display 35, which is a touch panel.

[0049] Thereafter, when a user performs a touch operation of tracing a region, which is estimated as a signal component of the abnormal sound, in the frequency spectrum waveform displayed on the display 35 that is a touch panel by a finger, for example, the controller 33 receives a designation of the region, in which the signal component of the abnormal sound is included, of the displayed frequency spectrum waveform based on the user’s touch operation.

[0050] Then, the controller 33 is configured to instruct the frequency analysis unit 32 to execute fast Fourier transform (1D-FFT (Fast Fourier Transform)) of performing the frequency analysis in a time-axis direction with respect to the frequency component of

2016378005 30 Oct 2019 the region designated as the region, in which the signal component of the abnormal sound is included, of the frequency spectrum waveform data obtained by the frequency analysis unit 32. For this reason, the frequency analysis unit 32 is configured to perform the fast Fourier transform in the time-axis direction with respect to the frequency component included in the instructed region.

[0051] Then, the controller 33 is configured to extract information of a period and a frequency of the abnormal sound from an analysis result of the fast Fourier transform in the frequency analysis unit 32.

[0052] In the meantime, even when the abnormal sound is not generated, a signal component of a usual operating sound is always included in a low-frequency region of a preset frequency or lower. For this reason, even when the region of the preset frequency or lower is designated as the region in which the signal component of the abnormal sound is included, the controller 33 may not receive the designation.

[0053] Also, the controller 33 is configured to transmit the received recording position information, the obtained information of the period and the frequency of the sound to the server apparatus 50 via the communication unit 36, together with model information such as a model name and a serial number of the image forming apparatus 20 and operating state information indicative of an operating state of the image forming apparatus 20. The operating state information may specifically include information as to whether a color printing or a monochrome printing, whether a duplex printing or oneside printing, whether an operation mode is a scan, a print or a copy, and a type of a sheet to be used. In this way, the controller 33 is configured to transmit the recording position information received from the position reception unit 38 and the information obtained from the frequency spectrum waveform data obtained by the frequency

2016378005 30 Oct 2019 analysis unit 32 to the server apparatus 50 via the communication unit 36.

[0054] The server apparatus 50 is configured to store spectrum waveform data, which is obtained by performing a frequency analysis on sound information of an abnormal sound previously generated in an apparatus equivalent to the image forming apparatus 20, together with information of original sound data, an operating state of the apparatus upon acquisition of the sound data, a cause of the abnormal sound, a method of coping with the abnormal sound, a generation position of the abnormal sound (abnormal sound generation position information), and the like.

[0055] The server apparatus 50 is configured to search for data based on the information of the period and the frequency of the abnormal sound and the recording position information transmitted from the terminal device 10 and to extract frequency spectrum waveform data, which corresponds to the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32. Then, the server apparatus 50 is configured to transmit the found frequency spectrum waveform data to the terminal device 10, together with information of sound data and the like stored as abnormal sound sample waveform data.

[0056] As a result, the controller 33 is configured to receive the frequency spectrum waveform data, which corresponds to the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32, from the server apparatus 50 via the communication unit 36.

[0057] The controller 33 is configured to control so as to display, on the display 35, the frequency spectrum waveform obtained by performing the frequency analysis on the sound information acquired by the sound acquisition unit 31 and the spectrum waveform received from the server apparatus 50 in parallel.

2016378005 30 Oct 2019 [0058] In the meantime, the controller 33 is configured to receive waveform data, which is preferentially selected based on the received recording position information from the plural frequency spectrum waveform data, of waveform data similar to the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 from the server apparatus 50 and to display the received waveform data on the display 35.

[0059] Subsequently, a functional configuration of the server apparatus 50 in the abnormal sound analysis system of the exemplary embodiment is described with reference to a block diagram of Fig. 4.

[0060] As shown in Fig. 4, the server apparatus 50 of the exemplary embodiment comprises a communication unit 51, a controller 52, and a waveform data storage 53.

[0061] The waveform data storage 53 is configured to store plural frequency spectrum waveform data, which is obtained by performing a frequency analysis on sound information of an abnormal sound previously generated in an apparatus equivalent to the image forming apparatus 20, which is an analysis target apparatus.

[0062] Specifically, as shown in Fig. 5, the waveform data storage 53 is configured to store information of frequency spectrum waveform data obtained by performing a timefrequency analysis on sound data of an abnormal sound acquired in advance, original sound data, a cause of the abnormal sound, a method of coping with the abnormal sound, an abnormal sound generation position and the like, for each model. The abnormal sound exists in plural regions of the apparatus, in many cases, and information of the plural regions is stored as the abnormal sound generation position.

[0063] When the information of the period and the frequency of the abnormal sound is received from the terminal device 10, the controller 52 selects waveform data, which is

2016378005 30 Oct 2019 similar to the frequency spectrum waveform data based on the abnormal sound acquired with the terminal device 10, from the plural frequency spectrum waveform data stored in the waveform data storage 53 based on the received information of the period and the frequency of the abnormal sound. Also, the controller 52 is configured to transmit waveform data, which is preferentially treated from the selected waveform data based on the received recording position information, to the terminal device 10 via the communication unit 51.

[0064] In the exemplary embodiment, the terminal device 10 is configured to perform the STFT and the fast Fourier transform for the sound data of the abnormal sound and to transmit the information of the period and the frequency of the abnormal sound to the server apparatus 50. However, the fast Fourier transform or both the STFT and the fast Fourier transform may be executed in the server apparatus 50.

[0065] In this case, the sound data of the abnormal sound is transmitted, as it is, or the frequency spectrum waveform data of the result obtained by performing the STFT for the sound data is transmitted from the terminal device 10 to the server apparatus 50, and the STFT or the fast Fourier transform is executed for the sound data in the server apparatus 50.

[0066] In the above exemplary embodiment, results, which are similar to the information of the frequency and the period of the abnormal sound, of the plural analysis results are extracted and a result is then extracted based on the position information of the abnormal sound. However, the present invention is not limited thereto. For example, results may be extracted based on the recording position information of the abnormal sound and then a result similar to the information of the frequency and the period of the abnormal sound may be extracted.

2016378005 30 Oct 2019 [0067] Also, the case where the plural regions in which a possibility of the abnormal sound generation is high is stored as the abnormal sound generation position information in the waveform data stored in the waveform data storage 53 has been described. However, the present invention is not limited thereto. The stored abnormal sound generation position information may be one, and a generation probability in each region may be stored.

[0068] Also, the information of the plural regions is stored as the abnormal sound generation position. However, the present invention is not limited thereto. For each waveform data, a region in which a possibility of the abnormal sound generation is high may be stored with a priority order.

[0069] Subsequently, an operation of the abnormal sound diagnostic system of the exemplary embodiment is described with reference to a sequence chart of Fig. 6.

[0070] When diagnosing the abnormal sound so as to specify a cause of the abnormal sound of the image forming apparatus 20 as a target apparatus, which is a measurement target, with the terminal device 10, an image as shown in Fig. 7 is displayed, and apparatus information such as a model name, a serial number, an operating state and the like is input (step S101).

[0071] Then, as shown in Fig. 8, an illustration image of an outer appearance of the image forming apparatus 20 corresponding to the input apparatus information is displayed on the screen (touch panel), which is the display 35 of the terminal device 10.

The terminal device 10 is displayed with auxiliary lines 90, 91, 92 for dividing the image forming apparatus 20 into six with being superimposed on the screen on which the image forming apparatus 20 is displayed.

The three auxiliary lines 90, 91, 92 are displayed so that the image forming

2016378005 30 Oct 2019 apparatus 20 is divided into six regions of a region a, a region b, a region c, a region d, a region e and a region f. In Fig. 8, information referred to as a front image A indicative of a direction of the apparatus is added, and the three auxiliary lines 90, 91, 92 are displayed so as to divide into a region Aa, a region Ab, a region Ac, a region Ad, a region Ae, and a region Af. When the user selects any one of the region Aa, the region Ab, the region Ac, the region Ad, the region Ae and the region Af on the screen and performs a touch operation (hereinafter, referred to as ‘tapping’) with a finger 65, it is possible to designate a recording position. The designated recording position is received as the recording position information by the controller 33.

[0072] Also, when the user performs the tapping of sliding the finger 65 on the screen in the right and left direction and the upper and lower direction from the front image A of the apparatus shown in Fig. 8, the outer appearance of the image forming apparatus 20 is displayed from a different direction, and the outer appearance of the image forming apparatus 20 is displayed with changing by 90°. That is, on the screen, the display image of the image forming apparatus 20 can be changed to any one of the front image A, a right-side image B, a rear image C, a left-side image D, a top image E.

Specifically, as shown in Fig. 9, whenever the user performs the tapping as sliding the image of the image forming apparatus 20 on the screen in the right and left direction, a posture of the image forming apparatus 20 changes from the front image A to the left-side image D or the right-side image B, from the right-side image B to the front image A or the rear image C, from the rear image C to the right-side image B or the left-side image D, and from the left-side image D to the rear image C or the front image A. Also, whenever the tapping as sliding in the upper and lower direction is performed, the posture changes from the front image A, the right-side image B, the rear

2016378005 30 Oct 2019 image C or the left-side image D to the top image E, and from the top image E to the front image A, the right-side image B, the rear image C or the left-side image D. That is, for each outer appearance of the image forming apparatus 20 of the different direction on the screen, the recording position information is changed based on the user’s operation. Also, the auxiliary lines 90, 91, 92 for division into the six regions are displayed with being superimposed on each of the images B to E, like the front image A, and the right-side image B is divided into regions Ba, Bb, Be, Bd, Be, Bf. The rear image C is divided into regions Ca, Cb, Cc, Cd, Ce, Cf. The left-side image D is divided into regions Da, Db, De, Dd, De, Df. The top image E is divided into regions Ea, Eb, Ec, Ed, Ee, Ef. The three auxiliary lines 90, 91, 92 are disposed so that the regions dividing the apparatus are different, in accordance with the apparatus information, the direction of the apparatus, and the like.

Here, although the illustration image of the outer appearance of the image forming apparatus 20 has been described, a photograph image of the outer appearance of the image forming apparatus 20 may be used. Also, although the tapping as sliding in the right and left direction and the upper and lower direction on the screen has been described, the present invention is not limited thereto. For example, a rotation arrow key may be provided on the screen and the image may be rotated by tapping the rotation arrow key.

That is, when the user designates a direction of the outer appearance of the image forming apparatus 20 for acquiring the sound information and further designates the divided region of the outer appearance of the apparatus, the recording position of the abnormal sound is received as the recording position information (step SI02).

[0073] Then, as shown in Fig. 10, the terminal device 10 sets an operation mode to a

2016378005 30 Oct 2019 sound recording mode and starts the recording by the microphone 17 close to the abnormal sound generation position at which the recording position information of the image forming apparatus 20 has been received, thereby acquiring the sound data (step S103).

[0074] Then, in the terminal device 10, the acquired sound data is subjected to the STFT by the frequency analysis unit 32, so that a frequency spectrum waveform indicative of a temporal change of a signal intensity distribution for each frequency is generated (step SI04).

[0075] As shown in Fig. 11, the STFT is processing of performing Fourier transform every short time and calculating a signal intensity for each frequency component in accordance with the temporal change. Fig. 12 depicts a waveform example where an analysis result obtained by the STFT is shown by one frequency spectrum waveform image.

[0076] In the example of the frequency spectrum waveform shown in Fig. 12, a horizontal axis indicates time, a vertical axis indicates a frequency and an intensity for each frequency is expressed by a color. Meanwhile, in Fig. 12, a difference of colors is expressed by a hatching pattern. Also, Fig. 12 exemplifies a case where the intensity for each frequency is expressed by a color. However, the intensity may also be expressed by a gradation.

[0077] In the example of the frequency spectrum waveform shown in Fig. 12, it can be seen that a frequency component 61 of the abnormal sound is periodically generated at a specific frequency. Meanwhile, in the example of the frequency spectrum waveform shown in Fig. 12, a low-frequency component is a usual operating sound and is not the frequency component of the abnormal sound.

2016378005 30 Oct 2019 [0078] When the frequency spectrum waveform as shown in Fig. 12 is obtained, the controller 33 displays the frequency spectrum waveform on the display 35. Then, as shown in Fig. 13, the controller 33 presents a display for urging the user to designate a region, which is estimated as the abnormal sound, to the displayed frequency spectrum waveform. In the example shown in Fig. 13, it can be seen that the characters “Please designate a region that is thought as the abnormal sound” are displayed, so that the user is urged to designate a region that is estimated as the abnormal sound.

[0079] By referring to the display like this, the user presented with the frequency spectrum waveform specifies the frequency component 61 of the abnormal sound and, for example, by operating the touch panel, selects a region in which the frequency component 61 of the abnormal sound is included.

[0080] Fig. 14 depicts an example of a selected region 80 selected in this way by the user. In the example shown in Fig. 14, it can be seen that a rectangular region including plural frequency components 61 of the abnormal sound is designated as the selected region 80.

[0081] When the selected region 80 is designated in this way, the fast Fourier transform (1D-FFT) is executed for the frequency components included in the selected region 80 by the frequency analysis unit 32 (step S105). Fig. 15 depicts an analysis result example of the fast Fourier transform executed in this way.

[0082] In Fig. 15, the period and the frequency of the signal of the frequency component for which the fast Fourier transform has been performed are detected so that the period and the frequency of the abnormal sound are specified. In the meantime, since the abnormal sound includes an overtone component and the like, plural periods may be detected. However, a period in which the signal intensity is strongest is

2016378005 30 Oct 2019 detected as the period of the abnormal sound.

[0083] Also, a signal component of a long period equal to or longer than a predetermined period is considered as a usual operating sound or a noise of an irregular period. Therefore, a region of the signal component of the long period is set as a determination exclusion region 62. An analysis result in the determination exclusion region 62 is ignored.

[0084] Also, since a low-frequency signal component of a predetermined frequency or lower is not distinguished from a usual operating sound, such a region of the lowfrequency signal component is set as a determination exclusion region 63. An analysis result in the determination exclusion region 63 is ignored.

[0085] The terminal device 10 transmits the information of the frequency and the period of the abnormal sound obtained by the analysis result of the fast Fourier transform and the recording position information related to the recording position at which the abnormal sound has been recorded to the server apparatus 50, together with the model information and the information of the operating state (step SI06). For example, the information that the recording position is the region Ab, a frequency of the abnormal sound is 4 kHz and a period of the abnormal sound is 2.0 seconds is transmitted to the server apparatus 50.

[0086] Then, the server apparatus 50 searches the waveform data storage 53 based on the received information of the frequency and the period of the abnormal sound (step S107).

[0087] The operation in the step SI07 is described in detail with reference to a flowchart of Fig. 16 and an example of Fig. 17 depicting an operation of displaying an analysis result selected based on the position information. In Fig. 17, an example

2016378005 30 Oct 2019 where the region Ab is received as the recording position information is described.

[0088] The server apparatus 50 receives the information of the frequency and the period of the abnormal sound and the recording position information from the terminal device 10 (step S201).

[0089] Then, it is determined whether the received information of the frequency and the period of the abnormal sound is similar to the waveform data stored in the waveform data storage 53 (step S202). The waveform data determined as similar is extracted (step S203). The determination in step S202 is executed for all the waveform data stored in the waveform data storage 53 (step S204), so that an extraction list as shown in (a) of Fig. 17 is generated (step S205). Here, in Fig. 17, only the frequency analysis result waveform data and abnormal sound generation position information are extracted and shown. However, the information of the original sound data, the cause of the abnormal sound, the coping method thereof and the like, which is shown in Fig. 5, is also stored in association with the waveform data.

[0090] Then, it is determined whether there is the abnormal sound generation position information of the waveform data of the extraction list generated in step S205, which matches the received recording position information (step S206).

The waveform data, which is determined to have the matched position information, of the extraction list generated in step S205 is selected and is preferentially extracted (step S207). Then, it is determined whether the determination of step S206 has been performed for all the waveform data of the generated extraction list (step S208).

[0091] That is, the waveform data, which has the region Ab as the abnormal sound generation position information, of the extraction list shown in (a) of Fig. 17 is

2016378005 30 Oct 2019 extracted, and as shown in (b) of Fig. 17, waveform data 1, waveform data 4 and waveform data 5 having the region Ab are preferentially (highly) treated in the extraction list.

[0092] Then, the server apparatus 50 transmits the extracted frequency spectrum waveform data to the terminal device 10, together with the information of the original sound data, the cause of the abnormal sound, the coping method thereof and the like (step SI08).

[0093] The terminal device 10 receives the frequency spectrum waveform data transmitted from the server apparatus 50 (step SI09). Then, the controller 33 of the terminal device 10 displays, on the display 35, the received frequency spectrum waveform and the frequency spectrum waveform obtained by the STFT (step SI 10).

[0094] Fig. 18 depicts a screen example of the terminal device 10, in which the two frequency spectrum waveforms are displayed in this way.

[0095] In the screen example of Fig. 18, the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as “the analysis result waveform of the abnormal sound recorded this time”. Also, it can be seen that the frequency spectrum waveform preferentially selected (having a high priority) by the recording position information and transmitted from the server apparatus 50 is displayed as “the past abnormal sound data” together with the cause of the abnormal sound “abrasion of the photosensitive drum”.

[0096] The service man who intends to perform the abnormal sound diagnosis compares the two frequency spectrum waveforms and determines whether the abnormal sound components in the waveforms are similar, thereby specifying the cause of the abnormal sound.

2016378005 30 Oct 2019 [0097] Also, when plural frequency spectrum waveforms are transmitted from the server apparatus 50, by tracing an image of the frequency spectrum waveform displayed as “the past abnormal sound data” in the horizontal direction by a touch operation, for example, so that a separate frequency spectrum waveform having the second highest priority is displayed, as shown in Fig. 19.

[0098] Fig. 19 depicts an image example where the frequency spectrum waveform of the abnormal sound is displayed when the cause of the abnormal sound is “a trouble of the drive system motor”.

[0099] Like this, when the plural frequency spectrum waveforms are transmitted, the waveform having a higher possibility of the generation cause of the abnormal sound is first selected and displayed. The service man determines to which frequency spectrum waveforms, which are displayed in order of the higher possibility of the generation cause of the abnormal sound, the frequency spectrum waveform of the abnormal sound acquired this time is more similar, thereby specifying the cause of the abnormal sound. In the meantime, when specifying the cause of the abnormal sound, the service man hears and compares the abnormal sound acquired this time and the sound corresponding to the frequency spectrum waveform transmitted from the server apparatus 50 by playing back the original sound data with the sound playback unit 37, not only the comparison of the shapes of the frequency spectrum waveforms, the period and the frequency of the abnormal sound component, the acquisition position of the abnormal sound and the like, and then specifies the cause of the abnormal sound.

[0100] Fig. 20 depicts another example of a display screen for displaying a generation cause of the abnormal sound.

[0101] Fig. 20 depicts a screen example where only a generation cause of the abnormal

2016378005 30 Oct 2019 sound and a coping method thereof are displayed, i.e., a cause of the abnormal sound “abrasion of the photosensitive drum” and a coping method “replace the photosensitive drum” are displayed.

Like this, the generation cause part of the abnormal sound and the component number may be designated and displayed.

[0102] [Modified Embodiments]

The above exemplary embodiment has been described using the case where the server apparatus 50 performs the operation based on the recording position information. However, the present invention is not limited thereto. The operation may be performed in the terminal device 10.

[0103] The above exemplary embodiment has been described using the case where the terminal device 10 is a tablet terminal device. However, the present invention is not limited thereto. For example, the operation panel of the image forming apparatus 20 may be used as the terminal device if the operation panel can be detached from a main body and has embedded functions of performing communication with the server apparatus 50 and acquiring the sound information.

[0104] Also, the above exemplary embodiment has been described using the case where the terminal device 10 has the microphone 17 embedded therein. However, when the terminal device 10 has a sound recording function, the acquisition unit of the sound information may be implemented by connecting a sound collection device such as the microphone to an outside.

[0105] Also, the above exemplary embodiment has been described using the case where the target apparatus of the abnormal sound analysis is the image forming apparatus. However, the target apparatus of the abnormal sound analysis is not limited

2016378005 30 Oct 2019 to the image forming apparatus. The present invention can be applied to other apparatus inasmuch as the apparatus may cause the abnormal sound having periodicity. [0106] In the above, the diverse exemplary embodiments have been described. However, the exemplary embodiments may be combined.

Also, the present disclosure is not limited to the above exemplary embodiment and can be implemented in diverse forms without departing from the gist of the present disclosure.

The present application is based on Japanese Patent Application No. 2015254322 filed on December 25, 2015, the contents of which are incorporated herein as reference.

Description of Reference Numerals [0107] 10: terminal device

11: CPU

12: memory

13: storage device

14: wireless LAN interface (IF)

15: input device

16: display device

17: microphone

18: control bus

20: image forming apparatus

30: wireless LAN terminal

31: sound acquisition unit

2016378005 30 Oct 2019

32: frequency analysis unit

33: controller

34: sound data storage

35: display

36: communication unit

37: sound playback unit

38: position reception unit

40: Internet communication network

50: server apparatus

51: communication unit

52: controller

53: waveform data storage

61: frequency component of abnormal sound

62, 63: determination exclusion region

65: finger

90, 91, 92: auxiliary line

2016378005 30 Oct 2019

Claims

1. A terminal device comprising:

an acquisition unit that acquires sound information;

a reception unit that receives position information related to a position at which the sound information is to be acquired, a display that displays at least one of an analysis result selected from a plurality of analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition unit and the position information received by the reception unit, and information associated with the selected analysis result, a frequency analysis unit that performs a time-frequency analysis on the sound information acquired by the acquisition unit and generates an analysis result indicative of a temporal change of an intensity distribution for each frequency, a transmission unit that transmits information obtained from the analysis result generated by the frequency analysis unit, the position information received by the reception unit and apparatus information related to a measurement target apparatus to an external apparatus, and a receiving unit that receives an analysis result, which is selected based on the position information received by the reception unit from a plurality of analysis results obtained by a frequency analysis on a sound signal, of analysis results similar to the analysis results generated by the frequency analysis unit from the external apparatus, wherein the display displays the analysis result generated by the frequency

2016378005 30 Oct 2019 analysis unit and the analysis result received by the receiving unit.

2. The terminal device according to claim 1, wherein the display displays a different analysis result in correspondence to the position information received by the reception unit.

3. The terminal device according to claims 1 or 2, wherein when displaying a plurality of analysis results, the display changes an order of the analysis results to be displayed, in correspondence to the position information received by the reception unit.

4. The terminal device according to any one of claims 1 to 3, wherein the display displays an outer appearance of a target apparatus, which is a measurement target, and wherein the reception unit receives position information of the target apparatus to be displayed on the display.

5. The terminal device according to claim 4, wherein the display displays an outer appearance of a direction different from the outer appearance of the target apparatus, and wherein the reception unit receives the position information of the target apparatus to be displayed on the display, for each outer appearance of the different direction.

2016378005 30 Oct 2019

6. A diagnostic system comprising:

a terminal device comprising:

an acquisition unit that acquires sound information;

a reception unit that receives position information related to a position at which the sound information is to be acquired, a display that displays at least one of an analysis result selected from a plurality of analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition unit and the position information received by the reception unit, and information associated with the selected analysis result, and a server apparatus comprising:

a storage that stores a plurality of analysis results obtained by performing a frequency analysis on a sound signal and generation position information of a sound, wherein generation position information is position information at which the sound was generated, and a transmission unit that, when information obtained from an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition unit is received from the terminal device, together with the position information received by the reception unit, transmits at least one of an analysis result selected from the plurality of analysis results stored in the storage, the analysis result being selected based on the received analysis result and the position information received by the reception unit, and information

2016378005 30 Oct 2019 associated with the selected analysis result to the terminal device, and a frequency analysis unit that performs a time-frequency analysis on the sound information acquired by the acquisition unit and generates an analysis result indicative of a temporal change of an intensity distribution for each frequency, a transmission unit that transmits information obtained from the analysis result generated by the frequency analysis unit, the position information received by the reception unit and apparatus information related to a measurement target apparatus to an external apparatus, and a receiving unit that receives an analysis result, which is selected based on the position information received by the reception unit from a plurality of analysis results obtained by a frequency analysis on a sound signal, of analysis results similar to the analysis results generated by the frequency analysis unit from the external apparatus, wherein the display displays the analysis result generated by the frequency analysis unit and the analysis result received by the receiving unit.

7. A diagnostic method comprising:

an acquisition step of acquiring sound information;

a reception step of receiving position information related to a position at which the sound information is to be acquired, and a display step of displaying at least one of an analysis result selected from a plurality of analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition step and the position information received by the reception step, and information associated with the selected

2016378005 30 Oct 2019 analysis result, a frequency analysis step of performing a time-frequency analysis on the sound information acquired at the acquisition step and generating an analysis result indicative of a temporal change of an intensity distribution for each frequency, a transmission step of transmitting information obtained from the analysis result generated at the frequency analysis step, the position information received at the reception step and apparatus information related to a measurement target apparatus to an external apparatus, and a second reception step of receiving, at a reception unit, an analysis result, which is selected based on the position information received by the reception unit from a plurality of analysis results obtained by a frequency analysis on a sound signal, of analysis results similar to the analysis results generated at the frequency analysis step from the external apparatus, wherein the display step includes displaying the analysis result generated at the frequency analysis step and the analysis result received by the receiving unit.

8. A program that enables a computer to execute:

an acquisition step of acquiring sound information;

a reception step of receiving position information related to a position at which the sound information is to be acquired, and a display step of displaying at least one of an analysis result selected from a plurality of analysis results obtained by a frequency analysis on a sound signal, the analysis result being selected based on an analysis result obtained by a frequency analysis on the sound information acquired by the acquisition step and the position

2016378005 30 Oct 2019 information received by the reception step, and information associated with the selected analysis result a frequency analysis step of performing a time-frequency analysis on the sound information acquired at the acquisition step and generating an analysis result indicative of a temporal change of an intensity distribution for each frequency, a transmission step of transmitting information obtained from the analysis result generated at the frequency analysis step, the position information received at the reception step and apparatus information related to a measurement target apparatus to an external apparatus, and a second reception step of receiving, at a reception unit, an analysis result, which is selected based on the position information received by the reception unit from a plurality of analysis results obtained by a frequency analysis on a sound signal, of analysis results similar to the analysis results generated at the frequency analysis step from the external apparatus, wherein the display step includes displaying the analysis result generated at the frequency analysis step and the analysis result received by the receiving unit.