JP6763255B2 - Diagnostic equipment, diagnostic systems and programs - Google Patents

Description

The present invention relates to diagnostic devices, diagnostic systems and programs.

Patent Document 1 includes a RAM or ROM that stores a normal operating sound of the image forming apparatus, and a microphone that detects an operating sound generated by the image forming apparatus, and is stored in the RAM or ROM. A system for identifying an abnormal portion of an image forming apparatus based on a first sound information, a second sound information detected by a microphone, and an operation information of the image forming apparatus is disclosed.

Patent Document 2 describes a sound conversion unit that converts sound inside the device into an electric signal in an image processing device having an image forming unit that forms an image on the printing paper and a conveying unit that conveys the printing paper. An image processing device including a sound analysis unit that analyzes an electric signal converted by a sound conversion unit to obtain a component for each frequency and an output unit that outputs a component for each frequency obtained by the sound analysis unit is disclosed. There is.

JP-A-2007-079263 Japanese Unexamined Patent Publication No. 2008-290288

When an abnormal noise (abnormal sound) occurs in a certain device, the voice generated in the device to be analyzed is input to acquire a voice signal, and the acquired voice signal and a device equivalent to the device to be analyzed have generated in the past. In some cases, it is attempted to clarify the cause of the abnormal noise by comparing it with the voice signal of the abnormal noise.

In such a case, by performing time-frequency analysis of the acquired sound information, a frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency can be obtained, and a region including an abnormal sound in this frequency spectrum waveform can be obtained. By frequency analysis again, information on the period and frequency of abnormal sounds included in the frequency spectrum waveform can be obtained. Then, based on the obtained information on the period and frequency of the abnormal sound, the frequency spectrum waveform of the sound information acquired this time is compared with the frequency spectrum waveform of the abnormal sound generated in the past to cause the abnormal sound. We are clarifying.

However, for an inexperienced user, when the abnormal sound is a periodic sound, it is difficult to determine which region of the frequency spectrum waveform contains the abnormal sound. Even in such a case, if the abnormal sound is a periodic sound, it is relatively easy to discriminate the abnormal sound on the screen displaying the information on the period and frequency of the abnormal sound.

On the contrary, when the abnormal sound is a continuous sound, it is relatively easy to determine in which region the abnormal sound is included in the frequency spectrum waveform. However, when the abnormal sound is a continuous sound, it is difficult to distinguish it from the normal operation sound and the indefinite period noise on the screen displaying the cycle and frequency information of the abnormal sound. Is difficult.

An object of the present invention is a diagnostic device capable of switching and displaying an analysis result screen that is easy to discriminate according to the type of sound when sound information is acquired and frequency analysis is performed to discriminate the contained sound. To provide diagnostic systems and programs.

[Diagnostic device]
The present invention according to claim 1 comprises an acquisition means for inputting generated sound and acquiring sound information.
The first screen displaying the frequency spectrum waveform showing the time change of the signal intensity distribution for each frequency obtained by performing the time-frequency analysis of the acquired sound information, and the frequency by frequency-analyzing the frequency spectrum waveform. It is a diagnostic device provided with a display means for switching and displaying a second screen showing information on the period and frequency of sound included in the spectrum waveform according to the operation of the user.

The present invention according to claim 2 is the diagnostic device according to claim 1, wherein the display means displays the first screen when the user selects that he / she wants to refer to the analysis result of continuous sound.

The present invention according to claim 3 is the diagnostic apparatus according to claim 1, wherein the display means displays the second screen when the user selects that he / she wants to refer to the analysis result of the periodic sound.

According to the fourth aspect of the present invention, when the display means displays the first and second screens in parallel and one of the first and second screens displayed in parallel is selected. The diagnostic device according to any one of claims 1 to 3, which displays the selected screen.

According to the fifth aspect of the present invention, the time-frequency analysis of the sound information acquired by the acquisition means is performed to generate the frequency spectrum waveform, and the frequency component included in the region specified by the user in the frequency spectrum waveform. The diagnostic apparatus according to any one of claims 1 to 4, further comprising a frequency analysis means for performing frequency analysis on the device.

According to the sixth aspect of the present invention, when a plurality of regions are specified by the display means in the frequency spectrum waveform, the period and frequency obtained by performing frequency analysis on the frequency components included in the respective regions. The diagnostic device according to claim 5, wherein the information of the above is displayed by different methods on the second screen.

According to the seventh aspect of the present invention, when a plurality of regions are repeatedly specified by the display means in the frequency spectrum waveform, the period and the period obtained by performing frequency analysis on the frequency components included in the respective regions. The diagnostic device according to claim 5, wherein the frequency information is displayed on the second screen so that the designated order can be understood.

The present invention according to claim 8 is a communication means for communicating with an external device and a communication means.
A transmission means for transmitting the period and frequency information selected by the user from the plurality of period and frequency information displayed on the second screen to the external device via the communication means.
Further provided with a receiving means for receiving a registered frequency spectrum waveform corresponding to the period and frequency information transmitted by the transmitting means from an external device via the communication means.
The diagnostic apparatus according to claim 6 or 7, wherein the display means displays the registered frequency spectrum waveform received by the receiving means and the frequency spectrum waveform generated by the frequency analysis means side by side.

According to the ninth aspect of the present invention, the acquisition means for inputting the generated sound to acquire the sound information and the time change of the signal intensity distribution for each frequency obtained by performing the time-frequency analysis of the acquired sound information are obtained. The user operates the first screen for displaying the represented frequency spectrum waveform and the second screen for displaying information on the period and frequency of the sound included in the frequency spectrum waveform by frequency analysis of the frequency spectrum waveform. The frequency spectrum waveform is generated by performing time-frequency analysis of the sound information acquired by the display means and the sound information acquired by the acquisition means, and the frequency spectrum waveform is included in the region specified by the user in the frequency spectrum waveform. The user selects from the frequency analysis means for performing frequency analysis on the frequency component, the communication means for communicating with the external device, and the plurality of period and frequency information displayed on the second screen. A first transmission means for transmitting the generated period and frequency information to the external device via the communication means, and a registered frequency spectrum corresponding to the period and frequency information transmitted by the first transmission means. A diagnostic device including a receiving means for receiving a waveform from an external device via the communication means, and a diagnostic device.
A storage means for storing a plurality of frequency spectrum waveforms obtained by frequency analysis of sound information of abnormal sound, and when sound cycle and frequency information is received from the diagnostic device, the storage means stored in the storage means. Diagnosis including a server device provided with a second transmission means for selecting a frequency spectrum waveform corresponding to received sound cycle and frequency information from a plurality of frequency spectrum waveforms and transmitting the frequency spectrum waveform to the diagnostic device. It is a system.

[program]
The present invention according to claim 10 includes an acquisition step of inputting generated sound and acquiring sound information.
The first screen displaying the frequency spectrum waveform showing the time change of the signal intensity distribution for each frequency obtained by performing the time-frequency analysis of the acquired sound information, and the frequency by frequency-analyzing the frequency spectrum waveform. This is a program for causing a computer to execute a display step of switching and displaying a second screen showing information on the period and frequency of sounds included in a spectrum waveform according to a user's operation.

According to the present invention according to claims 1 to 3, when sound information is acquired and frequency analysis is performed to discriminate the contained sound, an analysis result screen that is easy to discriminate is switched and displayed according to the type of sound. It is possible to provide a diagnostic device capable of this.

According to the fourth aspect of the present invention, the display screen is switched between the parallel display of two types of analysis result screens and the display of only one of the analysis result screens, sound information is acquired, and frequency analysis is performed. It is possible to provide a diagnostic device capable of switching and displaying an analysis result screen that is easy to discriminate according to the type of sound when discriminating the sounds included in the sound.

According to the fifth aspect of the present invention, it is possible to provide a diagnostic device capable of acquiring two types of analysis results from the acquired sound information.

According to the sixth aspect of the present invention, in the frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency, a plurality of regions are designated, and the period and frequency of the frequency component included in each region are analyzed. It is possible to provide a diagnostic device capable of acquiring the result.

According to the seventh aspect of the present invention, in the frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency, the designation of the region is repeated a plurality of times to determine the period and frequency of the frequency component included in each region. It is possible to provide a diagnostic device capable of acquiring the analysis result.

According to the eighth aspect of the present invention, there is provided a diagnostic apparatus capable of acquiring a registered frequency spectrum waveform corresponding to the acquired sound information and displaying it side by side with the frequency waveform of the acquired sound information. be able to.

According to the ninth aspect of the present invention, when sound information is acquired and frequency analysis is performed to discriminate the contained sound, the analysis result screen that is easy to discriminate can be switched and displayed according to the type of sound. A possible diagnostic system can be provided.

According to the tenth aspect of the present invention, when sound information is acquired and frequency analysis is performed to discriminate the contained sound, the analysis result screen that is easy to discriminate can be switched and displayed according to the type of sound. Possible programs can be provided.

It is a system diagram which shows the structure of the abnormal noise diagnosis system of one Embodiment of this invention. It is a block diagram which shows the hardware structure of the abnormal noise diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the functional structure of the abnormal noise diagnostic apparatus 10 in one Embodiment of this invention. It is a block diagram which shows the functional structure of the server apparatus 50 in one Embodiment of this invention. It is a figure which shows an example of the information stored in the waveform data storage part 53 in FIG. It is a sequence chart for demonstrating the operation of the abnormal noise diagnosis system of one Embodiment of this invention. It is a figure which shows the display screen example of the abnormal noise diagnosis apparatus 10 when inputting various information such as a model name, a serial number, and an operating state. It is a figure for demonstrating the concept of STFT. It is a figure which shows the image example of the frequency spectrum waveform based on the analysis result obtained by the FTFT. It is a figure which shows an example of the selection area 80 selected by the user in the image example of the frequency spectrum waveform of FIG. It is a figure which shows the analysis result example of the fast Fourier transform. It is a figure which shows the screen example of the abnormal noise diagnostic apparatus 10 which displayed two frequency spectrum waveforms. It is a figure which shows the image example of the frequency spectrum waveform when the frequency analysis result of an abnormal sound is actually performed. It is a figure which shows the example of the STFT analysis result screen when the abnormal sound is a continuous sound. It is a figure which shows the example of the 1D-FFT analysis result screen when the abnormal sound is a periodic sound. It is a figure which shows the example of the 1D-FFT analysis result screen when the abnormal sound is a continuous sound. It is a figure which shows the screen example at the time of displaying the STFT analysis result screen and 1D-FFT analysis result screen in parallel. It is a figure which shows the case where the CTRL analysis result screen is displayed. It is a figure which shows the case where the 1D-FFT analysis result screen is displayed. It is a figure for demonstrating how the display is switched between three display modes. It is a figure for demonstrating how the analysis result for a selection area 80 and the analysis result for other areas are displayed by different display methods. It is a figure for demonstrating how the analysis result in the first selection area 81 and the analysis result in the second selection area 82 are displayed by different display methods on the FTFT analysis result screen. It is a figure for demonstrating how the analysis result in each area is displayed by the different display method when a plurality of areas are designated in the FTFT analysis result screen.

Next, an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a system diagram showing a configuration of an abnormal noise diagnosis system according to an embodiment of the present invention.

As shown in FIG. 1, the abnormal noise diagnostic system according to the embodiment of the present invention includes a portable abnormal noise diagnostic device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50. ..

The present invention can be applied to the abnormal noise diagnostic device 10 as long as it can be connected to the server device 50 via a communication network. However, in the present embodiment, the case where the abnormal noise diagnostic device 10 is a device such as a microphone capable of acquiring an audio signal and a tablet terminal device provided with a touch panel capable of touch input will be described.

The abnormal noise diagnostic device 10 is carried by a serviceman (maintenance personnel) who performs maintenance management, repair, and the like of the image forming apparatus 20 such as a printer used by the end user, and the abnormal noise (abnormality) generated in the image forming apparatus 20 is carried. Sound) signal is acquired and the acquired abnormal noise signal is frequency-analyzed, or the waveform of the frequency analysis result of the registered past abnormal noise signal acquired from the server device 50 and the frequency analysis result of the acquired abnormal noise signal. Used to display waveforms.

The abnormal noise diagnosis device 10 and the server device 50 are connected to each other via a wireless LAN terminal 30 such as a Wi-Fi router or an Internet communication network 40 to transmit and receive information.

When the abnormal noise diagnostic device 10 is a mobile phone device, a smartphone, or the like, the abnormal noise diagnostic device 10 and the server device 50 are connected to each other via a mobile phone network to transmit and receive defect information. It is also possible.

In the abnormal noise diagnosis system of the present embodiment, when an abnormal noise is generated in the image forming apparatus 20 which is a target electronic device installed at the place of the end user, the serviceman carries the abnormal noise diagnostic apparatus 10 with the image forming apparatus. Go to 20 places. Then, the serviceman acquires the abnormal noise signal by recording the abnormal noise generated by using the abnormal noise diagnostic device 10, and performs the abnormal noise diagnosis for identifying the cause of the abnormal noise.

Although it is technically possible to provide the image forming apparatus 20 with a microphone or the like to have a recording function and record the abnormal noise by the recording function when an abnormal noise is generated, the image forming apparatus 20 When installed in an end user's office or the like, it is not possible to provide the image forming apparatus 20 with a function of recording voice for security reasons.

Next, FIG. 2 shows the hardware configuration of the abnormal noise diagnosis device 10 in the abnormal noise diagnosis system of the present embodiment.

As shown in FIG. 2, the abnormal noise diagnostic device 10 performs wireless communication with the CPU 11, the memory 12 capable of temporarily storing data, the storage device 13 such as a flash memory, and the wireless LAN terminal 30 to perform data. It has a wireless LAN interface (IF) 14 for transmitting and receiving data, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. These components are connected to each other via a control bus 18.

The abnormal noise diagnostic device 10 of the present embodiment is provided with a touch panel provided as an input device 15 with a touch sensor for detecting a touch position on the display device 16, and the display is performed using the touch panel. Input from the user is performed.

The CPU 11 executes a predetermined process based on the control program stored in the memory 12 or the storage device 13 to control the operation of the abnormal noise diagnosis device 10. This control program can also be obtained by downloading via the Internet communication network 40 or the mobile phone line network and provided to the CPU 11, and the program is stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.

The abnormal noise diagnostic device 10 of the present embodiment performs the operations as described below when the above control program is executed, and assists the serviceman in the work of identifying the cause of the abnormal noise.

FIG. 3 is a block diagram showing a functional configuration of the abnormal noise diagnosis device 10 realized by executing the above control program.

As shown in FIG. 3, the abnormal noise diagnosis device 10 of the present embodiment includes a voice acquisition unit 31, a frequency analysis unit 32, a control unit 33, a voice data storage unit 34, a display unit 35, and a communication unit. 36 and a voice reproduction unit 37 are provided.

The display unit 35 displays various data based on the control by the control unit 33. The communication unit 36 communicates with the server device 50, which is an external device. The voice reproduction unit 37 reproduces the recorded voice data or the like and converts it into a voice signal based on the control by the control unit 33.

The voice acquisition unit 31 acquires a voice signal by inputting the voice of abnormal noise generated in the image forming device 20 which is the device to be analyzed.

In the present embodiment, the voice acquisition unit 31 is described as inputting the voice of the abnormal sound generated in the image forming apparatus 20 to acquire the voice signal. However, the voice is an example of the sound, and the voice is used. The signal is an example of sound information.

The frequency analysis unit 32 performs time-frequency analysis (time-dependent frequency analysis) of the voice signal acquired by the voice acquisition unit 31, and represents the time change of the signal intensity distribution for each frequency of the acquired abnormal sound signal. Generates spectral waveform data (first analysis result). The frequency spectrum waveform data is an analysis result obtained by performing frequency analysis.

Specifically, the frequency analysis unit 32 generates frequency spectrum waveform data by performing an STFT (Short time Fourier transform) on the audio signal acquired by the audio acquisition unit 31. The description of this FTFT will be described later.

The control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the voice data storage unit 34 together with the voice data.

Further, the control unit 33 performs a fast Fourier transform (1D-FFT) that performs frequency analysis in the time axis direction for a frequency component estimated to be an abnormal sound in the frequency spectrum waveform data obtained by the frequency analysis unit 32. (Fast Fourier Transform)) is instructed to the frequency analysis unit 32.

Here, the control unit 33 may extract a signal component having periodicity from the frequency spectrum waveform data and select the signal component as a signal component having a high possibility of abnormal noise. .. Further, the control unit 33 displays the obtained frequency spectrum waveform data on the display unit 35, and specifies a frequency component that is likely to be an abnormal sound by the user who sees the frequency spectrum waveform, thereby that frequency. The component may be selected as a signal component that is likely to be an abnormal sound.

Then, the frequency analysis unit 32 performs a fast Fourier transform in the time axis direction on the frequency component estimated to be an abnormal sound based on the instruction by the control unit 33.

Then, the control unit 33 acquires information on the period and frequency of the abnormal sound based on the analysis result of the fast Fourier transform in the frequency analysis unit 32.

Further, the control unit 33 uses the acquired abnormal noise cycle and frequency information together with the model information such as the model name and serial number of the image forming apparatus 20 and the operating state information indicating the operating state of the image forming apparatus 20 together with the communication unit 36. Is transmitted to the server device 50 via. Specifically, this operation status information includes information such as whether it is color printing or black-and-white printing, double-sided printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included. In this way, the control unit 33 transmits the information obtained from the frequency spectrum waveform data obtained by the frequency analysis unit 32 to the server device 50 via the communication unit 36.

In the server device 50, the original audio data and the audio data were acquired from the spectral waveform data obtained by performing frequency analysis of the audio signal of the abnormal sound generated in the past in an apparatus equivalent to the apparatus of the image forming apparatus 20. It stores information such as the operating status of the device, the cause of abnormal noise, and how to deal with abnormal noise.

Then, the server device 50 receives frequency spectrum waveform data (corresponding to the frequency spectrum waveform data obtained as a result of frequency analysis by the frequency analysis unit 32 from the information on the period and frequency of the abnormal sound transmitted from the abnormal sound diagnostic device 10. The second analysis result) is searched, and the found frequency spectrum waveform data is transmitted to the abnormal sound diagnostic device 10 together with information such as voice data stored as sample waveform data of abnormal sound.

As a result, the control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.

The control unit 33 displays the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the spectrum waveform received from the server device 50 in parallel on the display unit 35.

At this time, the control unit 33 has at least one of the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50. The display content is changed in the time axis direction based on the operation of the user (user).

The control unit 33 ensures that the frequency spectrum waveform obtained by frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the periodic waveform in the frequency spectrum waveform transmitted from the server device 50 match. In addition, the display content in the time axis direction in at least one of the two frequency spectrum waveforms may be changed.

Here, as a specific example of changing the display content of the frequency spectrum waveform in the time axis direction, changing the display position of the frequency spectrum waveform in the time axis direction can be mentioned.

The waveform of either one of the frequency spectrum waveform obtained by frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50 is the other waveform. It is set to have a longer waveform than that.

As an example, in the present embodiment, the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 is data for about 10 seconds and is transmitted from the server device 50. The frequency spectrum waveform is data for about 8 seconds.

Further, when there are a plurality of frequency spectrum waveform data transmitted from the server device 50, the control unit 33 may use the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 among the plurality of frequency spectrum waveform data. The ones having a high degree of similarity are displayed on the display unit 33 with priority.

Further, the control unit 33 is a waveform of either one of the frequency spectrum waveform obtained by performing frequency analysis of the voice signal acquired by the voice acquisition unit 31 and the frequency spectrum waveform transmitted from the server device 50. When one of the waveforms is enlarged or reduced, the other waveform is enlarged or reduced so as to have the same size.

Further, the control unit 33 is the image forming apparatus when the process speed (image forming speed) of the image forming apparatus 20 when the different sound wave type is acquired and the frequency spectrum waveform transmitted from the server apparatus 50 are acquired. If the process speeds are different from each other, the length of the frequency spectrum waveform transmitted from the server device 50 in the time axis direction may be expanded or contracted and displayed based on these two process speeds.

This is because the period of abnormal noise generated changes as the process speed changes, so it is not possible to make a correct comparison by comparing them as they are. Further, acquiring and preparing abnormal noise data for each of a plurality of process speeds increases the amount of data and also increases the time and effort required to acquire the abnormal noise data.

Further, when the user instructs to reproduce the voice data, the voice reproduction unit 37 controls the voice data acquired by the voice acquisition unit 31 and the frequency transmitted from the server device 50 based on the control from the control unit 33. The audio data corresponding to the spectrum waveform may be reproduced as a left signal and a right signal for stereo reproduction, respectively.

Further, in order to facilitate the comparison of the two frequency spectrum waveforms, the control unit 33 has an adjustable frequency auxiliary line indicating the same frequency on the two frequency spectrum waveforms displayed in parallel, and a time axis direction. Adjustable common time axis auxiliary lines for comparing the positions of the may be superimposed and displayed.

Next, the functional configuration of the server device 50 in the abnormal noise analysis system of the present embodiment will be described with reference to the block diagram of FIG.

As shown in FIG. 4, the server device 50 of the present embodiment includes a communication unit 51, a control unit 52, and a waveform data storage unit 53.

The waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of an audio signal of an abnormal sound generated in the past in a device equivalent to the image forming device 20 which is a device to be analyzed.

Specifically, as shown in FIG. 5, the waveform data storage unit 53 includes frequency spectrum waveform data obtained by time-frequency analysis of audio data of abnormal sounds acquired in advance, and original audio. Information such as data, the cause of abnormal noise, and how to deal with it is stored for each model.

Then, when the control unit 52 receives the information on the period and frequency of the abnormal sound from the abnormal sound diagnostic device 10, the received difference is obtained from the waveform data of the plurality of frequency spectra stored in the waveform data storage unit 53. Based on the sound cycle and frequency information, a waveform data similar to the frequency spectrum based on the abnormal sound acquired by the abnormal sound diagnostic device 10 is selected and transmitted to the abnormal sound diagnostic device 10 via the communication unit 51. To do.

In the present embodiment, it is described that the abnormal sound diagnostic device 10 performs the STFT and the fast Fourier transform of the abnormal sound voice data and transmits the information on the period and frequency of the abnormal sound to the server device 50. , Fast Fourier Transform or STFT, Fast Fourier Transform may be executed on the server device 50 side.

In this case, the abnormal noise diagnostic device 10 transmits the voice data as it is to the server device 50, or the frequency spectrum waveform data as a result of performing the FTFT on the voice data is transmitted, and the voice data is transmitted in the server device 50. The SFTT and Fast Fourier Transform will be performed on the data.

Next, the operation of the abnormal noise diagnosis system of the present embodiment will be described with reference to the sequence chart of FIG.

When the abnormal noise diagnosis device 10 attempts to perform abnormal noise diagnosis to identify the cause of abnormal noise, an image as shown in FIG. 7 is displayed and various information such as a model name, serial number, and operating state is input. (Step S101).

Then, in the abnormal noise diagnosis device 10, the operation mode is set to the voice recording mode, and the microphone 17 is brought close to the abnormal sound generation location of the image forming device 20 to record the abnormal sound and acquire the voice data (step S102).

Then, in the abnormal noise diagnostic apparatus 10, the acquired voice data is settled by the frequency analysis unit 32 to generate a frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency (step S103).

As shown in FIG. 8, this FTFT is obtained by performing a Fourier transform every short time and calculating the signal intensity for each frequency component according to the time change. FIG. 9 shows an example of a waveform when the analysis result obtained by this FTFT is used as an image of one frequency spectrum waveform.

In the frequency spectrum waveform example shown in FIG. 9, the horizontal axis represents time and the vertical axis represents frequency, and the intensity of each frequency is represented by color. In FIG. 9, this difference in color is represented by a hatching pattern. Further, although FIG. 9 illustrates a case where the intensity for each frequency is expressed by color, it is also possible to express this intensity by gradation.

In the frequency spectrum waveform example of FIG. 9, it can be seen that the frequency component 61 of the abnormal sound is periodically generated at a specific frequency. In the frequency spectrum waveform example shown in FIG. 9, the low frequency component is a normal operating sound and is not a frequency component of an abnormal sound.

When the frequency spectrum waveform as shown in FIG. 9 is obtained, the control unit 33 displays the frequency spectrum waveform on the display unit 35. Then, the user who is presented with the frequency spectrum waveform identifies the frequency component 61 of the abnormal sound, and selects a region including the frequency component 61 of the abnormal sound by, for example, operating the touch panel.

FIG. 10 shows an example of the selection area 80 selected by the user in this way. In the example shown in FIG. 10, it can be seen that a rectangular region including a plurality of abnormal sound frequency components 61 is designated as the selection region 80.

Then, when the selection region 80 is designated in this way, the fast Fourier transform (1D-FFT) for the frequency component included in the selection region 80 is executed by the frequency analysis unit 32 (step S104). An example of the analysis result (1D-FFT analysis result screen example) of the fast Fourier transform executed in this manner is shown in FIG.

In FIG. 11, the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform. Since the abnormal sound includes harmonic components and the like, a plurality of cycles may be detected, but the cycle having the strongest signal strength is detected as the abnormal sound cycle.

Further, since the signal component having a long period of a predetermined period or longer is considered to be a normal operation sound or an indefinite period noise, such a region of the signal component having a long period is set as a judgment exclusion area 62 in the judgment exclusion area 62. The analysis result is ignored.

Further, since the low frequency signal component below the predetermined frequency is also indistinguishable from the normal operating sound, the region of such a low frequency signal component is set as the judgment exclusion region 63, and the analysis result in this judgment exclusion region 63 is It will be ignored.

The abnormal noise diagnostic device 10 transmits information on the frequency and period of the abnormal noise to the server device 50 together with model information and operating state information based on the analysis result of the fast Fourier transform (step S105). For example, information such that the abnormal noise frequency is 4 kHz and the abnormal noise cycle is 2.0 seconds is transmitted to the server device 50.

Then, the server device 50 extracts the frequency spectrum waveform data corresponding to the received information by searching the waveform data storage unit 53 based on the received information (step S106).

Then, the server device 50 transmits the extracted frequency spectrum waveform data to the abnormal noise diagnostic device 10 together with information such as the original voice data, the cause of the abnormal noise, and the coping method thereof (step S107).

Then, the abnormal noise diagnostic device 10 receives the frequency spectrum waveform data transmitted from the server device 50 (step S108). Then, the control unit 33 of the abnormal noise diagnosis device 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by the FTFT on the display unit 35 (step S109).

FIG. 12 shows a screen example of the abnormal noise diagnostic apparatus 10 in which the two frequency spectrum waveforms are displayed in this way.

In the screen example shown in FIG. 12, the frequency spectrum waveform obtained by the FTFT in the frequency analysis unit 32 is displayed as the "analysis result waveform of the abnormal sound recorded this time", and the frequency spectrum waveform transmitted from the server device 50. However, it can be seen that it is displayed as "past abnormal noise data" together with the abnormal noise cause of "wearing of the photoconductor drum".

A serviceman who intends to perform an abnormal noise diagnosis identifies the cause of the abnormal noise by comparing the two frequency spectrum waveforms and determining whether or not the abnormal noise components in the waveform are similar.

Further, when a plurality of frequency spectrum waveforms are transmitted from the server device 50, for example, by tracing the image of the frequency spectrum waveform displayed as "past abnormal sound data" in the horizontal direction by a touch operation. Another frequency spectrum waveform is displayed.

When a plurality of frequency spectrum waveforms are transmitted in this way, the serviceman determines which frequency spectrum waveform the frequency spectrum waveform of the abnormal sound acquired this time is more similar to the abnormal sound. Identify the cause of. When identifying the cause of this abnormal noise, not only the shape of the frequency spectrum waveform and the period and frequency of the abnormal noise component are compared, but also the original audio data is reproduced by the audio reproduction unit 37 this time. The cause of the abnormal noise is identified by listening to and comparing the acquired abnormal noise with the voice corresponding to the frequency spectrum waveform transmitted from the server device 50.

However, there are various types of abnormal noise generated in the image forming apparatus 20, and when the abnormal noise actually generated is recorded and analyzed, it is determined on the analysis result screen which frequency component is the abnormal noise. It can be difficult to do. In particular, in the case of a user who has little experience in determining the cause of abnormal noise, it may not be possible to determine which region contains the abnormal noise even by referring to the frequency spectrum screen.

Specifically, in FIGS. 9 and 10, for the sake of simplicity, the case where the frequency component 61 of the abnormal sound can be clearly distinguished by a color different from the other frequency components is shown as an example. When the frequency analysis result of abnormal noise is actually performed, it is often difficult to distinguish it from other frequency components, for example, as shown in FIG.

In the FTFT analysis result screen as shown in FIG. 13, the level of the signal strength is shown by color, but when the abnormal sound component and the non-abnormal sound component are displayed in the same color, the frequency of the abnormal sound is displayed. It may be difficult to distinguish the component 91 from the frequency components of sounds other than abnormal sounds.

Note that FIG. 13 shows an example of a display screen when the abnormal sound is a periodic sound generated at a constant cycle, but FIG. 14 shows an example of a display screen when the abnormal sound is a continuous sound.

FIG. 14 shows a case where the frequency component 92 of the abnormal sound, which is a continuous sound, is displayed on the STFT analysis result screen. As shown in FIG. 14, when the abnormal sound is a continuous sound, it is often easier to distinguish it from the frequency components of other sounds as compared with the case where the abnormal sound is a periodic sound.

Next, FIG. 15 and FIG. 16 show examples of 1D-FFT analysis result screens when the abnormal sound is a periodic sound and a continuous sound.

FIG. 15 is an example of a 1D-FFT analysis result screen when the abnormal sound is a periodic sound, and it can be seen that when the frequency component 93 of the periodic abnormal sound is present, it is easier to discriminate than the SFTT screen. ..

FIG. 16 is an example of a 1D-FFT analysis result screen when the abnormal sound is a continuous sound, and the frequency component 94 of the abnormal sound which is a continuous sound is shown by one point, and the analysis result is based on the normal operation sound and the indefinite period noise. It can be seen that it is included in the determination exclusion area 62 which cannot be referred to. That is, when the sound is actually recorded and analyzed, it is difficult to discriminate the abnormal sound component of the continuous sound on the 1D-FFT analysis result screen.

Therefore, in the abnormal noise diagnosis device 10 of the present embodiment, as shown in FIG. 17, the control unit 33 displays the SFTT analysis result screen and the 1D-FFT analysis result screen in parallel.

Then, the control unit 33 displays the analysis result screen selected when either the SFT analysis result screen or the 1D-FFT analysis result screen displayed in parallel is selected.

For example, FIG. 17 shows a case where the FTFT analysis result screen is selected by the finger 70, and in such a case, the FTFT analysis result screen is displayed as shown in FIG.

Then, when the button "To continuous sound analysis screen" is selected by the finger 70 on the SFT analysis result screen shown in FIG. 18, the 1D-FFT analysis result screen is displayed as shown in FIG.

Further, when the button "To the periodic sound analysis screen" is selected by the finger 70 on the 1D-FFT analysis result screen shown in FIG. 19, the SFTT analysis result screen as shown in FIG. 18 is displayed.

As described above, in the abnormal sound diagnostic device 10 of the present embodiment, the control unit 33 obtains a frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency obtained by performing the time-frequency analysis of the acquired sound information. The STFT analysis result screen to be displayed and the 1D-FFT analysis result screen showing information on the period and frequency of the sound included in the frequency spectrum waveform by frequency analysis of the frequency spectrum waveform are switched according to the user's operation. To display.

That is, when the user selects that he / she wants to refer to the continuous sound analysis result, the control unit 33 displays the FTFT analysis result screen on the display unit 35. Then, when the user selects that he / she wants to refer to the analysis result of the periodic sound, the control unit 33 displays the 1D-FFT analysis result screen.

Note that the case where the user selects that he / she wants to refer to the analysis result of the continuous sound is not limited to the case where the expression "continuous sound" is explicitly expressed, but also the other expression "sustained sound" or It shall also be included when onomatopoeic expressions such as "Bee" and [Boo] are selected. That is, the case where an expression similar to the continuous sound other than the expression "continuous sound" is selected is included.

Similarly, the case where the user selects that he / she wants to refer to the analysis result of the periodic sound is not only when the expression "periodic sound" is explicitly used, but also when other expressions such as "intermittent sound" or "intermittent sound" are used. It shall also include the case where onomatopoeic expressions such as "gongongon" and "tonton" are selected. That is, the case where an expression similar to the periodic sound other than the expression "periodic sound" is selected is included.

Further, in both the screens of FIGS. 18 and 19, when the button "return to the two-screen display" is selected, the screen in which the two analysis results are arranged in parallel as shown in FIG. Will be displayed.

That is, as shown in FIG. 20, a two-screen display mode in which the two analysis results display the surfaces in parallel, an SFTF analysis result screen display mode in which the SFTF analysis result screen is displayed, and 1D-FFT analysis result screen are displayed in 1D-. The display is switched between the three display modes of the FFT analysis result screen display mode.

The frequency analysis unit 32 performs time-frequency analysis of the sound information acquired by the voice acquisition unit 31 to generate a frequency spectrum waveform (STFT analysis result), and includes the frequency spectrum waveform in a region designated by the user. Frequency analysis is performed again on the frequency components to obtain information on the period and frequency of abnormal sounds. Then, the control unit 33 displays the obtained abnormal noise cycle and frequency information on the display unit 35 as a 1D-FFT analysis result screen.

At that time, in FIGS. 10 and 11, 1D-FFT analysis was performed only on the frequency components included in the selected region 80, but 1D was also performed on the frequency components included in the regions other than the selected region 80. -FFT analysis may be performed.

In such a case, as shown in FIG. 21, the analysis result for the selected area 80 and the analysis result for the other area are displayed in different display methods.

Further, when a plurality of regions are repeatedly specified in the SFTT analysis result, the control unit 33 obtains 1D of period and frequency information obtained by performing 1D-FFT analysis on the frequency components included in each region. -On the FFT analysis result screen, it may be displayed so that the specified order can be understood.

FIG. 22 shows an example of a display screen when such processing is performed. In the display screen shown in FIG. 22, it can be seen that the analysis result in the first selection area 81 and the analysis result in the second selection area 82 are the first time and the second time, respectively, on the FTFT analysis result screen. It is displayed in.

Further, a plurality of regions may be specified at the same time in the FTFT analysis result. When a plurality of regions are specified in the SFTT analysis result in this way, the control unit 33 performs 1D-FFT analysis on the frequency components included in each region as shown in FIG. 23, and the period is obtained. And frequency information is displayed on the 1D-FFT analysis result screen by different display methods.

In any of FIGS. 21 to 23, the transmitted analysis result (cycle and cycle) is transmitted by selecting the analysis result determined by the user to be abnormal noise from the plurality of analysis results and transmitting it to the server device 50. The waveform of the registered past abnormal sound corresponding to the frequency) will be searched.

[Modification example]
In the above embodiment, the case where the abnormal noise diagnostic device 10 is a tablet terminal device has been described, but the present invention is not limited to this, and even when another device is used as the abnormal noise diagnostic device. The present invention can be applied. For example, when the operation panel of the image forming apparatus 20 is detachable from the main body and can communicate with the server apparatus 50 and has a built-in audio signal acquisition function, the operation panel makes an abnormal noise. It may be used as a diagnostic device.

Further, in the above embodiment, the case where the abnormal noise diagnostic device 10 has a built-in microphone 17 is described. However, if the abnormal noise diagnostic device 10 is provided with a voice recording function, a collection of microphones and the like is used. A voice signal acquisition means may be realized by connecting a sound device to the outside.

Further, in the above embodiment, the case where the target device for abnormal noise analysis is an image forming device is described, but the target device for abnormal sound analysis is not limited to the image forming device and is not limited to the image forming device. The present invention can be similarly applied to other devices as long as they are devices that may generate abnormal noises.

10 Abnormal noise diagnostic device 11 CPU
12 Memory 13 Storage device 14 Wireless LAN interface (IF)
15 Input device 16 Display device 17 Microphone 18 Control bus 20 Image forming device 30 Wireless LAN terminal 31 Voice acquisition unit 32 Frequency analysis unit 33 Control unit 34 Voice data storage unit 35 Display unit 36 Communication unit 37 Voice playback unit 40 Internet communication network 50 Server device 51 Communication unit 52 Control unit 53 Waveform data storage unit 61 Abnormal noise frequency component 62, 63 Judgment exclusion area 70 Finger 80 to 82 Selection area 91 to 94 Abnormal noise frequency component

Claims (10)

An acquisition method for inputting the generated sound and acquiring sound information,
The first screen displaying the frequency spectrum waveform showing the time change of the signal intensity distribution for each frequency obtained by performing the time-frequency analysis of the acquired sound information, and the frequency by frequency-analyzing the frequency spectrum waveform. A display means for switching and displaying a second screen showing information on the period and frequency of the sound included in the spectral waveform according to the operation of the user, and
Diagnostic device equipped with. The diagnostic device according to claim 1, wherein the display means displays the first screen when the user selects that he / she wants to refer to the analysis result of continuous sound. The diagnostic device according to claim 1, wherein the display means displays the second screen when the user selects that he / she wants to refer to the analysis result of the periodic sound. The claim means that the display means displays the first and second screens in parallel, and displays the selected screen when any of the first and second screens displayed in parallel is selected. The diagnostic device according to any one of 1 to 3. Frequency analysis that performs time-frequency analysis of the sound information acquired by the acquisition means to generate the frequency spectrum waveform, and performs frequency analysis on the frequency component included in the region specified by the user in the frequency spectrum waveform. The diagnostic device according to any one of claims 1 to 4, further comprising means. When a plurality of regions are specified in the frequency spectrum waveform, the display means displays the period and frequency information obtained by performing frequency analysis on the frequency components included in the respective regions on the second screen. The diagnostic apparatus according to claim 5, wherein the diagnostic apparatus is displayed by a different method. When a plurality of regions are repeatedly designated in the frequency spectrum waveform, the display means obtains the period and frequency information obtained by performing frequency analysis on the frequency components included in the respective regions. The diagnostic device according to claim 5, which displays on the screen so that the designated order can be understood. Communication means for communicating with external devices and
A transmission means for transmitting the period and frequency information selected by the user from the plurality of period and frequency information displayed on the second screen to the external device via the communication means.
Further provided with a receiving means for receiving a registered frequency spectrum waveform corresponding to the period and frequency information transmitted by the transmitting means from an external device via the communication means.
The diagnostic apparatus according to claim 6 or 7, wherein the display means displays the registered frequency spectrum waveform received by the receiving means and the frequency spectrum waveform generated by the frequency analysis means side by side. The acquisition means for inputting the generated sound and acquiring the sound information, and the frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency obtained by performing the time-frequency analysis of the acquired sound information are displayed. A display means for switching and displaying one screen and a second screen showing information on the period and frequency of the sound included in the frequency spectrum waveform by frequency analysis of the frequency spectrum waveform according to the operation of the user. Then, the time-frequency analysis of the sound information acquired by the acquisition means is performed to generate the frequency spectrum waveform, and the frequency analysis is performed on the frequency component included in the region specified by the user in the frequency spectrum waveform. The period and frequency information selected by the user from the frequency analysis means, the communication means for communicating with the external device, and the plurality of period and frequency information displayed on the second screen is described above. A first transmission means for transmitting to an external device via the communication means and a registered frequency spectrum waveform corresponding to the period and frequency information transmitted by the first transmission means are externally transmitted via the communication means. A diagnostic device equipped with a receiving means for receiving from the device,
A storage means for storing a plurality of frequency spectrum waveforms obtained by frequency analysis of sound information of abnormal sound, and when sound cycle and frequency information is received from the diagnostic device, the storage means stored in the storage means. A server device provided with a second transmission means for selecting a frequency spectrum waveform corresponding to received sound cycle and frequency information from a plurality of frequency spectrum waveforms and transmitting the frequency spectrum waveform to the diagnostic device.
Diagnostic system with. The acquisition step of inputting the generated sound and acquiring the sound information,
The first screen displaying the frequency spectrum waveform showing the time change of the signal intensity distribution for each frequency obtained by performing the time-frequency analysis of the acquired sound information, and the frequency by frequency-analyzing the frequency spectrum waveform. A program for causing a computer to perform a display step of switching and displaying a second screen showing information on the period and frequency of sound included in a spectral waveform according to a user's operation.