JP7813019B2 - Leak inspection device, information processing device and program - Google Patents

Description

Article 30, Paragraph 2 of the Patent Act applies. March 22nd to 26th, 2021. Posted on website. Main website URL: https://vsstatic.akamaized.net/event/30/66/19/1/rt/1/resources/koeisetsubi_05-7EB6.pdf

Article 30, Paragraph 2 of the Patent Act applied. Performance test conducted at Metropolitan Hotel Yamagata on December 15, 2020.

Article 30, Paragraph 2 of the Patent Act applied February 19, 2021 Performance tests were conducted on Buildings 2 and 3 of the childcare support housing complex in Funagata-cho, Mogami-gun, Yamagata Prefecture.

Article 30, Paragraph 2 of the Patent Act applied. Performance testing conducted at the Nagoya City Waterworks and Sewerage Bureau Iroha Training Center from March 25th to 26th, 2021.

Article 30, paragraph 2 of the Patent Act applies. Disclosed on May 10, 2021 by JR East Building Technology Co., Ltd.

Article 30, paragraph 2 of the Patent Act applies. Publication by MDI Co., Ltd. on June 25, 2020.

Article 30, Paragraph 2 of the Patent Act is applicable. Disclosure at a study session and networking event for partner companies and content vendors held at Hotel Metropolitan Sendai on May 25, 2021.

Article 30, paragraph 2 of the Patent Act applies. July 6, 2020. Publication by Ugo Equipment Co., Ltd.

Article 30, paragraph 2 of the Patent Act applies. April 14, 2021. Publication at Toshiaki Endo Office.

Article 30, paragraph 2 of the Patent Act applies. June 24, 2020. Disclosure by STEP Co., Ltd.

Article 30, paragraph 2 of the Patent Act applies. July 29, 2020. Publication by Crossweber Co., Ltd.

Patent Act Article 30, Paragraph 2 applied May 11, 2021 Disclosure by Brutus Consulting Co., Ltd.

Article 30, paragraph 2 of the Patent Act applies. Publication by Koei System Engineering Co., Ltd. on August 1, 2020.

Article 30, paragraph 2 of the Patent Act applies. Publication by Kyoritsu Setsubi Kogyo Co., Ltd. on November 13, 2020.

Article 30, paragraph 2 of the Patent Act applies. Publication by Kenrei Kogyo Co., Ltd. on March 12, 2021.

Article 30, paragraph 2 of the Patent Act applies. Publication by Koei Equipment Industry Co., Ltd. on August 1, 2020.

Article 30, paragraph 2 of the Patent Act applies. October 7, 2020. Disclosure by Hankyu Hanshin Building Management Co., Ltd.

Patent Law Article 30, Paragraph 2 applied. September 16, 2020. Disclosed as part of the 2020 Challenge Business Support Project by the Business Support Group of the Employment Creation Division, Commerce, Industry and Tourism Department, Yamagata City.

Article 30, paragraph 2 of the Patent Act applies. March 15, 2021. Disclosure by Daiichi Kankyo Co., Ltd.

Article 30, paragraph 2 of the Patent Act applies. April 26, 2021. Disclosed by East Japan Railway Company.

Article 30, paragraph 2 of the Patent Act applies. Publication by Toyosan Management Co., Ltd. on June 8, 2021.

Article 30, paragraph 2 of the Patent Act applies. February 10, 2021. Publication by Honda Sheet Metal Industry Co., Ltd.

Patent Law Article 30, Paragraph 2 applied. Exhibited at the 3rd Kansai Facility Renovation Expo from September 9th to 11th, 2020.

Patent Law Article 30, Paragraph 2 applied. Exhibited at the 3rd Tokyo Facility Renovation Expo from December 2nd to 4th, 2020.

The present invention relates to a leak inspection device, an information processing device, and a program.

At the site where leaks are being inspected, vibration data is recorded for each measurement point, and any suspected leaks are noted.

Japanese Patent Application Laid-Open No. 2019-164613

It is possible to link the location of suspected leaks to records determined by GPS (Global Positioning System), but the distance accuracy of GPS available for private use is only about 10 meters. This makes it insufficient to pinpoint leak locations. It is also possible to improve the accuracy of GPS locations by using special equipment, but this would result in expensive equipment.
Furthermore, even if you want to check the results of analyzing the vibration data recorded at each measurement point and the positional relationship of the measurement points after the fact, existing products have low position reproducibility due to the low accuracy of the recorded positions.

The purpose of this invention is to reduce the discrepancy between measurement points in the data and measurement points in the field.

The invention described in claim 1 is a leak inspection device used by an operator at a site where fluid leaks from piping are inspected, and includes a control unit that displays an overall image of the site on a work screen, and a reception unit that accepts partial areas on the overall image as measurement points, wherein the control unit links measured vibration data to the measurement points on the overall image, and the control unit synthesizes and displays a virtual section on the overall image, and sets the position of the section selected by the operator as the measurement point.
A second aspect of the present invention is the leak test device according to the first aspect, wherein the control unit accepts settings for the entire image in an initial step of the on-site test.
A third aspect of the present invention is the leak test device according to the first aspect, wherein the number and arrangement of the compartments are set in advance.
A fourth aspect of the present invention is the leak inspection device according to the first aspect, wherein the number and arrangement of the sections are automatically set in accordance with information on the scale of the entire image.
A fifth aspect of the present invention is the leak test device according to the first aspect, wherein the number and arrangement of the sections are set according to the size of the entire image displayed on the work screen.
A sixth aspect of the present invention is the leak test device according to any one of the third to fifth aspects, wherein the number and arrangement of the compartments can be changed by an operator.
The invention described in claim 7 is a leak testing device described in any one of claims 1 to 6, in which the control unit displays, for each of the measurement points on the overall image, the analysis results of the vibration data linked to that measurement point.
An eighth aspect of the present invention is the leak test device according to the seventh aspect, wherein the control unit displays the section corresponding to the measurement point in a color according to the analysis result.
The invention described in claim 9 is a leak testing device described in any one of claims 1 to 8, in which the control unit links a photograph of the site that is different from the overall image and that was taken when measuring the measurement point.
The invention described in claim 10 is a leak testing device described in any one of claims 1 to 9, wherein the control unit has an interface for registering a specific measurement point on the overall image as a leak point.
The invention described in claim 11 is an information processing device that works in conjunction with a leak inspection device used at a site where fluid leaks from pipes are inspected, and has a control unit that displays an overall image of the site on a work screen of the leak inspection device, and a reception unit that receives partial areas on the overall image as measurement points through the leak inspection device, wherein the control unit links measured vibration data to the measurement points on the overall image, and the control unit synthesizes and displays a virtual section on the overall image, and sets the position of the section selected by the worker as the measurement point.
The invention described in claim 12 is a program for enabling a computer used to inspect fluid leaks from pipes to perform the following functions on a work screen: displaying an overall image corresponding to the site; accepting partial areas on the overall image as measurement points; linking measured vibration data to measurement points on the overall image; synthesizing and displaying virtual sections on the overall image; and setting the position of the section selected by the worker as the measurement point.

According to the first aspect of the present invention, since the candidates for the partial area are displayed as partitions, it becomes easy to specify the measurement points.
According to the second aspect of the present invention, the display of the image used to specify the measurement points can be completed in the initial operation, thereby improving workability.
According to the third aspect of the present invention, there is no need to set the number and arrangement of sections each time work is performed, and workability is improved.
According to the fourth aspect of the present invention, the number and arrangement of sections can be optimized according to the scale of the image.
According to the fifth aspect of the present invention, the number and arrangement of the sections can be adjusted according to the size of the display of the work screen, thereby improving visibility.
According to the sixth aspect of the present invention, the number and arrangement of the sections can be optimized depending on the purpose of the inspection, etc.
According to the seventh aspect of the present invention, the results of analyzing vibration data can be confirmed in association with measurement points on site.
According to the eighth aspect of the present invention, the results of analyzing vibration data can be confirmed in association with measurement points on site.
According to the ninth aspect of the present invention, subsequent on-site inspection can be facilitated.
According to the tenth aspect of the present invention, the leak point can be registered at the discretion of the on-site worker at the time of measurement.
According to the eleventh aspect of the present invention , it is possible to reduce the deviation between the measurement points on the data and the measurement points on the site.
According to the twelfth aspect of the present invention, it is possible to reduce the deviation between the measurement points on the data and the measurement points on the site.

FIG. 1 is a diagram illustrating an example of the conceptual configuration of a water leakage detection system used in a first embodiment. FIG. 2 is a diagram illustrating an outline of the connection configuration of the water leakage inspection system used in the first embodiment and the flow of data between devices. 1A and 1B are diagrams illustrating an example of the hardware configuration of an information terminal and an analysis server used in embodiment 1. FIG. 1A is an example of the configuration of an information terminal, and FIG. 1B is an example of the configuration of an analysis server. FIG. 2 illustrates an example of a data structure of a database. 10 is a diagram illustrating an example of a processing operation executed by cooperation between an information terminal and an analysis server when an operator selects a simple measurement mode. FIG. 10A to 10D are diagrams illustrating an example of transition of operation screens up to the input of site information when the simple measurement mode is selected, where (A) is the initial screen, and (B) to (D) are screens for inputting site information. 10A and 10B are diagrams illustrating an example of transition of the operation screen after inputting on-site information when the simplified measurement mode is selected, where (A) is the operation screen used to select whether or not to capture an image of the measurement location, (B) is the operation screen during image capture, (C) is the operation screen for instructing the start of measurement, and (D) is the operation screen indicating that measurement is in progress. 1A and 1B are diagrams illustrating examples of spectra obtained as a result of analyzing vibration data, in which (A) is an example spectrum when there is no water leakage, (B) is an example spectrum when there is a suspected possibility of water leakage, and (C) is an example spectrum when there is a high possibility of water leakage. 10A and 10B are diagrams illustrating an example of transition of the operation screen displayed after the first measurement is completed when the simplified measurement mode is selected, where (A) is the operation screen used to select whether to continue measurement, (B) is the operation screen used to select whether to image the measurement point, (C) is the operation screen during image capture, and (D) is the operation screen for instructing the start of measurement. 10A and 10B are diagrams illustrating other examples of transitions of the operation screen displayed after the first measurement is completed when the simplified measurement mode is selected, where (A) is the operation screen used to select whether to continue measurement, (B) is the operation screen used to select whether to capture an image of the measurement point, and (C) is the operation screen indicating that measurement is in progress. 10A and 10B are diagrams illustrating another example of transitions in the operation screen displayed after the second measurement is completed when the simplified measurement mode is selected, where (A) is the operation screen immediately after the second measurement is completed, (B) is a selection screen illustrating the state in which the button labeled "Details" is selected, (C) is a detailed display screen of the analysis results, and (D) is the operation screen after the "Close" button is operated. 10A and 10B are diagrams illustrating another example of transitions in the operation screen displayed after the second measurement is completed when the simplified measurement mode is selected, where (A) is the operation screen immediately after the second measurement is completed, (B) is the operation screen illustrating the state in which the check boxes for the first and second analysis results are selected, (C) is a comparison screen for the two selected analysis results, and (D) is the operation screen after the "Close" button is operated. 10 is a diagram illustrating an example of a processing operation executed by cooperation between the information terminal and the analysis server when an operator selects a detailed measurement mode. FIG. 10A to 10D are diagrams illustrating an example of transition of operation screens up to the input of construction information when the detailed measurement mode is selected, where (A) is the initial screen, and (B) to (D) are construction information input screens. 10A to 10C are diagrams illustrating an example of transitions used to input site information when the detailed measurement mode is selected, showing the site information input screen. 10A and 10B are diagrams illustrating an example of transition of an operation screen when measuring an entire image of a measurement point when a detailed measurement mode is selected, where (A) is an operation screen used to select whether or not to capture an entire image of the measurement point, (B) is an operation screen during image capture, (C) is an operation screen after image capture, and (D) is an operation screen used to specify a measurement point. 10A and 10B are diagrams illustrating an example of transition of operation screens displayed until the first measurement is started when the detailed measurement mode is selected, where (A) is the operation screen when setting the measurement point, (B) is the selection screen for imaging the measurement point, (C) is the operation screen immediately after imaging, and (D) is the operation screen for starting the measurement. 10A and 10B are diagrams illustrating an example of transitions of the operation screen when on-site measurements are repeated with the detailed measurement mode selected, where (A) is an operation screen indicating that measurement is in progress, (B) is an operation screen displayed immediately after measurement of two measurement locations is completed, (C) is an operation screen displayed immediately after measurement of three measurement locations is completed, and (D) is an operation screen displayed immediately after measurement of six measurement locations is completed. 1A and 1B are diagrams illustrating an example of an operation screen used to display detailed analysis results of a measurement point, where (A) shows the upper part of the screen and (B) shows the lower part of the screen. 10A and 10B are diagrams illustrating an example of the transition of the operation screen when the detailed measurement mode is ended, in which (A) shows the operation screen when the end of the measurement is instructed, (B) shows the operation screen for specifying how to handle the measurement results, and (C) shows the operation screen used to end the detailed measurement mode. FIG. 10 is a diagram illustrating an example of the conceptual configuration of a water leakage detection system used in a second embodiment. FIG. 10 is a diagram for explaining an outline of the flow of data between devices constituting the water leakage inspection system used in embodiment 2. 10A and 10B are diagrams illustrating an example of the conceptual configuration of a water leak detection system used in embodiment 3. FIG. 10A is an example of the appearance of the water leak detection system, and FIG. 10B is a diagram illustrating an outline of the data flow between devices that configure the water leak detection system. FIG. 10 is a diagram illustrating an example of an operation screen used to select the type of image to be used as the whole image. 10 is a diagram illustrating an example of the display on the operation screen when an aerial photograph taken from above the water leak inspection site, an image taken by a drone, or any similar image is used as the overall image. FIG. 10A and 10B are diagrams illustrating examples of spectra that are analysis results of vibration data, where (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when there is a suspected possibility of water leakage, and (C) is an example of a spectrum when there is a high possibility of water leakage. 10A and 10B are diagrams illustrating an example of the transition of an operation screen before and after a change in the mesh structure, in which (A) shows an overall image combined with the mesh set in the initial settings, (B) shows an example of a screen used to accept a change in the mesh structure, and (C) shows an overall image combined with the changed mesh.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
First Embodiment
<System Configuration>
FIG. 1 is a diagram illustrating an example of the conceptual configuration of a water leakage detection system 1 used in the first embodiment.

The water leak inspection system 1 shown in FIG. 1 is composed of a water leak detection system 10 used at the site of a water leak inspection, an analysis server 40, and a communication network 50.
The communication network 50 here is, for example, the Internet or a mobile communication system such as 4G or 5G. Note that part of the communication network 50 also includes a wireless LAN (Local Area Network) and a wired LAN.

The water leak detection system 10 shown in Fig. 1 is composed of a water leak detector 20 that measures vibrations at a measurement point, and an information terminal 30 that presents to an operator the results of analyzing the vibrations (hereinafter referred to as "vibration data") measured by the water leak detector 20. The information terminal 30 here is an example of a leak inspection device used on-site.
The measurement points here are assumed to be, for example, the surface of an exposed pipe, the ground surface where the pipe is buried, the wall or ceiling of a structure where the pipe is installed, and equipment such as valves.
In this embodiment, the points where vibration data is measured are referred to as “measurement points” or “measurement locations.” In this embodiment, the measurement points or measurement locations are determined by workers on-site.

The piping in this embodiment is assumed to include, for example, water distribution pipes, water supply pipes, drainage pipes, sewer pipes, gas pipes, and refrigerant pipes.
Liquids flow through water pipes, drainage pipes, and sewer pipes, while gases flow through gas pipes and refrigerant pipes. Examples of liquids include tap water, sewage, rainwater, and cooling water.
Furthermore, gases include not only city gas but also gases as fuels or reactants, air, steam, and the like.
The term "pipes" also includes pipes through which liquid materials and fuels used in various chemical plants and factories flow. These liquids and gases are examples of fluids that flow through pipes.

The water leak detector 20 is composed of a metal listening rod 21 that transmits vibrations at the measurement point, a grip 22 that is held by the operator, a vibration sensor 23 that converts the vibration data transmitted from the listening rod 21 into an electrical signal, a communication cable 24, and a device main body 25. The vibration sensor 23 may be, for example, a bone conduction pickup sensor.
The device main body 25 has, for example, a built-in rechargeable battery, and the battery supplies the power necessary for the operation of the vibration sensor 23 and the like.

The device main body 25 also includes an amplifier that adjusts the gain of vibration data received as an electrical signal from the vibration sensor 23, and a communication device that transmits the amplified vibration data to the information terminal 30.
In this embodiment, a USB (Universal Serial Bus) connector is used for the communication device, so that the device main body 25 and the information terminal 30 are electrically connected via a USB cable 24A.

A notch 26 is provided at the upper end of the device body 25 so as not to interfere with imaging by a camera 35 (see FIG. 3 described later) provided on the information terminal 30. The position and size of the notch 26 are determined depending on the information terminal 30 that is attached to the device body 25 and used.
In addition, the device main body 25 also has built-in volume buttons for adjusting the volume when playing vibration data as sound from earphones, a controller for adjusting the signal strength of the vibration data input from the vibration sensor 23, a power button, etc.

In this embodiment, a smartphone is used as the information terminal 30 .
In addition, the information terminal 30 may be a tablet computer, a notebook computer, a smart watch, smart glasses, or the like that are wirelessly connected via a USB wireless adapter or a Bluetooth (registered trademark) adapter.

The analysis server 40 is located on the cloud side and performs analysis processing of the vibration data. In this embodiment, it generates the spectrum of the vibration data, a waveform diagram of the spectrum, and the like, and also has the function of calculating the possibility that the measurement point is a water leak location in numerical value such as a percentage.
For example, artificial intelligence for determining water leakage is provided in the analysis server 40. The artificial intelligence is realized as a learning model that learns from vibration data at the water leakage point as training data.

When vibration data is input into the learning model, the possibility of a water leak is output as a numerical value such as a percentage. It is desirable for the learning model to learn from vibration data that corresponds to the pipe material, the type of equipment used for measurement, the estimated depth of the pipe, the density of the soil in which the pipe is buried, the diameter of the pipe, the water pressure, and the condition of the measurement surface as training data.
The learning algorithm uses, for example, a neural network.

<Circuit configuration>
FIG. 2 is a diagram for explaining an outline of the connection configuration of the water leakage detection system 1 used in the first embodiment and the flow of data between the devices.
In the water leak detector 20, vibration data is provided from the vibration sensor 23 to a main circuit 25A of the device main body 25. The main circuit 25A here includes an amplifier that electronically amplifies the vibration data. In this embodiment, the gain of the amplifier can be switched between three levels by operating a switch.
In one measurement, vibration data is acquired for approximately 5 seconds.

The main circuit 25A is provided with a bandpass filter that selectively extracts a frequency band that contains many vibration components due to water leakage. For example, a bandpass filter with a passband of approximately 100 Hz to 4 kHz is used.
However, vibration data in the frequency band that passes through the bandpass filter includes environmental sounds in addition to the water leakage sound. Environmental sounds depend on the measurement point and become noise when detecting the water leakage sound.

The vibration data amplified by the main circuit 25A is output to the information terminal 30. The information terminal 30 adds the measurement time, on-site information, etc. to the acquired vibration data and transmits it to the analysis server 40.
The analysis server 40 generates a spectrum of the vibration data and transmits to the information terminal 30 the analysis result indicating the possibility that the measurement point is a water leak location.
It takes approximately 15 to 20 seconds for the information terminal 30 to obtain the analysis results from the analysis server 40. However, this time varies depending on the communication environment and the processing capacity of the analysis server 40.
The information terminal 30 displays the acquired analysis results to the workers on-site in real time.

<Hardware configuration>
3A and 3B are diagrams illustrating an example of the hardware configuration of the information terminal 30 and the analysis server 40 used in the first embodiment. (A) is an example of the configuration of the information terminal 30, and (B) is an example of the configuration of the analysis server 40.
The information terminal 30 shown in FIG. 3(A) is composed of a processor 31 that controls the operation of the entire device, a RAM (Random Access Memory) 32 used as a main storage device, a flash memory 33 which is a non-volatile semiconductor memory, a touch panel 34, a camera 35, and a communication module 36 used for communication with an analysis server 40, etc.
In this embodiment, the processor 31 is composed of a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit), and realizes various functions through the execution of programs.

One of the functions is to acquire vibration data at measurement points during inspection work. This function corresponds to the "acquisition unit" in the claims.
Another function is to transmit the acquired vibration data to a predetermined analysis server 40 via the communication module 36 .
Another function is to display an operation screen that supports the inspection work by the operator. This function also includes a function to display the spectrum or spectra acquired as the analysis results on the touch panel 34. This function corresponds to the "controller" in the claims.

The RAM 32 is used as an execution area for programs.
The flash memory 33 stores the BIOS (Basic Input Output System), firmware, a water leak detection application program, vibration data, etc. The vibration data is deleted after it has been uploaded to the analysis server 40. Therefore, if uploading of the vibration data to the analysis server 40 is not completed due to poor communication or the like, the vibration data is stored in the flash memory 33.

The touch panel 34 is composed of a display and a capacitance type touch sensor arranged on the surface of the display.
The display may be, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display.
A touch sensor is a device that is highly transparent to light, so it can detect a tap operation or the like by a worker without interfering with the worker's vision.

The camera 35 uses, for example, a CMOS (=Complementary Metal Oxide Semiconductor) image sensor.
The communication module 36 uses a device that complies with a mobile communication system such as USB (Universal Serial Bus), wireless LAN, Bluetooth, 4G, or 5G.
In this embodiment, the processor 31, RAM 32, and flash memory 33 constitute a so-called computer.

The analysis server 40 shown in Figure 3 (B) is composed of a processor 41 that controls the operation of the entire device, RAM 42 used as a main memory device, ROM (Read Only Memory) 43 in which the BIOS and other programs are stored, a hard disk drive 44 used as a secondary memory device, and a communication module 45 used for communication with the communication network 50. These devices are connected via a signal line 46 such as a bus.

In addition to the display, devices such as a keyboard and a mouse may be connected to the analysis server 40 .
Furthermore, the analysis server 40 does not have to be a single server, but may be a collection of multiple servers with different roles and functions.

The processor 41 is composed of a CPU and realizes various functions by executing programs.
In the present embodiment, some of the functions include a function to store the acquired vibration data in association with the site, a function to analyze the acquired vibration data and return the data to the information terminal 30 at the site, etc. The analysis results are stored in the hard disk drive 44.

A database 400 for leak detection (see FIG. 4, which will be described later) is stored in the hard disk drive 44. The database 400 stores vibration data, analysis results, and the like uploaded from the site, linked to measurement points.
In addition, the hard disk drive 44 also stores an operating system and an application program for analysis.
However, instead of the hard disk drive 44, a large-capacity semiconductor memory may be used.

The communication module 45 uses a device that complies with a mobile communication system such as wireless LAN, Ethernet (registered trademark), 4G, or 5G.
In this embodiment, the processor 41, RAM 42, and ROM 43 constitute a so-called computer.

<Database data structure example>
FIG. 4 is a diagram showing an example of the data structure of the database 400. As shown in FIG.
The data structure shown in Fig. 4 is an example, and other items may be included instead of the items shown in Fig. 4. Also, items not shown in Fig. 4 may be included.
The site ID 401 is an ID used to link with information that identifies the site of the water leak inspection. The ID here is linked to the name, address, etc. of the site of the water leak inspection. The name, address, etc. of the site of the water leak inspection are stored in a separate table.

The examination date is stored in the examination date 402. In Fig. 4, the examination date is specified by the month and day, but the examination date in the data is stored including the examination year.
The entire image ID 403 is an ID used to link with an image including the entire area of the site to be inspected. In this embodiment, an image, drawing, etc. corresponding to the site periphery used to identify measurement points is called an "entire image."

The overall image may include images captured by the information terminal 30 (see Figure 1) or other terminals, aerial photographs, photographs taken from above the site by a drone (hereinafter also referred to as "aerial photographs"), drawings such as construction drawings and blueprints of the site, and scanned or digital maps.
The whole image to be used is specified by the operator at the start of the inspection.

Intra-mesh position information 404 is information that indicates the position within a virtual mesh that is combined with the overall image to identify the measurement point. If the mesh is composed of 10 rows and 10 columns of sections, intra-mesh position information 404 identifies the position of one of a total of 100 sections. A section here defines a specific partial area within the overall image.

In the case of Figure 4, the intra-mesh position information 404 is given as coordinates within the mesh. "10*10" in the figure means the section in the 10th row and 10th column. Incidentally, the origin of the coordinates is predetermined. For example, if the north direction is the top of the image, the upper left corner of the image is set as the origin.

The measurement point ID 405 is an ID for managing the measurement point. In the case of the database 400 shown in Fig. 4, the measurement points in the first and second rows are the same. This means that two measurements have been performed for the same measurement point.
The time at which the vibration data was measured is recorded in the measurement time 406. For example, the time at which the information terminal 30 acquired the vibration data is used as the measurement time 406.
The vibration data ID 407 is an ID that identifies the vibration data stored in the storage area.

The captured image ID 408 is an ID that identifies an image captured at a site by linking it to a measurement point. If multiple images are captured, multiple IDs are recorded.
The analysis waveform ID 409 is an ID that identifies the spectrum of the vibration data stored in the hard disk drive 44 (see FIG. 3B).
A spectrum is a characteristic diagram with frequency on the horizontal axis and sound pressure (dB) on the vertical axis. A spectrum is a characteristic diagram with time on the horizontal axis and frequency on the vertical axis, and the difference in sound pressure (dB) for each frequency at each time is expressed by different colors.

A numerical value indicating the probability that the measurement point is a leak location is recorded in the leak probability 410. In this embodiment, the possibility of a leak location is given as a percentage. Note that instead of or together with the leak probability 410, a classification of the leak possibility may be recorded.
The analysis waveform and leakage probability shown here are both examples of analysis results.
In the water leakage location setting 411, information on whether or not the worker has set the location as a water leakage location is recorded.

<Processing Operation>
<Simple measurement mode>
The processing operations and transitions of the operation screens executed when the simple measurement mode is selected will be described below with reference to Figures 5 to 12. Note that the operation screens and transitions between screens described below are all examples.
In this embodiment, the simplified measurement mode is a measurement mode used to narrow down the pipeline systems that are likely to have a water leak.
The purpose of this measurement mode is to narrow down the pipeline systems that may have a water leak, so even if the analysis server 40 (see FIG. 1) analyzes the vibration data, the vibration data is not stored.

5 is a diagram illustrating an example of a processing operation executed by cooperation between the information terminal 30 and the analysis server 40 when the operator selects the simple measurement mode. Note that the symbol S in the diagram represents a step.
6 to 12 show examples of transitions of operation screens displayed on the information terminal 30 (see FIG. 1) when the simple measurement mode is selected.

The process shown in FIG. 5 is realized through the execution of a program by the processor 31 of the information terminal 30 (see FIG. 3A) or the processor 41 of the analysis server 40 (see FIG. 3B).
First, the information terminal 30 accepts the selection of a measurement mode on the initial screen (Step 1). Note that the options include a simple measurement mode and a detailed measurement mode. The detailed measurement mode is a measurement mode used to narrow down points with a high possibility of water leakage.
When the selection is accepted, the information terminal 30 determines whether or not the mode is the simple measurement mode (step 2).
If the simple measurement mode is selected as the measurement mode, the information terminal 30 obtains a positive result in step 2. The information terminal 30 that obtains a positive result in step 2 accepts input of site information (step 3).

6A to 6D are diagrams illustrating an example of the transition of operation screens up to the input of site information when the simple measurement mode is selected. (A) is an initial screen 300A, and (B) to (D) are site information input screens 300B to 300D.
An initial screen 300A shown in Fig. 6A has a button 301 labeled "Simple Measurement" and a button 302 labeled "Detailed Measurement." In Fig. 6A, the selected state of the button 301 is indicated by shading.

An input screen 300B shown in FIG. 6B is used to input the material of the pipes buried or exposed at the site.
The input screen 300B has a material selection field 303, a button 304 with a left-pointing arrow that means "back," a button 305 with a right-pointing arrow that means "forward," and a "cancel" button 306.
6B, five options, namely, steel pipe, plastic pipe, PVC pipe, other, and unknown, are displayed in the selection column 303. Of course, these are just examples.
When button 304 is operated, the screen transitions to initial screen 300A. On the other hand, when button 305 is operated, the screen transitions to input screen 300C shown in Fig. 6(C). Checking a checkbox may be required to transition to input screen 300C. The same applies to the other input screens 300C and 300D.

An input screen 300C shown in FIG. 6C is used to input information about a measuring device.
Input screen 300C has a selection field 307 for the device to be used to measure vibration data, a button 304 with a left-pointing arrow meaning "back," a button 305 with a right-pointing arrow meaning "forward," and a "cancel" button 306.
6(C), three options are displayed in the selection field 307: "listening rod,""flatplacement," and "don't know." Here, "flat placement" means removing the vibration sensor 23 (see FIG. 1) from the listening rod 21 (see FIG. 1) and placing it directly at the measurement point. Of course, the options are just examples.
When button 304 is operated, the screen transitions to the previous input screen 300B. On the other hand, when button 305 is operated, the screen transitions to input screen 300D shown in FIG.

An input screen 300D shown in FIG. 6(D) is used to input the measurement depth.
The input screen 300D has a depth selection field 308, a button 304 with a left-pointing arrow that means "back," a button 305 with a right-pointing arrow that means "forward," and a "cancel" button 306.
In the case of Figure 6 (D), seven options are displayed in the selection field 308: 20 cm, 40 cm, 60 cm, 80 cm, 150 cm, 200 cm, and 250 cm. Of course, this is just one example. An option of "I don't know" may also be provided.
When button 304 is operated, the screen transitions to the previous operation screen 300C. On the other hand, when button 305 is operated, the screen transitions to operation screen 300E shown in FIG.

Returning to the description of FIG.
When the input of the site information is completed in step 3, the information terminal 30 determines whether or not to capture an image of the measurement location (step 4).
If a positive result is obtained in step 4, the information terminal 30 acquires the captured image (step 5). The image is captured using, for example, the camera 35 (see FIG. 3A) of the information terminal 30. In the simple measurement mode, the captured image data is used exclusively for confirmation during on-site work.

When an image is acquired in step 5, or when a negative result is obtained in step 4, the information terminal 30 starts measurement (step 6) and transmits the measured vibration data and the like to the analysis server 40 (step 7). Here, in addition to the vibration data, site information is also uploaded.
When the analysis server 40 receives the vibration data, etc., it analyzes the vibration data (step 8). When the analysis process is completed, the analysis server 40 transmits the analysis results to the information terminal 30 (step 9).

The information terminal 30 receives the analysis results from the analysis server 40 and displays the analysis results (step 10).
Thereafter, the information terminal 30 determines whether or not to continue measuring (step 11).
If a positive result is obtained in step 11, the information terminal 30 returns to step 4. On the other hand, if a negative result is obtained in step 11, the information terminal 30 ends the inspection process.

It takes about 15 to 20 seconds from the transmission of the vibration data until the analysis server 40 notifies the information terminal 30 of the analysis result. Therefore, it is possible to start the next measurement immediately after the analysis result is displayed.
In this embodiment, the spectrum of the vibration data is displayed as the analysis result. When the analysis result is displayed, it is also possible to display the results of multiple analyses for comparison.

7A and 7B are diagrams illustrating an example of transition of the operation screen after inputting the site information when the simplified measurement mode is selected. (A) is an operation screen 300E used to select whether or not to capture an image of the measurement location, (B) is an operation screen 300F showing that the image is being captured, (C) is an operation screen 300G for instructing the start of measurement, and (D) is an operation screen 300H showing that the measurement is in progress.
7A, there are arranged a button 309 labeled "Take an image of the measurement point," a button 310 labeled "Do not take an image," and a button 311 labeled "Stop measurement." In FIG. 7A, the selected state of the button 309 is indicated by shading.

When button 310 is selected, information terminal 30 immediately starts measuring vibration data. In this case, operation screen 300E transitions to operation screen 300H.
On the other hand, when the button 311 is operated, the information terminal 30 transitions to the initial screen 300A (see FIG. 6A).
An operation screen 300F shown in FIG. 7B displays an image 312 of a subject within the field of view of the camera 35 (see FIG. 3A). In the case of FIG. 7B, an image of the vibration sensor 23 (reference numeral omitted in the figure) placed flat on the floor, which is the measurement location, is captured. When the image capture button 313 is tapped, the image 312 of the subject at the time of tapping is acquired as an image of the measurement location.

On the operation screen 300G shown in FIG. 7C, a button 314 labeled "Start Measurement" and a button 315 labeled "Stop Measurement" are displayed on the screen.
When button 314 is selected, operation screen 300G transitions to operation screen 300H.
An operation screen 300H shown in FIG. 7(D) displays a waveform display field 316 showing the sound pressure change in the time axis direction of the vibration data, and an icon 317 indicating that measurement is in progress.
In this embodiment, the vibration at the measurement location is measured for about 5 seconds. The measured vibration data is automatically uploaded from the information terminal 30 to the analysis server 40 (see FIG. 1).

8A and 8B are diagrams illustrating examples of spectra obtained as a result of analyzing vibration data, where (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when there is a suspicion of a water leakage, and (C) is an example of a spectrum when there is a high possibility of a water leakage.
The spectrum when there is no water leak is almost flat, but the spectrum where there is a suspected water leak has whisker-like spikes superimposed in the frequency band enclosed by the dashed line. This is thought to be caused by temporary vibrations detected at the site, such as wind or noise. This is what is known as noise. The effect of noise may be distinguishable by acquiring vibration data multiple times.
The spectrum indicating a high possibility of a water leak contains a steady, continuous high sound pressure in the frequency band indicated by the dashed line. This type of waveform is characteristic of a water leak.

<When the second measurement is started consecutively>
9A and 9B are diagrams illustrating an example of the transition of the operation screens displayed after the first measurement is completed when the simplified measurement mode is selected. (A) is an operation screen 300I used to select whether or not to continue measurement, (B) is an operation screen 300E used to select whether or not to image the measurement location, (C) is an operation screen 300F during image capture, and (D) is an operation screen 300G for instructing the start of measurement. In Fig. 9, the same symbols are used to indicate parts corresponding to those in Fig. 7.

9A, a button 318 labeled "Continue measurement," a button 319 labeled "End," a display field 320 for the analysis results of the first measurement, and a button 321 labeled "Details" are arranged. In FIG. 9A, the selected state of button 318 is indicated by shading.
When button 318 is selected, a measurement similar to the first measurement is started.
When button 319 is selected, the measurement of vibration data is immediately terminated and the screen transitions to the initial screen 300A.

In the analysis result display field 320, the time when the first measurement was performed and the completion of transmission of vibration data to the analysis server 40 are written alongside check boxes for selection.
In the case of the operation screen 300I shown in FIG. 9A, 16:31 is displayed as the first measurement time.
When button 321 is selected, the details of the analysis results of the first vibration data are displayed.

The operation screen 300E shown in Fig. 9B is the same as the operation screen 300E in Fig. 7A. In Fig. 9B, the button 309 labeled "Take an image of the measurement point" is also selected.
The operation screen 300F shown in Fig. 9(C) is the same as the operation screen 300F in Fig. 7(B). When the image capture button 313 is tapped in Fig. 9(C), the operation screen 300F transitions to the operation screen 300G shown in Fig. 9(D). The screen transitions after the start of measurement are the same as those for the first image capture, and therefore will not be described.

<When not measuring the image of the measurement point>
10 is a diagram illustrating another example of the transition of the operation screen displayed after the first measurement is completed when the simplified measurement mode is selected. (A) is an operation screen 300I used to select whether or not to continue measurement, (B) is an operation screen 300E used to select whether or not to capture an image of the measurement location, and (C) is an operation screen 300H indicating that measurement is in progress. In FIG. 10, the same symbols are used to indicate parts corresponding to those in FIGS. 7 and 9.
10A and 10B, the button 310 labeled "Do not capture" is selected after the button 318 is selected, so the operation screen 300E transitions to the operation screen 300H shown in FIG. 10C, and recording of vibration data begins.

<If the Details button is pressed after the second measurement is completed>
11A and 11B are diagrams illustrating another example of transitions in the operation screen displayed after the second measurement is completed when the simplified measurement mode is selected. (A) is the operation screen 300J immediately after the second measurement is completed, (B) is the selection screen 300J illustrating the state in which the button 321A labeled "Details" is selected, (C) is the detailed display screen 300K of the analysis results, and (D) is the operation screen 300J after the "Close" button 325 is operated.
In FIG. 11, parts corresponding to those in FIG. 9 are denoted by the same reference numerals.

The operation screen 300J shown in Figure 11(A) displays display fields 320A and 320B for the two analysis results, and corresponding buttons 321A and 321B labeled "Details." Note that in Figure 11(A), the second analysis results have already been notified from the analysis server 40. Therefore, display field 320B shows that the second measurement time was 16:32, and that the possibility of a leak is 0%. Note that neither button has been selected in Figure 11(A).

On the operation screen 300J shown in FIG. 11B, a button 321A corresponding to a display field 320A of the first analysis result is selected.
When button 321A is selected, operation screen 300J shown in FIG. 11(B) transitions to detailed display screen 300K shown in FIG. 11(C).
The detailed display screen 300K shown in Figure 11 (C) displays a spectrum 322 of the vibration data recorded in the first measurement, a leakage probability column 323 of the first measurement results, an image 324 of the measurement location measured during the first measurement, and a button 325 labeled "Close."

The detailed display screen 300K displays the spectrum 322, allowing the operator to visually determine the characteristics of the vibration data. Because the characteristics of the vibration data are visualized, the operator does not need the skill of a craftsman to distinguish the vibration data by listening to it.
Furthermore, the detailed display screen 300K indicates in the water leak probability column 323 that the first analysis result indicates that there is a 0% chance that the measurement point is a water leak point. By referring to the probability, the operator can assist in making his or her own judgment based on the spectrum 322.
When the button 325 is operated, the detailed display screen 300K is changed to the operation screen 300J shown in FIG. 11(D).

11(D), a button 319 labeled "End" is selected. When button 319 is selected, the measurement of vibration data is immediately ended and the screen transitions to the initial screen 300A shown in FIG. 6(A).
The simple measurement mode is a measurement mode used by on-site workers to easily and efficiently identify leaking pipelines, and therefore vibration data and analysis results are not stored in the analysis server 40 .

<When the button to compare the two analysis results is pressed after the second measurement is completed>
12A and 12B are diagrams illustrating another example of transitions in the operation screen displayed after the second measurement is completed when the simplified measurement mode is selected. (A) is the operation screen 300J immediately after the second measurement is completed, (B) is the operation screen 300L illustrating the state in which the check boxes for the first and second analysis results are selected, (C) is the comparison screen 300M for the two selected analysis results, and (D) is the operation screen 300N after the "Close" button 325 is operated. The comparison screen 300M here is an example of the "screen" in the claims.
In FIG. 12, parts corresponding to those in FIG. 11 are denoted by the same reference numerals.

The operation screen 300J shown in Figure 12(A) displays display fields 320A and 320B for the two analysis results, and corresponding buttons 321A and 321B labeled "Details." Note that in Figure 12(A), the second analysis results have already been notified from the analysis server 40. Therefore, display field 320B shows that the second measurement time was 16:32, and that the possibility of a leak is 0%. Note that in Figure 12(A), neither button has been selected.

In operation screen 300L shown in Fig. 12(B), two check boxes are selected, and as a result, button 326 labeled "Compare" is displayed. In Fig. 12(B), button 326 is in a selected state.
The comparison screen 300M shown in Figure 12 (C) displays a spectrum 327 corresponding to the vibration data recorded in the first and second measurements, a water leakage probability column 328A for the first measurement results, a water leakage probability column 328B for the second measurement results, and a button 325 labeled "Close."

The comparison screen 300M displays a first water leakage probability column 328A and a second water leakage probability column 328B side by side, allowing the operator to visually determine the possibility of water leakage.
When the "Close" button 325 is pressed on the comparison screen 300M, the screen transitions to the operation screen 300N shown in Fig. 12(D) . When the "Close" button 325 is pressed to transition to the operation screen 300N, the check boxes in the analysis result display fields 320A and 320B are displayed in a cleared state.
12(D), the "End" button 319 is selected. When the button 319 is selected, the measurement of vibration data is immediately ended, and the screen transitions to the initial screen 300A shown in FIG. 6(A).
The simple measurement mode is a measurement mode used by on-site workers to easily and efficiently identify leaking pipelines, and therefore vibration data and analysis results are not stored in the analysis server 40 .

<Detailed measurement mode>
The processing operations and transitions of operation screens executed when the detailed measurement mode is selected will be described below with reference to Figures 13 to 20. Note that the operation screens and transitions between screens described below are all examples.
In this embodiment, the detailed measurement mode is a measurement mode used to pinpoint locations where there is a high possibility of water leakage.

13 is a diagram illustrating an example of a processing operation executed by cooperation between the information terminal 30 and the analysis server 40 when the operator selects the detailed measurement mode. Note that the symbol S in the diagram represents a step.
The processing procedure shown in Fig. 13 is started when a negative result is obtained in the above-mentioned step 2 (see Fig. 5) because in this embodiment, two selectable measurement modes are assumed: a simple measurement mode and a detailed measurement mode.
14 to 20 show examples of transitions of operation screens displayed on the information terminal 30 (see FIG. 1) when the detailed measurement mode is selected.

The processing shown in FIG. 13 is also realized through the execution of a program by the processor 31 of the information terminal 30 (see FIG. 3A) or the processor 41 of the analysis server 40 (see FIG. 3B).
The information terminal 30 that has started the detailed measurement mode accepts input of construction information and site information (step 21).
14 is a diagram illustrating an example of the transition of operation screens up to the input of construction information when the detailed measurement mode is selected. (A) is the initial screen 300A, and (B) to (D) are construction information input screens 300O to 300Q. In FIG. 14, parts corresponding to those in FIG. 6 are assigned the same reference numerals.

An initial screen 300A shown in Fig. 14A has a button 301 labeled "Simple Measurement" and a button 302 labeled "Detailed Measurement." In Fig. 14A, the selected state of the button 302 is indicated by shading.
The input screen 300O shown in FIG. 14(B) is used to select a registered construction name or to register a new construction name.

The input screen 300O displays a list 330 of registered construction names, including construction 1 to construction 7. A button 331 labeled "New Registration" is also located at the bottom of the input screen 300O. In the input screen 300O shown in FIG. 14(B), the selected state of the button 331 is indicated by shading.
Incidentally, when one of the registered construction names is selected, the input screen 300O transitions to a site information input screen.

14(C) is used to input a new construction name. Input screen 300P has an input field 332 for inputting registration information, a button 333 labeled "Cancel," and a button 334 labeled "Register."
In the case of input screen 300P shown in FIG. 14(C), the registration items provided are "construction name,""constructionnumber,""address" of the site, and "comments."
When button 333 is operated, the screen transitions to input screen 300O. On the other hand, when button 334 is operated, the input items are registered, and the screen transitions to input screen 300Q shown in FIG. 14(D).
An input screen 300Q shown in FIG. 14(D) has an additional row for "Project Name 8: Buried Pipe Measurement 1."

When a predetermined time has elapsed since the input screen 300Q shown in FIG. 14(D) was displayed, the screen is switched to an input screen for site information.
15A to 15C are diagrams illustrating an example of the transitions used to input site information when the detailed measurement mode is selected. (A) to (C) are site information input screens 300B to 300D. In FIG. 15, the same reference numerals are used to denote parts corresponding to those in FIG. 6.

The input screen 300B shown in Figure 15 (A) is used to input the material of the pipes buried or exposed at the site, and on this screen are arranged a material selection field 303, a button 304 with a left-pointing arrow meaning "back," a button 305 with a right-pointing arrow meaning "forward," and a "cancel" button 306.
When the button 304 is operated, the screen transitions to the input screen 300O (or the input screen 300Q). On the other hand, when the button 305 is operated, the screen transitions to the input screen 300C shown in FIG.

Input screen 300C shown in FIG. 15(B) is used to input the equipment to be used to measure vibration data, and on this screen are arranged an equipment selection field 307, a button 304 with a left-pointing arrow meaning "back," a button 305 with a right-pointing arrow meaning "forward," and a "cancel" button 306.
When button 304 is operated, the screen transitions to the previous input screen 300B. On the other hand, when button 305 is operated, the screen transitions to input screen 300D shown in FIG.

The input screen 300D shown in Figure 15 (C) is for inputting the measurement depth, and on this screen are arranged a depth selection field 308, a button 304 with a left-pointing arrow meaning "back," a button 305 with a right-pointing arrow meaning "forward," and a "cancel" button 306.
When button 304 is operated, the screen transitions to the previous input screen 300C. On the other hand, when button 305 is operated, the screen transitions to operation screen 300R shown in FIG.

Returning to the description of FIG.
When the input of the construction information and site information is completed in step 21, the information terminal 30 determines whether or not to acquire an entire image of the measurement location (step 22).
If a positive result is obtained in step 22, the information terminal 30 acquires an overall image of the type specified by the worker (step 23). For example, an image capturing an area where there is a high possibility of a water leak is acquired.
Next, the information terminal 30 combines the mesh with the overall image (step 24). As described above, the mesh is made up of a plurality of sections. In this embodiment, the layout of the sections is determined in advance.

Next, the information terminal 30 accepts the designation of a measurement point by the operator (step 25). The measurement point here is designated by designating one of the multiple sections that make up the mesh.
Thereafter, the information terminal 30 determines whether or not to capture an image of the measurement location (step 26). If a negative result is obtained in the above-mentioned step 22, the information terminal 30 skips steps 23 to 25 and executes the determination in step 26.
The image captured in step 26 is not for identifying the measurement point, but refers to any image that can be linked to the measurement point.

If a positive result is obtained in step 26, the information terminal 30 acquires the captured image (step 27). The image is captured using, for example, the camera 35 of the information terminal 30 (see FIG. 3A).
When an image is acquired in step 27, or when a negative result is obtained in step 26, the information terminal 30 starts measurement (step 28) and transmits the acquired vibration data and the like to the analysis server 40 (step 29). Here, information such as construction information, site information, and the date and time of measurement that are linked to the vibration data are also uploaded.

Upon receiving the vibration data, the analysis server 40 analyzes the vibration data (step 30). Upon completion of the analysis process, the analysis server 40 transmits the analysis results to the information terminal 30 (step 31). The analysis server 40 also records the acquired measurement data in the database 400 (see FIG. 4) (step 32).
Meanwhile, the information terminal 30 that has received the analysis results displays the analysis results in association with specific measurement points within the mesh (step 33).
Next, the information terminal 30 determines whether or not the location has been set as a water leak location (step 34). Specifically, it determines whether or not the worker has set the location as a water leak location.

If a positive result is obtained in step 34, the information terminal 30 instructs the analysis server 40 to set the location of the water leak (step 35).
Upon receiving the instruction, the analysis server 40 links the instruction to the measurement point currently being analyzed and updates the database 400 (step 37).
After instructing the setting of the leak location, or if a negative result is obtained in step 34, the information terminal 30 determines whether or not to continue measuring (step 36).
If a positive result is obtained in step 36, the information terminal 30 returns to step 25 and accepts the specification of a new measurement point.
On the other hand, if a negative result is obtained in step 36, the information terminal 30 ends the inspection process.

16A and 16B are diagrams illustrating an example of transition of the operation screen when measuring an entire image of a measurement point when the detailed measurement mode is selected. (A) is an operation screen 300R used to select whether or not to capture an entire image of the measurement point, (B) is an operation screen 300S during image capture, (C) is an operation screen 300T after image capture, and (D) is an operation screen 300U used to specify a measurement point.
16A, a button 335 labeled "Take an entire image of the measurement point," a button 336 labeled "Do not take an image," and a button 337 labeled "Stop measurement" are arranged. In FIG. 16A, the selected state of the button 335 is indicated by shading.

When button 336 is selected, information terminal 30 immediately starts measuring vibration data. In this case, selection screen 300R transitions to operation screen 300H (see FIG. 18).
On the other hand, when the button 337 is operated, the information terminal 30 transitions to the initial screen 300A (see FIG. 14A).
An operation screen 300S shown in FIG. 16(B) displays an image 312 of a subject within the field of view of the camera 35 (see FIG. 3(A)). In the case of FIG. 16(B), an image of the vibration sensor 23 (reference numeral omitted in the figure) laid flat on the floor, which is the measurement location, is captured. When the image capture button 313 is tapped, the image 312 of the subject at the time of tapping is acquired as an entire image 312A of the measurement location.

An operation screen 300T shown in FIG. 16C displays the acquired image as a whole image.
If the worker wishes to retake the displayed image, he or she operates the button labeled "Retake" 338. Upon detecting the operation of this button 338, the information terminal 30 returns to the operation screen 300S.
On the other hand, if the displayed image is to be used as is, the worker operates button 339 labeled "Use Photo." When the information terminal 30 detects the operation of this button 339, it transitions to operation screen 300U. Note that in FIG. 16(C) , the selected state of button 339 is indicated by shading.

An operation screen 300U shown in Fig. 16(D) is used for inputting the designation of measurement points. In the case of the operation screen 300U, a virtual mesh 340 is displayed in the center of the screen, superimposed on the entire image 312A. In the case of Fig. 16(D), the mesh 340 is made up of a total of 84 sections, with 12 rows and 7 columns. In the case of this embodiment, the mesh configuration is based on the initial setting.
In FIG. 16D, a cursor K indicating the position of a candidate measurement point is located at the upper left corner of the mesh 340.

The position of cursor K, which specifies the measurement point, can be moved by operating cursor key 341. Note that even after the entire image 312A has been acquired, imaging can be continued using information terminal 30 fixed to a tripod or the like, and the captured image can be superimposed on the entire image 312A on operation screen 300U. In this case, the actual positions of the tip of listening rod 21 and vibration sensor 23 can be confirmed on the screen. This makes it easy to ensure that the area specified on the screen is the same as the actual location of the tip of listening rod 21 and vibration sensor 23.

However, this method is just one example, and it is also possible to match the image of the measurement point taken for each measurement with the overall image 312A by image processing, and confirm whether the designated section matches the actual measurement point.
Furthermore, if the section specified on the overall image 312A does not match the actual measurement point, the relationship between the actual measurement point and the section on the overall image 312A may be automatically adjusted by image processing.

In addition, a survey map of the site may be generated using LiDAR (Light Detection and Ranging) or similar technology installed on the information terminal 30 and used as the overall image. A virtual map in which mesh 340 is superimposed on the survey map may be linked to other devices related to on-site work, such as other smartphones or smart glasses. If there are artificial or natural objects in the virtual map that can be used as markers, capturing the markers within the field of view of the camera of another smartphone or smart glasses makes it easy to share the mesh 340 as seen from the location of another device or specified measurement points.

Markers can be natural objects such as stones or trees, or man-made objects such as plastic ornaments in multiple colors such as red, blue, and yellow. To specify the direction, multiple markers, preferably three or more, are required. It is desirable for the markers to have a color, shape, and size that allow them to be distinguished from others.
This function can also be used to easily guide on-site workers to designated measurement points. Guidance can be achieved using voice guidance, a virtual arrow displayed on the display of another smartphone, or in front of the wearer of smart glasses. In other words, augmented reality (AR) technology can also be used.

Alternatively, a projector may be used to project an image of mesh 340 onto the leak inspection site so that it matches the mesh 340 on the captured overall image 312A. If it is guaranteed that the image of mesh 340 projected by the projector matches the mesh 340 captured as part of the overall image 312A displayed on the screen, then after capturing the overall image 312A, even if actual measurement points are determined using the divisions of mesh 340 projected onto the site as a reference, it is possible to ensure that they match the divisions specified on the operation screen 300U.

Furthermore, when an image of mesh 340 is projected onto the site using a projector and the projected site state is captured as overall image 312A, measurements are performed with the listening rod 21 or vibration sensor 23 positioned in the section of the projected image, and the state is captured by camera 35, so there is no need to superimpose mesh 340 onto overall image 312A on information terminal 30. In this case, the image captured by the projected image of mesh 340 becomes the overall image. In this case, overall image 312A is processed to extract straight line segments corresponding to mesh 340, and the area surrounded by the extracted straight lines is identified as the section. The identified section is then managed using intra-mesh position information 404 (see Figure 4).

In addition, in this embodiment, a virtual mesh 340 is superimposed on the overall image 312A, but it is also possible to install surveying threads in a matrix at the site prior to inspection and capture this state as the overall image 312A. In this case, the mesh 340 included in the overall image 312A is given by the actual surveying threads. In this case, just as when an image of the mesh 340 is projected on site, image processing of the captured overall image 312A can be used to extract straight line segments corresponding to the surveying threads, and the area surrounded by the extracted straight lines can be identified as a section, allowing measurement points to be managed.

An indicator 342 is displayed in the upper section of the operation screen 300U shown in Fig. 16(D), using colors to indicate the probability that the location is a water leak. The indicator 342 shown in Fig. 16(D) has six levels: "0%", "20%", "40%", "60%", "80%", and "Leak", and the higher the possibility, the darker the color. Note that these classifications and display formats are merely examples.
In addition, the operation screen 300U displays a display field 343 for the number of sections that have been measured. In the case of Fig. 16(D), since the entire image 312A has just been captured, the number of sections that have been measured is 0 (zero). The denominator is 84 (= 12 x 7).

The operation screen 300U also has a button 344 for setting the section where the cursor K is located as the measurement point, a button 345 for use when you want to display detailed analysis results of the measurement point on the screen, and a button 346 for use when you want to end measurement in the detailed measurement mode.
The button 344 is labeled "Measurement Point." The button 345 is labeled "Display." The button 346 is labeled "Back."

Figure 17 is a diagram illustrating an example of the transition of operation screens displayed before the first measurement is started when the detailed measurement mode is selected. (A) is operation screen 300V when setting the measurement location, (B) is operation screen 300E when capturing an image of the measurement location, (C) is operation screen 300T immediately after capturing the image, and (D) is operation screen 300G for starting measurement. In Figure 17, parts corresponding to those in Figures 7 and 16 are assigned the same reference numerals.

17A, the cursor K is moved to the section where the vibration sensor 23 (see FIG. 1) placed flat on the floor is located. When the button 344 is operated, the section where the cursor K is located is set as the measurement point. After this, the operation screen 300V transitions to the operation screen 300E.
17(B) is provided with a button 309 labeled "Take image of measurement point," a button 310 labeled "Do not take image," and a button 311 labeled "Stop measurement." In FIG. 17(B), the selected state of button 309 is indicated by shading.

When button 309 is operated, operation screen 300E transitions to operation screen 300T via operation screen 300F (see FIG. 7B).
17C, an object image 312 within the imaging field of view of camera 35 (see FIG. 3A) is displayed on the screen. The object image 312 here is an image captured independently of the entire image 312A.
17(D), a button 314 labeled "Start measurement" and a button 315 labeled "Stop measurement" are displayed on the screen. Here, the button 314 used to instruct the start of measurement is selected.
By operating button 314, operation screen 300G transitions to operation screen 300H (see FIG. 18A).

18A and 18B are diagrams illustrating an example of transitions of the operation screen when on-site measurements are repeated with the detailed measurement mode selected. (A) is an operation screen 300H indicating that measurement is in progress, (B) is an operation screen 300U displayed immediately after measurement of two measurement locations is completed, (C) is an operation screen 300U displayed immediately after measurement of three measurement locations is completed, and (D) is an operation screen 300U displayed immediately after measurement of six measurement locations is completed.
In FIG. 18, parts corresponding to those in FIGS. 7 and 16 are denoted by the same reference numerals.

As the number of measurement locations increases, the number displayed in the display field 343 for the number of sections that have been measured is also counted up.
In the overall image 312A, the sections for which vibration data has been measured are colored in accordance with the analysis results. The color of the section is updated each time the analysis results are notified from the analysis server 40 (see FIG. 1).
According to the operation screen 300U shown in FIG. 18(D), it can be seen that there is a high possibility that water leakage has occurred at the fourth to sixth designated measurement points.

In Fig. 18(D), button 345 used to display detailed analysis results of the measurement location is in a selected state. When button 345 is operated, operation screen 300U transitions to information screen 300X shown in Fig. 19(A). Information screen 300X here is an example of a "screen" in the claims.
19A and 19B are diagrams illustrating an example of an operation screen used to display detailed analysis results of a measurement point, where (A) shows the upper part of the screen and (B) shows the lower part of the screen.
In the information screen 300X shown in Fig. 19(A), the slider of the scroll bar 357 is located at the top of the screen. Therefore, the top of the analysis result page is displayed. In the information screen 300X shown in Fig. 19(B), the slider of the scroll bar 357 is located at the bottom of the screen. Therefore, the bottom of the analysis result page is displayed.

The information screen 300X shown in Figures 19 (A) and (B) has a mesh information column 347, a leak probability column 348, a diagnostic comment column 349, a measurement data column 350, a measurement date and time column 351, a measurer column 352, a tag column 353, an image column 354 of the measurement location, and a spectrum column 355.
In addition, the information screen 300X is provided with a button 356 labeled "Set as leak location," a scroll bar 357, and a button 358 labeled "Back." Operating the button 358 returns to the previous screen.

The mesh information column 347 displays the structure and type of the mesh used, for example, it displays that the mesh is made up of 12 rows and 7 columns, totaling 84 sections.
The water leakage probability column 348 displays the water leakage probability calculated by the analysis server 40 (see FIG. 1). Since the button 356 is selected, the water leakage probability is displayed as "100%." Incidentally, even if a measurement point has been set as the location of a water leakage, the setting can be canceled by operating the button 356 again.
The button 356 here is an example of an interface for registering a specific measurement point on the overall image 312A as a leak point.
The location of the water leak may be set using voice recognition technology. Also, a dedicated hardware key may be provided on the device main body 25 or the like for setting the location of the water leak.

In addition, the diagnostic comment field 349 displays a brief diagnostic comment notified by the analysis server 40. Here, the facts set by the operator as the leak location are displayed. The facts set by the operator as the leak location are also uploaded to the analysis server 40 and reflected in the database 400 (see Figure 4).

The measurement data field 350 displays various information related to the acquisition of vibration data.
On the information screen 300X, a measurement date and time column 351, an operator column 352, a tag column 353, an image column 354 of the measurement location, and a spectrum column 355 are displayed in association with a measurement data column 350.
The information in each field related to the measurement data field 350 is stored in the database 400 in association with the measurement location.
The screen of the measurement location image field 354 can also be used to check the measurement location when visiting at a later date.
The spectrum of the vibration data is displayed in the spectrum field 355. In other words, the operator can visually confirm the characteristics of the vibration data. Displaying the spectrum of the vibration data makes it easier to determine whether there is a water leak compared to listening to the vibration data.

20A and 20B are diagrams illustrating an example of the transition of the operation screen when the detailed measurement mode is ended. (A) shows the operation screen 300U when the end of measurement is instructed, (B) shows the operation screen 300Y for specifying how to handle the measurement results, and (C) shows the operation screen 300Z used to end the detailed measurement mode.
In FIG. 20, parts corresponding to those in FIG. 16 are denoted by the same reference numerals.
20A, the button 346 labeled "Back" is in a selected state, and the information terminal 30 recognizes that the measurement in the detailed measurement mode has ended.

When the operator operates the button 346, the operation screen 300U transitions to an operation screen 300Y shown in FIG. 20(B).
The operation screen 300Y has a button 359 used to instruct the output of a report linked to the construction name initially input, and a button 360 used to instruct the new registration of measurement results.
The button 359 is labeled "Result Output." The button 360 is labeled "New Registration." In the case of Fig. 20(B), the button 360 is in a selected state.
An operation screen 300Z shown in Fig. 20C has a button 361 labeled "Exit." The button 361 in Fig. 20C is in a selected state. When the button 361 is operated, the screen returns to the initial screen 300A (see Fig. 14).

<Summary>
In this embodiment, the spectrum of the vibration data measured on-site is displayed as the analysis result on the information terminal 30. Therefore, a worker working on-site can visually confirm the difference in the frequency characteristics of the vibration data.
Furthermore, since the spectrum of the vibration data is displayed, even workers who do not possess so-called craftsmanship can determine the location of the leak with high accuracy.
In addition, displaying the spectrum of vibration data makes it easier to share information and transfer skills.

In this embodiment, the probability that a measurement point is a leak location is displayed on the screen using text and color. In particular, in the detailed measurement mode, the section within the mesh 340 designated as the measurement point is displayed in a color corresponding to the probability that it is a leak location, making it easy to confirm the location of the leak at the site.
Furthermore, since the actual measurement points are linked to the sections within the mesh 340, it is possible to reduce the discrepancy between the measurement points in the data and the measurement points at the site. As a result, it is possible to pinpoint the location of the leak even during repair work at a later date.
In addition, in this embodiment, a button 356 (see Figure 19) is provided for setting the measurement point corresponding to the information screen 300X (see Figure 19) as the leak location, so that the determination by an on-site worker that it is the leak location can be recorded.

<Second Embodiment>
<System Configuration>
Fig. 21 is a diagram illustrating an example of the conceptual configuration of a water leakage detection system 1A used in embodiment 2. In Fig. 21, parts corresponding to those in Fig. 1 are assigned the same reference numerals.
The water leak inspection system 1A shown in FIG. 21 differs from the water leak detection system 10 (see FIG. 1) described in the first embodiment in that the water leak detection system 10A is composed of a water leak detector 20 and a device main body 250.

The device main body 250 used in this embodiment is a device in which the device main body 25 (see FIG. 1) in the first embodiment and the information terminal 30 (see FIG. 1) are integrated.
Fig. 22 is a diagram illustrating an outline of the flow of data between devices constituting the water leakage detection system 1A used in embodiment 2. In Fig. 22, parts corresponding to those in Fig. 2 are assigned the same reference numerals.

The device main body 250 shown in Fig. 22 is composed of a main body circuit 25A and an information processing unit 25B. The hardware configuration of the information processing unit 25B is similar to that of the information terminal 30 shown in Fig. 3A, for example. That is, the information processing unit 25B is provided with a processor 31 that executes programs required to display an operation screen presented to a worker on-site, a touch panel 34 used to display the operation screen, a camera 35 used to capture an overall image 312A of the site (see Fig. 17A) and an image of a subject 312 at a measurement location (see Fig. 17C), a communication module 36 used to communicate with the analysis server 40, and the like.
The device main body 250 here is an example of a leak test device.

<Third Embodiment>
23 is a diagram illustrating an example of the conceptual configuration of a water leak detection system 1B used in embodiment 3. (A) is an example of the appearance of the water leak detection system 1B, and (B) is a diagram illustrating an outline of the data flow between devices that make up the water leak detection system 1B. In FIG. 23, parts corresponding to those in FIG. 1 are assigned the same reference numerals.
The water leak inspection system 1B shown in Figure 23 differs from the water leak detection system 10 (see Figure 1) described in embodiment 1 and the water leak detection system 10A (see Figure 21) described in embodiment 2 in that the water leak detection system 10B is composed of a water leak detector 20 and a device main body 260, and the device main body 260 performs analysis processing of vibration data.

That is, the water leakage detection system 1B used in this embodiment does not require the analysis server 40 (see FIG. 1).
23B is composed of a main circuit 25A and an information processing unit 25C. The hardware configuration of the information processing unit 25C is the same as that of the information processing unit 25B (see FIG. 22) described in the second embodiment.
However, the calculation capability of the information processing unit 25C is much faster than that of the information processing unit 25B described in the second embodiment, and has a sufficient storage capacity to store the measurement data.
In this system configuration, communication with the analysis server 40 is not required, so leak inspection of the measurement point can be performed even at a site where communication conditions are poor.
The device main body 260 here is an example of a leak test device.

<Other embodiments>
(1) Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the scope of the above-described embodiments. It is clear from the claims that various modifications and improvements to the above-described embodiments are also included in the technical scope of the present invention.

(2) In the above-described embodiment, when button 335 (see FIG. 16A) is operated, the camera 35 (see FIG. 3) of the information terminal 30 (see FIG. 1) starts capturing an entire image 312A (see FIG. 16D). However, after button 335 is operated, an operation screen 300AA may be displayed to select the type of entire image 312A.
FIG. 24 is a diagram illustrating an example of an operation screen used to select the type of image to be used as the entire image 312A.

The operation screen 300AA shown in Figure 24 has arranged thereon a button 371 labeled "Use images taken by camera," a button 372 labeled "Use map," a button 373 labeled "Use piping diagram," a button 374 labeled "Use aerial photograph," a button 375 labeled "Use photos taken by drone," and a button 376 labeled "Stop measurement."
The contents of the labels attached to these buttons 371 to 375 and the number of buttons are examples. When any button is operated, a screen for selecting the corresponding type of image is displayed in place of operation screen 300S (see FIG. 16B) or operation screen 300T (see FIG. 16C).

Fig. 25 is a diagram illustrating a display example of the operation screen 300U when an aerial photograph of the leak inspection site taken from above, an image taken by a drone, or any similar image is used as the overall image. In Fig. 25, parts corresponding to those in Fig. 16(D) are denoted by the same reference numerals.
In the operation screen 300U shown in Figure 25, a virtual mesh 340 is displayed within an aerial photograph of a site where multiple vehicles are parked, and the leakage probability notified as an analysis result is displayed in color at the measured locations in the sections that divide the mesh 340.

(3) In the above embodiment, an example was described in which a spectrum was displayed as the analysis result of vibration data, but a spectrum may also be displayed.
26A and 26B are diagrams illustrating examples of spectra that are analysis results of vibration data, where (A) is an example of a spectrum when there is no water leakage, (B) is an example of a spectrum when there is a suspected possibility of water leakage, and (C) is an example of a spectrum when there is a high possibility of water leakage.
When there is no water leakage (i.e., the case of FIG. 26(A)), the sound pressure level at all frequencies is low and no change over time is observed.

On the other hand, when there is a suspicion of a water leak (i.e., the case of Figure 26(B)), an increase in sound pressure level is observed in the mid-to-high frequency range, and particularly high sound pressure levels appear over time in the mid-range frequency range. However, the sound pressure levels are discrete and are likely to be temporary noise.
When there is a high possibility of a water leak (i.e., the case of Figure 26(C)), the sound pressure level of mid-to-high frequencies remains high. When this spectrum appears, even an unskilled person can easily determine that there is an extremely high possibility of a water leak.

(4) In the above embodiment, the mesh 340 having a structure given by default is synthesized with the entire image 312A. However, the structure of the mesh 340 may be changeable by the operator.
27A and 27B are diagrams illustrating an example of the transition of the operation screen before and after a change in the structure of the mesh 340. (A) shows an entire image 312A onto which the mesh 340 set in the initial settings has been superimposed, (B) shows an example of a screen used to accept a change in the structure of the mesh 340, and (C) shows the entire image 312A onto which the mesh 340 has been superimposed after the change.

The operation screen 300U shown in Fig. 27(A) is the same as the operation screen 300U shown in Fig. 16(D). Therefore, a mesh 340 consisting of 12 rows and 7 columns of sections is superimposed on the entire image 312A.
27(B) displays a pop-up screen 361A used to accept changes to the mesh structure (hereinafter referred to as the "change acceptance screen") 361A. Arranged on change acceptance screen 361A are a display field 362 showing the current structure, a display field 363 showing the structure after the change, and an execute change button 364.

In the case of the change acceptance screen 361A shown in Fig. 27(B), the values of the number of rows and columns after the change are input fields. For example, the values that can be input may be displayed outside the fields. A display field 363 shows an example of changing to four rows and four columns.
27(C), the structure of mesh 340 superimposed on overall image 312A has been changed to 4 rows and 4 columns. By using this function, it is possible to freely set the mesh structure according to the site.

The structure of mesh 340 may be automatically adjusted according to the scale information of entire image 312A and the display size of entire image 312A displayed on operation screen 300U.
For example, the structure of the mesh 340 is automatically optimized between a 1:1 scale and a 1:100 scale. If the structure of the mesh 340 is the same, the size of each section in real space will be significantly different, even if it is the same section on the overall image 312A. For example, if one section on the screen corresponds to a 20 m x 20 m area in real space, it will be difficult to identify the location of the leak in real space. Therefore, if scale information is available, the structure of the mesh 340 can be automatically adjusted according to the scale.

Furthermore, when the display size of the overall image 312A displayed on the operation screen 300U is small, displaying the mesh 340 in the same structure as when the display size is large may impair the visibility of the sections. In such cases, the structure of the mesh 340 synthesized on the screen may be automatically changed to ensure visibility.

(5) The analysis server 40 (see Figures 1 and 21) in the above-described first and second embodiments analyzes vibration data measured on-site and records the measurement data, etc. in a database. In addition to these functions, the analysis server 40 may also perform processing related to operation screens and transitions between screens to be displayed on the touch panel 34 (see Figure 3) of the information terminal 30 (see Figure 1) or the device main body 250 (see Figure 21) used on-site.
In particular, the analysis server 40 may have the function of displaying an overall image of the leak inspection site as an operation screen and the function of accepting specific sections of the overall image as measurement points. In this case, the information terminal 30 and the device main body 250 used at the site are used as information input/output devices. The analysis server 40 having these functions is an example of an information processing device that cooperates with the leak inspection device used at the site, and is also an example of a computer used for leak inspection.

It is also possible to provide a server that analyzes vibration data and a server that provides operation screens for the information terminal 30 and the device main body 250 used on-site.
In other words, a cloud service consisting of a service that analyzes vibration data and a service that manages operation screens and transitions between those screens may be realized on a single server or through the cooperation of multiple servers.
Incidentally, the server may be in any hardware form as long as it is a computer that provides services to the information terminals 30 used on-site.

(6) In the above-described embodiment, an example was described in which a virtual mesh 340 (see FIG. 16(D)), in which each section is defined as a collection of squares, is directly composited onto the overall image 312A (see FIG. 16(D)) and displayed.
However, when capturing images of the ground or walls at a leak inspection site, the wider the capture range, the flat surface will be captured from an oblique direction. For example, Figures 16(B) and 16(C) show examples of capturing images of a floor surface covered with square tiles. However, because the image was captured from an obliquely upward angle relative to the floor surface, the tiles appear trapezoidal. In other words, the capturing direction of the information terminal 30 is tilted in one axis direction from the direction directly facing the floor surface.
Therefore, when synthesizing mesh 340, the tilt angle may be calculated from the subject in entire image 312A, mesh 340 may be deformed into a trapezoid shape according to the calculated tilt angle, and the deformed mesh 340 may be synthesized with entire image 312A. Note that deformation of mesh 340 may also be performed via a manual interface.

1, 1A, 1B... Water leak inspection system, 10, 10A, 10B... Water leak detection system, 20... Water leak detector, 21... Sound listening rod, 23... Vibration sensor, 25, 250, 260... Device main body, 25B, 25C... Information processing unit, 30... Information terminal, 40... Analysis server, 400... Database

Claims (12)

A leak testing device used by a worker at a site where a fluid leak from a pipe is to be tested,
a control unit that displays an overall image of the site on a work screen;
a reception unit that receives a partial area on the entire image as a measurement point;
and
The control unit associates the measured vibration data with the measurement point on the entire image.
It is a leak testing device,
the control unit synthesizes and displays a virtual section on the entire image,
setting the position of the section selected by the operator as the measurement point;
Leak testing equipment. the control unit accepts a setting of the entire image in an initial operation of the on-site inspection.
The leak test device according to claim 1 . The number and arrangement of the compartments are preset.
The leak test device according to claim 1 . the number and arrangement of the sections are automatically set according to information on the scale of the entire image;
The leak test device according to claim 1 . the number and arrangement of the sections are set according to the size of the entire image displayed on the work screen;
The leak test device according to claim 1 . The number and arrangement of the compartments can be changed by the operator.
The leak inspection device according to any one of claims 3 to 5. the control unit displays, at each of the measurement points on the entire image, an analysis result of the vibration data associated with the measurement point.
The leak inspection device according to any one of claims 1 to 6. the control unit displays the section corresponding to the measurement point in a color according to the analysis result.
The leak test device according to claim 7. The control unit associates a photograph of the site, which is taken when measuring the measurement point and is different from the overall image, with the measurement point.
The leak inspection device according to any one of claims 1 to 8. The control unit has an interface for registering a specific measurement point on the entire image as a leak point.
The leak inspection device according to any one of claims 1 to 9. An information processing device that cooperates with a leak inspection device used on-site to inspect for fluid leaks from piping,
a control unit that displays an overall image of the site on a work screen of the leak test device;
a receiving unit that receives a partial area on the entire image as a measurement point through the leak inspection device;
and
the control unit associates the measured vibration data with the measurement points on the entire image;
the control unit synthesizes and displays a virtual section on the entire image, and sets the position of the section selected by the operator as the measurement point.
Information processing device. The computer used to check for fluid leaks from pipes
A function to display an overall image of the site on the work screen,
a function of accepting a partial area on the entire image as a measurement point;
a function of linking measured vibration data to measurement points on the entire image;
a function of synthesizing and displaying a virtual section on the entire image;
a function of setting the position of the section selected by the operator as the measurement point;
A program to achieve this.