JP7575738B2 - Display device - Google Patents

Description

The present invention relates to a display device that displays information using augmented reality.

In recent years, in order to address the deterioration of structures (structural elements) made of concrete, such as tunnels, bridges, levees, and buildings, various inspections have been carried out to identify deteriorated parts and to maintain the concrete structures by repairing the deteriorated parts. Such inspections include inspections for physical deterioration such as floating, peeling, and cracks in concrete structures using ultrasonic, radar, infrared, X-ray, and hammering methods (Patent Document 1).

There are also inspections of the chemical deterioration state of concrete structures, such as neutralization and chloride content. One method of inspecting the chemical deterioration state is to, for example, drill holes in the concrete structure to take samples from the structure, and then inspect the samples using reagents. Another method of inspecting chemical deterioration is to use infrared rays (see Patent Document 2).

JP 2005-291881 A JP 2016-025204 A

However, there was a problem in that it was not easy to identify which locations the above-mentioned inspections should be performed on. In addition, when using the results of the above-mentioned inspections to repair deteriorated parts of a structure, there was a problem in that it was not easy to identify which locations the inspection results correspond to. Thus, in the past, there was a problem in that it was not easy to identify the target locations within a structure.

The present invention was made to solve the above problems, and aims to make it easier to identify the desired location within a structure.

The display device of the present invention comprises a first memory unit that stores multiple display contents for each of multiple divided regions obtained by dividing a structure, a second memory unit that stores layout information for the multiple divided regions, and a display control unit that arranges the multiple display contents stored in the first memory unit in a matrix form using augmented reality and displays them on the display unit, relative to each of the multiple divided regions based on the layout information stored in the second memory unit.

In one example configuration of the above display device, the display content is identification information that identifies the locations of the multiple divided areas.

In one example of the above display device, the display content is a number of measurement results obtained by measuring the surface side of the structure for each of the multiple divided regions.

In one example configuration of the above display device, the display control unit displays multiple display contents on the display unit together with corresponding layout information.

In one example of the configuration of the above display device, the display control unit displays multiple display contents on the display unit in different colors according to the magnitude of the measurement values.

In one configuration example of the display device, a third storage unit that stores the position information of the structure in correspondence with the identification information of the structure, and a position information acquisition unit that acquires the position information of the device itself are further included, and the display control unit displays on the display unit multiple display contents of the structure of the identification information corresponding to the position information acquired by the position information acquisition unit.

In one example configuration of the display device, the display device further includes an imaging unit that captures an image of the front of the device, a detection unit that detects a symbol that is set from the image captured by the imaging unit, and a reference setting unit that sets the position of the symbol detected by the detection unit as a reference position, and the display control unit adjusts the placement reference of the placement information to the reference position and displays multiple display contents on the display unit in relative correspondence with each of the multiple divided areas.

In one example configuration of the above display device, the display control unit displays the image captured by the imaging unit on the display unit by superimposing the image on the multiple display contents.

In one example configuration of the above display device, the structure is made of reinforced concrete, and each of the multiple display contents indicates the deterioration state of the structure, including salt concentration, peeling, cracks, and cavities.

In one example of the above display device, the display unit is a head-mounted display.

As described above, according to the present invention, the display control unit relatively corresponds multiple display contents to each of multiple measurement areas based on the placement information, and displays them on the display unit using augmented reality, making it easier to identify the desired location within the structure.

FIG. 1 is a diagram showing a configuration of a display device according to a first embodiment of the present invention. FIG. 2 is a diagram showing a configuration of a display device according to a second embodiment of the present invention. FIG. 3 is a diagram showing a configuration of a display device according to a third embodiment of the present invention. FIG. 4 is a diagram showing a hardware configuration of a display device according to an embodiment of the present invention.

The following describes a display device according to an embodiment of the present invention.

[First embodiment]
First, a display device according to a first embodiment of the present invention will be described with reference to Fig. 1. This display device includes a first storage unit 101, a second storage unit 102, a display control unit 103, and a display unit 104.

The first memory unit 101 stores multiple display contents for each of multiple divided regions of the structure. The structure is, for example, made of reinforced concrete. The display contents are identification information that identifies the locations of the multiple divided regions. For example, the identification information identifies each location of the divided regions arranged in a matrix. The multiple display contents are multiple measurement results obtained by measuring the surface side of the structure for each of the multiple divided regions. The measurements are, for example, measurements of the deterioration state of the structure, including salt concentration, peeling, cracks, and cavities, and each of the multiple measurement results indicates the deterioration state of the structure, including salt concentration, peeling, cracks, and cavities.

The display contents are obtained by actually measuring the state of the target structure in advance and stored in the first storage unit 101.

The second storage unit 102 stores the layout information of the multiple divided regions. The display control unit 103 displays the multiple display contents stored in the first storage unit 101 on the display unit 104 using augmented reality by relatively matching them to each of the multiple divided regions based on the layout information stored in the second storage unit 102. The display control unit 103 can, for example, display the multiple display contents on the display unit 104 together with the corresponding layout information. The display control unit 103 can also display the multiple display contents on the display unit 104 by color-coding them according to the magnitude of the measurement value.

The display unit 104 is, for example, a head-mounted display. The display unit 104 can also be a transparent display. The display unit 104 displays images of multiple display contents in a transparent or semi-transparent state, thereby superimposing augmented reality information (multiple display contents) on the target structure viewed through the display unit 104.

For example, the first storage unit 101 can be arranged in a server connected to the display unit 104 via a network. The display control unit 103 acquires multiple pieces of identification information (display contents) from the first storage unit 101 via a network, for example. The display control unit 103 also displays the acquired multiple pieces of identification information (display contents) on the display unit 104 using augmented reality, in a manner that corresponds relatively to each of the multiple divided areas based on the arrangement information stored in the second storage unit 102. The examiner refers to the identification information for each divided area displayed on the display unit 104 in this manner to perform measurements for the examination.

The examiner positions the display unit 104 so that the lower left corner of the entire display area displayed by augmented reality is the point set as the reference point of the target structure, and visually confirms (checks) the display by augmented reality. In this way, the locations of the multiple divided areas displayed by augmented reality can be matched with the locations of the actual divided areas of the structure. Such a reference point is not limited to the lower left corner, and can also be the center, and can be determined in advance.

After performing the measurements as described above, the measurement results are stored in the first storage unit 101 together with the identification information. The server associates the measurement results stored in the first storage unit 101 together with the identification information with the identification information. Furthermore, a shading display based on the measurement results, for example, color scale data corresponding to the salinity concentration obtained by the measurement, is stored in the first storage unit 101.

As described above, after the measurement results are accumulated, when a repair contractor carries out repairs based on the measurement results, the display control unit 103 acquires multiple measurement results (display contents) from the first storage unit 101, for example, via a network. The display control unit 103 also displays the multiple acquired measurement results on the display unit 104 using augmented reality, by relatively matching each of the multiple divided areas with the placement information stored in the second storage unit 102 based on the associated identification information. As a result, the repair contractor can get an overview of which parts of the structure should be repaired with priority.

For example, when inspecting structures such as the inner walls of tunnels, the areas to be inspected are generally marked with chalk or the like, and samples are taken and inspected from those areas, making it difficult to match the inspection data obtained with the corresponding inspection areas. In addition, areas that require repairs must be newly marked with chalk or the like, but there is a possibility of mismatching the marked areas. Furthermore, it is not easy to express the priority of repair areas using the above-mentioned marks, making it difficult to obtain an overall view of the repair areas. In general, the construction client, the inspection company, and the repair company are often different people (separate corporations), and there have been frequent discrepancies in the confirmation, reporting, and repair instructions for repair areas.

According to the first embodiment, by placing the display unit 104 facing the surface of the target structure to be repaired, the display contents (information identifying the divided area and measurement results such as salinity concentration) for each of the divided areas can be viewed along with the surface of the structure. Therefore, according to the first embodiment, it is easy to identify the target location. For example, it is easier to identify the measured area, and it is easier to identify the part of the structure that needs repair.

[Embodiment 2]
Next, a display device according to a second embodiment of the present invention will be described with reference to Fig. 2. This display device includes a first storage unit 101, a second storage unit 102, a third storage unit 105, a display control unit 103a, a position information acquisition unit 106, and a display unit 104. The first storage unit 101, the second storage unit 102, and the display unit 104 are the same as those in the first embodiment. In the second embodiment, a third storage unit 105 and a position information acquisition unit 106 are newly included.

The third storage unit 105 stores the position information of the structure in association with the identification information of the structure. The position information acquisition unit 106 acquires the position information of the device itself. The position information acquisition unit 106 acquires the position information of the device itself, for example, by a well-known GPS (Global Positioning System) function. The display control unit 103a displays on the display unit 104 multiple display contents of the structure whose identification information corresponds to the position information acquired by the position information acquisition unit 106.

According to the second embodiment, the display unit 104 displays display content associated with location information of the structure that the display device has placed and that the user is trying to check. For example, even if the first storage unit 101 stores display content of multiple structures that are each in a different location, problems such as selecting the wrong target structure do not occur.

[Embodiment 3]
Next, a display device according to a third embodiment of the present invention will be described with reference to Fig. 3. This display device includes a first storage unit 101, a second storage unit 102, a display control unit 103b, an imaging unit 107, a detection unit 108, a reference setting unit 109, and a display unit 104. The first storage unit 101, the second storage unit 102, and the display unit 104 are the same as those in the first embodiment. In the third embodiment, the display device newly includes the imaging unit 107, the detection unit 108, and the reference setting unit 109.

The imaging unit 107 captures an image of the front of the device. The imaging unit 107 can be, for example, an electronic still camera. The detection unit 108 detects the set symbol from the image captured by the imaging unit 107 using a well-known image processing function. The symbol can be a matrix-type two-dimensional code affixed to the structure. The shape of a specific location in the target structure can also be set as the symbol. In this case, the detection unit 108 detects a shape that matches the set shape from the image captured by the imaging unit 107. The reference setting unit 109 sets the position of the symbol detected by the detection unit 108 as the reference position.

In the third embodiment, the display control unit 103b adapts the placement criteria of the placement information to the reference position, and displays the multiple display contents on the display unit 104 in relative correspondence with each of the multiple divided areas. As a result, the locations of the multiple divided areas displayed by augmented reality automatically match the locations of the actual divided areas in the structure. Therefore, according to the third embodiment, it becomes even easier to identify the location of the structure that corresponds to the inspection results. The display control unit 103b can also superimpose an image captured by the imaging unit 107 on the multiple display contents and display them on the display unit 104.

As shown in FIG. 4, the display device according to the above-described embodiment may be a computer device including a CPU (Central Processing Unit) 301, a main memory device 302, an external memory device 303, and a network connection device 304, and the above-described functions may be realized by the CPU 301 operating (executing) a program deployed in the main memory device 302. The network connection device 304 is connected to a network 305. The functions may also be distributed among multiple computer devices.

As described above, according to the present invention, the display control unit relatively corresponds multiple display contents to each of the multiple divided areas based on the placement information, and displays them on the display unit using augmented reality, making it easier to identify the desired location within the structure.

The present invention is not limited to the embodiments described above, and it is clear that many modifications and combinations can be implemented by those with ordinary skill in the art within the technical concept of the present invention.

101: first storage unit, 102: second storage unit, 103: display control unit, 104: display unit.

Claims (11)

a first storage unit that stores a plurality of display contents for each of a plurality of divided regions of the structure;
A second storage unit that stores layout information of the plurality of divided regions;
a display control unit that relatively corresponds the plurality of display contents stored in the first storage unit to each of the plurality of divided areas based on the arrangement information stored in the second storage unit, and displays the display contents on a display unit in a matrix arrangement by augmented reality ,
a third storage unit that stores the position information of the structure in correspondence with identification information of the structure;
a location information acquisition unit for acquiring location information of the own device;
Further equipped with
The display control unit is a display device that displays, on the display unit, the multiple display contents of the structure of identification information corresponding to the position information acquired by the position information acquisition unit . 2. The display device according to claim 1 ,
The structure is made of reinforced concrete,
The display device according to claim 1, wherein each of the plurality of display contents indicates a deterioration state of the structure, including salt concentration, peeling, cracks, and cavities. a first storage unit that stores a plurality of display contents for each of a plurality of divided regions of the structure;
A second storage unit that stores layout information of the plurality of divided regions;
a display control unit that relatively corresponds the plurality of display contents stored in the first storage unit to each of the plurality of divided areas based on the arrangement information stored in the second storage unit, and displays the display contents on a display unit in a matrix arrangement by augmented reality ,
The structure is made of reinforced concrete,
A display device in which each of the multiple display contents indicates a deterioration state of the structure, including salt concentration, peeling, cracks, and cavities . The display device according to any one of claims 1 to 3 ,
The display device according to claim 1, wherein the display contents are identification information for identifying locations of the divided regions. The display device according to any one of claims 1 to 3 ,
The display device according to claim 1, wherein the plurality of display contents indicate measurement locations. The display device according to any one of claims 1 to 3 ,
The display device according to claim 1, wherein the plurality of display contents are a plurality of measurement results obtained by measuring the surface side of the structure for each of the plurality of divided regions. The display device according to any one of claims 1 to 6 ,
The display device according to claim 1, wherein the display control unit displays the plurality of display contents together with the corresponding arrangement information on the display unit. The display device according to any one of claims 1 to 7 ,
The display device according to claim 1, wherein the display control unit displays the plurality of display contents on the display unit in different colors according to the magnitude of the measured values. The display device according to any one of claims 1 to 8 ,
An imaging unit that captures an image of the front side of the device;
a detection unit that detects a set symbol from an image captured by the imaging unit;
a reference setting unit that sets the position of the symbol detected by the detection unit as a reference position,
The display control unit adjusts a placement criterion of the placement information to the reference position, and displays the plurality of display contents on the display unit in relative correspondence with each of the plurality of divided areas. 10. The display device according to claim 9 ,
The display device, wherein the display control unit displays, on the display unit, an image captured by the imaging unit over the plurality of display contents. The display device according to any one of claims 1 to 10,
The display device, wherein the display unit is composed of a head-mounted display.

Images