WO2020174613A1 - Data processing device, data processing system, data processing method, and data processing program - Google Patents

Abstract

A data processing device (1) is provided with a storage unit (20), an acquiring unit (31), a converting unit (32), and an output unit (34). The storage unit (20) stores attribute data of a plurality of constituent elements constituting a structure. The acquiring unit (31) acquires three-dimensional point cloud data of the structure. The converting unit (32), on the basis of the attribute data of the plurality of constituent elements stored in the storage unit (20), converts the three-dimensional point cloud data acquired by the acquiring unit (31) into three-dimensional computer-assisted design data of the structure including three-dimensional computer-assisted design data of each of the plurality of constituent elements. The output unit (34) outputs the three-dimensional computer-assisted design data of the structure obtained by the conversion by the converting unit (32).

Description

Data processing device, data processing system, data processing method, and data processing program

The present invention relates to a data processing device, a data processing system, a data processing method, and a data processing program that perform a process of generating three-dimensional data of a structure.

Three-dimensional point cloud data of structures obtained by using traveling type measuring devices such as MMS (Mobile Mapping System) in order to improve efficiency and sophistication of inspection and maintenance of structures such as tunnels, roads or bridges Is being used. For example, in Patent Document 1, a management server that stores three-dimensional point cloud data of a structure, and three-dimensional point cloud data of the structure are acquired from the management server, and based on the acquired three-dimensional point cloud data of the structure. A structure information providing system including a terminal device that displays an image is disclosed.

JP, 2016-142662, A

However, since the 3D point cloud data is data that represents a structure as a set of 3D points, the data size is large. Therefore, the technique described in Patent Document 1 requires a high-performance terminal device for processing three-dimensional point cloud data, and when a terminal device with low performance is used, the display of an image is delayed, etc. Therefore, there is a problem that smooth inspection work cannot be performed on the structure.

The present invention has been made in view of the above, and an object of the present invention is to obtain a data processing device capable of obtaining three-dimensional data of a structure having a small data size while utilizing the three-dimensional point cloud data of the structure. And

In order to solve the above-mentioned problems and achieve the object, the data processing device of the present invention includes a storage unit, an acquisition unit, a conversion unit, and an output unit. The storage unit stores attribute data of a plurality of constituent elements that make up the structure. The acquisition unit acquires three-dimensional point cloud data of the structure. The conversion unit includes the three-dimensional point cloud data acquired by the acquisition unit based on the attribute data of the plurality of constituent elements stored in the storage unit, and a structure including the three-dimensional computer-aided design data of each of the plurality of constituent elements. Convert 3D computer-aided design data for objects. The output unit outputs the three-dimensional computer-aided design data of the structure converted by the conversion unit.

According to the present invention, it is possible to obtain the three-dimensional data of a structure having a small data size while utilizing the three-dimensional point cloud data of the structure.

The figure which shows the structural example of the data processing apparatus concerning Embodiment 1 of this invention. FIG. 3 is a diagram for explaining processing by the data processing device according to the first exemplary embodiment FIG. 3 is a diagram showing a configuration example of a data processing system according to the first exemplary embodiment. The figure which shows an example of the three-dimensional point cloud data table concerning Embodiment 1. The figure which shows an example of the attribute data table concerning Embodiment 1. The figure which shows an example of the transformation data table concerning Embodiment 1. FIG. 3 is a diagram for explaining the relationship between the size of a polygon and the importance of components according to the first embodiment. FIG. 3 is a diagram for explaining three-dimensional CAD data of constituent elements that partially include three-dimensional point data according to the first embodiment. FIG. 3 is a diagram showing an example of a three-dimensional image of a structure displayed on the display unit of the terminal device according to the first embodiment. Flowchart showing an example of processing of the data processing apparatus according to the first exemplary embodiment The flowchart which shows an example of a process of the terminal device concerning Embodiment 1. FIG. 1 is a diagram showing an example of a hardware configuration of a data processing device according to the first exemplary embodiment

A data processing device, a data processing system, a data processing method, and a data processing program according to an embodiment of the present invention will be described below in detail with reference to the drawings. The present invention is not limited to this embodiment.

Embodiment 1.
FIG. 1 is a diagram showing a configuration example of a data processing device according to the first exemplary embodiment of the present invention. FIG. 2 is a diagram for explaining a process performed by the data processing device according to the first embodiment.

As shown in FIG. 1, the data processing device 1 according to the first embodiment includes a communication unit 10, a storage unit 20, and a processing unit 30. The communication unit 10 is communicatively connected to the terminal device 4 via a network (not shown). The processing unit 30 can transmit, for example, data in response to a request from the terminal device 4 from the communication unit 10 to the terminal device 4 via a network (not shown).

The storage unit 20 stores the attribute data of the structure. The structure is, for example, a tunnel, a road, or a bridge. The attribute data of the structure includes attribute data of a plurality of constituent elements that make up the structure. For example, when the structure is a tunnel, the attribute data of a plurality of constituent elements includes the attribute data of the tunnel body, the attribute data of the lighting equipment installed in the tunnel body, the attribute data of the blower installed in the tunnel body, etc. Be done.

The processing unit 30 includes an acquisition unit 31, a conversion unit 32, and an output unit 34. The acquisition unit 31 acquires three-dimensional point cloud data of a structure generated by the traveling measurement device 2 such as MMS. The three-dimensional point cloud data of the structure includes a plurality of three-dimensional point data, and each three-dimensional point data includes data indicating the three-dimensional position of the three-dimensional point.

The traveling-type measuring device 2 has a laser scanner device, and generates three-dimensional point cloud data of a structure from measurement data obtained by the laser scanner device while traveling. For example, when the structure is a tunnel, as shown in FIG. 2, the traveling-type measuring device 2 uses three-dimensional points on the inner wall of the tunnel based on the measurement data of the inner wall of the tunnel obtained by the laser scanner device while traveling in the tunnel. Generate group data.

The conversion unit 32 converts the three-dimensional point cloud data of the structure acquired by the acquisition unit 31 into the three-dimensional computer-aided design data of the structure based on the attribute data stored in the storage unit 20. Specifically, the conversion unit 32 converts the three-dimensional point cloud data of the structure into the three-dimensional computer-aided design data of each of the plurality of constituent elements based on the attribute data of the plurality of constituent elements that make up the structure. Convert to 3D computer-aided design data for structures containing. The three-dimensional computer-aided design data is generally called three-dimensional CAD data, and is hereinafter referred to as three-dimensional CAD data.

The attribute data of each component includes information for identifying the component, such as the name, model, or shape of the component. The conversion unit 32 determines a plurality of three-dimensional points corresponding to the constituent element among the plurality of three-dimensional points included in the three-dimensional point group data based on the attribute data of the constituent element, and calculates the data of the three-dimensional points. The process of replacing the three-dimensional CAD data of the component is performed for each component. Accordingly, the conversion unit 32 can convert the three-dimensional point cloud data of the structure into the three-dimensional CAD data of the structure including the three-dimensional CAD data of each component. The three-dimensional CAD data of such a constituent element is data that represents a constituent element by points, lines, and surfaces, and has a smaller data size than the aggregate data of three-dimensional point data that represents a constituent element only by a set of points.

When the structure is a tunnel, for example, the conversion unit 32 converts the three-dimensional point cloud of the tunnel into the three-dimensional CAD data of the tunnel based on the attribute data of the tunnel body and the attribute data of the lighting equipment. As shown in FIG. 2, the three-dimensional CAD data of the tunnel includes the three-dimensional CAD data of the tunnel body, the three-dimensional CAD data of the lighting device, and the three-dimensional CAD data of the deformed shape.

The output unit 34 outputs the three-dimensional CAD data of the structure converted by the conversion unit 32 to the terminal device 4 via a network (not shown). The terminal device 4 generates image data of the structure based on the three-dimensional CAD data of the structure acquired from the data processing device 1, and displays the generated image data on a display unit (not shown). For example, when the structure is a tunnel, the terminal device 4 determines the tunnel main body, the lighting device, the deformation, and the like based on the three-dimensional CAD data of the structure received from the data processing device 1, as shown in FIG. Display the image of the tunnel containing.

In the case of 3D point cloud data represented by a set of 3D points arranged in mm units, if a space of several hundred meters is represented by a point cloud like a tunnel, the data will become enormous. In the data processing device 1, since the three-dimensional point cloud data of the structure is converted into the three-dimensional CAD data of the structure, the three-dimensional point cloud data of the structure is utilized and the three-dimensional data of the structure having a small data size is converted. Can be generated. Therefore, for example, the data processing device 1 can suppress the data size of the three-dimensional data transmitted to the terminal device 4. In addition, the terminal device 4 can also display an image based on the three-dimensional data of the structure without providing a high-performance processor for processing the three-dimensional point cloud data.

Hereinafter, the data processing system including the data processing device 1 according to the first embodiment will be described in more detail. FIG. 3 is a diagram illustrating a configuration example of the data processing system according to the first embodiment. As shown in FIG. 3, the data processing system 100 according to the first embodiment includes a data processing device 1, a traveling measurement device 2, and a terminal device 4. The data processing device 1 includes a communication unit 10, a storage unit 20, and a processing unit 30.

The communication unit 10 is connected to the network 6 and receives the three-dimensional point cloud data from the traveling measuring device 2 via the network 6. Further, the communication unit 10 is connected to the network 6 and transmits/receives data to/from the terminal device 4 via the network 6. The network 6 is, for example, a WAN (Wide Area Network) such as the Internet or a LAN (Local Area Network). The network 6 may be a dedicated line.

The terminal device 4 is, for example, a tablet terminal, a smartphone, a laptop PC (Personal Computer), a PDA (Personal Digital Assistant), or the like. The terminal device 4 is used, for example, by an inspector who inspects the structure or an administrator who maintains and manages the structure.

The storage unit 20 stores a three-dimensional point cloud data table 21, an attribute data table 22, and a transformation data table 23. The three-dimensional point cloud data table 21 includes the three-dimensional point cloud data of the structure transmitted from the traveling measurement device 2 to the data processing device 1.

FIG. 4 is a diagram showing an example of the three-dimensional point cloud data table according to the first embodiment. As shown in FIG. 4, the three-dimensional point group data table 21 includes three-dimensional data including “three-dimensional point ID (Identifier)”, “X coordinate”, “Y coordinate”, “Z coordinate”, and “luminance”. Multiple points data are included. The “3D point ID” is identification information of a 3D point included in the 3D point group of the structure. The “X coordinate”, the “Y coordinate”, and the “Z coordinate” are the coordinates of the three-dimensional point in the XYZ coordinate system. That is, the “X coordinate” is the X coordinate of the three-dimensional point in the XYZ coordinate system, the “Y coordinate” is the Y coordinate of the three-dimensional point in the XYZ coordinate system, and the “Z coordinate” is the three-dimensional point. It is the Z coordinate. “Brightness” is information indicating the brightness of a three-dimensional point.

In the example shown in FIG. 4, the three-dimensional point with the three-dimensional point ID “10001” has the X coordinate “123.456”, the Y coordinate “789.123”, the Z coordinate “456.789”, and the brightness “123”. It is a three-dimensional point. The three-dimensional point with the three-dimensional point ID “10002” is the three-dimensional point with the X coordinate “125.121”, the Y coordinate “788.821”, the Z coordinate “450.864”, and the brightness “111”. .. The three-dimensional point with the three-dimensional point ID “10003” is the three-dimensional point with the X coordinate “124.327”, the Y coordinate “790.631”, the Z coordinate “455.427”, and the brightness “120”. ..

The attribute data table 22 includes attribute data of each of a plurality of constituent elements that make up a structure. FIG. 5 is a diagram showing an example of the attribute data table according to the first embodiment. As shown in FIG. 5, the attribute data table 22 includes a plurality of component attribute data including “component ID”, “name”, and “specification”. The “component ID” is identification information of a component. “Name” is information indicating the name of the component. “Specifications” is information indicating the specifications of the constituent elements. The specifications of the component include information such as the model, length, and shape of the component, for example. The names and specifications of the constituent elements are information for identifying the constituent elements and are an example of attribute data of the constituent elements.

In the example shown in FIG. 5, the component with the component ID “11” is the component with the name “tunnel body SS1” and the specifications “L=10 m”. The component with the component ID “12” is the component with the name “tunnel body SS2” and specifications “L=10 m”. The constituent element with the constituent element ID “13” is a constituent element with the name “illumination device G1” and specifications “model ABC”. The constituent element with the constituent element ID “14” is the constituent element with the name “illumination device G2” and the specification “model ABC”.

The transformation data table 23 includes data of transformations that have occurred in the constituent elements. FIG. 6 is a diagram illustrating an example of the modification data table according to the first embodiment. As shown in FIG. 6, the transformation data table 23 includes a plurality of data including “transformation ID”, “component ID”, and “transformation state”. The "transformation ID" is identification information of the transformation that has occurred in the component. The “component ID” is identification information of the component in which the deformation has occurred. The “transformation state” is information indicating the state of the transformation, and includes attribute data indicating the attribute of the transformation that has occurred in the component. For example, if the component is a tunnel body, the attributes of the transformation are cracks, peels, or water leaks. Further, when the constituent element is a lighting device, the attribute of the deformation is, for example, a light bulb burnout.

In the example shown in FIG. 6, the transformation of the transformation ID “1” is the transformation of the constituent element of the constituent element ID “11”, and the transformation state is “water leakage 30 cm”. The deformation with the deformation ID “2” is the deformation of the constituent element with the constituent element ID “11”, and the deformation state is “crack 20 cm”. The transformation of the transformation ID “3” is a transformation of the constituent element of the constituent element ID “13”, and the transformation state is “light bulb burned out”.

Returning to FIG. 3, the processing unit 30 will be described. The processing unit 30 includes an acquisition unit 31, a conversion unit 32, a combining unit 33, an output unit 34, and a display processing unit 35. The acquisition unit 31 acquires from the communication unit 10 the three-dimensional point cloud data of the structure, which is received by the communication unit 10 from the traveling measuring device 2 via the network 6. The acquisition unit 31 stores the three-dimensional point cloud data table 21 including the three-dimensional point cloud data of the structure acquired from the communication unit 10 in the storage unit 20.

Further, when the communication unit 10 receives the data transmission request from the terminal device 4, the acquisition unit 31 acquires the three-dimensional point cloud data of the structure from the three-dimensional point cloud data table 21, and the attribute data table 22. The attribute data of each of the plurality of constituent elements that form the structure is acquired from.

The conversion unit 32 converts the three-dimensional point cloud data of the structure acquired by the acquisition unit 31 into the three-dimensional CAD data of each component, based on the attribute data of each component acquired by the acquisition unit 31. .. The attribute data of the plurality of components includes, for example, attribute data of a structure body, which is a structure body, and attribute data of equipment included in the structure. The conversion unit 32 converts the three-dimensional point cloud data acquired by the acquisition unit 31 into the three-dimensional CAD data of the structure body and the three-dimensional CAD data of the equipment on the basis of the attribute data of the structure body and the attribute data of the equipment. Is converted into three-dimensional CAD data of the structure including.

For example, when the attribute data table 22 is in the state shown in FIG. 5, the attribute data of each component is the attribute data of the tunnel body or the attribute data of the lighting equipment. In this case, the conversion unit 32 converts the three-dimensional point cloud data of the tunnel into the three-dimensional CAD data of the tunnel including the three-dimensional CAD data of the tunnel body and the three-dimensional CAD data of the lighting device. The tunnel body is an example of a structure body, and the lighting device is an example of equipment. When the structure is a tunnel, the equipment may include, for example, a blower.

The conversion unit 32 compares a plurality of three-dimensional points included in the three-dimensional point cloud data with a template corresponding to the attribute data of the constituent elements on a constituent element basis, and based on the comparison result, the three-dimensional shape of each constituent element. 3D CAD data of a structure including CAD data is generated.

The conversion unit 32 selects or generates a tunnel body template, for example, based on the attribute data of the tunnel body. For example, assume that the attribute data of the tunnel body is “L=10 mm” shown in FIG. In this case, the conversion unit 32 selects or generates a template corresponding to the tunnel body having a length of 10 m. The conversion unit 32 has a plurality of types of templates for each component, and can select one template from the plurality of types of templates based on the attribute data. Further, the conversion unit 32 can also generate a template based on the attribute data of the tunnel body, for example, when the attribute data of the tunnel body includes data indicating details of the dimensions of the tunnel body.

The conversion unit 32 compares the template of the tunnel body with a plurality of 3D points included in the 3D point cloud data of the tunnel. Then, the conversion unit 32 determines a set of three-dimensional points of the tunnel main body that satisfy the condition that the degree of coincidence with the template is preset among the plurality of three-dimensional points included in the three-dimensional point cloud data of the tunnel. Is determined as a set of. Then, the conversion unit 32 replaces the set of three-dimensional points of the tunnel body with the three-dimensional CAD data of the tunnel body.

3D CAD data of the tunnel body is 3D CAD data that represents the tunnel body with a combination of polygons defined by points, lines, and surfaces. The conversion unit 32 has three-dimensional CAD data of the tunnel body for each template of the tunnel body, and a template used for comparing the set of three-dimensional points of the tunnel body with the set of three-dimensional points of the tunnel body. Replace with the CAD data of the tunnel body corresponding to.

The conversion unit 32 also compares, for example, the deformation template and a plurality of three-dimensional points included in the three-dimensional point cloud data of the tunnel based on the attribute data of the tunnel body for each type of deformation. The conversion unit 32 can compare, for example, the deformed template and a plurality of three-dimensional points included in the three-dimensional point group data for each type while changing the enlargement ratio or the reduction ratio of each deformed template. .. Then, the conversion unit 32 determines a set of three-dimensional points whose degree of coincidence with the deformed template satisfies a preset condition as a set of deformed three-dimensional points, and sets the deformed three-dimensional points. Is replaced with modified three-dimensional CAD data.

The three-dimensional CAD data of deformation is three-dimensional CAD data that represents the deformation with a combination of polygons defined by points, lines, and surfaces. The conversion unit 32 has deformed three-dimensional CAD data for each deformed template, and a template used for comparison of the deformed three-dimensional point set with the deformed three-dimensional point set. Is replaced with the deformed three-dimensional CAD data.

The conversion unit 32 can also determine whether or not a deformation has occurred in the tunnel body based on the deformation data table 23. For example, when the conversion unit 32 determines that the tunnel body is cracked based on the transformation data table 23, the conversion unit 32 determines the crack template to be a plurality of three-dimensional points included in the three-dimensional point cloud data of the tunnel. Can be compared. The conversion unit 32 determines a set of three-dimensional points whose degree of coincidence with the crack template satisfies a preset condition as a set of three-dimensional points of the crack, and determines the set of three-dimensional points of the crack as a three-dimensional crack. Replace with CAD data.

The conversion unit 32 also generates or selects a template of the lighting device based on the attribute data of the lighting device. For example, it is assumed that the attribute data of the lighting device is “model ABC” shown in FIG. In this case, the conversion unit 32 selects the template corresponding to the lighting device of model ABC. The conversion unit 32 has a plurality of types of illumination device templates including the model ABC, and can select a model ABC template from the plurality of types of templates based on the attribute data.

The conversion unit 32 compares the template of the lighting device with a plurality of 3D points included in the 3D point cloud data of the tunnel. Then, the conversion unit 32 determines a set of three-dimensional points of the lighting device that satisfy the condition that the degree of coincidence with the template is preset among the plurality of three-dimensional points included in the three-dimensional point cloud data of the tunnel. Is determined as a set of. The conversion unit 32 replaces the set of three-dimensional points of the lighting device with the three-dimensional CAD data of the lighting device.

3D CAD data of lighting equipment is 3D CAD data that represents lighting equipment by a combination of polygons defined by points, lines, and surfaces. The conversion unit 32 has three-dimensional CAD data of the lighting device for each template of the lighting device, and a template used for comparison of a set of three-dimensional points of the lighting device with a set of three-dimensional points of the lighting device. Replace with 3D CAD data of the lighting equipment corresponding to.

Note that the conversion unit 32 divides the three-dimensional space into a grid of a predetermined size, and sets the data points of a plurality of three-dimensional points and the data points of the template existing in each grid as feature amounts, and the feature amount is Can be compared. The conversion unit 32 can determine a set of three-dimensional points whose matching degree with the template satisfies a preset condition based on the comparison.

Also, the conversion unit 32 may have a configuration having one or more calculation models generated by machine learning for each component. The conversion unit 32 can also determine the set of three-dimensional points indicating the constituent elements by inputting the three-dimensional point group data of the structure to the calculation model. Such a calculation model is generated by using a learning algorithm such as clustering, support vector machine, neural network, or reinforcement learning.

In addition, when there is one or more three-dimensional points whose comparison result with the template does not satisfy the preset condition among the plurality of three-dimensional points, the conversion unit 32 excludes the data of the one or more three-dimensional points. The data of the three-dimensional points can be converted into three-dimensional CAD data.

3D CAD data of the constituent elements that make up the structure include data that defines the polygons that make up the constituent elements in the 3D CAD. The conversion unit 32 changes the size of the polygons forming the constituent element based on the importance of the constituent element. For example, the conversion unit 32 has a plurality of three-dimensional CAD data corresponding to each template and having different polygon sizes. The conversion unit 32 can convert the three-dimensional CAD data of a polygon having a size corresponding to the degree of importance of the constituent element into the three-dimensional CAD data of the constituent element out of a plurality of three-dimensional CAD data having different polygon sizes. .. The polygon is a polygon defined by the points, lines, and planes described above.

For example, if the importance of the tunnel body is set higher than the importance of the lighting equipment, the size of the polygon is smaller in the 3D CAD data of the tunnel body than in the 3D CAD data of the lighting equipment. In this case, the three-dimensional image of the tunnel body can be expressed more finely than the three-dimensional image of the lighting device.

FIG. 7 is a diagram for explaining the relationship between the size of the polygon and the importance of the constituent elements according to the first embodiment. As shown in FIG. 7, in the three-dimensional CAD, the constituent elements are composed of smaller polygons with higher importance. In the example shown in FIG. 7, the size of the polygon is changed in three steps according to the importance of the constituent elements, but the size of the polygon may be changed in two steps or in four or more steps. May be.

Note that the importance of each component may be set in the conversion unit 32 in advance, or may be set in the conversion unit 32 from the terminal device 4. Moreover, the conversion part 32 can also change the importance degree of a component for every component, for example based on the elapsed time after construction of a structure. For example, the conversion unit 32 can change the degree of importance of a constituent element based on the elapsed time since the constituent element of the structure was constructed or installed and the progressing rate of aging deterioration of each constituent element.

For example, it is assumed that the useful life of the lighting equipment is the period Ta1. In this case, the conversion unit 32 makes the polygon of the illumination device after the period Ta1 has elapsed from the installation of the illumination device smaller than the polygon of the illumination device from the installation of the illumination device until the period Ta1 has elapsed. be able to. Further, the conversion unit 32 can change the size of the polygon of the tunnel body depending on whether or not the elapsed time Ta2 after the tunnel body is constructed is equal to or longer than the period Tth. For example, the conversion unit 32 makes the polygon of the tunnel body when the elapsed time Ta2 after the construction of the tunnel body is the period Tth or more smaller than the polygon of the tunnel body when the elapsed time Ta2 is less than the period Tth. be able to. The conversion unit 32 can change the size of the polygon by selecting the three-dimensional CAD data corresponding to the period Ta1 or the elapsed time Ta2 from the plurality of three-dimensional CAD data having different polygon sizes. it can.

The conversion unit 32 can also change the size of the polygon in three or more steps. Further, when the constituent elements are defined by polygons having different sizes, the size of the above-mentioned polygon is the size of the lower limit value of the polygon.

Further, the conversion unit 32 can generate three-dimensional CAD data including data defining a polygon and three-dimensional point data as the three-dimensional CAD data of the constituent elements. For example, among the plurality of 3D points, the degree of coincidence between the plurality of 3D points in a part of the area and the template satisfies a preset condition, and the degree of coincidence between the plurality of 3D points in the remaining area and the template is It is assumed that the preset conditions are not satisfied. In this case, the conversion unit 32 converts a plurality of three-dimensional points in a part of the area into data defining a polygon, and a three-dimensional CAD including the converted data and data of a plurality of three-dimensional points in the remaining area. The data can be generated as three-dimensional CAD data for the components.

FIG. 8 is a diagram for explaining the three-dimensional CAD data of the constituent elements that partially include the three-dimensional point data according to the first embodiment. In the conversion unit 32, the template of the component and the three-dimensional point group are compared, as shown in FIG. In the example shown in FIG. 8, the first region of the component template has a high degree of coincidence with the three-dimensional point cloud and satisfies a preset condition, and the second region of the component template has a three-dimensional point cloud. The degree of coincidence is low and the preset condition is not satisfied. In this case, the conversion unit 32 converts the data of the three-dimensional point group in the first area into conversion data that is data defining a polygon. The conversion unit 32 generates three-dimensional CAD data including the converted data of the first area and the three-dimensional point cloud data of the second area as the three-dimensional CAD data of the constituent elements.

In this way, the conversion unit 32 can generate the three-dimensional CAD data that represents a portion that does not match the template of the component with a three-dimensional point group as the three-dimensional CAD data of the component. Therefore, for example, when the component does not match the template due to damage or the like, the damaged portion of the component can be confirmed by the three-dimensional point cloud. In the above-mentioned example, the template of the constituent element is divided into two areas for description, but the conversion unit 32 divides the template into three or more areas and defines the polygon for each area and the three-dimensional point group. One of the data can be selected.

Returning to FIG. 3, the combining unit 33 of the processing unit 30 will be described. The combining unit 33 associates the three-dimensional CAD data of each of the plurality of constituent elements with the text data regarding the corresponding constituent element among the plurality of constituent elements. For example, the combining unit 33 extracts the text data regarding each component from the attribute data table 22 and the transformation data table 23, and associates the extracted text data with the three-dimensional CAD data of the corresponding component among the plurality of components. Generate combined data. Such combined data includes three-dimensional CAD data of the constituent element and text data regarding the constituent element.

The combined data is data including the three-dimensional CAD data of the constituent element and the text data regarding the constituent element, but is not limited to such an example. For example, the combined data may be data including the identification information of the three-dimensional CAD data of the component and the identification information of the text data of the component. When the component is the tunnel body with the component ID “11” shown in FIG. 5, the text data of the component “L=10 mm” shown in FIG. Includes text information of the deformed state "water leak 30 cm" and the deformed state "crack 20 cm". It should be noted that each of the text of the deformed state “leak water 30 cm” and the text of the deformed state “crack 20 cm” is associated with the deformed position in the tunnel body. The text data associated with the three-dimensional CAD data of the constituent elements is not limited to the example described above, and may be data including an inspection history, a failure state, a failure history, and the like.

In addition, the output unit 34 receives the three-dimensional CAD data of the structure including the three-dimensional CAD data associated with the text data related to the component by the coupling unit 33 for each component from the communication unit 10 via the network 6 and the terminal device 4 Can be sent to. The terminal device 4 can acquire the three-dimensional CAD data of the structure via the network 6 and display the three-dimensional image of the structure based on the acquired three-dimensional CAD data of the structure.

The terminal device 4 has a communication unit 41, an acquisition unit 42, a display processing unit 43, a display unit 44, and an input unit 45. The communication unit 41 is connected to the network 6, and the acquisition unit 42 makes a data transmission request to the data processing device 1 in response to an operation on the input unit 45. The acquisition unit 42 acquires the three-dimensional CAD data of the structure transmitted from the data processing device 1 in response to the data transmission request via the network 6 and the communication unit 41.

The display processing unit 43 generates image data of the structure based on the three-dimensional CAD data of the structure acquired by the acquisition unit 42. The display processing unit 43 causes the display unit 44 to display a three-dimensional image of the structure by outputting the generated image data of the structure to the display unit 44. The three-dimensional image is displayed two-dimensionally, but if the display unit 44 is capable of three-dimensional display, the three-dimensional image is three-dimensionally displayed. Stereoscopic display is performed using parallax, for example.

Further, when the operation on the input unit 45 is an operation of changing the viewpoint position and the line-of-sight direction, the display processing unit 43 displays a three-dimensional image of the structure when the structure is viewed at the changed viewpoint position and the line-of-sight direction. The image data of the structure is generated so that The display processing unit 43 outputs the generated image data of the structure to the display unit 44.

FIG. 9 is a diagram showing an example of a three-dimensional image of the structure displayed on the display unit of the terminal device according to the first embodiment. In the example shown in FIG. 9, a three-dimensional image of the tunnel is shown. The three-dimensional image of the tunnel shown in FIG. 9 includes a three-dimensional image of the tunnel body, a three-dimensional image of the lighting device, and a deformed three-dimensional image. The three-dimensional image of the tunnel body is generated based on the three-dimensional CAD data of the tunnel body. The 3D image of the lighting device is generated based on the 3D CAD data of the lighting device. The deformed three-dimensional image is generated based on the deformed three-dimensional CAD data.

Further, in the example illustrated in FIG. 9, the display processing unit 43 generates image data of an image associated with a constituent element corresponding to the text related to each constituent element based on the text data related to each constituent element. The based image is displayed on the display unit 44. For example, the text related to the tunnel body is displayed in association with the tunnel body, the text related to the lighting device is displayed in association with the lighting device, and the text related to the deformation is displayed in association with the deformation. As a result, the user of the terminal device 4 can easily understand the position and state of each component.

Returning to FIG. 3, the display processing unit 35 of the processing unit 30 will be described. The display processing unit 35 generates the image data of the structure based on the three-dimensional CAD data of the structure including the three-dimensional CAD data associated with the text data related to the component by the combining unit 33 for each component. The display processing unit 35 can cause the display device 3 to display a three-dimensional image of the structure by outputting the generated image data of the structure to the display device 3.

The display processing unit 35 can perform the same processing as the display processing unit 43. For example, when the operation on the input device 5 is an operation of changing the viewpoint position and the line-of-sight direction, the display processing unit 35 displays a three-dimensional image of the structure when the structure is viewed at the changed viewpoint position and the line-of-sight direction. The image data of the structure is generated so that The display processing unit 35 outputs the generated image data of the structure to the display device 3. The processing unit 30 can convert the three-dimensional point cloud data of the structure into the three-dimensional CAD data of the structure when the operation on the input device 5 is a specific operation.

Next, the operation of the data processing device 1 will be described using a flowchart. FIG. 10 is a flowchart illustrating an example of processing of the data processing device according to the first exemplary embodiment. The process illustrated in FIG. 10 is executed by the processing unit 30 of the data processing device 1 when a data transmission request is issued from the terminal device 4, for example.

As shown in FIG. 10, the processing unit 30 of the data processing device 1 acquires the three-dimensional point cloud data from the storage unit 20 (step S11). Next, the processing unit 30 uses the three-dimensional point cloud data acquired in step S11 based on the attribute data of a plurality of constituent elements that make up the structure to determine the structure 3 including the three-dimensional CAD data of each constituent element. It is converted into three-dimensional CAD data (step S12).

Next, the processing unit 30 associates the three-dimensional CAD data of the component with the text data regarding the component (step S13). Then, the processing unit 30 outputs, to the terminal device 4, the three-dimensional CAD data of the structure including the three-dimensional CAD data of the constituent elements associated with the text data regarding the constituent elements for each constituent element (step S14). The processing shown is ended.

Next, the operation of the terminal device 4 will be described using a flowchart. FIG. 11 is a flowchart illustrating an example of processing of the terminal device according to the first embodiment. The process illustrated in FIG. 11 is started, for example, when a specific operation is performed on the input unit 45 of the terminal device 4.

As shown in FIG. 11, the acquisition unit 42 of the terminal device 4 transmits a data transmission request from the communication unit 41 to the data processing device 1 (step S21). The acquisition unit 42 acquires the three-dimensional CAD data of the structure transmitted from the data processing device 1 in response to the data transmission request transmitted in step S21 via the network 6 and the communication unit 41 (step S22).

Next, the display processing unit 43 of the terminal device 4 displays the three-dimensional image of the structure and the related information on the display unit 44 based on the three-dimensional CAD data acquired by the acquisition unit 42 in step S22 (step S23). Then, the processing shown in FIG. 11 ends. The related information of the structure is the text of each component described above.

FIG. 12 is a diagram illustrating an example of the hardware configuration of the data processing device according to the first embodiment. As shown in FIG. 12, the data processing device 1 includes a computer including a processor 101, a memory 102, an input/output circuit 103, and a communication device 104.

The processor 101, the memory 102, the input/output circuit 103, and the communication device 104 can send and receive data to and from each other via the bus 105, for example. The communication unit 10 is realized by the communication device 104. The storage unit 20 is realized by the memory 102. The processor 101 executes the functions of the acquisition unit 31, the conversion unit 32, the combining unit 33, the output unit 34, and the display processing unit 35 by reading and executing the program stored in the memory 102. The processor 101 is an example of a processing circuit, and includes one or more of a CPU (Central Processing Unit), a DSP (Digital Signal Processor), and a system LSI (Large Scale Integration).

The memory 102 is one or more of RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), and EEPROM (registered trademark) (Electrically Erasable Programmable Read Only Memory). Including. The memory 102 also includes a recording medium in which a computer-readable program is recorded. The recording medium includes one or more of a nonvolatile or volatile semiconductor memory, a magnetic disk, a flexible memory, an optical disk, a compact disk, and a DVD (Digital Versatile Disc). The data processing device 1 may include integrated circuits such as ASIC (Application Specific Integrated Circuit) and FPGA (Field Programmable Gate Array).

As described above, the data processing device 1 according to the first embodiment includes the storage unit 20, the acquisition unit 31, the conversion unit 32, and the output unit 34. The storage unit 20 stores attribute data of a plurality of constituent elements that make up a structure. The acquisition unit 31 acquires three-dimensional point cloud data of a structure. The conversion unit 32 includes the three-dimensional point cloud data acquired by the acquisition unit 31 based on the attribute data of the plurality of constituent elements stored in the storage unit 20 and the three-dimensional CAD data of each of the plurality of constituent elements. Convert to 3D CAD data of the structure. The output unit 34 outputs the three-dimensional CAD data of the structure converted by the conversion unit 32. As described above, in the data processing device 1, since the three-dimensional point cloud data of the structure is converted into the three-dimensional CAD data of the structure, the three-dimensional point cloud data of the structure is used and the data size of the structure is small. It is possible to generate three-dimensional data. Therefore, for example, the data processing device 1 can suppress the data size of the three-dimensional data transmitted to the terminal device 4.

Further, the attribute data of the plurality of constituent elements includes the attribute data of the structure body, which is the body of the structure, and the attribute data of the equipment included in the structure. The conversion unit 32 converts the three-dimensional point cloud data acquired by the acquisition unit 31 into the three-dimensional CAD data of the structure main body and the three-dimensional CAD data of the equipment based on the attribute data of the structure body and the attribute data of the equipment. Is converted into three-dimensional CAD data of the structure including. Accordingly, the structure can be divided into the structure body and the equipment to generate three-dimensional CAD data. Therefore, for example, it is possible to display a three-dimensional image of only the structure main body or a three-dimensional image of only the equipment, and it is possible to perform the confirmation work by focusing on the components that require confirmation. Therefore, it is possible to easily inspect or manage the structure.

In addition, the conversion unit 32 uses the attribute data of the constituent elements to convert the three-dimensional point cloud data acquired by the acquisition unit 31 into the three-dimensional CAD data of the structure including the three-dimensional CAD data of the deformation of the constituent elements. Convert to data. Accordingly, even if the structure has a deformation, the deformation can be represented by the three-dimensional CAD data, and the data size of the data representing the deformation can be reduced. Further, it is possible to display a three-dimensional image of only the deformation, and it is possible to quickly confirm the deformation that has occurred in the structure.

Also, the three-dimensional CAD data of each of the plurality of constituent elements includes one or more data defining a polygon. The conversion unit 32 changes the size of each polygon of the plurality of constituent elements based on the degree of importance of each of the plurality of constituent elements. Thereby, for example, a three-dimensional image of a component having higher importance can be displayed as a finer image. Therefore, it is possible to accurately confirm the component having higher importance.

In addition, the conversion unit 32 compares a plurality of three-dimensional points included in the three-dimensional point cloud data with a template corresponding to the attribute data in units of constituent elements, and generates three-dimensional CAD data based on the comparison result. .. This makes it possible to easily generate the three-dimensional CAD data of the constituent element.

In addition, the conversion unit 32 satisfies a preset condition that a difference between a template and a plurality of three-dimensional points in a part of the plurality of three-dimensional points, and a plurality of three-dimensional points and a template in the remaining area. If the difference between the two does not satisfy the preset condition, a plurality of 3D points in a part of the area are converted into data defining a polygon, and the converted data and data of a plurality of 3D points in the remaining area are 3D CAD data including is generated as 3D CAD data of the constituent elements. Thereby, for example, when the component does not match the template due to damage or the like, the damaged portion of the component can be confirmed by the three-dimensional point cloud.

The data processing device 1 also includes a combining unit 33 that associates the three-dimensional CAD data of each of the plurality of components with the text data relating to the corresponding component of the plurality of components. Then, the output unit 34 outputs the three-dimensional CAD data of the structure including the three-dimensional CAD data associated with the text data related to the component by the combining unit 33 for each component. Thereby, for example, the position and state of each component can be easily grasped by the text.

The data processing device 1 also includes a display processing unit 35 that displays a three-dimensional image of the structure on the display device 3 based on the three-dimensional CAD data of the structure output by the output unit 34. As a result, the image of the structure can be generated by using the three-dimensional CAD data instead of the three-dimensional point cloud data. The processing load of the image generation processing in 35 can be reduced.

The terminal device 4 also includes an acquisition unit 42 and a display processing unit 43. The acquisition unit 42 acquires the three-dimensional CAD data of the structure from the data processing device 1. The display processing unit 43 displays the image of the structure on the display unit 44 based on the three-dimensional CAD data of the structure. As a result, the image of the structure can be generated by using the three-dimensional CAD data instead of the three-dimensional point cloud data. It is possible to reduce the processing load of the image generation processing in.

The configurations shown in the above embodiments are examples of the content of the present invention, and can be combined with other known techniques, and the configurations of the configurations are not departing from the scope of the present invention. It is also possible to omit or change parts.

1 data processing device, 2 running measuring device, 3 display device, 4 terminal device, 5 input device, 6 network, 10, 41 communication unit, 20 storage unit, 21 3D point cloud data table, 22 attribute data table, 23 Transformation data table, 30 processing unit, 31, 42 acquisition unit, 32 conversion unit, 33 combining unit, 34 output unit, 35, 43 display processing unit, 44 display unit, 45 input unit, 100 data processing system.

Claims (11)

A storage unit that stores attribute data of a plurality of constituent elements that make up the structure,
An acquisition unit for acquiring three-dimensional point cloud data of the structure,
The structure including the three-dimensional point cloud data acquired by the acquisition unit based on the attribute data of the plurality of constituent elements stored in the storage unit, including the three-dimensional computer-aided design data of each of the plurality of constituent elements. A conversion unit for converting the three-dimensional computer-aided design data of the object,
An output unit for outputting the three-dimensional computer-aided design data of the structure converted by the conversion unit, the data processing device. The attribute data of the plurality of components is
Includes attribute data of a structure body that is the body of the structure, and attribute data of equipment included in the structure,
The conversion unit is
Based on the attribute data of the structure body and the attribute data of the equipment, the three-dimensional point cloud data acquired by the acquisition unit is used as the three-dimensional computer-aided design data of the structure body and the three-dimensional computer assistance of the equipment. The data processing apparatus according to claim 1, wherein the data processing apparatus converts the structure into three-dimensional computer-aided design data including the design data. The conversion unit is
Three-dimensional computer-aided design of the structure including three-dimensional point cloud data acquired by the acquisition unit based on the attribute data of the constituent element, including three-dimensional computer-aided design data of the deformation generated in the constituent element The data processing device according to claim 2, wherein the data processing device converts the data. The three-dimensional computer aided design data for each of the plurality of components is
Including one or more data that defines polygons,
The conversion unit is
The data processing according to claim 1, wherein the size of the polygon of each of the plurality of constituent elements is changed based on the degree of importance of each of the plurality of constituent elements. apparatus. The conversion unit is
Comparing a plurality of three-dimensional points included in the three-dimensional point group data with a template corresponding to the attribute data in units of the constituent elements, and generating the three-dimensional computer-aided design data based on the comparison result. The data processing device according to any one of claims 1 to 4, characterized in that: The conversion unit is
The difference between the template and a plurality of three-dimensional points in a part of the plurality of three-dimensional points satisfies a preset condition, and the difference between the plurality of three-dimensional points in the remaining area and the template is aforesaid. When the preset condition is not satisfied, the plurality of three-dimensional points in the partial area are converted into data defining a polygon, and the converted data and the data of the plurality of three-dimensional points in the remaining area are used. The data processing device according to claim 5, wherein the three-dimensional computer-aided design data including the above is generated as the three-dimensional computer-aided design data of the constituent element. A connecting unit for associating the three-dimensional computer-aided design data of each of the plurality of components with text data relating to a corresponding component of the plurality of components,
The output unit is
The 3D computer-aided design data of the structure including, for each of the components, the 3D computer-aided design data associated with the text data related to the component by the combining unit is output. 6. The data processing device according to any one of 6. 8. A display processing unit for displaying an image of the structure on a display device based on the three-dimensional computer-aided design data of the structure output by the output unit. The data processing device according to one. A data processing device according to any one of claims 1 to 7,
And a terminal device,
The terminal device,
An acquisition unit for acquiring three-dimensional computer-aided design data of the structure from the data processing device;
A data processing system comprising: a display processing unit configured to display an image of the structure on a display unit based on three-dimensional computer-aided design data of the structure. A data processing method executed by a computer,
An acquisition step of acquiring three-dimensional point cloud data of the structure,
The three-dimensional point cloud data acquired in the acquisition step is calculated based on the attribute data of the plurality of constituent elements stored in the storage unit that stores the attribute data of the plurality of constituent elements that configure the structure. A conversion step of converting the three-dimensional computer-aided design data of each of the components of the structure into three-dimensional computer-aided design data of the structure;
An output step of outputting the three-dimensional computer-aided design data of the structure converted by the conversion step. An acquisition step of acquiring three-dimensional point cloud data of the structure,
The three-dimensional point cloud data acquired in the acquisition step is calculated based on the attribute data of the plurality of constituent elements stored in the storage unit that stores the attribute data of the plurality of constituent elements that form the structure. A conversion step of converting the three-dimensional computer-aided design data of each of the components of the structure into three-dimensional computer-aided design data of the structure;
And a outputting step of outputting three-dimensional computer-aided design data of the structure converted by the converting step, the data processing program.

Images