JP7808511B2 - Plant shape measurement device and measurement method - Google Patents

Description

The present invention relates to a plant shape measurement device and method that determines the position and orientation of a measuring device when measuring the shape of an object using, for example, a camera or LIDAR (Light Detection and Ranging) measuring device.

When carrying out maintenance or demolition work on large-scale structures such as power plants or chemical plants, it is important to understand the condition of the target structure in advance in order to carry out the work efficiently and without incurring unnecessary costs.
To achieve this, a method is sometimes used in which a three-dimensional model is generated through three-dimensional measurements using a camera or LIDAR, and this model is then used to compare the on-site situation with the design drawings.

These plant facilities are three-dimensional structures made up of numerous parts with complex shapes tightly assembled. Therefore, when viewing the facility from a certain point around the facility, there are many cases where the rear part of the facility is hidden by the front part and cannot be observed (occlusion). Operators determine the placement positions of multiple measuring instruments so that the rear part of the facility can be measured and all parts can be measured.
Determining the location of the measuring instrument is not an easy task, and requires considerable skill and experience to perform it quickly and efficiently. If the worker does not have sufficient skill or experience, the efficiency of the measurement work and the 3D model generation work may deteriorate.

For example, if there are not enough measurement instrument locations, sufficient measurement data cannot be obtained in one measurement operation, which may result in the measurement operation having to be performed again, resulting in a decrease in the efficiency of the measurement operation.Furthermore, if there are too many measurement instrument locations, the amount of measurement data obtained by measurement may become enormous, which may result in a longer time required for the 3D model generation process and a decrease in the efficiency of the 3D model generation operation.
As an invention for preventing such a decrease in the efficiency of the work of generating a three-dimensional model, for example, Patent Document 1 describes an optimal layout planning method for a measuring instrument, in which an SfM (Structure from Motion) model of a facility or the like is generated before measuring the facility or the like with a measuring instrument, and the location of the measuring instrument is determined almost automatically based on this SfM model.

Patent No. 6535779

However, as the scale and complexity of the target plant increases, the SfM model created can have omissions or errors, such as objects appearing where there really are none. Repeated re-measurements required to correct these errors ultimately result in reduced work efficiency.

The present invention provides a plant shape measurement device and measurement method that can streamline the creation of 3D models of large-scale plants with minimal omissions.

In order to solve the above problems, a plant shape measurement device according to the present invention includes a plant shape measurement sensor that acquires data for generating a point cloud that represents a detailed shape of a plant; a voxel map generation sensor that acquires data for generating a voxel map that manages omissions in observations made by the plant shape measurement sensor; a voxel map generation unit that generates a voxel map for the plant based on information from the voxel map generation sensor ; and a 3D-CAD model generation unit that generates point cloud data and generates a 3D-CAD model of the plant based on the information from the plant shape measurement sensor, and is characterized in that it further includes a display unit that classifies, based on the information from the plant shape measurement sensor, voxels that include an object, voxels that do not include an object, and voxels that have not been measured by the plant shape measurement sensor, presents the classification result to an operator , measures the plant shape, derives an observation trajectory that is a combination of the observation position and observation direction of the plant shape measurement sensor, and displays the observation trajectory on a display screen .

Furthermore, a plant shape measurement method according to the present invention is characterized in that it includes a voxel map generation sensor that acquires data for generating a point cloud representing a detailed shape of a plant, a voxel map generation unit that acquires data for generating a voxel map that manages omissions in observations by the plant shape measurement sensor, and a voxel map generation unit that generates a voxel map for the plant based on information from the voxel map generation sensor , a 3D-CAD model generation unit that generates point cloud data based on information from the plant shape measurement sensor and generates a 3D-CAD model of the plant, and classifies, based on information from the plant shape measurement sensor, voxels that include objects, voxels that do not include objects, and voxels that have not been measured by the plant shape measurement sensor, presenting the classification result to an operator while measuring the plant shape, deriving an observation trajectory that is a combination of the observation position and observation direction of the plant shape measurement sensor, and displaying the observation trajectory on a display screen of a display unit .

According to the present invention, it is possible to provide a plant shape measuring device and a measuring method that can improve the efficiency of the work of generating a three-dimensional model of a large-scale plant with few omissions.
Problems, configurations, and effects other than those described above will become apparent from the following description of the embodiments.

1 is a functional block diagram showing the overall configuration of a plant shape measuring apparatus according to an embodiment of the present invention. FIG. 2 is a perspective view showing the appearance of a data collection device constituting the plant shape measurement apparatus shown in FIG. 1 . 2 is a diagram showing an example of a measurement range of a data collection device constituting the plant shape measurement apparatus shown in FIG. 1 ; 2 is a functional block diagram showing the overall configuration of a three-dimensional position recognition device that constitutes the data collection device shown in FIG. 1. FIG. 2 is a diagram showing an example of data acquisition by a data collection device constituting the plant shape measuring apparatus shown in FIG. 1 . FIG. FIG. 1 is a diagram illustrating an example of a measurement target space according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of voxel division of a measurement target space according to an embodiment of the present invention. 2 is a diagram showing an example of measurement by a voxel map generating sensor that constitutes the data collection device shown in FIG. 1. FIG. 2 is a diagram showing an example of a measurement result obtained by a voxel map generating sensor included in the data collection device shown in FIG. 1 . FIG. 10 is a diagram showing an example of attribute transition of a voxel map according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of an observation permission area according to an embodiment of the present invention. 10A and 10B are diagrams illustrating an example of observation position and direction indication according to an embodiment of the present invention. 4 is a flowchart showing a processing procedure executed by an observation position/direction determination device and an observation position/direction presentation device according to an embodiment of the present invention. 10A and 10B are diagrams showing examples of displaying a current position, a target position, etc. using AR according to an embodiment of the present invention. 1 is an external perspective view showing an example of a data collection device according to an embodiment of the present invention; 1 is a diagram illustrating a data collection device and AR glasses according to an embodiment of the present invention. FIG. 10 is a diagram showing an example of an image displayed by AR glasses as a display according to an embodiment of the present invention. FIG. 10 is a diagram showing an example of an image displayed by AR glasses as a display according to an embodiment of the present invention. FIG. 1 is a diagram illustrating a relationship between AR glasses as a display and a plant according to an embodiment of the present invention. 2 is a flowchart showing an example of a flow of generating a 3D-CAD model of a plant by the CAD model generating device shown in FIG. 1 . 10 is a flowchart showing an example of a three-dimensional position and orientation estimation flow of the data collection device shown in FIG. 1 .

The following describes an embodiment of the present invention using the drawings.

1 is a functional block diagram showing the overall configuration of a plant shape measuring apparatus according to an embodiment of the present invention. As shown in FIG. 1, the plant shape measuring apparatus 100 according to this embodiment is composed of a data collecting device 110, an observation position/direction determining device 120, an observation position/direction presenting device 130, and a CAD model generating device 140.
The plant shape measuring device 100 that can create a three-dimensional model with few omissions and errors in a short period of time will be described in detail below.

As shown in FIG. 1, the data collection device 110 is a device that collects data on plant shape information in order to generate a 3D model of the plant, and is composed of a plant shape measurement sensor 111, a 3D position recognition device 112 that estimates the 3D position of the data collection device 110, and a voxel map generation sensor 113. FIG. 2 is an external perspective view of the data collection device that makes up the plant shape measurement device shown in FIG. 1. For example, as shown in FIG. 2, the data collection device 110 is constructed by combining a GNSS (Global Navigation Satellite System) receiver 301, a high-resolution camera 302, a LIDAR 303, and an IMU (Inertial Measurement Unit) 304.

The plant shape measurement sensor 111 is a sensor, such as a high-resolution camera or LIDAR, that acquires data to generate a point cloud that represents the detailed shape of the plant. The point cloud acquired by the plant shape measurement sensor 111 is converted into a point cloud defined in an external coordinate system by the CAD model generation device 140 based on the position and orientation of the data collection device 110 estimated by the 3D position recognition device 112, and then accumulated in the sensor data accumulation unit 141, which will be described in detail later. The plant shape measurement sensor 111 may also be configured to measure the plant shape using sensors such as an image sensor and/or LIDAR.

On the other hand, the voxel map generation sensor 113 is a sensor that acquires data to generate a voxel map that manages omissions in observations made by the plant shape measurement sensor 111. The data acquired by the voxel map generation sensor 113 is converted into information defined in an external coordinate system by the observation position/direction determination device 120 based on the position and orientation of the data collection device 110 estimated by the 3D position recognition device 112, and then an attributed voxel map is generated.

As shown in Figure 3, the voxel map generation sensor 113 is preferably a sensor that requires a short time to generate a voxel map, such as a LIDAR, and is also preferably a sensor with a wider detection range and a higher sampling period than the plant shape measurement sensor 111.

FIG. 4 is a functional block diagram showing the overall configuration of a three-dimensional position recognition device that constitutes the data collection device shown in FIG.
4 , for example, the three-dimensional position recognition device 112 includes a GNSS receiver 114, an IMU 115, an external environment recognition sensor 116, plant design data 117, a position and attitude estimation/map update unit 118, and a surrounding environment map 119. The three-dimensional position recognition device 112 estimates the three-dimensional position and attitude of the data collection device 110 with sufficient accuracy and frequency to generate the CAD model and voxel map. Here, the position and attitude estimation/map update unit 118 is realized by, for example, a processor such as a CPU (not shown), a ROM for storing various programs, a RAM for temporarily storing data in the calculation process, and a storage device such as an external storage device, and the processor such as the CPU reads and executes the various programs stored in the ROM and stores the execution results in the RAM or the external storage device.

The position and orientation estimation/map update unit 118 that constitutes the three-dimensional position recognition device 112 acquires data from the GNSS receiver 114 and IMU 115, and estimates the three-dimensional position and orientation of the data collection device 110 in the external coordinate system at a high sampling frequency using a Kalman filter or the like. It also estimates the three-dimensional position and orientation at a low sampling frequency but with high accuracy by scan matching the surrounding environment observation data acquired by the external environment recognition sensor 116 with the surrounding environment map 119 defined in the external coordinate system while referencing the plant design data 117, and combines this with the estimated three-dimensional position and orientation values.

Figure 5 shows an example of data acquisition by the data collection device that constitutes the plant shape measurement device shown in Figure 1. As shown in Figure 5, the observation position/direction determination device 120 is a device that calculates the observation position 203 and observation direction 204 of the data collection device 110, which are necessary to create a three-dimensional model with few omissions and errors. The observation position/direction determination device 120 is composed of an attributed voxel map update unit 121, an attributed voxel map 122, and an unmeasured portion observable position/direction calculation unit 123. Here, the attributed voxel map update unit 121 and the unmeasured portion observable position/direction calculation unit 123 are realized, for example, by a processor such as a CPU (not shown), a ROM that stores various programs, a RAM that temporarily stores data during the calculation process, and a storage device such as an external storage device. The processor such as a CPU reads and executes the various programs stored in the ROM, and stores the calculation results that result from the execution in the RAM or external storage device.

In order to generate a voxel map that manages omissions in observations by the plant shape measurement sensor 111, the attributed voxel map update unit 121 converts the data acquired by the voxel map generation sensor 113 into information defined in an external coordinate system based on the position and orientation of the data collection device 110 estimated by the three-dimensional position recognition device 112, and generates an attributed voxel map.
Fig. 6 is a diagram showing an example of a measurement target space according to an embodiment of the present invention. The attributed voxel map 122 is a map database in which a measurement target space 201 including a plant for which a 3D-CAD model as shown in Fig. 6 is to be created is divided into predetermined unit voxels 202 as shown in Fig. 7, and the divided voxels are assigned five attributes ((1) object present and measurement made, (2) object present and measurement not made, (3) no object present and measurement made, (4) no object present and measurement not made, (5) unknown).

Fig. 8 is a diagram showing an example of measurement by the voxel map generation sensor constituting the data collection device shown in Fig. 1. For example, when a LIDAR is used as the voxel map generation sensor 113, as shown in Fig. 8, a laser 311 is irradiated at regular intervals to acquire the distance to the reflection point, and the surface of the plant 200 in the measurement target space 201 is scanned, thereby updating the attributes of each voxel in the voxel map 122.
Here, when the device is started up, the attributes of all voxels are initialized to (5) unknown, and then, for all voxels through which the laser 311 passes, the attribute-added voxel map update unit 121 sets the attribute to "object present" if the voxel includes a reflection point 311p of the laser 311 irradiated by the LIDAR, as shown in Fig. 9, or sets the attribute to "object absent" if no object is present and the laser 311 passes through the voxel. Depending on this and whether the voxel is within the measurement range of the plant shape measurement sensor 111, one of the following measurement results is obtained: (1) object present/within measurement range, (2) object present/outside measurement range, (3) object absent/within measurement range, or (4) object absent/outside measurement range. The attribute-added voxel map update unit 121 updates each attribute according to the current attribute of each voxel, in accordance with the attribute transition table shown in Fig. 10. In the attribute transition table shown in FIG. 10, the current attributes on the horizontal axis represent the attributes before measurement, and if there is something that has already been measured, from unknown on the right end to something that has already been measured on the left end, it is "object present/measured." Furthermore, as you move from the right end to the left end, all attributes become "measured."
For example, if the shape of the plant 200 is such that an object is in an area surrounded by a rectangular-shaped obstruction as viewed from the information, it is expected that it will be difficult to measure the distance to the object regardless of the elevation angle. In this case, the object may be marked as "unknown" as shown in FIG. 10, or measurement may be performed using an aerial work platform, a drone, or the like. In this case, it is possible to identify the attribute by referring to the measurement results and design data.

The unmeasured portion observable position/direction calculation unit 123 calculates the position and observation direction of the data collection device 110 at which unmeasured voxels in the voxel map can be observed.

The observation position/direction presentation device 130 is a device that presents to the data collection worker the observation position/direction of the data collection device 110 necessary to create a three-dimensional model with few omissions and errors, and is composed of an observation position/direction instruction processing unit 131, a display 132, and a speaker 133.
FIG. 11 is a diagram showing an example of an observation permission area according to an embodiment of the present invention. The observation position/direction instruction processing unit 131 derives an observation trajectory 206, which is a combination of observation positions and observation directions that minimizes measurement time, as shown in FIG. 12 , from the positions and observation directions of the data collecting device 110 that are located within a specified observation permission area 205 as shown in FIG. 11 and that can observe unmeasured voxels in the voxel map ((2) object present/not measured, (3) object absent/not measured, (5) unknown) calculated by the unmeasured part observable position/direction calculation unit 123. The observation trajectory 206 is presented to an operator via the display 132 and speaker 133. Here, when two towers constituting the plant 200 overlap as shown in FIG. 8 above, it is difficult for the data collecting device 110 to measure the distance to the tower at the back of the overlapping portion with the front tower. However, by measuring the distance using the observation trajectory 206 shown in FIG. 12 (described later), it is possible to measure the distance to the tower at the back as well. Here, the observation position/direction instruction processing unit 131 is realized by, for example, a processor such as a CPU (not shown), a ROM for storing various programs, a RAM for temporarily storing data in the calculation process, and a storage device such as an external storage device, and the processor such as a CPU reads and executes the various programs stored in the ROM, and stores the calculation results that are the execution results in the RAM or the external storage device.

The CAD model generation device 140 is a device that generates a 3D-CAD model from a point cloud representing the acquired plant shape, and is composed of a sensor data storage unit 141, a sensor database 142, a high-density point cloud generation unit 143, a point cloud database 144, a design information database 145, a 3D-CAD model generation unit 146, and a 3D-CAD model 147. Here, the high-density point cloud generation unit 143 and the 3D-CAD model generation unit 146 are realized, for example, by a processor such as a CPU (not shown), a ROM that stores various programs, a RAM that temporarily stores data during the calculation process, and a storage device such as an external storage device, and the processor such as the CPU reads and executes the various programs stored in the ROM, and stores the calculation results that are the execution results in the RAM or external storage device.

The sensor data accumulation unit 141 associates the data acquired from the plant shape measurement sensor 113 with the self-position and orientation acquired in step S101 (FIG. 13) described later, and stores the data in the sensor database 142.
The high-density point cloud generator 143 generates a point cloud representing the detailed shape of the plant defined in an external coordinate system based on the sensor data acquired by the plant shape measurement sensor 111 and the position and orientation of the data collection device 110 estimated by the three-dimensional position recognition device 112, and stores the point cloud in a point cloud database 144.

The 3D-CAD model generation unit 146 matches the point cloud representing the plant shape stored in the point cloud database 144 with the partial CAD models of the plant's piping, etc., recorded in the design information database 145, to estimate the layout of each partial CAD model and generate a 3D-CAD model of the entire plant.

The above is an explanation of the configuration and components of the plant shape measurement device 100.

Next, a description will be given of the operations of the observation position/direction determination device 120 and the observation position/direction presentation device 130. Fig. 13 is a flowchart showing the processing procedure executed by the observation position/direction determination device 120 and the observation position/direction presentation device 130.
Steps S101 to S104 describe a method for calculating and presenting the observation position and direction of the data collection device 110 required to create a 3D model with few omissions and errors by the plant shape measurement device 100. This process is executed for each measurement cycle of the voxel map generation sensor 113.

In step S<b>101 , the position and orientation of the data collection device 110 are acquired from the three-dimensional position recognition device 112 .
In step S102, the data acquired from the voxel map generation sensor 113 is converted into information defined in an external coordinate system based on the position and orientation of the data collection device 110 estimated in step S101, and an attributed voxel map 122 is generated with five attributes ((1) object present, measurement performed, (2) object present, no measurement, (3) no object present, measurement performed, (4) no object present, no measurement, (5) unknown).

In step S103, the unmeasured portion observable position/direction calculation unit 123 calculates the position and observation direction of the data collection device 110 that can observe (2) object present/not measured, (3) object absent/not measured, and (5) unknown within the voxel map, based on the data in the attributed voxel map 122.

In step S104, based on the observable position and direction calculated in step S103, the observation position and direction of the data collection device 110 necessary to create a three-dimensional model with few omissions and errors is calculated by the observation position and direction presentation device 130, and the calculated observation position and direction are indicated by the display 132 and speaker 133.
Here, by varying the viewing angle of the plant shape measurement sensor 111 to calculate an appropriate angle of view and presenting it to the operator, it is possible to further shorten the time required to acquire data.

In addition, as shown in Figure 14, AR (augmented reality) can be used to display the observation position, observation direction, and field of view on the surrounding image, thereby making it possible for workers to acquire data more efficiently. In this case, it is desirable to use AR glasses as the display 132. In Figure 14, a current position display point 401, a target position display point 402, a current attitude display coordinate system 403, and a target attitude display coordinate system 404 are displayed within the environmental image of the plant.

Furthermore, as shown in FIG. 15 , by using a gimbal 405 to automate the adjustment of the orientation of the data collection device 110 and the adjustment of the viewing angle of the plant shape measurement sensor 111, the worker who acquires the data only needs to move, thereby reducing the burden on the worker.
The above is a description of an example of the flow of operations of the observation position/direction determination device 120 and the observation position/direction presentation device 130.

Here, information provided to the worker when the AR glasses 500 are worn as the display 132 constituting the observation position/direction determining device 130 will be described.
16 is a diagram showing a data collection device and AR glasses according to one embodiment of the present invention. As shown in FIG. 16, an operator wears AR glasses 500 and operates a camera dolly 501 with a handle to adjust the viewing angle or elevation angle of the data collection device.

Figure 17 is a diagram showing an example of an image displayed by AR glasses as a display according to one embodiment of the present invention. As shown in Figure 17, the plant environment is displayed as is in the AR glasses image 502, along with the current sensor and camera dolly 503a. Furthermore, a virtual model 503b representing the target position and orientation for the next data acquisition is superimposed on the AR glasses image 502.

Figure 18 is a diagram showing an example of an image displayed by AR glasses as a display according to one embodiment of the present invention. In the display shown in Figure 17 above, the camera dolly 501 with the handle is moved or operated so that the current sensor and camera dolly 503a overlap with the virtual model 503b representing the target position and orientation for the next data acquisition. A display is provided so that the worker can easily recognize that they have been able to move to the target position and orientation. In Figure 18, "OK" is displayed as an example.

Figure 19 is a diagram showing the relationship between AR glasses as a display and a plant in one embodiment of the present invention. When acquiring data within a plant in accordance with instructions from the AR glasses 500, workers simply move or operate a camera dolly 501 with a handle in accordance with instructions from the AR glasses 500.

Next, the operation of the CAD model generation device 140 will be described. Figure 20 is a flowchart showing an example of the flow for generating a 3D-CAD model of a plant using the CAD model generation device shown in Figure 1. This process is executed for each measurement cycle of the plant shape measurement sensor 111.

In steps S201 to S204, an example of a flow for generating a 3D-CAD model of a plant from sensor data representing the shape of the plant acquired by the plant shape measurement sensor 111 will be described.
In step S201, the position and orientation of the data collecting device 110 are acquired from the three-dimensional position recognition device 112 and stored in the sensor data storage unit 141 constituting the CAD model generating device 140.

In step S202, the data acquired from the plant shape measurement sensor 113 and the self-position and attitude acquired in step S101 are associated with each other and stored in the sensor database 142.
Regarding the association with the self-position and attitude, for example, when a camera is used as the plant shape measurement sensor 111, the captured image may be recorded as a geotag.

If 3D-CAD conversion of the plant is initiated in step S203, the 3D-CAD conversion process proceeds to step S204 and beyond.

In step S204, a high-density point cloud representing the shape of the target plant is generated from the sensor data stored in the sensor database 142 and stored in the point cloud database 144.
In step S205, a 3D-CAD model of the entire plant is generated and recorded based on the point cloud representing the shape of the plant recorded in the point cloud database 144 and the design information of the plant acquired from the design information database 145.
The above is a description of an example of the flow of the operation of the CAD model generating device 140.

Next, a description will be given of the operation of the three-dimensional position recognition device 112 that constitutes the data collection device 110. Fig. 20 is a flowchart showing an example of a three-dimensional position and orientation estimation flow of the data collection device shown in Fig. 1.
This process is executed for each measurement cycle of the three-dimensional position recognition device 112 .

In steps S301 to S305, an example of a flow for estimating the three-dimensional position and orientation of the three-dimensional position recognition device 112 constituting the data collection device 110 will be described.
In step S301, the position and orientation of the three-dimensional position recognition device 112 are updated based on the inertial momentum acquired by the IMU 115.
In step S302, if the GNSS receiver 114 acquires positioning information, in step S304, the position and attitude updated in step S301 are corrected using the positioning information acquired in step S302.

In step S303, when data is acquired from the external environment recognition sensor 116, the estimated position and orientation of the 3D position recognition device 112 and the surrounding environment map 119 are updated by matching the data acquired in step S303 with the surrounding environment map 119. This completes an example of the operation flow of the 3D position recognition device 112.

As described above, according to this embodiment, it is possible to provide a plant shape measuring device and a measuring method that can improve the efficiency of the work of generating a three-dimensional model with few omissions for a large-scale plant.
Furthermore, an observation trajectory 206, which is a combination of observation positions and observation directions that will shorten the measurement time as much as possible, is derived and presented to the worker via the display 132 and speaker 133, thereby improving the efficiency of the work.

The present invention is not limited to the above-described embodiments, and includes various modifications. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and are not necessarily limited to those including all of the described configurations. Furthermore, it is possible to replace part of the configuration of one embodiment with the configuration of another embodiment, or to add the configuration of another embodiment to the configuration of one embodiment. Furthermore, it is possible to add, delete, or replace part of the configuration of each embodiment with the configuration of another embodiment.

100... Plant shape measurement device 110... Data collection device 111... Plant shape measurement sensor 112... 3D position recognition device 113... Voxel map generation sensor 114... GNSS receiver 115... IMU
116...External environment recognition sensor 117...Plant design data 118...Position and orientation estimation/map update unit 119...Surrounding environment map 120...Observation position/direction determination device 121...Attributed voxel map update unit 122...Attributed voxel map 123...Unmeasured part observable position/direction calculation unit 130...Observation position/direction determination device 131...Observation position/direction instruction processing unit 132...Display 133...Speaker 140...CAD model generation device 141 ...sensor data accumulation unit 142...sensor data database 143...high-density point cloud generation unit 144...point cloud database 145...design information database 146...3D-CAD model generation unit 147...3D-CAD model 200...plant 201...measurement target space 202...voxel 203...observation position 204...observation direction 205...permitted observation area 206...observation orbit 301...GNSS receiver 302...high-resolution camera 303...LIDAR
304...IMU
311...Laser 311p...Laser reflection point 312...Voxel without object 313...Voxel with object 314...Unknown voxel 401...Current position display point 402...Target position display point 403...Current attitude display coordinate system 404...Target attitude display coordinate system 405...Gimbal 500...AR glasses 501...Camera dolly with handle 502...Image of AR glasses 503a...Current sensor and camera dolly 503b...Virtual model representing the target position and attitude in the next data acquisition

Claims (10)

A measurement device that measures the shape of a plant,
a plant shape measurement sensor that acquires data for generating a point cloud that represents a detailed shape of a plant; a voxel map generation sensor that acquires data for generating a voxel map that manages omissions in observations made by the plant shape measurement sensor; a voxel map generation unit that generates a voxel map for the plant based on information from the voxel map generation sensor ; and a 3D-CAD model generation unit that generates point cloud data and generates a 3D-CAD model of the plant based on information from the plant shape measurement sensor,
classifying the voxel map into voxels that include an object, voxels that do not include an object, and voxels that have not been measured by the plant shape measurement sensor based on information from the plant shape measurement sensor, and presenting the classification result to an operator while measuring the plant shape ;
The plant shape measurement device further comprises a display unit that derives an observation trajectory, which is a combination of the observation position and observation direction of the plant shape measurement sensor, and displays the observation trajectory on a display screen . 2. The plant shape measuring apparatus according to claim 1,
A plant shape measurement device characterized by calculating the position of the plant shape measurement sensor from which data can be acquired for voxels that are blocked by an obstruction or voxels that are not measured by the plant shape measurement sensor, and outputting the calculation results to a user. 3. The plant shape measuring apparatus according to claim 2,
the plant shape measurement sensor is a sensor that acquires high-resolution data,
The plant shape measuring device is characterized in that the voxel map generating sensor has a wider detection range and a higher sampling period than the plant shape measuring sensor. 2. The plant shape measuring apparatus according to claim 1 ,
A plant shape measurement device characterized in that it calculates a position and a field of view at which data can be acquired for a voxel not measured by the plant shape measurement sensor, and outputs the calculation result to a user . 5. The plant shape measuring apparatus according to claim 4,
A plant shape measuring device characterized in that the current position and observation position, current attitude and observation direction, and field of view of the plant shape measuring sensor are displayed on a display screen on a voxel map and provided to an operator. 5. The plant shape measuring apparatus according to claim 4 ,
A plant shape measurement device characterized in that the current position and observation position, current attitude and observation direction, and field of view of the plant shape measurement sensor are displayed in augmented reality using AR glasses on a voxel map and provided to workers. A plant shape measurement method for measuring a shape of a plant, comprising:
a plant shape measurement sensor acquires data for generating a point cloud representing a detailed shape of a plant; a voxel map generation unit acquires data for generating a voxel map for managing omissions in observations by the plant shape measurement sensor, and generates a voxel map for the plant based on information from the voxel map generation sensor; a 3D-CAD model generation unit generates point cloud data based on information from the plant shape measurement sensor and generates a 3D-CAD model of the plant;
classifying the voxel map into voxels that include an object, voxels that do not include an object, and voxels that have not been measured by the plant shape measurement sensor based on information from the plant shape measurement sensor, and presenting the classification result to an operator while measuring the plant shape;
A plant shape measurement method comprising : deriving an observation trajectory, which is a combination of the observation position and observation direction of the plant shape measurement sensor; and displaying the observation trajectory on a display screen of a display unit . The plant shape measurement method according to claim 7 ,
A plant shape measurement method, comprising : calculating a position and a field of view at which data can be acquired for a voxel not measured by the plant shape measurement sensor; and outputting the calculation results to a user . 9. The plant shape measurement method according to claim 8,
A plant shape measurement method characterized in that the current position and observation position, current attitude and observation direction, and field of view of the plant shape measurement sensor are displayed on a display screen on a voxel map and provided to an operator. 9. The plant shape measurement method according to claim 8 ,
A plant shape measurement method characterized in that the current position and observation position, current attitude and observation direction, and field of view of the plant shape measurement sensor are displayed in augmented reality using AR glasses on a voxel map and provided to workers .