JP7576969B2 - Information processing device - Google Patents

Description

The present invention relates to an information processing device.

Traditionally, 3D photography in the construction industry using 3D scanners (hereinafter also referred to as "3D scanners") has been conducted outdoors to photograph the building's framework, exterior, and equipment, just like in the civil engineering field. In addition, 3D photography is also conducted semi-outdoors (rooftops hidden by privacy walls, dry areas, pilotis, etc.) and indoors to photograph the building's framework, interior, and equipment.

The point cloud data acquired through 3D photography using this 3D scanner is used to check the on-site and current conditions on a personal computer, etc., and is also used to update design drawings, construction drawings, etc. to more accurately reflect the on-site conditions by overlaying them on BIM (Building Information Modeling) models.

Conventionally, in order to overlay an image based on point cloud data and an image based on a BIM model, at least one of the images based on point cloud data and the image based on the BIM model was manually moved in three dimensions to overlay them, which resulted in problems such as variation in the accuracy of the overlay depending on the skill of the person performing it, and low reproducibility.

The following technologies could be applied to solve this problem:

Patent Document 1 discloses a method for modifying architectural plans using a three-dimensional laser scanner. In this method, a three-dimensional laser scanner is used to stereoscopically measure three-dimensional data of the finished form surface at a construction site as point cloud data, and the distance between the measured finished form surface and the architectural plan surface is compared, and the architectural plan surface is moved so that at least one of the interference and gap between the finished form surface and the architectural plan surface is minimized.

Patent document 2 discloses a corresponding position calculation method using a corresponding position calculation device. In this corresponding position calculation method, the corresponding position calculation device has a design data reference designation unit, a measurement data reference designation unit, and a corresponding position calculation unit. In this corresponding position calculation method, the design data reference designation unit receives, for input design data, a designation of a structure that exists in the design data and serves as a reference for positional correspondence, and adds position information of the designated structure to the design data. In this corresponding position calculation method, the measurement data reference designation unit receives, for input measurement data, a designation of a structure that exists in the measurement data and serves as a reference for positional correspondence, and adds position information of the designated structure to the measurement data. In addition, in this corresponding position calculation method, the corresponding position calculation unit refers to position information indicating the same structure in the design data and the measurement data, and associates position information in the design data located near the designated structure with position information in the measurement data.

Patent No. 5048962 JP 2019-109191 A

However, when the technology described in Patent Document 1 is applied to the purpose of overlaying an image based on point cloud data and an image based on a BIM model, it is necessary to detect the surface of the component, etc. represented by the point cloud data and the surface of the component, etc. of the BIM model that corresponds to that surface. For this reason, this technology has the problem that it is not necessarily easy to overlay an image based on point cloud data and an image based on a BIM model.

Furthermore, when the technology described in Patent Document 2 is applied to the purpose of overlaying an image based on point cloud data and an image based on a BIM model, it is necessary to specify a structure that serves as a reference for the positional correspondence between the 3D image represented by the point cloud data and the 3D image represented by the BIM model. For this reason, even with this technology, there is a problem in that it is not necessarily easy to overlay an image based on point cloud data and an image based on a BIM model.

This disclosure has been made in consideration of the above circumstances, and aims to provide an information processing device that can more easily overlay an image based on point cloud data obtained by a 3D scanner and an image based on a BIM model.

The information processing device of the present invention described in claim 1 includes an acquisition unit that acquires first point cloud data obtained by installing a 3D scanner at two locations based on one street center line and taking three-dimensional photographs, and second point cloud data obtained by installing a 3D scanner at two locations based on another street center line and taking three-dimensional photographs, and a control unit that controls the display on a display unit of images based on the first point cloud data and the second point cloud data acquired by the acquisition unit, superimposed on an image based on the BIM model so as to overlap the corresponding street center line of the BIM model.

According to the information processing device of the present invention described in claim 1, first point cloud data obtained by installing a 3D scanner at two locations based on one street center and taking three-dimensional photographs, and second point cloud data obtained by installing a 3D scanner at two locations based on another street center and taking three-dimensional photographs are obtained, and images based on the acquired first point cloud data and second point cloud data are controlled to be displayed on the display unit superimposed on an image based on the BIM model so as to overlap the corresponding street center of the BIM model, making it possible to more easily superimpose an image based on the point cloud data obtained by the 3D scanner and an image based on the BIM model.

The information processing device of the present invention as described in claim 2 is the information processing device as described in claim 1, wherein the first point cloud data is obtained by installing a 3D scanner at two locations on the one street center line and taking three-dimensional photographs, and the second point cloud data is obtained by installing a 3D scanner at two locations on the other street center line and taking three-dimensional photographs.

According to the information processing device of the present invention described in claim 2, the first point cloud data is obtained by installing a 3D scanner at two locations on one street center line and taking three-dimensional photographs, and the second point cloud data is obtained by installing a 3D scanner at two locations on another street center line and taking three-dimensional photographs.This makes it easier to overlay an image based on the point cloud data obtained by the 3D scanner and an image based on the BIM model.

The information processing device of the present invention described in claim 3 is the information processing device described in claim 1, wherein the first point cloud data is obtained by placing a 3D scanner at two locations on the one of the grid lines and taking three-dimensional photographs, and the second point cloud data is obtained by placing a 3D scanner at two locations on a line offset from the other of the grid lines and taking three-dimensional photographs.

According to the information processing device of the present invention as described in claim 3, the first point cloud data is obtained by placing a 3D scanner at two locations on one street center line and taking three-dimensional photographs, and the second point cloud data is obtained by placing a 3D scanner at two locations on a line offset from the other street center line and taking three-dimensional photographs, thereby making it easier to perform three-dimensional photographs using a 3D scanner.

The information processing device of the present invention described in claim 4 is the information processing device described in claim 1, wherein the first point cloud data is obtained by placing a 3D scanner at two locations on a line offset with respect to the one grid line and performing three-dimensional photography, and the second point cloud data is obtained by placing a 3D scanner at two locations on a line offset with respect to the other grid line and performing three-dimensional photography.

According to the information processing device of the present invention as described in claim 4, the first point cloud data is obtained by placing a 3D scanner at two locations on a line offset with respect to one center line and performing three-dimensional photography, and the second point cloud data is obtained by placing a 3D scanner at two locations on a line offset with respect to another center line and performing three-dimensional photography, thereby making it easier to perform three-dimensional photography using a 3D scanner.

The information processing device according to the present invention described in claim 5 is the information processing device described in claim 3 or claim 4, in which one of the two shooting positions for the two 3D shooting performed to obtain the first point cloud data and the two shooting positions for the two 3D shooting performed to obtain the second point cloud data is a common position with one of the two shooting positions.

According to the information processing device of the present invention described in claim 5, one of the two shooting positions for 3D photography performed to obtain first point cloud data and one of the two shooting positions for 3D photography performed to obtain second point cloud data can be made to be a common position with one of the two shooting positions, making it easier to perform 3D photography using a 3D scanner.
The information processing device of the present invention described in claim 6 comprises an acquisition unit that acquires first point cloud data obtained by performing 3D photographing at two locations based on one street center line, and second point cloud data obtained by performing 3D photographing at two locations based on another street center line, and a control unit that controls images based on the first point cloud data and the second point cloud data acquired by the acquisition unit to be displayed on a display unit superimposed on an image based on the BIM model so as to overlap the corresponding street center line of the BIM model, wherein the first point cloud data was obtained by performing 3D photographing at two locations on the one street center line, and the second point cloud data was obtained by performing 3D photographing at two locations on a line offset with respect to the other street center line.
The information processing device of the present invention described in claim 7 comprises an acquisition unit that acquires first point cloud data obtained by performing 3D photographing at two locations based on one street center line, and second point cloud data obtained by performing 3D photographing at two locations based on another street center line, and a control unit that controls images based on the first point cloud data and the second point cloud data acquired by the acquisition unit to be displayed on a display unit superimposed on an image based on the BIM model so as to overlap the corresponding street center line of the BIM model, wherein the first point cloud data is obtained by performing 3D photographing at two locations on a line offset from the one street center line, and the second point cloud data is obtained by performing 3D photographing at two locations on a line offset from the other street center line.

As described above, according to the present invention, it is possible to more easily overlay an image based on point cloud data obtained by a 3D scanner and an image based on a BIM model.

1 is a block diagram showing an example of a hardware configuration of an information processing system according to an embodiment. FIG. 1 is a perspective view showing an example of a configuration of a 3D scanner according to an embodiment. FIG. 2 is a block diagram showing an example of a functional configuration of the information processing device according to the embodiment. FIG. 4 is a schematic diagram illustrating an example of a configuration of a scan information database according to the embodiment. FIG. 2 is a perspective view showing an example of an installation state of a 3D scanner according to an embodiment. 10 is a flowchart illustrating an example of information processing according to the embodiment. FIG. 13 is a diagram for explaining information processing according to an embodiment, and is a plan view showing an example of the relationship between the position of the marked out center line and the position of photography by a 3D scanner. FIG. 11 is a front view showing an example of a conventional overlapping display screen. FIG. 4 is a front view showing an example of an overlay display screen according to the embodiment; FIG. 13 is a diagram for explaining another example of information processing according to an embodiment, and is a plan view showing another example of the relationship between the position of the marked out center line and the photographing position by the 3D scanner. FIG. 13 is a diagram for explaining another example of information processing according to an embodiment, and is a plan view showing another example of the relationship between the position of the marked out center line and the photographing position by the 3D scanner. FIG. 13 is a diagram for explaining another example of information processing according to an embodiment, and is a plan view showing another example of the relationship between the position of the marked out center line and the photographing position by the 3D scanner. FIG. 13 is a diagram for explaining another example of information processing according to an embodiment, and is a plan view showing another example of the relationship between the position of the marked out center line and the photographing position by the 3D scanner.

Below, an example of an embodiment of the present invention will be described in detail with reference to the drawings.

First, the configuration of an information processing system 90 according to this embodiment will be described with reference to Figs. 1 to 3. Fig. 1 is a block diagram showing an example of the hardware configuration of the information processing system 90 according to this embodiment. Fig. 2 is a perspective view showing an example of the configuration of a 3D scanner 50 according to this embodiment. Furthermore, Fig. 3 is a block diagram showing an example of the functional configuration of an information processing device 10 according to this embodiment.

As shown in FIG. 1, the information processing system 90 according to this embodiment includes an information processing device 10 and a 3D scanner 50. Examples of the information processing device 10 include general-purpose or dedicated information processing devices such as personal computers and server computers.

The information processing device 10 according to this embodiment includes a CPU (Central Processing Unit) 11, a memory 12 as a temporary storage area, a non-volatile storage unit 13, an input unit 14 such as a keyboard and mouse, a display unit 15 such as a liquid crystal display, a media read/write device (R/W) 16, and a communication interface (I/F) unit 18. The CPU 11, memory 12, storage unit 13, input unit 14, display unit 15, media read/write device 16, and communication interface (I/F) unit 18 are connected to each other via a bus B. The media read/write device 16 reads information written to a recording medium 17 and writes information to the recording medium 17.

The storage unit 13 is realized by a hard disk drive (HDD), a solid state drive (SSD), a flash memory, etc. An information processing program 13A is stored in the storage unit 13 as a storage medium. The information processing program 13A is stored in the storage unit 13 when a recording medium 17 on which the information processing program 13A is written is set in the medium reading and writing device 16 and the medium reading and writing device 16 reads the information processing program 13A from the recording medium 17. The CPU 11 reads the information processing program 13A from the storage unit 13, expands it in the memory 12, and sequentially executes the processes of the information processing program 13A.

The memory unit 13 also stores a scan information database 13B and a BIM model 13C. In the information processing system 90 according to this embodiment, a conventionally known BIM model is used as the BIM model 13C.

In other words, the use of BIM is increasing in the field of architectural design. When designing an architecture, an architectural designer proceeds with the design work by creating a BIM model that represents a three-dimensional model of the building to be designed.

By utilizing BIM, an object representing the shape of a building is formed in a space on a computer, and attribute information is assigned to the object. For example, information on physical characteristics (specific gravity, material, strength, rigidity, etc.) or information on costs (for example, unit price per ^m2 and construction cost, etc.) can be linked to the object as attribute information. Therefore, for example, by linking the BIM model with various analysis tools, structural analysis, thermal load analysis, etc. can be automatically performed according to the BIM model.

Note that since BIM models are well known, further detailed explanation is omitted. The scan information database 13B will be described in detail later.

As shown in FIG. 1, the 3D scanner 50 according to this embodiment includes a scanner body 52 and a storage unit 58. Although not shown, the 3D scanner 50 according to this embodiment also includes a motor for changing the shooting direction of the scanner body 52 when performing 3D shooting with the scanner body 52, a control unit for controlling the operation of each part of the motor, the scanner body 52, etc.

As shown in FIG. 2, the 3D scanner 50 according to this embodiment has a scanner body 52 provided on the top of a tripod-shaped leg 60, and the scanner body 52 is capable of changing the shooting direction at the top of the leg 60 by driving the motor described above. It goes without saying that the leg 60 is not limited to a tripod.

The 3D scanner 50 according to this embodiment is a so-called time-of-flight type, which calculates the distance from the time it takes for a laser to be emitted from the scanner body 52 and reflected back from the target, while calculating the laser emission angle from the direction of movement of the scanner body 52, and uses these calculated values to identify the three-dimensional position. However, the method of identifying the three-dimensional position using the 3D scanner 50 is not limited to this. For example, the 3D scanner 50 may be a so-called phase-shift type, which emits a laser modulated in multiple ways from the scanner body 52, calculates the distance to the target based on the phase difference of the diffuse reflection component that hits the target and returns, and identifies the three-dimensional position from the distance and the laser emission angle.

In addition, in the 3D scanner 50 according to this embodiment, in addition to coordinate information indicating the coordinates of the three-dimensional position of each point, reflection intensity information indicating the reflection intensity of the laser at the corresponding point and color information indicating the color of the corresponding point are acquired as point cloud data. Then, in the 3D scanner 50 according to this embodiment, the acquired coordinate information, reflection intensity information, and color information are associated with each point in the point cloud data and stored. However, this is not limited to this form, and for example, only the coordinate information may be stored as point cloud data, or a combination of the coordinate information and either the reflection intensity information or the color information may be stored as point cloud data.

In the information processing system 90 according to the present embodiment, the various information stored in the storage unit 58 of the 3D scanner 50 is transmitted to the information processing device 10 by wired communication, but the present invention is not limited to this. For example, the various information stored in the storage unit 58 of the 3D scanner 50 may be transmitted to the information processing device 10 by wireless communication. In addition, the storage unit 58 may be a portable storage medium that is detachable from the 3D scanner 50, and the various information stored in the storage unit 58 of the 3D scanner 50 may be transferred to the information processing device 10 via the storage medium. Furthermore, the various information stored in the storage unit 58 of the 3D scanner 50 is not limited to being transmitted directly to the information processing device 10, and may be transmitted to the information processing device 10 via a cloud server, for example.

Next, the functional configuration of the information processing device 10 according to this embodiment will be described with reference to FIG. 3. As shown in FIG. 3, the information processing device 10 according to this embodiment includes an acquisition unit 11A and a control unit 11B. The CPU 11 of the information processing device 10 executes the information processing program 13A to function as the acquisition unit 11A and the control unit 11B.

The acquisition unit 11A according to this embodiment acquires first point cloud data obtained by performing 3D imaging at two locations based on one street centerline, and second point cloud data obtained by performing 3D imaging at two locations based on another street centerline. Note that in this embodiment, the first point cloud data is obtained by performing 3D imaging at two locations on the one street centerline, and the second point cloud data is obtained by performing 3D imaging at two locations on the other street centerline.

The control unit 11B according to this embodiment also controls the display unit 15 to display the images based on the first point cloud data and the second point cloud data acquired by the acquisition unit 11A superimposed on the image based on the BIM model 13C so as to overlap the corresponding center line of the BIM model 13C.

Next, the scan information database 13B according to this embodiment will be described with reference to FIG. 4. FIG. 4 is a schematic diagram showing an example of the configuration of the scan information database 13B according to this embodiment.

As shown in FIG. 4, the scan information database 13B according to this embodiment stores coordinates, reflection intensity, and color information in association with each other.

The coordinates are the above-mentioned coordinate information indicating the coordinates of the positions of the points obtained by three-dimensional imaging using the 3D scanner 50, the reflection intensity is the above-mentioned reflection intensity information at the corresponding points, and the color is the above-mentioned color information at the corresponding points. That is, the scan information database 13B according to this embodiment is a database in which point cloud data of coordinate information, reflection intensity information, and color information obtained by three-dimensional imaging using the 3D scanner 50 is registered.

Next, the operation of the information processing system 90 according to this embodiment will be described with reference to Figs. 5 to 9. Fig. 5 is a perspective view showing an example of the installation state of the 3D scanner 50 according to this embodiment. Fig. 6 is a flowchart showing an example of information processing according to this embodiment. Fig. 7 is a diagram for explaining information processing according to this embodiment, and is a plan view showing an example of the relationship between the position of the marked out center line and the position of photography by the 3D scanner 50.

As an example, as shown in FIG. 5, the photographer taking the 3D photograph takes 3D photographs at two locations above one marked street centerline (in this embodiment, the street centerline in the X-axis direction in the BIM model 13C) 82 inside the target building (hereinafter referred to as the "target building") 80. The photographer also takes 3D photographs at two locations above another marked street centerline (in this embodiment, the street centerline in the Y-axis direction in the BIM model 13C) 84 inside the target building 80. When taking 3D photographs at the above four locations, the photographer sets up the 3D scanner 50 so that the scanner body 52 is positioned as close as possible to the perpendicular line of the corresponding street centerline.

Through this 3D imaging, the above-mentioned coordinate information, reflection intensity information, and color information for each of the four imaging positions corresponding to the target building 80 are obtained and temporarily stored in the memory unit 58.

Then, the photographer performs an operation to transmit the coordinate information, reflection intensity information, and color information for each shooting position stored in the 3D scanner 50 to the information processing device 10.

When each piece of information for each shooting position is received from the 3D scanner 50, the information processing device 10 temporarily stores each piece of received information in its original form in a specified area of the storage unit 13. Then, in the information processing device 10, each piece of information, namely, coordinate information, reflection intensity information, and color information, is synthesized into one piece of information as point cloud data indicating the target building 80, and is registered in the scan information database 13B.

In this state, the user of the information processing device 10 inputs an instruction to start the execution of the information processing program 13A via the input unit 14. In response to this instruction, the CPU 11 of the information processing device 10 executes the information processing program 13A, thereby executing the information processing shown in FIG. 6.

In step 100 of FIG. 6, the CPU 11 reads each piece of information of the BIM model 13C from the storage unit 13. In step 102, the CPU 11 reads all information (hereinafter referred to as "scan information") from the scan information database 13B, and reads the coordinate information obtained by three-dimensional shooting at the above four shooting positions of the 3D scanner 50 from the above specified area of the storage unit 13. As shown in FIG. 7 as an example, in the following, one shooting position on the center line 82 on the X axis between the columns 86 is referred to as "shooting position X1", and the other shooting position is referred to as "shooting position X2". In the following, one shooting position on the center line 84 on the Y axis between the columns 86 is referred to as "shooting position Y1", and the other shooting position is referred to as "shooting position Y2".

In step 104, the CPU 11 identifies two shooting positions, shooting position X1 and shooting position X2, from the read coordinate information. Note that shooting position X1 can be obtained as the X and Y coordinate values corresponding to the position of the 3D scanner 50 itself in the coordinate information obtained by 3D shooting at shooting position X1 from the read coordinate information. Similarly, shooting position X2 can be obtained as the X and Y coordinate values corresponding to the position of the 3D scanner 50 itself in the coordinate information obtained by 3D shooting at shooting position X2 from the read coordinate information.

In general, 3D scanners often cannot obtain coordinate information indicating the position of the scanner itself in the horizontal plane (X-Y plane) because this is a blind spot when performing 3D imaging. However, in this case, it is possible to obtain coordinate information indicating the position of the periphery (outer periphery) of the blind spot area, and therefore it is possible to obtain coordinate information indicating the scanner's own position by calculating the center position of the blind spot from the coordinate information indicating the surrounding positions.

In step 106, the CPU 11 derives a straight line connecting the two identified shooting positions, X1 and X2 (hereinafter referred to as the "X-axis line").

In step 108, the CPU 11 identifies two shooting positions, shooting position Y1 and shooting position Y2, from the read coordinate information. Note that shooting position Y1 can be obtained as the X and Y coordinate values corresponding to the position of the 3D scanner 50 itself in the coordinate information obtained by 3D shooting at shooting position Y1 among the read coordinate information. Similarly, shooting position Y2 can be obtained as the X and Y coordinate values corresponding to the position of the 3D scanner 50 itself in the coordinate information obtained by 3D shooting at shooting position Y2 among the read coordinate information. Note that the response when there is a blind spot when performing 3D shooting with the 3D scanner 50 is the same as the case of identifying the two shooting positions, shooting position X1 and shooting position X2, described above.

In step 110, the CPU 11 derives a straight line connecting the two identified shooting positions, Y1 and Y2 (hereinafter referred to as the "Y-axis straight line").

In step 112, the CPU 11 identifies a center line corresponding to the X-axis center line 82 from the read BIM model 13C, and in step 114, the CPU 11 identifies a center line corresponding to the Y-axis center line 84 from the read BIM model 13C.

In step 116, the CPU 11 adjusts the attitude of the image shown by the read scan information (point cloud data) so that the derived X-axis straight line overlaps with the X-axis center line of the identified BIM model 13C, and the derived Y-axis straight line overlaps with the Y-axis center line of the identified BIM model 13C. This adjustment of the image attitude is performed, for example, by rotating the image or moving the image. The CPU 11 then controls the display unit 15 to display a screen showing an image in which the image after the attitude adjustment and the image shown by the BIM model 13C are superimposed (hereinafter referred to as the "superimposed display screen"), and in step 118, the CPU 11 waits until the specified information is input.

Figure 8 shows a front view of an example of a conventional overlapping display screen. Figure 9 shows a front view of an example of an overlapping display screen according to this embodiment.

As an example, as shown in Figure 8, in conventional overlay display screens, the position and angle of the image shown by the point cloud data often do not match that of the image from the BIM model, and it was necessary to manually adjust the posture of the image from the point cloud data on the displayed overlay display screen. As mentioned above, this adjustment had problems in that the accuracy of the overlay varies depending on the skill of the person performing it, and reproducibility is low.

In contrast, as shown in FIG. 9 as an example, in the overlay display screen according to this embodiment, the image is displayed with its posture automatically adjusted using point cloud data, making it easier to obtain the final overlay display screen.

Note that even after the adjustments according to this embodiment have been made, there may be a misalignment between the image from the BIM model and the image shown by the point cloud data due to factors such as the misalignment of the shooting position of the 3D scanner 50 from the position of the street center line. However, since the amount of misalignment is small even in this case, it is possible to obtain the final overlay display screen more easily than with conventional technology.

When the superimposed display screen shown in FIG. 9 is displayed on the display unit 15 as an example, the user checks the displayed superimposed display screen and then selects the end button 15E via the input unit 14. When the end button 15E is selected by the user, the result of step 118 is a positive judgment, and this information processing ends.

As described above, the information processing device 10 according to this embodiment includes an acquisition unit 11A that acquires first point cloud data obtained by performing 3D photography at two locations based on one street center line, and second point cloud data obtained by performing 3D photography at two locations based on another street center line, and a control unit 11B that controls the display unit to superimpose images based on the first point cloud data and the second point cloud data acquired by the acquisition unit 11A on an image based on the BIM model so that the images are superimposed on the corresponding street center lines of the BIM model. Therefore, it is possible to more easily superimpose an image based on the point cloud data acquired by the 3D scanner and an image based on the BIM model.

In particular, according to the information processing device 10 of this embodiment, the first point cloud data is obtained by taking 3D photographs at two locations on one street centerline, and the second point cloud data is obtained by taking 3D photographs at two locations on the other street centerline. Therefore, it is possible to more easily superimpose an image based on the point cloud data obtained by the 3D scanner and an image based on the BIM model.

In the above embodiment, a case has been described in which the centerline in the X-axis direction of the BIM model is applied as one centerline, and the centerline in the Y-axis direction of the BIM model is applied as the other centerline, but this is not limited to the above. For example, a centerline in the Z-axis direction (height direction) of the BIM model may be applied as the one or the other centerline. In this case, the 3D scanner is installed at two locations in the Z-axis direction to perform 3D photography.

In the above embodiment, the 3D scanner 50 performs 3D imaging at two locations on each of the center lines 82 and 84, for a total of four locations, but this is not limited to the above. For example, in addition to these four locations, the 3D scanner 50 may perform 3D imaging regardless of the position of the center lines.

In the above embodiment, the first point cloud data is obtained by taking 3D photographs at two locations on one street centerline, and the second point cloud data is obtained by taking 3D photographs at two locations on another street centerline, but this is not limited to the above. For example, the first point cloud data may be obtained by taking 3D photographs at two locations on one street centerline, and the second point cloud data may be obtained by taking 3D photographs at two locations on a line offset from the other street centerline (hereinafter referred to as the "second embodiment").

In addition, for example, the first point cloud data may be obtained by taking 3D images at two locations on a line offset from one center line, and the second point cloud data may be obtained by taking 3D images at two locations on a line offset from another center line (hereinafter referred to as the "third embodiment").

Furthermore, in the second and third embodiments, one of the two shooting positions for 3D photography performed to obtain the first point cloud data and one of the two shooting positions for 3D photography performed to obtain the second point cloud data may be a common position with one of the other two shooting positions.

Figure 10 is a diagram for explaining another example of information processing according to the above embodiment (an example of the second embodiment), and shows a plan view showing another example of the relationship between the positions of the marked out center lines and the positions photographed by the 3D scanner.

As shown in FIG. 10, in this embodiment, instead of the shooting positions X1 and X2 set at the position of the X-axis center line 82 in the above embodiment, shooting positions Y1 and X3, which are positions offset by a distance y1 in the Y-axis direction, are used as the shooting positions by the 3D scanner 50. In this embodiment, in the processing of step 106 in the above-mentioned information processing (see also FIG. 6), the derived X-axis straight line is translated by a distance y1 in the direction of the center line 82. Also, in this embodiment, the shooting position Y1 is set to the same position as the shooting position at the Y-axis center line 84. This makes it possible to reduce the number of shots by one.

Figure 11 is a diagram for explaining another example of information processing according to the above embodiment (an example of the third embodiment), and shows a plan view showing another example of the relationship between the positions of the marked out center lines and the positions photographed by the 3D scanner.

As shown in FIG. 11, in this embodiment, instead of the photographing positions Y1 and Y2 set at the Y-axis center line 84 in the embodiment shown in FIG. 10, photographing positions Y3 and Y4, which are offset by a distance x1 in the X-axis direction, are used as photographing positions by the 3D scanner 50. In this embodiment, in the process of step 110 in the information processing described above (see also FIG. 6), the derived Y-axis straight line is translated in the direction of the center line 84 by a distance x1.

In the above embodiment, a case where only one centerline is applied as the centerline of the X-axis and the centerline of the Y-axis is described, but this is not limited to the above. For example, a configuration in which multiple centerlines are applied as at least one of the centerlines of the X-axis and the Y-axis may be used.

Figure 12 is a diagram for explaining another example of information processing according to the above embodiment, and shows a plan view illustrating another example of the relationship between the positions of the marked out center lines and the positions photographed by the 3D scanner.

As shown in FIG. 12, in this embodiment, in addition to the shooting positions X1 and X2 set at the position of the X-axis center line 82 in the above embodiment and the shooting positions Y1 and Y2 set at the position of the Y-axis center line 84, shooting positions X3 and X4 are set at the position of the other X-axis center line 83, and shooting positions Y3 and Y4 are set at the position of the other Y-axis center line 85. In this embodiment, since two straight lines are obtained as the X-axis line and the Y-axis line, it is possible to superimpose the image based on the point cloud data and the image based on the BIM model with higher accuracy.

Furthermore, FIG. 13 is a diagram for explaining another example of information processing according to the above embodiment, and shows a plan view illustrating another example of the relationship between the positions of the marked out center lines and the photographing positions taken by the 3D scanner.

As shown in FIG. 13, in this embodiment, shooting positions X4 and Y4 are common to the embodiment shown in FIG. 12. Therefore, in this embodiment, the number of shots can be reduced by one compared to the embodiment shown in FIG. 12.

In addition, in the above embodiment, a case where an image based on point cloud data is superimposed on an image based on a BIM model has been described, but this is not limited to the above. It is not necessary to superimpose an image based on point cloud data on an image based on a BIM model, and the point is that by acquiring point cloud data based on the center line, it becomes possible to easily compare the acquired point cloud data with a two-dimensional drawing.

In the above embodiment, for example, the hardware structure of the processing unit that executes each process of the acquisition unit 11A and the control unit 11B can be the various processors shown below. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as a processing unit, as well as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field-Programmable Gate Array), a dedicated electrical circuit, which is a processor with a circuit configuration designed specifically to execute a specific process, such as an ASIC (Application Specific Integrated Circuit), etc.

The processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (e.g., a combination of multiple FPGAs, or a combination of a CPU and an FPGA). The processing unit may also be configured with a single processor.

As an example of configuring the processing unit as a single processor, first, there is a form in which one processor is configured as a combination of one or more CPUs and software, as typified by computers such as clients and servers, and this processor functions as the processing unit. Secondly, there is a form in which a processor is used to realize the functions of the entire system, including the processing unit, in a single IC (Integrated Circuit) chip, as typified by systems on chips (SoCs). In this way, the processing unit is configured as a hardware structure using one or more of the various processors listed above.

More specifically, the hardware structure of these various processors can be an electrical circuit that combines circuit elements such as semiconductor elements.

10 Information processing device 11 CPU
11A Acquisition unit 11B Control unit 12 Memory 13 Storage unit 13A Information processing program 13B Scan information database 13C BIM model 14 Input unit 15 Display unit 15E End button 16 Media reading and writing device 17 Recording medium 18 Communication I/F unit 50 3D scanner 52 Scanner body 58 Storage unit 60 Leg 80 Target building 82 to 85 Grid line 86 Column 90 Information processing system X1 to X4 Shooting position Y1 to Y4 Shooting position

Claims (7)

An acquisition unit that acquires first point cloud data obtained by installing a 3D scanner at two locations based on one center line and performing three-dimensional photography, and second point cloud data obtained by installing a 3D scanner at two locations based on another center line and performing three-dimensional photography;
A control unit that controls the display of the images based on the first point cloud data and the second point cloud data acquired by the acquisition unit on a display unit so as to overlap the image based on the BIM model so as to overlap the corresponding center line of the BIM model;
An information processing device comprising: The first point cloud data is obtained by installing a 3D scanner at two locations on the one center line and taking three-dimensional images,
The second point cloud data is obtained by installing a 3D scanner at two locations on the other street center line and taking three-dimensional photographs.
The information processing device according to claim 1 . The first point cloud data is obtained by installing a 3D scanner at two locations on the one center line and taking three-dimensional images,
The second point cloud data is obtained by installing a 3D scanner at two locations on a line offset from the other center line and performing three-dimensional photography.
The information processing device according to claim 1 . The first point cloud data is obtained by installing a 3D scanner at two points on a line offset from the one center line and performing three-dimensional photography,
The second point cloud data is obtained by installing a 3D scanner at two locations on a line offset from the other center line and performing three-dimensional photography.
The information processing device according to claim 1 . One of the two shooting positions of the three-dimensional photographing performed to obtain the first point cloud data and the two shooting positions of the three-dimensional photographing performed to obtain the second point cloud data is a common position to one of the two shooting positions of the other two shooting positions.
5. The information processing device according to claim 3. an acquisition unit that acquires first point cloud data obtained by performing three-dimensional photography at two locations based on one center line, and second point cloud data obtained by performing three-dimensional photography at two locations based on another center line;
A control unit that controls the display of the images based on the first point cloud data and the second point cloud data acquired by the acquisition unit on a display unit so as to overlap the image based on the BIM model so as to overlap the corresponding center line of the BIM model;
Equipped with
The first point cloud data is obtained by performing three-dimensional imaging at two points on the one center line,
The second point cloud data is obtained by performing three-dimensional photography at two points on a line offset from the other center line.
Information processing device. an acquisition unit that acquires first point cloud data obtained by performing three-dimensional photography at two locations based on one center line, and second point cloud data obtained by performing three-dimensional photography at two locations based on another center line;
A control unit that controls the display of the images based on the first point cloud data and the second point cloud data acquired by the acquisition unit on a display unit so as to overlap the image based on the BIM model so as to overlap the corresponding center line of the BIM model;
Equipped with
The first point cloud data is obtained by performing three-dimensional imaging at two points on a line offset from the one center line,
The second point cloud data is obtained by performing three-dimensional photography at two points on a line offset from the other center line.
Information processing device.