JP7752576B2 - Facility information management system, facility information management method, and facility information management program - Google Patents

Description

This disclosure relates to a facility information management system, a facility information management method, and a facility information management program that manage information about facilities.

Facility information management systems are known that manage the location information of facilities installed on roads or roadsides. To obtain facility location information, for example, a three-dimensional measurement device such as an MMS (Mobile Mapping System) is used, which automatically performs measurements while a vehicle is moving.

Patent Document 1 discloses a position measurement system that measures the position of road signs using a three-dimensional point cloud model and camera images. It identifies the range of the road sign from the camera image by pattern matching with pre-stored characteristic information of the road sign, and calculates the three-dimensional coordinates of the point cloud representing the road sign based on the results of projecting point cloud data onto that range. The position measurement system disclosed in Patent Document 1 stores the two-dimensional coordinates and three-dimensional coordinates of the road sign.

JP 2009-76096 A

The position measurement system disclosed in Patent Document 1 does not set a representative point for the range of a road sign when managing the location information of the road sign. This poses a problem in that the process of registering the location of equipment is cumbersome when displaying the location of road signs on a map or when registering the location of equipment in a geographic information system.

The present disclosure has been made in light of the above, and aims to provide a facility information management system that simplifies the process of registering facility locations.

To solve the above-mentioned problems and achieve the objectives, the equipment information management system disclosed herein comprises a measurement information storage device that stores point cloud data acquired in a measurement area, which is a three-dimensional area, and images of the measurement area; a detection device that detects equipment present in the measurement area from the images and sets a box that defines the portion of the measurement area where the equipment is located; an equipment information storage device that stores equipment position information including position information of the box and position information of a representative point that is a point that represents the box; a display device that generates an object representing the box based on the equipment position information and displays an image with the object superimposed and point cloud data with the object superimposed; and an equipment information editing device that modifies the box position information and the representative point position information in accordance with operations that move the object superimposed on the image or the object superimposed on the point cloud data on the screen.

The facility information management system disclosed herein has the effect of simplifying the process of registering facility locations.

FIG. 1 is a diagram illustrating a configuration example of a facility information management system according to a first embodiment; FIG. 1 is a first diagram showing an example of a box set by a detection device of a facility information management system according to a first embodiment; FIG. 2 is a second diagram showing an example of a box set by the detection device of the facility information management system according to the first embodiment; FIG. 10 is a diagram showing an example of an image displayed by a display device of the facility information management system according to the first embodiment; FIG. 1 is a diagram showing an example of point cloud data displayed by a display device of the facility information management system according to the first embodiment; FIG. 1 is a diagram showing an example of a map displayed by a display device of the facility information management system according to the first embodiment; 1 is a flowchart showing the procedure of an operation performed by the facility information management system according to the first embodiment; FIG. 10 is a diagram illustrating a configuration example of a detection device according to a second embodiment. FIG. 10 is a diagram showing an example of a map displayed by a display device according to a fourth embodiment; FIG. 10 is a diagram showing an example of an image displayed by a display device according to a fourth embodiment; FIG. 1 is a diagram illustrating an example of a hardware configuration of components of a facility information management system according to first to sixth embodiments.

The facility information management system, facility information management method, and facility information management program according to the embodiments are described in detail below with reference to the accompanying drawings.

Embodiment 1.
1 is a diagram illustrating an example of the configuration of a facility information management system 1 according to a first embodiment. The facility information management system 1 is a system that manages location information of facilities installed on roads or roadsides. The facilities include kilometer posts, road signs, traffic lights, guardrails, lighting poles, white lines, and utility poles.

The 3D measurement device 2 measures equipment installed on the road or roadside while moving along the road. The 3D measurement device 2 is, for example, an MMS. The 3D measurement device 2 acquires point cloud data of a measurement area, which is a three-dimensional area surrounding the 3D measurement device 2. The 3D measurement device 2 also acquires images by photographing the measurement area. The 3D measurement device 2 transmits the point cloud data acquired in the measurement area and the photographed image of the measurement area to the equipment information management system 1.

The terminal device 3 is a terminal used by a user who is a user of the equipment information management system 1. The user is, for example, a person who performs equipment management work. The terminal device 3 is capable of communicating with the equipment information management system 1 via a network, and sends and receives information to and from the equipment information management system 1. The network is, for example, a WAN (Wide Area Network) such as the Internet, but may also be a LAN (Local Area Network). The number of terminal devices 3 connected to the equipment information management system 1 is arbitrary.

The facility information management system 1 comprises a detection device 10, a facility information storage device 11, a display device 12, a facility information editing device 13, a measurement information storage device 14, and a map information storage device 15. In the example shown in FIG. 1, the detection device 10 is implemented in the facility detection server 4. The facility information storage device 11, the display device 12, and the facility information editing device 13 are implemented in the facility information management server 5. The measurement information storage device 14 is implemented in the measurement information management server 6. The map information storage device 15 is implemented in the map information management server 7.

Each of the facility detection server 4, facility information management server 5, measurement information management server 6, and map information management server 7 is configured as a cloud server. A cloud server is a server built in a cloud environment that includes computer resources provided by a cloud service platform. Each of the facility detection server 4, facility information management server 5, measurement information management server 6, and map information management server 7 may be a server other than a cloud server, for example, an on-premise server.

The detection device 10 detects equipment present in the measurement area from an image and sets a box that defines the portion of the measurement area where the equipment is located. The detection device 10 includes an acquisition unit 20 that acquires various information, a detection unit 21 that performs processing to detect equipment, and an ID assignment unit 22 that assigns an ID to the detected equipment.

The equipment information storage device 11 includes an acquisition unit 23 that acquires various types of information, and a representative point calculation unit 24. The equipment information storage device 11 also holds a database. The equipment information storage device 11 stores equipment location information in the database. The database held by the equipment information storage device 11 is not shown in the illustration.

The display device 12 generates display data and transmits it to the terminal device 3, thereby displaying various information on the screen of the terminal device 3. The display device 12 includes an acquisition unit 25 that acquires various information, and a presentation unit 26. The presentation unit 26 generates display data and transmits it to the terminal device 3, thereby presenting the display data to the terminal device 3.

The equipment information editing device 13 edits equipment location information in accordance with instructions from the terminal device 3. The equipment information editing device 13 includes a reception unit 27 that receives instructions from the terminal device 3, an editing unit 28 that performs processing to edit the equipment location information, and a data extraction unit 29 that performs data extraction processing. The data extraction processing will be described later.

The measurement information storage device 14 stores point cloud data, which is measurement information acquired in a measurement area, which is a three-dimensional area, and images of the measurement area. The measurement information storage device 14 includes an acquisition unit 30 that acquires the point cloud data and images. The measurement information storage device 14 also holds a database. The measurement information storage device 14 stores the point cloud data and images in the database. The database held by the measurement information storage device 14 is not shown in the illustration.

The map information storage device 15 stores map information. The map information storage device 15 acquires map information from outside the facility information management system 1. The map information storage device 15 also maintains a database. The map information storage device 15 stores map information in the database. The configuration of the map information storage device 15 is not shown in the figures.

Next, we will explain the processing in each component of the equipment information management system 1. The acquisition unit 30 of the measurement information storage device 14 acquires the point cloud data and images transmitted by the 3D measurement device 2. The measurement information storage device 14 stores the acquired point cloud data and acquired images in a database. The measurement information storage device 14 outputs the point cloud data and images to the detection device 10, equipment information storage device 11, display device 12, and equipment information editing device 13 as appropriate.

The acquisition unit 20 of the detection device 10 acquires point cloud data and images from the measurement information storage device 14. Here, the point cloud data acquired by the acquisition unit 20 is assumed to be point cloud data obtained by current measurement. The images acquired by the acquisition unit 20 are assumed to be images captured during the current measurement. In addition, the acquisition unit 20 acquires equipment location information for equipment detected by measurements taken earlier than the current time from the equipment information storage device 11.

The database of the equipment information storage device 11 stores, for equipment detected by past measurements, cropped images obtained by cropping out portions of the image that include the equipment, and cropped point cloud data obtained by cropping out portions of the point cloud data that include the equipment. The acquisition unit 20 acquires cropped images of equipment detected by past measurements from the equipment information storage device 11. The detection unit 21 of the detection device 10 detects equipment from the image based on the shape captured in the image taken during the current measurement and the shape of the equipment shown in the cropped image. The detection unit 21 may use any method to detect equipment. The detection unit 21 may learn the shape of each type of equipment in advance and detect equipment based on the learning results.

For the equipment detected by the current measurement, the detection unit 21 sets a box that defines the portion of the measurement area in which the equipment exists. The box represents the boundary of the three-dimensional space that includes the detected equipment.

Here, we will explain the boxes set by the detection device 10. Figure 2 is a first diagram showing an example of a box set by the detection device 10 of the facility information management system 1 according to the first embodiment. Figure 3 is a second diagram showing an example of a box set by the detection device 10 of the facility information management system 1 according to the first embodiment.

Image 40 shown in Figure 2 is an example of an image acquired during current measurement. Figure 2 also shows an image of a box set in the measurement area captured in image 40. Point cloud data 43 shown in Figure 3 is an example of point cloud data acquired through current measurement. Figure 3 also shows an image of a box set in the measurement area. Box 42 shown in Figures 2 and 3 is an example of a box set in the measurement area. The kilometer post, which is equipment 41 shown in Figures 2 and 3, is an example of equipment detected through current measurement.

The detection unit 21 sets a box 42 that contains the equipment 41. As shown in FIG. 3, the box 42 is a rectangular parallelepiped. As shown in FIG. 2, in the image 40, which is a two-dimensional image, the box 42 is represented by a planar rectangle. In the point cloud data 43 shown in FIG. 3, the box 42 is represented three-dimensionally. The method by which the detection unit 21 sets the box 42 is arbitrary. The detection unit 21 outputs the three-dimensional coordinates (X _bi , Y _bi , Z _bi ) of each vertex of the set box 42 to the ID assignment unit 22 of the detection device 10. i is an integer from 1 to 8. The detection unit 21 also outputs the two-dimensional coordinates (X _pj , Y _pj ) of each vertex of the box 42 in the image 40 to the ID assignment unit 22 of the detection device 10. j is an integer from 1 to 4.

The ID assignment unit 22 assigns equipment location information to equipment detected by the detection unit 21. The equipment location information includes an equipment ID, which is an identifier for identifying the detected equipment. The ID assignment unit 22 assigns a new equipment ID to equipment detected by current measurement. The equipment location information includes the image name of the image in which the equipment is detected.

If the equipment detected by past measurement includes equipment that may be the same as the equipment detected by the current measurement, the ID assignment unit 22 sets the equipment ID of the equipment that may be the same as the equipment detected by the current measurement as an equipment ID candidate. The ID assignment unit 22 includes the equipment ID candidate in the equipment location information. The ID assignment unit 22 determines that equipment detected by past measurement that is detected within a certain range from the position of the equipment detected by the current measurement and is of the same type as the equipment detected by the current measurement is equipment that may be the same as the equipment detected by the current measurement.

The ID assignment unit 22 includes the two-dimensional coordinates output by the detection unit 21 and the three-dimensional coordinates output by the detection unit 21 in the equipment location information. The detection device 10 outputs the equipment location information to the equipment information storage device 11. The equipment location information output by the detection device 10 includes the equipment ID, equipment ID candidates, image name, two-dimensional coordinates that are the location information of the box, and three-dimensional coordinates that are the location information of the box.

The acquisition unit 23 of the equipment information storage device 11 acquires equipment location information from the detection device 10. The equipment information storage device 11 stores the acquired equipment location information in its database. The representative point calculation unit 24 of the equipment information storage device 11 calculates a representative point of the box based on the box's location information included in the equipment location information. The representative point may be any point contained in the box. An example of the representative point is the center position of the box. The representative point may be the center of gravity of the box, one of the vertices of the box, or any point on each edge of the box. The representative point may also be the point in the point cloud that is closest to the center of gravity of the box. In this case, the acquisition unit 23 acquires point cloud data from the measurement information storage device 14. The representative point calculation unit 24 specifies a representative point from the point cloud of the point cloud data. The representative point may be a point in the point cloud other than the point closest to the center of gravity of the box.

The ID assignment unit 22 includes the three-dimensional coordinates ( _Xd , _Yd , _Zd ) of the calculated representative point in the equipment location information. The ID assignment unit 22 includes the two-dimensional coordinates ( _Xpj , _Ypj ) of the calculated representative point in the equipment location information. The equipment location information stored in the equipment information storage device 11 includes an equipment ID, equipment ID candidates, an image name, two-dimensional coordinates that are location information of the box, three-dimensional coordinates that are location information of the box, and location information of the representative point. In other words, the equipment information storage device 11 stores equipment location information that includes an equipment ID, equipment ID candidates, an image name, location information of the box, and location information of the representative point.

The acquisition unit 25 of the display device 12 acquires point cloud data and images from the measurement information storage device 14. The acquisition unit 25 acquires equipment location information for equipment detected by current measurement from the equipment information storage device 11. The acquisition unit 25 acquires map information from the map information storage device 15. Furthermore, the acquisition unit 25 acquires equipment location information for equipment indicated as equipment ID candidates from the equipment information storage device 11. In other words, the acquisition unit 25 acquires equipment location information for equipment detected by past measurement.

The presentation unit 26 of the display device 12 generates an object representing a box based on the facility location information. The presentation unit 26 displays an image including the superimposed object and point cloud data including the superimposed object. Furthermore, the presentation unit 26 displays a map of the area including the measurement area, and displays an icon indicating a representative point on the map.

Here, we will explain the image displayed by the display device 12, the point cloud data displayed by the display device 12, and the map displayed by the display device 12. Figure 4 is a diagram showing an example of an image displayed by the display device 12 of the facility information management system 1 according to the first embodiment. Figure 5 is a diagram showing an example of point cloud data displayed by the display device 12 of the facility information management system 1 according to the first embodiment. Figure 6 is a diagram showing an example of a map displayed by the display device 12 of the facility information management system 1 according to the first embodiment.

Image 50 shown in Figure 4 is an example of an image displayed by display device 12. Point cloud data 55 shown in Figure 5 is an example of point cloud data displayed by display device 12. The kilometer post, which is equipment 52 shown in Figures 4 and 5, is an example of equipment detected by current measurement. The presentation unit 26 generates an object 51 representing the box based on the box position information included in the equipment position information for equipment 52. As shown in Figure 4, in image 50, which is a two-dimensional image, object 51 is a flat rectangle. In point cloud data 55 shown in Figure 5, object 51 is represented three-dimensionally.

Facility 54 shown in Figures 4 and 5 is a kilometer post, the same type of facility as facility 52, and is an example of a facility indicated as a facility ID candidate. In the example shown in Figures 4 and 5, the position of facility 52 is shifted from the position of facility 54. For example, facility 52 is a new facility installed in place of facility 54.

The presentation unit 26 generates an object 53 representing a box based on the box position information included in the equipment position information for the equipment 54. As shown in FIG. 4, in image 50, which is a two-dimensional image, object 53 is a planar rectangle. In point cloud data 55 shown in FIG. 5, object 53 is represented three-dimensionally. Because the position of equipment 54 is shifted from the position of equipment 52, the position of object 53 in image 50 is shifted from the position of object 51. Furthermore, in point cloud data 55, the position of object 53 is shifted from the position of object 51.

In this way, the display device 12 acquires equipment position information for equipment 52 detected by current measurement and equipment position information for equipment 54 detected by past measurement, and displays a first object, which is object 51 for equipment 52 detected by current measurement, and a second object, which is object 53 for equipment 54 detected by past measurement. The display device 12 displays an image 50 including an overlay of objects 51 and 53, and point cloud data 55 including an overlay of objects 51 and 53. This display by the display device 12 allows the user to easily compare the position of equipment 52 detected by current measurement with the position of equipment 54 detected by past measurement.

In Figures 4 and 5, the display color of object 51 and the display color of object 53 are different from each other. That is, the display device 12 displays the first object and the second object in a manner that allows them to be visually distinguished from each other. This allows the user to easily distinguish between object 51 for equipment 52 detected by current measurement and object 53 for equipment 54 detected by past measurement. While an example in which the display colors of the first object and the second object are different from each other has been shown here, this is not limiting. The display device 12 may also display the first object and the second object using different elements other than display color. For example, the display device 12 may use different types of lines representing the outer edges of the boxes of the first object and the second object, such as representing the first object with a solid line and the second object with a dashed line.

Map 58 shown in Figure 6 is an example of a map displayed by display device 12. Presentation unit 26 generates icon 56 representing a representative point of facility 52 based on the location information of the representative point in the facility location information for facility 52. Presentation unit 26 generates icon 57 representing a representative point of facility 54 based on the location information of the representative point in the facility location information for facility 54. Because the location of facility 54 is shifted from facility 52, the location of icon 57 on map 58 is shifted from the location of icon 56.

In this way, the display device 12 acquires equipment location information for equipment 52 detected by current measurement and equipment location information for equipment 54 detected by past measurement, and displays a first icon, which is icon 56, representing equipment 52 detected by current measurement, and a second icon, which is icon 57, representing equipment 54 detected by past measurement. The display device 12 displays a map 58 of the area including the measurement area, and displays icons 56 and 57 indicating representative points on the map 58.

In FIG. 6, the display colors of icons 56 and 57 are different from each other. That is, the display device 12 displays the first icon and the second icon in a manner that allows them to be visually distinguished from each other. This allows the user to easily distinguish between equipment 52 detected by current measurement and equipment 54 detected by past measurement. While an example in which the display colors of the first icon and the second icon are different from each other has been shown here, this is not limiting. The display device 12 may also display the first icon and the second icon with different elements other than the display color. For example, the display device 12 may also display the first icon and the second icon with different sizes from each other.

The equipment information management system 1 can use the representative point as a point that uniquely identifies the position of the detected equipment 52 to display the equipment 52 on the map 58. The equipment information management system 1 can register the detected equipment 52 on the map 58 without the user having to perform tedious work using information obtained by measurement. Furthermore, by displaying on the display device 12 an icon 56 representing the equipment 52 detected by current measurement and an icon 57 representing the equipment 54 detected by past measurement, the user can easily compare the position of the equipment 52 detected by current measurement with the position of the equipment 54 detected by past measurement.

The display device 12 allows the user to confirm the position of the equipment 52 detected by current measurements from at least one of an image, point cloud data, and map. After confirming the position of the equipment 52, the user determines whether or not the equipment location information used to display that equipment 52 needs to be changed. If the user determines that the equipment location information does not need to be changed, the user operates the terminal device 3 to confirm the equipment location information used to display it as the equipment location information to be registered in the equipment information management system 1. On the other hand, if the user determines that the equipment location information needs to be changed, the user can operate the terminal device 3 to instruct the equipment information management system 1 to edit the equipment location information.

When an instruction to edit facility location information is sent from the terminal device 3 to the facility information management system 1, the reception unit 27 of the facility information editing device 13 receives the editing instruction. The editing unit 28 of the facility information editing device 13 edits the facility location information in accordance with the user's operation of the terminal device 3, i.e., in accordance with the editing instruction.

The editing unit 28 corrects the position information of the representative point for the equipment 52, for example, in accordance with an operation to move the object 51 in the image 50 shown in FIG. 4 on the screen. Alternatively, the editing unit 28 corrects the position information of the representative point for the equipment 52 in accordance with an operation to move the object 51 in the point cloud data 55 shown in FIG. 5 on the screen. The editing unit 28 corrects the position information of the box for the equipment 52 in conjunction with the correction of the position information of the representative point.

When the box position information and representative point position information are corrected due to movement of object 51 in image 50 or movement of object 51 in point cloud data 55, the editing unit 28 outputs the corrected equipment position information to the equipment information storage device 11. The acquisition unit 23 of the equipment information storage device 11 acquires the corrected equipment position information from the equipment information editing device 13. The equipment information storage device 11 stores the corrected equipment position information in a database.

In this way, the equipment information editing device 13 corrects the box position information and the representative point position information in accordance with the operation of moving the object 51 superimposed on the image 50 or the object 51 superimposed on the point cloud data 55 on the screen. The corrected equipment position information for the equipment 52 is stored in the equipment information storage device 11, and equipment position information indicating the exact location of the equipment 52 is registered in the equipment information management system 1.

The facility information management system 1 allows the user to edit facility location information by moving the object 51. This allows the facility information management system 1 to edit facility location information without the user having to perform tedious tasks. By correcting the location information of the representative point, the position of the icon 57 in the map 58 shown in Figure 6 is also corrected. In this way, by setting the representative point, the facility information management system 1 can easily reflect edits made to the location of the facility 52 on the map 58.

The editing unit 28 can also modify the location information of the representative point for the facility 52 by moving the icon 57 in the map 58 on the screen. The editing unit 28 modifies the location information of the box for the facility 52 in conjunction with the modification of the location information of the representative point. The facility information storage device 11 saves the modified facility location information in the database. By storing the modified facility location information for the facility 52 in the facility information storage device 11, facility location information indicating the exact location of the facility 52 is registered in the facility information management system 1.

In this way, the equipment information editing device 13 modifies the box location information and the representative point location information in accordance with the operation of moving the icon 57 on the screen displaying the map 58. The equipment information management system 1 allows the user to edit the equipment location information by moving the icon 57. This allows the equipment information management system 1 to edit the equipment location information without the user having to perform complicated tasks. By modifying the representative point location information, the position of the object 51 in the image 50 shown in FIG. 4 and the position of the object 51 in the point cloud data 55 shown in FIG. 5 are also modified. In this way, by setting the representative point, the equipment information management system 1 can easily reflect edits made to the position of the equipment 52 in both the image 50 and the point cloud data 55.

The equipment information editing device 13 modifies the equipment ID included in the equipment location information in accordance with user operation. For example, if it is determined that the equipment ID of the same equipment as equipment 52 detected by current measurement is included in the equipment ID candidates, the user operates the terminal device 3 to send an editing instruction to edit the equipment ID to the equipment information management system 1. The reception unit 27 receives the instruction to edit the equipment ID. The editing unit 28 modifies the equipment ID of equipment 52 in accordance with the editing instruction.

For example, the editing unit 28 replaces the facility ID of facility 52 with the facility ID candidate, which is the facility ID of facility 54, by simultaneously specifying object 51 of facility 52 and object 53 of facility 54 on the screen. Alternatively, the editing unit 28 modifies the facility ID of facility 52 by having the user input a character string for the facility ID. Once the facility ID has been modified, the editing unit 28 outputs the modified facility ID to the facility information storage device 11. The facility information storage device 11 stores the modified facility ID in its database.

By storing the corrected equipment ID for equipment 52 in the equipment information storage device 11, the accurate equipment ID for equipment 52 is registered in the equipment information management system 1. In other words, equipment 52 detected by current measurement is linked to equipment detected by past measurement. Note that if equipment 52 detected by current measurement is new equipment that has not been detected by past measurement, the equipment ID assigned by the ID assignment unit 22 of the detection device 10 is registered as the equipment ID for equipment 52.

The data clipping unit 29 of the equipment information editing device 13 generates a clipped image of the equipment 52 by performing data clipping processing to clip a portion of the image 50 that includes the equipment 52 detected by the current measurement. The data clipping unit 29 also generates clipped point cloud data for the equipment 52 by performing data clipping processing to clip a portion of the point cloud data 55 that includes the equipment 52 detected by the current measurement. Note that, as described above, if the box position information and the representative point position information are modified, the data clipping unit 29 performs data clipping processing based on the modified position information.

The data cropping unit 29 outputs the cropped image and cropped point cloud data for the equipment 52 to the equipment information storage device 11. The acquisition unit 23 of the equipment information storage device 11 acquires the cropped image and cropped point cloud data for the equipment 52 from the equipment information editing device 13. The equipment information storage device 11 saves the cropped image and cropped point cloud data for the equipment 52 in a database. As a result, the equipment information storage device 11 stores the cropped image and cropped point cloud data for the equipment 52 for which equipment position information is registered.

The equipment information editing device 13 outputs equipment location information to the equipment information storage device 11, and also outputs equipment location information to the measurement information storage device 14. The acquisition unit 30 of the measurement information storage device 14 acquires the equipment location information from the equipment information editing device 13. The measurement information storage device 14 stores the equipment location information for equipment 52 detected by current measurement, linked to the point cloud data and image for that equipment 52.

Next, the operational procedures of the facility information management system 1 will be described. Figure 7 is a flowchart showing the operational procedures of the facility information management system 1 according to the first embodiment.

In step S1, the measurement information storage device 14 acquires point cloud data and images from the 3D measurement device 2. The measurement information storage device 14 stores the acquired point cloud data and acquired images in a database.

The detection device 10 acquires point cloud data and images from the measurement information storage device 14. In step S2, the detection device 10 detects equipment from the image and sets a box. In step S3, the detection device 10 calculates a representative point. The detection device 10 outputs equipment location information including an equipment ID, equipment ID candidates, an image name, box location information, and representative point location information. In step S4, the equipment information management system 1 stores the equipment location information in the equipment information storage device 11.

In step S5, the display device 12 acquires images, point cloud data, and map information. The display device 12 acquires images and point cloud data from the measurement information storage device 14. The display device 12 acquires map information from the map information storage device 15. The display device 12 also acquires equipment location information for equipment detected by current measurement from the equipment information storage device 11.

In step S6, the display device 12 determines whether there is any equipment registered through past measurements. If the equipment location information for the equipment detected through current measurements includes a candidate equipment ID, the display device 12 determines that there is equipment registered through past measurements.

If there is equipment registered through past measurements (Step S6, Yes), the display device 12 acquires equipment location information for the equipment registered through past measurements from the equipment information storage device 11 in Step S7. After completing Step S7, the equipment information management system 1 proceeds to Step S8. On the other hand, if there is no equipment registered through past measurements (Step S6, No), the equipment information management system 1 skips Step S7 and proceeds to Step S8.

In step S8, the display device 12 displays an image, point cloud data, and a map. The display device 12 displays an image on which an object 51 for the equipment detected by current measurement is superimposed, and point cloud data on which the object 51 for the equipment detected by current measurement is superimposed. The display device 12 displays a map on which an icon 56 for the equipment detected by current measurement is superimposed. If there is equipment registered by past measurement, the display device 12 also superimposes an object 53 for the equipment detected by past measurement on each of the image and point cloud data. If there is equipment registered by past measurement, the display device 12 also superimposes an icon 57 for the equipment detected by past measurement on the map.

In step S9, the facility information editing device 13 determines whether an instruction to edit the facility location information has been received. If an instruction to edit the facility location information has been received (step S9, Yes), the facility information editing device 13 edits the facility location information in accordance with the editing instruction. The facility information editing device 13 outputs the corrected facility location information to the facility information storage device 11. In step S10, the facility information management system 1 stores the corrected facility location information in the facility information storage device 11. After completing step S10, the facility information management system 1 proceeds to step S11. On the other hand, if an instruction to edit the facility location information has not been received (step S9, No), the facility information management system 1 skips step S10 and proceeds to step S11.

In step S11, the equipment information editing device 13 performs image clipping and point cloud data clipping. That is, the equipment information editing device 13 performs data clipping processing to clip from the image a portion including the equipment detected by the current measurement, and data clipping processing to clip from the point cloud data a portion including the equipment detected by the current measurement.

The facility information editing device 13 outputs the cropped image and cropped point cloud data to the facility information storage device 11. In step S12, the facility information management system 1 stores the cropped image and cropped point cloud data in the facility information storage device 11. This completes the operation of the facility information management system 1 according to the procedure shown in Figure 7.

According to the first embodiment, the equipment information management system 1 sets a box that defines the area where the equipment is located, and accumulates equipment location information including the location information of the box and the location information of a representative point. The equipment information management system 1 displays an image including a superimposed object representing the box and point cloud data including a superimposed object representing the box, and modifies the location information of the box and the location information of the representative point according to an operation to move the object on the screen. The equipment information management system 1 can register detected equipment on a map without the user having to perform complicated work based on information obtained by measurement. The equipment information management system 1 can modify the location of equipment obtained by measurement with a simple operation. As described above, the equipment information management system 1 has the effect of simplifying the work involved in registering the location of equipment.

The functions of each component of the facility information management system 1 are not limited to those described in embodiment 1 and can be modified as appropriate. In the following embodiments 2 to 6, modified examples of the functions of each component of the facility information management system 1 are described. In embodiments 2 to 6, the same components as in embodiment 1 are given the same reference numerals, and functions that differ from embodiment 1 are mainly described.

Embodiment 2.
In the first embodiment, the detection device 10 detects equipment from an image by comparing an image captured during current measurement with the extracted image. In the second embodiment, an example in which equipment is detected by a user operation will be described.

Figure 8 is a diagram showing an example configuration of a detection device 10A according to the second embodiment. The detection device 10A accepts an operation to specify the location of a box and sets the box in accordance with the operation. In addition to having the same configuration as the detection device 10 shown in Figure 1, the detection device 10A also includes a reception unit 60 and a display unit 61.

The display unit 61 transmits an image acquired from the measurement information storage device 14 to the terminal device 3, thereby displaying the image on the screen of the terminal device 3. The user checks the equipment shown in the image and operates the terminal device 3 to specify the position of a box containing the equipment. The reception unit 60 receives an operation to specify the position of the box. For example, the position of the box is specified by specifying each of the four corners of the box on the screen. Alternatively, the display unit 61 acquires point cloud data from the measurement information storage device 14 and transmits the acquired point cloud data to the terminal device 3, thereby displaying the point cloud data on the screen of the terminal device 3. The user specifies the position of the box, for example, by specifying each vertex of the box on the screen. Alternatively, the user specifies an arbitrary position of the equipment in the image or point cloud data, thereby setting a box containing the specified position.

In embodiment 2, the detection device 10A has an optional function that allows the user to detect equipment from images or point cloud data. The detection device 10A can detect equipment present in the measurement area by selecting either a process to detect equipment using the detection unit 21 or user operation. The detection device 10A may also be configured to omit the detection unit 21 and detect equipment solely through user operation.

Embodiment 3.
In the first embodiment, the equipment information accumulation device 11 calculates a representative point using the representative point calculation unit 24. In the third embodiment, an example will be described in which location information of equipment is acquired and a representative point is set based on the location information. In the third embodiment, the equipment information accumulation device 11 acquires location information of equipment from outside the equipment information management system 1 and sets a representative point based on the location information of the equipment.

The acquisition unit 23 of the equipment information storage device 11 acquires equipment location information from outside the equipment information management system 1. The representative point calculation unit 24 converts the coordinates of the acquired location information into coordinates in a coordinate system that is used as the basis for the equipment information management system 1. The representative point calculation unit 24 sets the converted coordinates as the representative point. Note that if the coordinates acquired from outside are two-dimensional coordinates, i.e., XY coordinates, the representative point calculation unit 24 sets the three-dimensional coordinates of the representative point by adding a Z coordinate to the XY coordinates. For the Z coordinate, the Z coordinate of the position of the three-dimensional measurement device 2 can be used, for example.

In embodiment 3, the equipment information storage device 11 has an optional function for setting a representative point based on location information acquired from outside the equipment information management system 1. As in embodiment 1, the equipment information storage device 11 can set a representative point by selecting either a process for calculating a representative point based on box location information, or a process for acquiring equipment location information from outside and setting a representative point.

Embodiment 4.
In the first embodiment, the display device 12 displays a first object and a second object in a manner that allows them to be visually distinguished from each other. Furthermore, the display device 12 displays a first icon and a second icon in a manner that allows them to be visually distinguished from each other. In the fourth embodiment, an example will be described in which a message indicating the attributes of a current measurement and a message indicating the attributes of a past measurement are displayed.

Figure 9 is a diagram showing an example of a map 58 displayed by the display device 12 according to the fourth embodiment. Icon 70 is a first icon representing equipment 52 detected by current measurement. Icon 71 is a second icon representing equipment 54 detected by past measurement. In the example shown in Figure 9, the display color of icon 70 and the display color of icon 71 are the same.

On the screen, icon 70 is accompanied by a message 72 indicating the attributes of the current measurement. On the screen, icon 71 is accompanied by a message 73 indicating the attributes of a past measurement. In the example shown in FIG. 9, the attributes displayed as messages 72 and 73 are the year, month, and date of the measurement. Based on messages 72 and 73, the user can easily distinguish between the position of equipment 52 detected by current measurement and the position of equipment 54 detected by past measurement.

The display device 12 may be able to switch between displaying messages 72 and 73 and displaying the first icon and the second icon in different colors. The display device 12 may also display messages 72 and 73 and display the first icon and the second icon in different colors.

Figure 10 is a diagram showing an example of an image 50 displayed by the display device 12 according to the fourth embodiment. Object 74 is a first object representing the box of equipment 52 detected by current measurement. Object 75 is a second object representing the box of equipment 54 detected by past measurement. In the example shown in Figure 10, the display color of object 74 and the display color of object 75 are the same.

On the screen, object 74 is accompanied by a message 76 indicating the attributes of the current measurement. On the screen, object 75 is accompanied by a message 77 indicating the attributes of a past measurement. In the example shown in FIG. 10, the attributes displayed as messages 76 and 77 are the year, month, and date of the measurement. Based on messages 76 and 77, the user can easily distinguish between object 74 for equipment 52 detected by current measurement and object 75 for equipment 54 detected by past measurement.

The display device 12 may be able to switch between displaying messages 76 and 77 and displaying the first object and the second object in different colors. The display device 12 may also display messages 76 and 77 and display the first object and the second object in different colors.

When displaying point cloud data 55 as shown in FIG. 5, the display device 12 also attaches a message 76 indicating the attributes of the current measurement to the first object, and a message 77 indicating the attributes of the past measurement to the second object. Even in the point cloud data 55, the user can easily distinguish between an object 74 for equipment 52 detected by current measurement and an object 75 for equipment 54 detected by past measurement.

The attributes displayed as messages 72, 73, 76, and 77 are not limited to the date of measurement, as long as they allow for the current measurement to be distinguished from past measurements. The display device 12 may also display attributes other than the date of measurement as messages 72, 73, 76, and 77.

According to embodiment 4, the display device 12 can display a first icon and a second icon so that the equipment 52 detected by current measurement and the equipment 54 detected by past measurement can be easily distinguished. Furthermore, the display device 12 can display a first object and a second object so that the equipment 52 detected by current measurement and the equipment 54 detected by past measurement can be easily distinguished.

Embodiment 5.
In the first embodiment, the equipment information accumulation device 11 accumulates equipment location information acquired based on point cloud data measured by the three-dimensional measuring device 2 and images captured by the three-dimensional measuring device 2. In the fifth embodiment, an example will be described in which equipment location information is acquired from outside the equipment information management system 1, and the externally acquired location information is linked in the equipment information management system 1. In the fifth embodiment, the equipment information accumulation device 11 acquires equipment location information from outside the equipment information management system 1, and accumulates the externally acquired location information by linking it to the equipment location information.

The acquisition unit 23 of the equipment information storage device 11 acquires equipment location information from outside the equipment information management system 1. The equipment information storage device 11 links the acquired equipment information for the equipment to the equipment location information for that equipment and stores it in the equipment information storage device 11's database. In this way, the equipment information management system 1 links the equipment location information for the equipment detected in the equipment information management system 1 with the location information for that equipment acquired from outside. Location information acquired from outside the equipment information management system 1 is, for example, location information acquired by a person performing equipment management work by investigating the site, which is a road or roadside.

According to embodiment 5, the equipment information management system 1 manages equipment location information for equipment detected by the equipment information management system 1, as well as equipment information acquired from an external source. The equipment information management system 1 may use the equipment information acquired from an external source when editing the equipment location information, etc.

Embodiment 6.
In the first embodiment, the measurement information storage device 14 stores point cloud data measured by the three-dimensional measurement device 2 and images captured by the three-dimensional measurement device 2. In the sixth embodiment, an example will be described in which the measurement information storage device 14 also stores point cloud data or images acquired by a device other than the three-dimensional measurement device 2. The measurement information storage device 14 stores point cloud data and images acquired by using the three-dimensional measurement device 2, which is a measurement device, and further stores at least one of point cloud data and images acquired by using a device other than the three-dimensional measurement device 2.

The acquisition unit 23 of the equipment information storage device 11 acquires images or point cloud data transmitted from a device other than the 3D measurement device 2. The equipment information storage device 11 stores the acquired images or point cloud data in the equipment information storage device 11's database. An example of a device other than the 3D measurement device 2 is a drone equipped with a camera. The drone transmits the captured images to the equipment information storage device 11.

According to embodiment 6, the equipment information management system 1 manages images and point cloud data acquired by the 3D measurement device 2, and at least one of point cloud data and images acquired by a device other than the 3D measurement device 2. The equipment information management system 1 may also use at least one of point cloud data and images acquired by a device other than the 3D measurement device 2 when editing equipment location information, etc.

Next, the hardware configuration realizing each of the components of the facility information management system 1 according to embodiments 1 to 6, namely the detection device 10, 10A, facility information storage device 11, display device 12, facility information editing device 13, measurement information storage device 14, and map information storage device 15, will be described. FIG. 11 is a diagram showing an example of the hardware configuration of the components of the facility information management system 1 according to embodiments 1 to 6. Each of the detection device 10, 10A, facility information storage device 11, display device 12, facility information editing device 13, measurement information storage device 14, and map information storage device 15 is realized by a computer system including a processing circuit 80. The processing circuit 80 includes a processor 82 and a memory 83. The processing circuit 80 is a circuit on which the processor 82 executes software.

The input unit 81 is an interface circuit that receives data input from the outside and provides it to the processor 82. The output unit 84 is an interface circuit that sends data from the processor 82 or memory 83 to the outside. Each of the detection devices 10, 10A, facility information storage device 11, display device 12, facility information editing device 13, measurement information storage device 14, and map information storage device 15 is realized by software, firmware, or a combination of software and firmware. The software or firmware is written as a program and stored in memory 83. In the processing circuit 80, the processor 82 reads and executes the facility information management program stored in memory 83, thereby realizing the functions of each of the detection devices 10, 10A, facility information storage device 11, display device 12, facility information editing device 13, measurement information storage device 14, and map information storage device 15. In other words, the processing circuit 80 has memory 83 for storing the facility information management program that results in the processing of the facility information management system 1. The equipment information management program stored in memory 83 can be said to cause the computer to execute the procedures and methods of the equipment information management system 1.

The processor 82 is a CPU (Central Processing Unit). The processor 82 may also be a processing device, arithmetic unit, microprocessor, microcomputer, or DSP (Digital Signal Processor). The memory 83 may be, for example, a non-volatile or volatile semiconductor memory such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), or EEPROM (Electrically Erasable Programmable Read Only Memory), a magnetic disk, a flexible disk, an optical disk, a compact disk, a minidisk, or a DVD (Digital Versatile Disc).

The equipment information management program stored in memory 83 may be provided in a form written to a storage medium such as a CD (Compact Disc)-ROM or a DVD (Digital Versatile Disc)-ROM, or may be provided via a communication line.

The specific form of distribution or integration of each component in the facility information management system 1 according to embodiments 1 to 6 is not limited to that described in embodiments 1 to 6. All or part of the components of the facility information management system 1 may be functionally or physically distributed or integrated in any unit.

The configurations shown in the above embodiments are examples of the contents of this disclosure. The configurations of each embodiment can be combined with other known technologies. The configurations of each embodiment can also be combined as appropriate. Parts of the configurations of each embodiment can be omitted or modified without departing from the spirit of this disclosure.

The various aspects of this disclosure are summarized below as appendices.

(Appendix 1)
a measurement information storage device that stores point cloud data acquired in a measurement area that is a three-dimensional area and an image of the measurement area;
a detection device that detects equipment present in the measurement area from the image and sets a box that defines the portion of the measurement area where the equipment exists;
an equipment information storage device that stores equipment location information including location information of the box and location information of a representative point that is a point that represents the box;
a display device that generates an object representing the box based on the facility position information and displays the image including the superimposition of the object and the point cloud data including the superimposition of the object;
an equipment information editing device that modifies position information of the box and position information of the representative point in accordance with an operation of moving the object superimposed on the image or the object superimposed on the point cloud data on a screen;
A facility information management system comprising:
(Appendix 2)
The equipment information management system described in Appendix 1 is characterized in that the display device acquires the equipment location information for equipment detected by current measurement and the equipment location information for equipment detected by past measurement, and displays a first object which is the object for the equipment detected by current measurement and a second object which is the object for the equipment detected by past measurement.
(Appendix 3)
The facility information management system described in Appendix 1, characterized in that the display device further displays a map of an area including the measurement area, and displays an icon indicating the representative point on the map.
(Appendix 4)
The facility information management system described in Appendix 3, characterized in that the facility information editing device modifies the location information of the box and the location information of the representative point in accordance with an operation of moving the icon on the screen on which the map is displayed.
(Appendix 5)
The equipment information management system described in Appendix 3 or 4, characterized in that the display device acquires the equipment location information for equipment detected by current measurement and the equipment location information for equipment detected by past measurement, and displays a first icon which is the icon representing the equipment detected by current measurement and a second icon which is an icon representing the equipment detected by past measurement.
(Appendix 6)
The facility information management system described in any one of appendices 1 to 5, characterized in that the detection device accepts an operation to specify the position of the box and sets the box in accordance with the operation.
(Appendix 7)
The equipment information management system described in any one of appendices 1 to 6, characterized in that the equipment information storage device obtains location information of the equipment from outside the equipment information management system and sets the representative point based on the location information of the equipment.
(Appendix 8)
The equipment information management system described in any one of appendices 1 to 6, characterized in that the equipment information storage device acquires location information of the equipment from outside the equipment information management system, and stores the location information acquired from outside by linking it to the equipment location information.
(Appendix 9)
An equipment information management system described in any one of Appendices 1 to 8, characterized in that the measurement information storage device stores the point cloud data and the images acquired through the use of a measurement device, and further stores at least one of point cloud data and images acquired through the use of a device other than the measurement device.
(Appendix 10)
A facility information management method for managing information about a facility by a facility information management system, comprising:
A step of acquiring point cloud data acquired in a measurement region that is a three-dimensional region and an image of the measurement region;
detecting the equipment present in the measurement area from the image and setting a box that defines the portion of the measurement area where the equipment is present;
storing equipment location information including location information of the box and location information of a representative point that is a point that represents the box;
generating an object representing the box based on the facility location information, and displaying the image including the superimposition of the object and the point cloud data including the superimposition of the object;
modifying position information of the box and position information of the representative point according to an operation of moving the object superimposed on the image or the object superimposed on the point cloud data on a screen;
A facility information management method comprising:
(Appendix 11)
A step of acquiring point cloud data acquired in a measurement region that is a three-dimensional region and an image of the measurement region;
detecting equipment present in the measurement area from the image and setting a box that defines a portion of the measurement area where the equipment exists;
storing equipment location information including location information of the box and location information of a representative point that is a point that represents the box;
generating an object representing the box based on the facility location information, and displaying the image including the superimposition of the object and the point cloud data including the superimposition of the object;
modifying position information of the box and position information of the representative point according to an operation of moving the object superimposed on the image or the object superimposed on the point cloud data on a screen;
A facility information management program that causes a computer to execute the above.

1 Facility information management system, 2 3D measurement device, 3 Terminal device, 4 Facility detection server, 5 Facility information management server, 6 Measurement information management server, 7 Map information management server, 10, 10A Detection device, 11 Facility information storage device, 12 Display device, 13 Facility information editing device, 14 Measurement information storage device, 15 Map information storage device, 20, 23, 25, 30 Acquisition unit, 21 Detection unit, 22 ID assignment unit, 24 Representative point calculation unit, 26 Presentation unit, 27, 60 Reception unit, 28 Editing unit, 29 Data extraction unit, 40, 50 Image, 41, 52, 54 Facility, 42 Box, 43, 55 Point cloud data, 51, 53, 74, 75 Object, 56, 57, 70, 71 Icon, 58 Map, 61 Display unit, 72, 73, 76, 77 Message, 80 Processing circuit, 81 input section, 82 processor, 83 memory, 84 output section.

Claims (11)

a measurement information storage device that stores point cloud data acquired in a measurement area that is a three-dimensional area and an image of the measurement area;
a detection device that detects equipment present in the measurement area from the image and sets a box that defines the portion of the measurement area where the equipment exists;
an equipment information storage device that stores equipment location information including location information of the box and location information of a representative point that is a point that represents the box;
a display device that generates an object representing the box based on the facility position information and displays the image including the superimposition of the object and the point cloud data including the superimposition of the object;
an equipment information editing device that modifies position information of the box and position information of the representative point in accordance with an operation of moving the object superimposed on the image or the object superimposed on the point cloud data on a screen;
A facility information management system comprising: The equipment information management system described in claim 1, characterized in that the display device acquires the equipment location information for equipment detected by current measurement and the equipment location information for equipment detected by past measurement, and displays a first object that is the object for the equipment detected by current measurement and a second object that is the object for the equipment detected by past measurement. The facility information management system described in claim 1, characterized in that the display device further displays a map of the area including the measurement area, and displays an icon indicating the representative point on the map. The facility information management system described in claim 3, characterized in that the facility information editing device modifies the location information of the box and the location information of the representative point in accordance with an operation to move the icon on the screen displaying the map. The equipment information management system described in claim 3, characterized in that the display device acquires the equipment location information for equipment detected by current measurement and the equipment location information for equipment detected by past measurement, and displays a first icon representing the equipment detected by current measurement and a second icon representing the equipment detected by past measurement. The facility information management system described in any one of claims 1 to 5, characterized in that the detection device accepts an operation to specify the location of the box and sets the box in accordance with the operation. An equipment information management system as described in any one of claims 1 to 5, characterized in that the equipment information storage device acquires location information of the equipment from outside the equipment information management system and sets the representative point based on the location information of the equipment. An equipment information management system as described in any one of claims 1 to 5, characterized in that the equipment information storage device acquires the location information of the equipment from outside the equipment information management system, and stores the acquired location information in association with the equipment location information. 6. An equipment information management system as described in any one of claims 1 to 5, characterized in that the measurement information storage device stores the point cloud data and the images acquired through the use of a measurement device, and further stores at least one of point cloud data and images acquired through the use of a measurement device other than the measurement device. A facility information management method for managing information about a facility by a facility information management system, comprising:
A step of acquiring point cloud data acquired in a measurement region that is a three-dimensional region and an image of the measurement region;
detecting the equipment present in the measurement area from the image and setting a box that defines the portion of the measurement area where the equipment is present;
storing equipment location information including location information of the box and location information of a representative point that is a point that represents the box;
generating an object representing the box based on the facility location information, and displaying the image including the superimposition of the object and the point cloud data including the superimposition of the object;
modifying position information of the box and position information of the representative point according to an operation of moving the object superimposed on the image or the object superimposed on the point cloud data on a screen;
A facility information management method comprising: A step of acquiring point cloud data acquired in a measurement region that is a three-dimensional region and an image of the measurement region;
detecting equipment present in the measurement area from the image and setting a box that defines a portion of the measurement area where the equipment exists;
storing equipment location information including location information of the box and location information of a representative point that is a point that represents the box;
generating an object representing the box based on the facility location information, and displaying the image including the superimposition of the object and the point cloud data including the superimposition of the object;
modifying position information of the box and position information of the representative point according to an operation of moving the object superimposed on the image or the object superimposed on the point cloud data on a screen;
A facility information management program that causes a computer to execute the above.