JP7684880B2 - Fastening bolt inspection device - Google Patents

Description

The present invention relates to a fastening bolt evaluation device that determines whether a fastening bolt used to join a beam and a column is a bolt of appropriate specifications.

Three-dimensional shape measuring devices that measure the three-dimensional shape of construction objects have been used at construction sites and other locations for some time. For example, Patent Document 1 proposes a situation assessment system that uses a three-dimensional shape measuring device to assess the status of construction work at a construction site.

JP 2021-47610 A

However, while the system shown in Patent Document 1 can grasp the status of construction work at a construction site, it cannot grasp whether bolts of appropriate specifications have been used to connect beams and columns.

The present invention was made in consideration of these points, and its purpose is to provide a fastening bolt judgment device that can determine whether the fastening bolts used to join beams and columns are of the appropriate specifications.

In consideration of the above problem, the fastening bolt determination device of the present invention is a fastening bolt determination device that determines, from an overall image including a beam and a column, whether a fastening bolt that connects the beam and the column, among the bolts included in the overall image, is a bolt of appropriate specifications, and is characterized by having at least an area detection unit that detects the area of the beam, the column, and the bolt that matches the specifications from the overall image, a column straight line calculation unit that calculates an approximate straight line of the column along the column from the column area, a fastening bolt identification unit that identifies the fastening bolt based on information about the beam area and the approximate straight line of the column, and a specification determination unit that determines whether the identified fastening bolt is a bolt of appropriate specifications.

According to the present invention, first, the area detection unit detects areas of beams, columns, and bolts that match the specifications (bolts for each specification) from the overall image, so that it is possible to identify which component each detected area of each beam, column, and bolt that matches the specifications corresponds to.

Next, the column straight line calculation unit calculates an approximate column straight line along the column from the column area. Compared to beams, which are arranged two-dimensionally along the horizontal direction in the detected area, columns are arranged only along the vertical direction, so it is possible to calculate an approximate column straight line with high accuracy from the column area.

Next, the fastening bolt identification unit identifies the fastening bolt using the approximation line of the column, so that the fastening bolt can be identified with high accuracy from the area of multiple bolts. As a result, the specification determination unit can accurately determine whether the fastening bolt is a bolt with appropriate specifications.

In a further preferred embodiment, the fastening bolt identification unit calculates an approximate straight line of the beam along the beam as information about the beam area, and identifies the fastening bolt from the distance between the intersection of the approximate straight line of the beam and the approximate straight line of the column and the bolt area.

According to this aspect, for example, since a region of connecting bolts exists near the intersection of the beam's approximation line and the column's approximation line, it is possible to identify bolts in a region that exists within a predetermined distance range, for example, as connecting bolts, based on the distance between this intersection and the region of each bolt.

In yet another preferred embodiment, the fastening bolt identification unit extracts the boundary line of the beam region as information about the beam region, and identifies the fastening bolt from the distance between the intersection of the beam boundary line and the column approximation line and the bolt region.

According to this aspect, since the shape of the beam area, which is arranged two-dimensionally along the horizontal direction, is complex, the boundary line of the beam area is extracted and the intersection point between the boundary line of the beam and the approximation line of the column is used, so that the connecting bolts can be identified more accurately and easily.

Furthermore, in a preferred embodiment, the fastening bolt identification unit calculates the center of gravity of the column region, and identifies the bolts in the bolt region that are close to the intersection and the center of gravity as fastening bolts that connect the column.

According to this aspect, when there are multiple bolt regions close to the intersection of the beam's approximation line and the column's approximation line or the intersection of the beam's boundary line and the column's approximation line, the center of gravity of the column region can be used to more accurately identify the connecting bolt that connects the columns.

In yet another preferred embodiment, the fastening bolt identification unit identifies bolts in the area of the bolts that are close to the approximate straight line of the column and the intersection point as fastening bolts that join the column.

According to this aspect, bolts in the area close to the column's approximation line and intersection point, i.e., bolts that are within a predetermined distance from the column's approximation line and intersection point and are also within a predetermined range from the intersection point, are likely to be connecting bolts that connect columns, so that connecting bolts that connect columns can be identified more accurately.

The present invention makes it possible to determine whether bolts of appropriate specifications are used for connecting beams and columns.

1 is a schematic diagram showing a part of a building under construction including a beam and a column joined with a joining bolt according to this embodiment, and a schematic diagram of a determination device. FIG. FIG. 2 is a block diagram of the determination device shown in FIG. 1 . FIG. 2 is a schematic diagram of an entire image captured by an imaging device. 3B is a schematic diagram of a region detection image in which the region of each member is detected from the entire image of FIG. 3A. FIG. In comparison with FIG. 3B, this figure shows pillar and beam areas detected and approximate straight lines of the beams and pillars set. FIG. 3 is an explanatory diagram for explaining a method for identifying the fastening bolt identifying portion shown in FIG. 2 . FIG. 3 is a flow diagram of the determination device shown in FIG. 2 . In comparison with FIG. 3B, this figure shows pillar and beam regions detected and approximate pillar lines and beam boundary lines set. 3 is an explanatory diagram for explaining a specification method according to a modified example of the fastening bolt specifying portion shown in FIG. 2 . FIG.

The fastening bolt determination device 10 according to this embodiment will be described below with reference to Figures 1 to 5.

1. Regarding the joint structure of columns 3 and beams 4 of a building 1 In this embodiment, for example, in a building 1 during construction, it is determined whether bolts of appropriate specifications are used for joining columns and beams. A column 3 is erected in the building 1 and joined to a beam 4 via a joint box (a column-beam joining member that joins the column 3 and beam 4) 6. A stud (partition) 9 is arranged vertically on the beam 4, and a brace (bracing) 7 is fixed horizontally.

Here, the column 3 is joined to the joint box 6 with a joining bolt 51A, and the beam 4 is joined to the joint box 6 with a joining bolt 51B. Furthermore, the brace 7 is attached to the flange portion of the beam 4 with a fixing bolt 52A. In this embodiment, the joining bolts 51A, 51B and the bolt 51C attached to the column 3 are high-strength bolts 51 (hereinafter sometimes referred to as "bolt 51"), while the fixing bolt 52A and another fixing bolt 52B are normal bolts 52 (hereinafter sometimes referred to as "bolt 52"), and the bolt specifications are different.

The high-strength bolt 51 and the normal bolt 52 may be different in color so that the image of the high-strength bolt 51 and the image of the normal bolt 52 can be distinguished by object detection or the like in the image captured by the imaging device 20. For example, a mark may be provided on the bolt head, or the shape, etc. may be changed.

If a normal bolt 52 is used as a bolt 51A for connecting a column 3 or the like in a place where a high-strength bolt 51 should be used, the originally set connecting strength of the column 3 cannot be obtained, which is not preferable. Therefore, the judgment device 10 shown below is used to judge whether the bolt specifications are appropriate.

2. Hardware configuration of the determination device 10 for the fastening bolt 51A The determination device 10 is configured with ROM, RAM, etc. as hardware, and includes a storage unit 10A in which programs such as for determining and identifying components created by machine learning are recorded, and a calculation unit 10B that executes these programs.

The input device 31 and the output device 32 are connected to the determination device 10. In this embodiment, the input device 31 and the output device 32 may be an integrated touch panel display. Data such as specific conditions for the bolts 51 and 52, specifications of the connecting bolts 51A and 51B according to the specifications and number of floors of the building 1, etc. are input via the input device 31. In this embodiment, image data captured by the imaging device 20 may be input via the input device 31. The data input by the input device 31 is stored in the memory unit 10A. The output device 32 displays image data captured by the imaging device 20, calculation results calculated by the calculation unit 10B, etc.

In this embodiment, the determination device 10 is configured with a memory unit 10A and a calculation unit 10B, but may also include, for example, an input device 31 and an output device 32. In addition to the input device 31 and the output device 32, the determination device 10 may further include an imaging device 20, and these may be integrated into a mobile terminal such as a smartphone or tablet.

3. Software Configuration of the Determination Device 10 for the Fastening Bolt 51A As shown in FIG. 2 , the determination device 10 includes an area detection unit 11, a column straight line calculation unit 12, a fastening bolt specification unit 13, and a specification determination unit 14.

The area detection unit 11 detects areas corresponding to the pillar 3, beam 4, and bolts 51, 52 according to the specifications from the overall image G1 captured by the imaging device 20 shown in FIG. 3A. Here, the area detection unit 11 detects the areas of the beam 4, pillar 3, bolts 51, 52, joint box 6, and brace 7 using an object detection task, as shown in FIG. 3B, using an application that has been machine-learned in advance. That is, the detected areas are areas according to the shapes of the pillar 3, beam 4, bolts 51, 52, joint box 6, and brace 7 shown in the overall image G1, and each area is associated with a component code to indicate which of the beam 4, pillar 3, bolts 51, 52, joint box 6, and brace 7 it belongs to.

Here, machine learning can be exemplified by deep learning, and its algorithms include Adagrad, Adatelta, RMSprop, Adam, AdaBound, and AMSBound. In the learning stage of machine learning, overall image data of the building 1, including the pillars 3, beams 4, bolts 51 and 52, joint boxes 6, and braces 7, is prepared as teacher image data, and for each of these overall images, image areas for each component are specified, and the names (codes) of the components are assigned to the specified areas, thereby performing learning.

As a result, at the utilization stage, the learned application detects areas from the loaded overall image according to the shapes of the column 3, beam 4, bolts 51, 52, joint box 6, and brace 7, and assigns a code to which component the detected area corresponds. Here, as described above, for bolts 51, 52, high-strength bolt 51 and normal bolt 52 are distinguished and detected as areas 51R and 52R.

In this way, as shown in Figure 3B, it is possible to detect region 3R of column 3, region 3R of beam 4, region 51R of high-strength bolt 51, region 52R of bolt 52 in which normal bolt 52 is used, region 6R of joint box 6, and region 7R of brace 7. In Figure 3B, in order to distinguish between the regions, the same color may be applied to members of the same type for each region detection image G2, and different colors may be assigned to members of different types.

In this embodiment, as shown in FIG. 3B, an instance segmentation task that detects only the pillar 3, beam 4, bolts 51 and 52, joint box 6, and brace 7 is used as the object detection task. However, a semantic segmentation task that extracts regions from the images of all components captured in the overall image may also be used.

In this way, according to this embodiment, the area detection unit 11 can detect areas 3R, 4R, 51R, 52R, etc., corresponding to the pillars 3, beams 4, and bolts 51, 52, etc., that match the specifications, from the overall image G1. This makes it possible to identify which components the detected areas 3R, 4R, 51R, 52R correspond to, in the areas 3R, 4R, 51R, 52R detected for each of the pillars 3, beams 4, and bolts 51, 52.

Here, the images of each area detected by object detection can be identified as images of any of the components: the column 3, the beam 4, the bolts 51, 52, the joint box 6, and the brace 7. However, it is not possible to determine in which location the bolts were used from only the areas 51R and 52R of the bolts 51 and 52. Therefore, in this embodiment, the determination device 10 further includes a column straight line calculation unit 12 and a connecting bolt identification unit 13.

As shown in FIG. 3C, the column straight line calculation unit 12 calculates an approximate straight line 3L of the column 3 along the column 3 from the region 3R of the column 3. For example, the column straight line calculation unit 12 may calculate the approximate straight line 3L of the column 3 from an image of the region 3R of the column 3 by a general line detection process or the like, and the approximate straight line 3L is preferably a straight line along the longitudinal direction of the column 3 and a straight line that passes through the center of the width of the region 3R of the column 3 (or the center of gravity of the region 3R). As long as such a straight line can be obtained, the method of calculating the approximate straight line 3L of the column 3 is not particularly limited.

In this way, the column straight line calculation unit 12 calculates the column 3's approximate straight line 3L along the column 3's longitudinal direction from the column 3's region 3R. As a result, while the beam 4 is often a complex structure arranged two-dimensionally along the horizontal direction, the column 3 is arranged only along the vertical direction, so the calculated column 3's approximate straight line 4L from the column 3's region 3R can be used as a reference line for identifying the connecting bolt 51A.

The fastening bolt identification unit 13 identifies the fastening bolt 51A that joins the column 3 based on information about the region 4R of the beam 4 and the approximation line 3L of the column 3. The fastening bolt identification unit 13 may also identify the fastening bolt 51B that joins the beam 4. The following describes how to identify the fastening bolt 51A that joins the column 3.

First, the fastening bolt identification unit 13 calculates an approximate straight line 4L of the beam along the beam 4 as information about the region 4R of the beam 4. Here, the approximate straight line 4L of the beam 4 is calculated as shown in FIG. 3C in a manner similar to the calculation method of the approximate straight line shown for the column 3.

Next, as shown in FIG. 3D, the connecting bolt identification unit 13 calculates the intersection C1 between the approximate straight line 3L of the column 3 and the approximate straight line 4L of the beam 4. Here, the connecting bolt identification unit 13 may use the distance (shortest distance) from the intersection C1 to the areas 51R, 52R of the bolt 51 to identify the bolts 51, 52 corresponding to the areas 51R, 52R where this distance is within a predetermined range as the connecting bolt 51A of the column 3.

In this embodiment, the regions 51R, 52R of the bolts 51, 52 closest to the intersection C1 are the connecting bolts 51A of the column 3, so the connecting bolts 51A of the column 3 can be identified from the regions 51R, 52R of the bolts 51, 52.

In FIG. 3D, because bolts of the appropriate specifications are being used, the joining bolts 51A, 51B, etc. are shown in parentheses in the region 51R of the high-strength bolt 51; however, if a bolt of the wrong specifications is being used, the region 52R of the normal bolt 52 will be identified as the joining bolt 51A.

Here, for example, depending on the imaging conditions, etc., the distance from the intersection C1 to the connecting bolt 51B of the beam 4 may also fall within a predetermined range. Therefore, as shown in FIG. 3D, the connecting bolt identification unit 13 may calculate the center of gravity (center of gravity position) S of the region 3R of the column 3, and identify the bolts in the regions 51R, 52R of the bolts 51, 52 that are close to the intersection C1 and the center of gravity S as the connecting bolt 51A that connects the column 3.

Here, the regions 51R, 52R close to the intersection C1 and the center of gravity S are, for example, the regions 51R, 52R of the bolts 51, 52 that are within a predetermined distance range set for the intersection C1 and the center of gravity S, respectively. Note that if the region 52R of the normal bolt 52 is within the predetermined distance range, this normal bolt 52 is a bolt that has been mistakenly installed as the high-strength bolt 51.

In this way, for example, in cases where there are multiple regions 51R, 52R of bolts 51, 52 close to the intersection C1 between the approximate straight line 4L of the beam 4 and the approximate straight line 3L of the column 3, the center of gravity S can be further used to more accurately identify the connecting bolt 51A that connects the column 3.

In addition, the fastening bolt identification unit 13 may identify the bolts 51, 52, among the regions 51R, 52R of the bolts 51, 52, that are close to the approximation line 3L of the column 3 and the intersection point C1, as the fastening bolts 51A that join the column 3. Here, close to the approximation line 3L of the column 3 and the intersection point C1 means, for example, the regions 51R, 52R of the bolts 51, 52 that are within a predetermined distance range from the approximation line 3L of the column 3 and the intersection point C1, respectively. In this way, since the region of the fastening bolt 45A exists at a close distance to the approximation line 3L of the column 3 and the intersection point C1, the fastening bolt 51A can be accurately identified.

Here, the two identification methods described above may be combined. Furthermore, in the two identification methods described above, for example, if the number of connecting bolts 51A to be used for one column 3 is known in advance, the number may be input in advance via the input device 31, and the regions 51R, 52R close to the intersection C1 and the center of gravity S may be selected from the multiple regions 51R, 52R until this number is reached, and the bolts 51, 52 in the selected regions 51R, 52R may be identified as connecting bolts 51A that connect the column 3.

The specification determination unit 14 determines whether the connecting bolt 51A identified by the connecting bolt identification unit 13 is a bolt with appropriate specifications (i.e., high-strength bolt 51). Here, in the case of this embodiment, for example, the appropriate specifications are for the connecting bolts 51A and 51B to be high-strength bolts 51. However, depending on the specifications of the building 1 and the number of floors, it may be appropriate to use normal bolts 52, rather than high-strength bolts 51, as the bolts used for connecting columns and beams. Such bolt specifications are stored in the memory unit 10A via the input device 31, as described above.

In this embodiment, as an example, since the fastening bolts 51A and 51B have specifications suitable for use with the high-strength bolt 51, if the fastening bolt 51A identified by the fastening bolt identification unit 13 is an ordinary bolt 52, the ordinary bolt 52 is a bolt that has been mistakenly attached as the high-strength bolt 51. Therefore, in such a case, the specification determination unit 14 determines that an inappropriate bolt (ordinary bolt 52) has been attached to the fastening bolt 51A. On the other hand, if the fastening bolt 51A identified by the fastening bolt identification unit 13 is a high-strength bolt 51, the specification determination unit 14 determines that an appropriate bolt has been attached to the fastening bolt 51A. The determination result may be displayed on the output device 32 by the determination device 10, for example, together with the overall image shown in FIG. 3A.

In this embodiment, a method for identifying the connecting bolt 51A that connects the column 3 has been described, but in the same manner as described above, the connecting bolt identification unit 13 may identify the connecting bolt 51B that connects the beam 4, and the specification determination unit 14 may determine whether the connecting bolt 51B is a bolt with appropriate specifications (i.e., a high-strength bolt 51).

In this manner, in this embodiment, the fastening bolt identification unit 13 identifies the fastening bolt 51A using the approximation line 3L of the column 3. Therefore, the fastening bolt 51A can be accurately identified from the regions 51R, 52R of the multiple bolts 51, 52. As a result, the specification determination unit 14 can accurately determine whether the fastening bolt 51A is a bolt with appropriate specifications.

In addition, since a region of the connecting bolt 51A exists near the intersection C1 between the approximation line 4L of the beam 4 and the approximation line 3L of the column 3, the bolts 51, 52 in the region that exists within a predetermined distance range, for example, can be identified as the connecting bolt 51A, based on the distance between this intersection C1 and the regions 51R, 52R of each bolt 51, 52.

The following describes a determination method using the determination device 10 according to this embodiment with reference to FIG. 4. First, in step S1, the imaging device 20 captures an image of the area of the building 1 to be inspected. Next, in step S2, the area detection unit 11 detects the areas of the beam 4, column 3, bolts 51, 52, joint box 6, and brace 7 using an object detection task, and the process proceeds to step S3.

In step S3, the column straight line calculation unit 12 calculates an approximate straight line 3L of the column 3 along the column 3 from the region 3R of the column 3, and proceeds to step S4. The connecting bolt identification unit 13 calculates an approximate straight line 4L of the beam along the beam 4 as information about the region 4R of the beam 4, and proceeds to step S5.

In step S5, the connecting bolt identification unit 13 calculates the intersection C1 between the approximate straight line 3L of the column 3 and the approximate straight line 4L of the beam 4, and the process proceeds to step S6. In step S6, the connecting bolt identification unit 13 identifies the connecting bolt 51A of the column 3 at the joint between the column 3 and the beam 4 from the bolt areas 51R and 52R, and the process proceeds to step S7. In step S7, the specification determination unit 14 determines whether the identified connecting bolt 51A is a bolt with appropriate specifications (i.e., a high-strength bolt 51), and displays this result on the output device 32.

In the embodiment shown above, the connecting bolt identification unit 13 calculates an approximate straight line 4L of the beam 4 along the beam 4 as information about the region 4R of the beam 4, and uses this approximate straight line 4L, but for example, the boundary line (contour line) 4D of the region 4R of the beam 4 may also be used.

Specifically, as shown in FIG. 5A, in this modified example, the fastening bolt identification unit 13 extracts the boundary line 4D of the region 4R of the beam 4 as information related to the region 4R of the beam 4. Next, as shown in FIG. 5B, the fastening bolt identification unit 13 identifies the fastening bolt 51A of the column 3 from the distance between the intersection C2 of the boundary line 4D of the beam 4 and the approximation line 3L of the column 3 and the regions 51R and 52R of the bolts 51 and 52. Here, if there are multiple intersections between the approximation line 3L and the boundary line 4D of the beam 4, the intersection closest to the center of gravity S is used.

According to this modified example, since the region 4R of the beam 4, which is arranged two-dimensionally along the horizontal direction, has a complex shape, the boundary line 4D of the region 4R of the beam 4 is extracted, and the intersection C2 between the boundary line 4D of the beam 4 and the approximation line 3L of the column 3 is used, so that the connecting bolt 51A that connects the column 3 can be identified more accurately and simply.

In this modified example, the fastening bolt identification unit 13 may also calculate the center of gravity S of the region 3R of the column 3, and identify the bolts in the regions 51R, 52R of the bolts 51, 52 that are close to the intersection C2 and the center of gravity S as the fastening bolts 51A that join the column 3. As in the above-described case, the fastening bolt identification unit 13 may also identify the bolts 51, 52 in the regions 51R, 52R of the bolts 51, 52 that are close to the approximation line 3L of the column 3 and the intersection C2 as the fastening bolts 51A that join the column 3.

Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the above-mentioned embodiments, and various design changes can be made without departing from the spirit of the present invention as described in the claims.

1: Building, 3: Column, 3L: Approximate line, 3R: Column area, 4: Beam, 4D: Beam boundary, 4L: Approximate line, 4R: Beam area, 10: Determination device, 11: Area detection unit, 12: Column line calculation unit, 13: Joint bolt identification unit, 14: Specification determination unit, 51: High strength bolt, 52: Standard bolt, 51A: Joint bolt, 51R, 52R: Bolt area, C1, C2: Intersection, G: Center of gravity

Claims (5)

A fastening bolt determination device that determines whether a fastening bolt that joins a beam and a column is a bolt of appropriate specifications among bolts included in an entire image including the beam and the column,
an area detection unit that detects areas of the beam, the column, and the bolt according to the specifications from the entire image;
a column straight line calculation unit that calculates an approximation straight line of the column along the column from the column region;
a fastening bolt identification unit that identifies the fastening bolt based on information about the region of the beam and an approximation straight line of the column;
A fastening bolt determination device comprising at least a specification determination unit that determines whether the identified fastening bolt is a bolt of appropriate specifications. The fastening bolt identification unit calculates an approximate straight line of a beam along the beam as information about the region of the beam,
2. The fastening bolt determination device according to claim 1, wherein the fastening bolt is identified from a distance between an intersection of an approximation line of the beam and an approximation line of the column and an area of the bolt. The fastening bolt identification unit extracts a boundary line of the beam region as information about the beam region,
2. The fastening bolt determination device according to claim 1, wherein the fastening bolt is identified based on the distance between the intersection of the boundary line of the beam and the approximation line of the column and the area of the bolt. The fastening bolt determination device according to claim 2 or 3, characterized in that the fastening bolt identification unit calculates the center of gravity of the column area, and identifies the bolts in the bolt area that are close to the intersection and the center of gravity as fastening bolts that connect the column. The fastening bolt determination device according to claim 2 or 3, characterized in that the fastening bolt identification unit identifies bolts in the area of the bolt that are close to the approximate straight line of the column and the intersection point as fastening bolts that join the column.

Images