JP7828193B2 - Image measurement device, image measurement method, and image measurement program - Google Patents

Description

The present invention relates to an image measurement device, an image measurement method, and an image measurement program that measure column reinforcement using image processing.

Currently, technology is being developed to measure rebar diameter, spacing, and other parameters by analyzing photographed images of rebar arrangement. Furthermore, development is also underway on user assistance technologies for photographing and measuring rebar arrangement, as well as technologies to improve measurement accuracy.

For example, the notification device in Patent Document 1 acquires stereo images of reinforcing bars, generates three-dimensional point cloud coordinates based on the acquired stereo images, and identifies the plane formed by the reinforcing bars that make up the reinforcing bars based on the generated three-dimensional point cloud coordinates. Next, if the notification device determines that reinforcing bars cannot be measured when generating the three-dimensional point cloud coordinates or when identifying the plane, it issues information indicating this. If the notification device is unable to generate three-dimensional point cloud coordinates, or if the inclination angle of the identified plane or the distance to the plane does not satisfy specified conditions, it determines that reinforcing bars cannot be measured.

Japanese Patent Application Laid-Open No. 2018-173275

However, when measuring column reinforcement, images are taken of at least four sides, not just one. Furthermore, when checking after measuring the column reinforcement, it is necessary not only to check whether the measurement results for each side are properly associated, but also to check that the measurement results for each side are correlated with each other, to ensure that no rebar is counted twice, and that no measurements have been missed. Therefore, simply measuring each individual image appropriately places a heavy workload on the person taking the measurements, which can lead to human error. For example, there is the problem that even when looking at an image of column reinforcement, it is not clear which rebar plane was photographed.

In consideration of the above-mentioned issues, one aspect of the present invention aims to prevent double counting of rebar and missed measurements by making it possible to identify the surface on which photographed column reinforcement is placed.

In order to solve the above problem, one aspect of the present invention provides an image measurement device that measures column reinforcement using an image of the column reinforcement. The image measurement device includes: an acquisition unit that acquires a first image, which is an image of a first surface of the column reinforcement, and a second image, which is an image of a second surface of the column reinforcement adjacent to the first surface; a selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; an integration unit that uses the first and second corner reinforcing bars to integrate data related to each reinforcing bar on the first surface, including first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data related to each reinforcing bar on the second surface, including second reinforcing bar data indicating the location of the second corner reinforcing bar; and an output unit that outputs data obtained by integrating the first reinforcing bar data and the second reinforcing bar data.

In order to solve the above-mentioned problems, an image measurement device according to one aspect of the present invention is an image measurement device that measures column reinforcement using an image of the column reinforcement, and includes: an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface; a selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; and an output unit that outputs data related to each reinforcing bar on the first surface, first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data related to each reinforcing bar on the second surface, indicating the location of the second corner reinforcing bar.

In order to solve the above-mentioned problems, one aspect of the present invention provides an image measurement method for measuring column reinforcement using an image of the column reinforcement, and includes the following steps: acquiring a first image, which is an image of a first surface of the column reinforcement, and a second image, which is an image of a second surface of the column reinforcement adjacent to the first surface; selecting a first corner reinforcing bar from the first image, which is a corner reinforcing bar to be placed on the first surface, and selecting a second corner reinforcing bar from the second image, which is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; using the first and second corner reinforcing bars to integrate data related to each reinforcing bar on the first surface, first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data related to each reinforcing bar on the second surface, which is data indicating the location of the second corner reinforcing bar; and outputting data obtained by integrating the first reinforcing bar data and the second reinforcing bar data.

According to one aspect of the present invention, it is possible to identify the surface on which the photographed column reinforcement is placed.

1 is a block diagram showing a configuration of an image measurement device according to a first embodiment of the present invention. FIG. 1 is a perspective view showing a column reinforcement structure according to a first embodiment of the present invention. FIG. 2 is a diagram showing an image of a first surface of a column reinforcement according to the first embodiment of the present invention. FIG. 10 is a diagram showing an image summarizing the measurement results of the first surface of the column reinforcement according to the first embodiment of the present invention. FIG. 2 is a diagram showing an image of the second surface of the column reinforcement according to the first embodiment of the present invention. FIG. 10 is a diagram showing an image summarizing the measurement results of the second surface of the column reinforcement according to the first embodiment of the present invention. FIG. 10 is a diagram showing an example of a screen for setting corner reinforcing bars according to the first embodiment of the present invention. FIG. 10 is a diagram showing an example of output of measurement results that integrate the judgment results of the reinforcing bar standard according to the first embodiment of the present invention. FIG. 10 is a diagram showing an example of output of measurement results that integrate the judgment results of the reinforcing bar standard according to the first embodiment of the present invention. FIG. 10 is a diagram showing an example of an output result obtained by integrating images of measurement results according to the first embodiment of the present invention. 10 is a flowchart showing a process for integrating and outputting the measurement results of the first surface and the measurement results of the second surface according to the first embodiment of the present invention. FIG. 10 is a diagram showing an example of a screen for setting the number of photographed surfaces and the photographing order of column reinforcement according to the second embodiment of the present invention. FIG. 10 is a diagram showing an example of a screen prompting the user to photograph the next side according to the second embodiment of the present invention. FIG. 10 is a diagram showing an example of a screen for setting corner reinforcing bars according to the second embodiment of the present invention. FIG. 10 is a diagram showing an example of a screen for setting corner reinforcing bars according to the second embodiment of the present invention. 10 is an example of a top view of column reinforcement according to a second embodiment of the present invention. 10 is an example of a top view of column reinforcement according to a second embodiment of the present invention.

Embodiments of the present invention will be described in detail with reference to the drawings.

[Embodiment 1]
1 is a block diagram showing the configuration of an image measurement device 100 according to a first embodiment of the present invention. The image measurement device 100 measures column reinforcement using an image of the column reinforcement. As shown in FIG. 1, the image measurement device 100 includes, as hardware, an imaging unit 101, an imaging unit 102, an image processing unit 103, a display unit 104, an input unit 105, and a storage unit 106.

Image capture units 101 and 102 are composed of solid-state image capture elements such as CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) sensors, lenses, etc., and capture images according to set shooting conditions such as exposure and focus position.

The image processing unit 103 performs image processing to measure the distance between a point and a plane. The image processing unit 103 can be implemented by software processing using a CPU (Central Processing Unit) or GPU (Graphics Processing Unit), or by hardware processing using an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

The display unit 104 is a display for displaying images acquired by the imaging units 101 and 102, measurement results of the distance between a point and a plane, etc. The display unit 104 is composed of a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display.

The input unit 105 is composed of a mouse, the touch panel of the display unit 104, etc. The storage unit 106 has storage media such as flash memory and a magnetic disk, and stores captured images, measurement results, etc.

The image processing unit 103 calculates parallax from the images captured by the imaging units 101 and 102, and calculates three-dimensional information about the subject in the image. Parallax is the amount of displacement of the subject between two images, and is calculated using block matching or similar techniques. In block matching, a reference window is set at a pixel of interest in the reference image, and reference windows are sequentially set in the reference image, and the similarity or difference between the pixels in the reference window and those in the reference window is evaluated. Measures such as SAD (Sum of Absolute Difference) and SSD (Sum of Squared Difference) are used for the evaluation.

The relationship between the distance Z to the photographed subject and the parallax D is expressed as D = f × B/Z, where f is the focal length of the image capture units 101 and 102, and B is the distance between the two image capture units. Furthermore, the three-dimensional coordinates (X, Y, Z) of the subject at distance Z from coordinates (x, y) on the image can be calculated as X = x × Z/f and Y = y × Z/f.

Here, with regard to the image measurement device 100 according to this embodiment, a method for calculating parallax from images acquired by the two image capturing units 101 and 102 when acquiring three-dimensional information (depth information) will be described. Note that other methods may also be used; for example, parallax may be calculated from three or more image capturing units, or depth information may be acquired using TOF (Time Of Flight).

The column reinforcement in this embodiment refers to reinforcement arranged in the shape of a square pillar. Measurements of column reinforcement include the number of rebars, their diameter, and spacing. Regarding the number of rebars, the number of main rebars, the number of tie bars, and the total number that make up the column reinforcement are measured. Main rebars are rebars that extend vertically and refer to thick rebars found in concrete such as columns. Tie bars are rebars that extend horizontally and refer to thin rebars used in columns and surround the main rebars.

Regarding rebar diameter, in some cases only the rebar diameter is output, and in other cases the measured rebar diameter is compared with the nominal diameter, node height, etc. to determine the rebar standard of the measured rebar and output the name of that standard. Furthermore, in regards to rebar spacing, the distance between the rebar position lines indicating the center positions of the rebars may be measured, or the distance between the surfaces of opposing rebars may be measured as the space between the rebars.

Figure 2 is a perspective view showing the structure of the column reinforcement 200 according to this embodiment. Figure 2 also shows the state in which the first face F1 of the column reinforcement 200 is being photographed using the image measurement device 100. As shown in Figure 2, the column reinforcement 200 is composed of four faces: the first face F1, the second face F2, the third face F3, and the fourth face F4. Here, a face does not refer to the physical surface of the rebar itself, but rather to a face on which rebars arranged on the same plane are present. For example, the second face F2 is adjacent to the right of the first face F1. The fourth face F4 is adjacent to the left of the first face F1. The image measurement device 100 acquires images of each face of the column reinforcement 200, determines the rebar standard of the column reinforcement 200 from the images, and outputs the determination result. Here, "adjacent" does not necessarily mean that the two faces are in contact; it simply means that two faces that share a common corner rebar in the column reinforcement are adjacent but not in contact.

Figure 3 is a diagram showing an image of the first surface F1 of the column reinforcement 200 captured using the image measurement device 100 according to this embodiment. Figure 3 further shows the state after the first surface F1 has been measured. As shown in Figure 3, dashed lines and numbers indicating the center positions of the rebars are added to the main reinforcement and tie bars arranged on the measured first surface F1. In addition, the corner rebar C11 of the column reinforcement 200 is photographed as main reinforcement 1, and the corner rebar C12 is photographed as main reinforcement 6. Here, the image shown in Figure 3 does not display the measurement results, including the rebar standard judgment results, but the measurement results may be output to a text file or an image summarizing the measurement results may be displayed. An area for displaying the measurement results may be provided adjacent to the image shown in Figure 3, and the measurement results may be displayed in that area.

Figure 4 shows an image summarizing the measurement results of the first face F1 of the column reinforcement 200 according to this embodiment. As shown in Figure 4, the main reinforcements are assigned numbers from 1 to 6, and the standard determination result for each main reinforcement is marked with D29. The hoops are assigned numbers from 1 to 3, and the standard determination result for each hoop is marked with D13. As a result of the above, by saving the measurement results in an area separate from the image or displaying them on a screen separate from the image, the visibility of the rebars in the captured image is not reduced.

Figure 5 is a diagram showing an image of the second surface F2 of the column reinforcement 200 captured using the image measurement device 100 according to this embodiment. Figure 5 further shows the state after the second surface F2 has been measured. As shown in Figure 5, dashed lines and numbers indicating the center positions of the rebars are added to the main reinforcements and ties placed on the measured second surface F2. In addition, the corner rebar C21 of the column reinforcement 200 is photographed as main reinforcement 1, and the corner rebar C22 is photographed as main reinforcement 4. Here, the image shown in Figure 5 does not display the rebar standard judgment results, which are the measurement results, but the measurement results can be output to a text file or an image summarizing the measurement results can be displayed. An area for displaying the measurement results can be provided adjacent to the image shown in Figure 5, and the measurement results can be displayed in that area.

Figure 6 shows an image summarizing the measurement results of the second surface F2 of the column reinforcement 200 according to this embodiment. As shown in Figure 6, the main reinforcements are assigned numbers from 1 to 4, and the standard determination result for each main reinforcement is marked with D29. The hoops are assigned numbers from 1 to 3, and the standard determination result for each hoop is marked with D13. As a result of the above, by saving the measurement results in an area separate from the image or displaying them on a screen separate from the image, the visibility of the rebars in the captured image is not reduced.

In the case of conventional image measurement devices, the data in Figures 3 and 4 (measurement results of the first surface F1) and the data in Figures 5 and 6 (measurement results of the second surface F2) are stored separately. In contrast, the image measurement device 100 according to this embodiment integrates the measurement result data (first rebar data) obtained from the captured image of the first surface F1 and the measurement result data (second rebar data) obtained from the captured image of the second surface F2, and stores the integrated data in the memory unit 106 or displays (outputs) it on the display unit 104.

Of the rebars included in the column reinforcement 200, the square rebar (first square rebar) C12 placed on the first face F1 shown in FIG. 3 and the square rebar (second square rebar) C21 placed on the second face F2 shown in FIG. 5 are the same rebar. Therefore, in order to integrate the measurement results, the image measurement device 100 sets (selects) the square rebar C12 and the square rebar C21 corresponding to the square rebar C12 as common square rebars placed on both the first face F1 and the second face F2.

Figure 7 is a diagram showing an example of a screen for setting square reinforcing bars according to this embodiment. Square reinforcing bars are set by the user specifying the first surface F1 and the second surface F2 after displaying them on the display unit 104 of the image measurement device 100. Square reinforcing bars can also be set by displaying the images shown in Figures 3 and 5 separately. However, as shown in Figure 7, the images of the two surfaces to be combined are displayed side by side, which is preferable because it makes it easier to understand the correspondence between them. In this case, the display unit 104 displays the first surface F1 image on the left side of the screen and the second surface F2 image on the right side of the screen, in accordance with the positional relationship between the first surface F1 and the second surface F2 when the column reinforcement 200 is viewed from the outside.

In addition, when a user specifies a corner rebar on each image, the color of the line indicating the center position of that corner rebar on the image may be made different from the color of the lines indicating the center positions of the other rebars, or a number indicating the specified rebar may be displayed in a separate frame. This allows the user to easily understand the status of the corner rebar specification.

Once the corner rebars are set, the image measurement device 100 uses the corner rebars to integrate multiple measurement results (rebar data indicating the location of the corner rebars). The measurement results integrated by the image measurement device 100 include, for example, rebar standard determination results and images.

Figure 8 shows an example of measurement results output that combines the rebar standard assessment results. The six main bars located on the first surface F1 and the four located on the second surface F2 are combined, resulting in a rebar standard assessment result of nine bars, taking into account overlapping corner bars. Furthermore, since three tie bars are common between the first surface F1 and the second surface F2, all results are combined to result in three.

Here, we have described three tie bars in the column reinforcement 200 according to this embodiment, but there may be two or fewer, or four or more tie bars, and if the measurement range is different, the number and position of tie bars may differ. In such cases, the user can specify tie bars that are common to the first face F1 and the second face F2, in the same way as specifying corner reinforcing bars, and the tie bar measurement results can be integrated.

Figure 9 is a diagram showing an example of measurement result output that integrates the rebar standard assessment results according to this embodiment. As shown in Figure 9, the image measurement device 100 may assign attributes to each rebar according to the rebar standard assessment results. In Figure 9, each rebar is assigned one of the following attributes: first surface, second surface, or square rebar. Furthermore, the number 6 of main rebar 6, which is a square rebar, is underlined to distinguish it from other rebars, which is preferable because it makes it clear that it is a square rebar. In Figure 9, the main rebar number is underlined, but the same effect as underlining can be achieved by changing the font, color, thickness, etc. of the number, encircling the number, or adding a mark near the number to distinguish it from others.

Figure 10 is a diagram showing an example output of the result of integrating images of measurement results according to this embodiment. The image measurement device 100 generates the image shown in Figure 10 by integrating the image shown in Figure 3 and the image shown in Figure 5 based on the position of the square reinforcing bar C12 shown in Figure 3 and the position of the square reinforcing bar C21 shown in Figure 5. The image measurement device 100 integrates the images so that, for example, the square reinforcing bar C12 shown in Figure 3 and the square reinforcing bar C21 shown in Figure 5 overlap as the main reinforcement 6 shown in Figure 10.

When merging two images, the center positions of the corner rebars are made to overlap. A natural-looking image can be generated by performing a weighted average according to the distance from the position of the corner rebar, so that the weight of the image of the first face F1 is heavier on the first face F1 side centered around the position of the corner rebar, and the weight of the image of the second face F2 side centered around the position of the corner rebar. Furthermore, the main reinforcement bars 6, which are corner rebars, can be distinguished from other rebars by changing the color, thickness, etc. of the line indicating the center position of the rebar and the number.

Furthermore, by calculating the rebar plane on each surface where the rebar to be measured exists and converting and integrating the images so that the rebar planes on each surface overlap, an image that appears as if the rebars are arranged on the same surface can be generated, which is advantageous. For example, the image measurement device 100 generates an image that integrates an image of the first surface F1 and an image of the second surface F2 based on the first plane F1, which is the plane on which multiple rebars are arranged, and the second plane F2, which is the plane on which multiple rebars are arranged. In this case, by aligning the normal vector of the plane with the plane that is most directly photographed among the images of each surface, processing time can be shortened without converting the image of that plane, and an integrated image that is closer to being directly photographed can be generated.

Figure 11 is a flowchart showing the process in which the image measurement device 100 according to this embodiment integrates and outputs the measurement results of the first surface F1 and the measurement results of the second surface F2.

(Step S1: Acquisition step)
In the image measurement device 100, the image processing unit (acquisition unit) 103 acquires an image of the first surface F1 and an image of the second surface F2 of the column reinforcement 200, which is the measurement target, captured by the imaging unit 101 and the imaging unit 102.

(Step S2)
The image processing unit 103 performs measurement processing on the rebar to be measured from the acquired images of each surface. For example, if the measurement processing is to determine the rebar standard, the image processing unit 103 calculates the three-dimensional coordinates of the feature points, calculates a least-squares plane from the calculated point cloud while removing noise components, and calculates the rebar position by calculating straight-line components from the point cloud on the least-squares plane. The image processing unit 103 then calculates the rebar edge from the point cloud around the calculated rebar position, calculates the rebar diameter from the rebar edge, and determines the rebar standard by comparing the calculated rebar diameter with a pre-registered rebar standard.

(Step S3: Selection step)
The image processing unit 103 sets a common square reinforcing bar to be placed on both the first surface F1 and the second surface F2. When the user specifies a square reinforcing bar, the display unit 104 displays an image of the first surface F1 and an image of the second surface F2. The input unit 105 accepts the specification of the position of the square reinforcing bar. The image processing unit (selection unit) 103 selects the reinforcing bar at the specified position as the square reinforcing bar.

(Step S4: Integration step)
The image processing unit (integration unit) 103 integrates the measurement results based on the set square reinforcing bars.

(Step S5: Output step)
The image processing unit (output unit) 103 outputs the integrated measurement results. For example, the image processing unit 103 displays the measurement results on the display unit 104 or stores them in the memory unit 106. The measurement results include the rebar standard determination, rebar diameter, rebar spacing, rebar position, number of rebars, images, etc.

With the above configuration, by integrating the measurement results indicating the location of the selected corner reinforcing bars C, it becomes clear whether a given main reinforcing bar is located on the first surface F1 or the second surface F2, making it possible to identify the surface on which the photographed column reinforcement 200 is located. In other words, it becomes possible to determine which reinforcing bar plane was photographed in the image of the column reinforcement 200.

Here, in the flowchart of Figure 11, the image measurement device 100 is described as performing measurement processing after photographing the first face F1 and second face F2 of the column reinforcement 200, but the second face F2 may be photographed after completing the measurement processing of the first face F1, or the measurement processing of the first face F1 and the photographing and measurement processing of the second face F2 may be performed in parallel.

Next, in this embodiment, a method has been described in which images captured by the imaging units 101 and 102 in the image measurement device 100 are directly input to the image processing unit 103. However, the same effect can be achieved if the image processing unit 103 acquires images previously stored in the storage unit 106. Furthermore, the same effect can be achieved if the image processing unit 103 acquires the measurement results of each surface stored in the storage unit 106 and integrates these measurement results.

In addition, while this embodiment has described a method for integrating the first face F1 and second face F2 of the column reinforcement 200, other faces can be integrated using similar processing. For example, the measurement results of the third face F3 can be integrated with the measurement results of the first face F1 and second face F2, and the measurement results of the fourth face F4 can be integrated with the measurement results of the first face F1, second face F2, and third face F3, thereby integrating the measurement results of the four faces that make up the column reinforcement 200. Using the above method, the measurement results of the column reinforcement 200 can be associated and stored, preventing missed images and making it easier to check the condition of each face.

Furthermore, while the above describes a method of integrating measurement results by specifying the corner reinforcing bars between two adjacent faces each time two adjacent faces are photographed, a method of integrating measurement results all at once by photographing three or four faces and then specifying the corner reinforcing bars between two adjacent faces after photographing three or four faces may also be used. For example, if the column reinforcement arrangement 200 has four faces to photograph, the image measurement device 100 photographs each of the first face F1, second face F2, third face F3, and fourth face F4 and measures the reinforcing bars on each face. Next, the image measurement device 100 selects the corner reinforcing bars between the first face F1 and the second face F2, the corner reinforcing bars between the second face F2 and the third face F3, and the corner reinforcing bars between the third face F3 and the fourth face F4. The image measurement device 100 then integrates the first face F1, second face F2, third face F3, and fourth face F4 using the selected three sets of corner reinforcing bars.

The image measurement device 100 may output each measurement result (rebar data) for each surface of the column reinforcement 200 without integrating them.

[Embodiment 2]
A second embodiment of the present invention will be described below. For ease of explanation, the same reference numerals will be used to designate components having the same functions as those described in the first embodiment, and the description thereof will not be repeated.

In embodiment 2 of the present invention, when photographing each surface of the column reinforcement 200 using the image measurement device 100, the number of surfaces of the column reinforcement 200 to be photographed, the order in which the surfaces will be photographed, etc. are set in advance.

At an actual construction site, it may not be possible to capture images of all surfaces of the column reinforcement 200 due to the presence of other objects or the influence of scaffolding. Therefore, by setting in advance the number of surfaces of the column reinforcement 200 to be photographed in the image measurement device 100, it becomes possible to properly guide the user during photography. Furthermore, by setting in advance the direction in which photography will be performed in the image measurement device 100, it becomes possible to provide an image measurement device 100 that is easy for the user to use during photography.

Figure 12 is a diagram showing an example of screen G1 for setting the number of planes to be photographed and the photographing order of the column reinforcement 200 according to this embodiment. Screen G1 is displayed on the display unit 104 of the image measurement device 100. Using the buttons displayed on the right side of screen G1, it is possible to select one of the number of planes to be photographed and one of the photographing orders. The number of planes to be photographed indicates the number of planes of the column reinforcement 200 that can actually be photographed. As shown in Figure 12, two, three, or four planes can be selected as the number of planes to be photographed. The photographing order indicates the order in which each plane is photographed when the column reinforcement 200 is viewed from directly above. As shown in Figure 12, the photographing order can be selected as clockwise (i.e., (3) -> (2) -> (1)) or counterclockwise (i.e., (1) -> (2) -> (3)).

The bottom right of screen G1 has a "Back" button and a "Decide" button. After selecting the imaging conditions to be implemented, the user can click the "Decide" button to properly photograph the column reinforcement 200. Clicking the "Back" button returns the user to the previous screen. Also, on the left side of screen G1, a top view of the column reinforcement 200 is displayed, indicating the number of images to be photographed and the order in which they were photographed. This is advantageous as it makes it easier for the user to check the imaging conditions.

The following describes the photographing procedure for the column reinforcement 200 when the number of photographed surfaces is set to three and the photographing order is set to counterclockwise, as shown in Figure 12.

Figure 13 is a diagram showing an example of a screen G2 that guides the user to photograph the next surface according to this embodiment. After photographing the first surface F1 using the image measurement device 100, the user moves on to photographing the second surface F2. At this time, the image measurement device 100 displays (outputs) on screen G2 the existence of the next surface of the column reinforcement 200 to be photographed and a message guiding the user to photograph that surface (indicating that the second surface F2 should be photographed) based on the number of surfaces to be photographed and the photographing order set on screen G1 in Figure 12. For example, since the photographing order is set counterclockwise on screen G1 in Figure 12, the next surface to be photographed is on the right side for the user, and therefore the message "Please photograph the surface to the right" is displayed on screen G2 in Figure 13.

The "Back" button and "Photograph" button are located on the lower right side of screen G1. The user can smoothly measure the column reinforcement 200 by clicking the "Photograph" button in accordance with the message on screen G2. Clicking the "Back" button returns the user to the previous screen. The image measurement device 100 may also display the set number of photographed images and the number of images that have been photographed on the screen of the display unit 104 to notify the user of the remaining number of photographs to be taken.

When the user follows the message on screen G2 to photograph the second surface F2 and then photograph the third surface F3, the number of surfaces photographed reaches three, which is the number of surfaces set on screen G1. Therefore, rather than guiding the user to photograph the next surface, the image measurement device 100 notifies the user that the set photographs have been completed, or transitions to a screen for setting the corner rebar. This allows the user to avoid taking unnecessary photographs and move on to the next task quickly.

Figure 14 is a diagram showing an example of screen G3 for setting corner reinforcing bars according to this embodiment. Screen G3 displays images of each face of the column reinforcement 200 based on the shooting order set on screen G1 in Figure 12. Since the shooting order is set counterclockwise on screen G1, as shown in Figure 14, the first face F1 is located on the left and the second face F2 is located on the right.

The corner rebars on the first surface F1 are main rebars 6, and the corner rebars on the second surface F2 are main rebars 1. Therefore, by arranging the first surface F1 and the second surface F2 on screen G3 as described above, the corner rebars on each surface to be selected are displayed close to each other. This makes it easy for users to select and confirm the corner rebars.

The "Back" and "Decide" buttons are located in the lower right corner of screen G3. After selecting a square rebar, the user can click the "Decide" button to display an image in which the first surface F1 and the second surface F2 are integrated. The user can return to the previous screen by clicking the "Back" button.

Figure 15 shows an example of screen G4 for setting square reinforcing bars according to this embodiment. When the shooting order is set clockwise on screen G1, as shown in Figure 15, the square reinforcing bar on the first surface F1 is main reinforcing bar 1, and the square reinforcing bar on the fourth surface F4 is main reinforcing bar 4. Therefore, on screen G4, the first surface F1 is located on the right side, and the fourth surface F4 is located on the left side.

Furthermore, if the shooting order has been set, the relative positions of each surface to be integrated can be determined, and it can be determined that the rebars at the ends of the multiple main reinforcements will become square rebars. This means that the outermost rebars that integrate each surface can be automatically set as square rebars, or the position of the square rebars can be initially set, simplifying the task of the user specifying them.

The "Back" and "Decide" buttons are located in the lower right corner of screen G4. After selecting a square rebar, the user can click the "Decide" button to display an image in which the first surface F1 and the second surface F2 are integrated. The user can return to the previous screen by clicking the "Back" button.

In addition, Figures 14 and 15 show an example of setting square reinforcing bars on a screen displaying images of two faces, i.e., the first face F1 and the second face F2, and the first face F1 and the fourth face F4. However, the same effect can be achieved by setting square reinforcing bars on a screen displaying each image. For example, square reinforcing bars may be set on a screen displaying three consecutive faces, or square reinforcing bars may be set simultaneously on a screen displaying all faces.

In this case, similar to Figures 14 and 15, the images of each face are arranged so that identical corner reinforcing bars on each face are displayed close to each other. For example, the image measurement device 100 arranges the image of the first face F1 and the image of the second face F2 side by side so that the corner reinforcing bars on the first face F1 and the corner reinforcing bars on the second face F2 are close to each other, and displays a screen that allows the user to select corner reinforcing bars from the image of the first face F1 and the image of the second face F2. This allows the user to easily set the corner reinforcing bars on each face.

In the above, an example was described in which both the number of photographed surfaces and the photographing order of the column reinforcement 200 were set in advance on screen G1. However, the respective effects can be achieved by setting either the number of photographed surfaces or the photographing order. When the number of photographed surfaces is set, it is possible to determine whether there are any remaining surfaces to be photographed. In this case, the image measurement device 100 may display a screen prompting the user to photograph the next surface when fewer surfaces than the set number of photographed surfaces have been photographed, or may display a screen guiding the user to move on to the next process (e.g., prompting the user to select a corner reinforcing bar) when the same number of surfaces as the set number of photographed surfaces have been photographed. When the photographing order is set, it is possible to determine the direction in which each photographed image should be joined. Therefore, by arranging the images side by side so that the corner reinforcing bars in each of the two images are close to each other, it is possible to easily set and check the corner reinforcing bars.

Figure 16 is an example of a top view of the column reinforcement 200 according to this embodiment. As shown in Figure 16, it is preferable to generate a top view of the column reinforcement 200 as an output that integrates the measurement results of each surface of the column reinforcement 200, as this makes the position of the main reinforcement easier to understand. In Figure 16, the measurement results of the four surfaces of the column reinforcement 200 are integrated, and then the position of the main reinforcement is positioned and drawn on each surface. The positions at which each main reinforcement is drawn may be equally spaced, but if the spacing between each main reinforcement has been measured, it is preferable to draw the positions of the main reinforcement at a ratio of that spacing, as this will allow the actual column reinforcement 200 to be expressed.

Figure 17 is an example of a top view of the column reinforcement 200 according to this embodiment. If there are any surfaces of the column reinforcement 200 that have not been measured (i.e., surfaces that have not been integrated), as shown in Figure 17, the positions of the main reinforcement that have not actually been measured but are estimated from the opposing reinforcement may be drawn using dotted lines or the like. This makes it possible to distinguish them from the measured main reinforcement. Then, to make it easier to distinguish the position of each main reinforcement, auxiliary lines may be drawn or the rebar numbers corresponding to the measurement results may be assigned, making the measurement results easier to understand.

In the above embodiment, the case of measuring column reinforcement 200 was described, but this can also be applied to rectangular reinforcement, and the same effect can be obtained when measuring beam reinforcement, for example.

As explained above, with the image measurement device 100 according to this embodiment, by setting the number of photographed surfaces, it is possible to notify the completion of photographing and move on to the next task promptly. In addition, by setting the photographing order, the photographing order can be notified, and images can be arranged so that the corner rebars on each surface are close to each other, allowing the corner rebars to be specified, or the corner rebars to be automatically determined.

In particular, when the two images are displayed side by side, it is easy to see that the rebars on the inside of both images (i.e., the right-hand rebar in the left-hand image and the left-hand rebar in the right-hand image) are common corner rebars.

[Software implementation example]
The functions of the image measurement device 100 (hereinafter referred to as the "device") can be realized by a program that causes a computer to function as the device, and a program that causes a computer to function as each control block of the device (particularly, the image processing unit 103).

In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The functions described in each of the above embodiments are realized by executing the program using this control device and storage device.

The above program may be stored non-transitory on one or more computer-readable storage media. These storage media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

Furthermore, some or all of the functions of each of the above control blocks can be realized by logic circuits. For example, integrated circuits incorporating logic circuits that function as each of the above control blocks are also included in the scope of the present invention. In addition, the functions of each of the above control blocks can also be realized by, for example, a quantum computer.

Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may run on the control device, or on another device (for example, an edge computer or a cloud server).

〔summary〕
The image measuring device according to aspect 1 of the present invention is an image measuring device that measures column reinforcement using an image of the column reinforcement, and includes: an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface; a selection unit that selects a first corner reinforcing bar from the first image, which is a corner reinforcing bar that will be placed on the first surface, and selects a second corner reinforcing bar from the second image, which is a corner reinforcing bar that will be placed on the second surface and corresponds to the first corner reinforcing bar; an integration unit that uses the first corner reinforcing bar and the second corner reinforcing bar to integrate data regarding each reinforcing bar on the first surface, including first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data regarding each reinforcing bar on the second surface, including second reinforcing bar data indicating the location of the second corner reinforcing bar; and an output unit that outputs data obtained by integrating the first reinforcing bar data and the second reinforcing bar data.

In the image measurement device according to aspect 2 of the present invention, in the above-mentioned aspect 1, the integration unit may generate an image by integrating the first image and the second image based on the positions of the first corner reinforcing bar and the second corner reinforcing bar.

In the image measurement device according to aspect 3 of the present invention, in the above-described aspect 2, the integration unit may generate an image by integrating the first image and the second image based on a first plane on which the multiple reinforcing bars of the first surface are arranged and a second plane on which the multiple reinforcing bars of the second surface are arranged.

In the image measurement device according to Aspect 4 of the present invention, in Aspect 1 above, the output unit may set the order in which to photograph each surface of the column reinforcement, arrange the first image and the second image side by side so that the first corner reinforcing bar and the second corner reinforcing bar are close to each other, and display a screen that allows the user to select the first corner reinforcing bar from the first image and the second corner reinforcing bar from the second image.

In the image measurement device according to Aspect 5 of the present invention, in Aspect 1 above, the output unit may output a signal indicating that the second surface should be photographed after the first surface has been photographed.

In the image measurement device according to Aspect 6 of the present invention, in Aspect 1 above, the output unit may allow the user to set the number of faces to be photographed of the column reinforcement, and when the set number of faces have been photographed, may display a screen that allows the user to select the corner reinforcing bars.

The image measurement device according to aspect 7 of the present invention is an image measurement device that measures column reinforcement using an image of the column reinforcement. It includes an acquisition unit that acquires a first image, which is an image of a first surface of the column reinforcement, and a second image, which is an image of a second surface of the column reinforcement adjacent to the first surface; a selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar; and an output unit that outputs data related to each reinforcing bar on the first surface, first reinforcing bar data indicating the location of the first corner reinforcing bar, and second reinforcing bar data related to each reinforcing bar on the second surface, indicating the location of the second corner reinforcing bar.

The image measurement method according to aspect 8 of the present invention is an image measurement method for measuring column reinforcement using an image of the column reinforcement, and includes the following steps: acquiring a first image, which is an image of a first surface of the column reinforcement, and a second image, which is an image of a second surface of the column reinforcement adjacent to the first surface; selecting a first corner reinforcing bar, which is a corner reinforcing bar to be placed on the first surface, from the first image, and selecting a second corner reinforcing bar, which is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar, from the second image; integrating, using the first corner reinforcing bar and the second corner reinforcing bar, data related to each reinforcing bar on the first surface, first reinforcing bar data indicating the location of the first corner reinforcing bar, and data related to each reinforcing bar on the second surface, second reinforcing bar data indicating the location of the second corner reinforcing bar; and outputting data obtained by integrating the first reinforcing bar data and the second reinforcing bar data.

The image measurement device according to each aspect of the present invention may be realized by a computer. In this case, the control program for the image measurement device, which causes the computer to operate as each unit (software element) of the image measurement device, thereby realizing the image measurement device on the computer, and the computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Furthermore, new technical features can be created by combining the technical means disclosed in each embodiment. For example, column reinforcement includes concepts such as beams and bridges.

100 Image measurement device 101 Imaging unit 102 Imaging unit 103 Image processing unit (acquisition unit, selection unit, integration unit, output unit)
104 Display unit 105 Input unit 106 Memory unit 200 Column reinforcement C12 Corner reinforcement (first corner reinforcement)
C21 Corner reinforcing bar (second corner reinforcing bar)
F1 1st page F2 2nd page

Claims (8)

An image measurement device that measures column reinforcement using an image of the column reinforcement,
an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface;
A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar;
an integration unit that integrates, using the first corner reinforcing bar and the second corner reinforcing bar, first reinforcing bar data that indicates the location of the first corner reinforcing bar, which is data that individually indicates the measurement results of each reinforcing bar on the first side, and second reinforcing bar data that indicates the location of the second corner reinforcing bar, which is data that individually indicates the measurement results of each reinforcing bar on the second side;
an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data;
An image measurement device comprising: An image measurement device that measures column reinforcement using an image of the column reinforcement,
an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface;
A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar;
An integration unit that integrates, using the first corner reinforcing bars and the second corner reinforcing bars, first reinforcing bar data indicating the location of the first corner reinforcing bars, and second reinforcing bar data indicating the location of the second corner reinforcing bars, which are data regarding each reinforcing bar on the first side, and second reinforcing bar data indicating the location of the second corner reinforcing bars;
an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data,
The integration unit
An image measurement device characterized by generating an image that integrates the first image and the second image based on the position of the first corner reinforcing bar and the position of the second corner reinforcing bar. The integration unit
The image measurement device described in claim 2, characterized in that an image is generated by integrating the first image and the second image based on a first plane, which is a plane on which the multiple reinforcing bars of the first surface are arranged, and a second plane, which is a plane on which the multiple reinforcing bars of the second surface are arranged. An image measurement device that measures column reinforcement using an image of the column reinforcement,
an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface;
A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar;
An integration unit that integrates, using the first corner reinforcing bars and the second corner reinforcing bars, first reinforcing bar data indicating the location of the first corner reinforcing bars, and second reinforcing bar data indicating the location of the second corner reinforcing bars, which are data regarding each reinforcing bar on the first side, and second reinforcing bar data indicating the location of the second corner reinforcing bars;
an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data,
The output unit
An image measurement device characterized by setting the order in which each side of the column reinforcement is photographed, arranging the first image and the second image side by side so that the first corner reinforcing bar and the second corner reinforcing bar are close to each other, and displaying a screen that allows the user to select the first corner reinforcing bar from the first image and the second corner reinforcing bar from the second image . An image measurement device that measures column reinforcement using an image of the column reinforcement,
an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface;
A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar;
An integration unit that integrates, using the first corner reinforcing bars and the second corner reinforcing bars, first reinforcing bar data indicating the location of the first corner reinforcing bars, and second reinforcing bar data indicating the location of the second corner reinforcing bars, which are data regarding each reinforcing bar on the first side, and second reinforcing bar data indicating the location of the second corner reinforcing bars;
an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data,
The output unit
An image measuring device characterized in that, after the first surface is photographed, a message is output to the effect that the second surface should be photographed. An image measurement device that measures column reinforcement using an image of the column reinforcement,
an acquisition unit that acquires a first image that is an image of a first surface of the column reinforcement and a second image that is an image of a second surface of the column reinforcement adjacent to the first surface;
A selection unit that selects, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selects, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar;
An integration unit that integrates, using the first corner reinforcing bars and the second corner reinforcing bars, first reinforcing bar data indicating the location of the first corner reinforcing bars, and second reinforcing bar data indicating the location of the second corner reinforcing bars, which are data regarding each reinforcing bar on the first side, and second reinforcing bar data indicating the location of the second corner reinforcing bars;
an output unit that outputs data that integrates the first reinforcing bar data and the second reinforcing bar data,
The output unit
An image measurement device characterized in that the number of faces to be photographed of the column reinforcement is set, and when the photographing of the set number of faces is completed, a screen is displayed that allows the user to select the corner reinforcing bars. An image measurement method for measuring column reinforcement using an image of the column reinforcement,
an acquisition step of acquiring a first image which is an image of a first surface of the column reinforcement and a second image which is an image of a second surface of the column reinforcement adjacent to the first surface;
A selection step of selecting, from the first image, a first corner reinforcing bar that is a corner reinforcing bar to be placed on the first surface, and selecting, from the second image, a second corner reinforcing bar that is a corner reinforcing bar to be placed on the second surface and corresponds to the first corner reinforcing bar;
an integration step of integrating, using the first corner reinforcing bar and the second corner reinforcing bar, first reinforcing bar data, which is data individually showing the measurement results of each reinforcing bar on the first side and indicates the location of the first corner reinforcing bar, and second reinforcing bar data, which is data individually showing the measurement results of each reinforcing bar on the second side and indicates the location of the second corner reinforcing bar;
an output step of outputting data obtained by integrating the first reinforcing bar data and the second reinforcing bar data;
An image measurement method comprising: 2. An image measurement program for causing a computer to function as the image measurement device according to claim 1, the image measurement program causing a computer to function as the acquisition unit, the selection unit, the integration unit, and the output unit.