JP7706282B2 - Image generating device, control method for image generating device, and image generating program - Google Patents

Description

One aspect of the present invention relates to an image generating device, a control method for the image generating device, and an image generating program that measure the diameter and spacing of rebars from image data captured by a stereo camera and generate image data that appropriately displays indicators of the measurement values to the user.

A measuring device that uses an imaging unit such as a stereo camera to capture images of multiple reinforcing bars arranged vertically and horizontally in a reinforced concrete building and measures the reinforcing bars is known as prior art.

Patent Document 1 discloses a measuring device that measures the diameter or spacing of reinforcing bars from an image of a reinforcing bar that has multiple reinforcing bars arranged, and superimposes an index on the image to confirm the dimensions of the measured reinforcing bars.

JP 2020-91237 A

If some of the multiple rebars are inclined or have joints, the spacing between the rebars, including those rebars, will vary depending on the measurement position. In conventional reinforcement inspections, in order to clearly indicate the diameter or spacing of the rebars, a tape measure or measuring rod is placed on the actual rebars as an indicator and an image is taken. In this case, the user places an indicator for measurement at any position, so the measurement position is the position intended by the user.

However, when electronically superimposing an index on an image of a measurement target, in devices such as those of the conventional technology, due to the aforementioned inclination of the rebar, the value of the rebar diameter or rebar spacing calculated at the measurement position intended by the user may differ from the value of the rebar diameter or rebar spacing at the index position that the user reads from the index, potentially confusing the user.

The present invention was made in consideration of the above problems, and aims to enable the user to position the index and measurement positions as intended when electronically superimposing an index on an image of a measurement target, and to read appropriate values from the index.

In order to solve the above problem, an image generating device according to one aspect of the present invention includes an input unit that accepts input of a specified position designated by a user in an image of a rebar, a setting unit that sets an index position of an index indicating the length of the rebar in the image and a measurement position for measuring the rebar based on the specified position in the image, and an image generating unit that generates an image on which the index and measurement position information indicating the measurement position are superimposed based on the index position and the measurement position.

In order to solve the above problem, a control method for an image generating device according to one aspect of the present invention includes the steps of: an image generating device receiving an input of a designated position designated by a user in an image in which a rebar is captured; the image generating device setting an index position of an index indicating the length of the rebar in the image and a measurement position for measuring the rebar based on the designated position in the image; and the image generating device generating an image in which the index and measurement position information indicating the measurement position are superimposed based on the index position and the measurement position.

According to one aspect of the present invention, when an index is electronically superimposed on an image of a measurement target, the index position and measurement position can be positioned as intended by the user, and appropriate values can be read from the index.

1 is a functional block diagram showing a configuration of a measurement device according to a first embodiment. FIG. 13 is a diagram showing an example of an image of a reinforcing bar input to an input unit. FIG. 13 is a diagram showing how to set measurement positions when a reinforcing bar is inclined. FIG. 13 is a diagram showing how to set measurement positions when there is a joint between reinforcing bars. 13 is an example of an image in which an index is arranged. 13 is an example of an image in which an index is arranged. 13 is an example of an image in which an index is arranged. 13 is an example of an image in which an index is arranged. 13 is an example of an image in which an index is arranged. FIG. 11 is a diagram for explaining an example of an index. 4 is a flowchart illustrating an example of a control method for the measurement device according to the first embodiment. 10 is a flowchart showing an example of a method for setting measurement positions and scale positions. FIG. 11 is a functional block diagram showing the configuration of a measurement device according to a second embodiment. 10 is a flowchart illustrating an example of a control method for a measurement device according to a second embodiment. 10 is a flowchart showing an example of a method for setting an index position and a scale position.

Each embodiment of the present invention will be described in detail with reference to the drawings. Each drawing merely shows a specific embodiment according to the principles of the present invention. These drawings are merely provided for the understanding of the present invention and are not intended to limit the interpretation of the present invention. In addition, each element shown in each drawing is exaggerated to provide a better understanding of the present invention, and therefore differs from the actual spacing and size of each element.

In the following description, if the same reference numeral is used for an element in one drawing and the same reference numeral is used for the same element in another drawing, the configuration and function of the same element are the same as those of the other element, and therefore a detailed description of the same element will be omitted.

[Embodiment 1]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings.

<Measuring device 100>
Fig. 1 is a functional block diagram showing the configuration of a measuring device 100 according to the first embodiment. The measuring device 100 is a device that captures an image of a reinforcing bar and displays an index or the like (described later) superimposed on the captured image. As shown in Fig. 1, the measuring device 100 includes an imaging unit 8 and an image generating device 1.

[Imaging unit 8]
The imaging unit 8 is a camera capable of capturing at least still images, and is realized as, for example, a stereo camera. The imaging unit 8 captures images of the reinforcing bars, and supplies the captured images to the input unit 2 of the image generating device 1.

[Image generating device 1]
As shown in FIG. 1, the image generating device 1 includes an input unit 2, a setting unit 3, an image generating unit 4, a measuring unit 5, a storage unit 6, and a display unit 7.

The image generating device 1 of this embodiment generates an image on which an indicator indicating the length of the rebar and measurement position information indicating the measurement position for measuring the rebar are superimposed, based on a specified position specified by a user on an image of the rebar captured by the imaging unit 8. The image generating device 1 may be realized as a mobile terminal such as a tablet or a personal computer. The image generating device 1 may also be provided in a location remote from the building containing the rebar, and the image may be input via a network.

In the above example, the image generating device 1 does not include an imaging unit 8, but in this embodiment, the image generating device 1 may include an imaging unit 8.

(Input section 2)
The input unit 2 is an interface that accepts input to the image generating device 1. The input unit 2 accepts input of an image of one or more rebars captured by the imaging unit 8. The input unit 2 also accepts input of a designated position designated by a user. In this embodiment, the designated position designated by the user corresponds to an index position, which is the position of an image showing an index. In addition, in the present disclosure, the image showing the index may also be simply referred to as an "indicator."

The designated position is input by the input unit 2, for example, by the user using a mouse or a touch panel to designate two points on the image and to designate a straight line or line segment connecting the two points as the designated position.

As another example, a line segment or straight line indicating the measurement position is superimposed on the image as an object, the position and angle are adjusted, and the measurement position is input by a confirmation action such as pressing the confirm button or double-clicking. The measurement position can be adjusted by selecting and moving a point specified by the user, or an end point of the line or line segment, moving the line or line segment, or inputting the amount of movement and rotation angle of the line or line segment.

Figure 2 shows an example of an image of reinforcing bars input to the input unit 2. The images shown in Figure 2 and Figure 3 (described later) contain one layer of reinforcing bars. Here, a layer of reinforcing bars means a set of reinforcing bars located on approximately the same plane, or a range including the set of reinforcing bars. In other words, the reinforcing bars included in the images in Figure 2 and other images are located on approximately the same plane. Note that the layer of reinforcing bars may have a certain range of thickness.

In the image of FIG. 2, vertical reinforcing bars 10, vertical reinforcing bars 11, horizontal reinforcing bars 12, horizontal reinforcing bars 13, and horizontal reinforcing bars 14 are arranged. At this time, horizontal reinforcing bars 13 and horizontal reinforcing bars 14 are jointed, and vertical reinforcing bars 10 are inclined to the left relative to vertical reinforcing bars 11. Image generating device 1 presents the image illustrated in FIG. 2 to the user using an external display device such as a display or a display or the like possessed by the device itself, and the user inputs a specified position via input unit 2.

The input unit 2 is not limited to a configuration in which the user directly specifies and inputs the coordinates of the position on the image that the user wants to measure. When an index is displayed, the user may select an index or measurement position information to be moved and move the index, etc. to specify the measurement position. When the input unit 2 is realized as a touch panel, the index, etc. may be moved by dragging. At this time, the measurement value of the interval is calculated for the newly input measurement position in the same manner as the process described above, and the index is displayed. During the above-mentioned movement, the position during movement may be set as the measurement position, the interval may be calculated, and the index, etc. may be superimposed on the measurement result screen. In addition, in this configuration, for example, the user may be able to switch whether the relative position of the measurement position information with respect to the index is changed or fixed as the index moves.

This is advantageous because it eliminates the need to directly specify the index position or measurement position, and allows the measurement position to be changed more easily, just like measurements with an actual measuring rod, etc.

When moving the index or measurement position information, the rebar position information may be used to restrict the movement position of the index so that it follows the longitudinal position of the rebar closest to the current display position of the index. A position of the rebar on the image may be specified and its vicinity may be used as the index position or measurement position, or the vanishing point of the group of rebars to be measured may be found and the longitudinal direction of the index may be adjusted to match the vanishing point direction. This is preferable as it makes it easier to set the measurement position for an image captured at an angle to the rebars. Note that the method of inputting the index position and measurement position is one example and other methods may be used.

(Setting Unit 3)
Based on a specified position in an image input to the input unit 2, the setting unit 3 sets an index position of an index indicating a length of the reinforcing bar in the image, and a measurement position for measuring the reinforcing bar.

First, the setting unit 3 sets the index position based on the specified position. For example, the setting unit 3 may be configured to set the index position so that a part of the outer periphery of the index is superimposed on the straight line or line segment indicating the specified position. Alternatively, the setting unit 3 may be configured to set the index position so that a straight line passing through the center of the index is superimposed on the straight line or line segment indicating the specified position. Also, for example, in a configuration in which the specified position is indicated by a point, the setting unit 3 may set the index position so that the point is superimposed on a specified corner of the index. This makes it possible to position the index position and measurement position as intended by the user when electronically superimposing an index on an image of a measurement target.

Next, the setting unit 3 sets the measurement position based on the set index position. By automatically setting the measurement position based on the index position, the index position and the measurement position can be positioned as intended by the user without the user having to specify the index position and the measurement position separately. Also, for example, the setting unit 3 may set a position adjacent to the scale of the index position as the measurement position.

When setting the measurement position, the user may specify the direction of the rebar to be measured. However, taking into consideration that the vertical and horizontal rebars are approximately perpendicular to each other, it is preferable to automatically determine the direction of the rebar to be measured based on the direction of the specified position specified by the user, as this reduces the amount of work for the user.

Figure 3 is a diagram showing how to set measurement positions when the rebar is inclined. In Figure 3, points 15 and 16, and points 17 and 18 respectively show examples of designated positions specified by the user. Because vertical rebar 10 is inclined to the left, when measuring the spacing between the vertical rebars, the measurement results differ depending on the measurement position. For example, the rebar spacing between points 15 and 16 is different from the rebar spacing between points 17 and 18. Also, arrow 35 shows an example of the rebar diameter.

Figure 4 is a diagram showing the measurement of rebar spacing when there is a joint between the rebars. In Figure 4, points 19 and 20, points 21 and 22, and points 23 and 24 respectively show examples of designated positions specified by the user. Since horizontal rebar 13 and horizontal rebar 14 form a joint, when measuring the spacing between the horizontal rebars, the measurement result differs depending on the measurement position. For example, the distance between points 19 and 20 at a position that does not include a joint is different from the distance between points 21 and 22 at a position that includes a joint, and the distance between points 19 and 20 at a position that does not include a joint is different from the distance between points 23 and 24 at a position that does not include a joint.

As described above, even if the rebar being measured is the same, the length of the rebar may differ depending on the position of the rebar. The configuration of the present disclosure in which the indicator and measurement position information are superimposed on a position based on the specified position allows the user to easily understand at which location the length of the rebar is to be measured.

Note that while Figures 3 and 4 show examples in which the rebar spacing is measured from the right and top edges of the rebar, the setting unit 3 may set the measurement position at the left or bottom edge of the rebar, or at the center of the rebar or any rebar position determined by the measurement process.

In addition, when the index position is set above a predetermined position in the image, the setting unit 3 may set the measurement position below the index position. In addition, when the index position is set below the predetermined position, the setting unit 3 may set the measurement position above the index position.

Normally, rebars are placed at approximately equal intervals, and when an image of the rebar is taken from a standing-on position, the intervals between the rebars are approximately equal. When an image of the rebar is taken from an inclined position, the intervals between the rebars become shorter the farther the position is from the imaging unit 8.

Therefore, when imaging rebars, including the rebar to be measured, the image is usually taken so that the rebar to be measured is positioned at the center of the image so that the rebar spacing of the rebar to be measured can be measured accurately. Therefore, if an index is placed at the center of the image, there is a risk that it will block the rebar to be measured.

In response to this, by having the setting unit 3 set the measurement position as described above, the indicator is more likely to be placed at the top or bottom of the image, preventing the indicator from blocking the center of the image, where the rebar to be measured is most likely to be, and improving the visibility of the image.

Figure 5 is an example of an image in which an index is placed in measuring the rebar spacing for vertical rebars. In Figure 5, index 25 shows an example of an index, and measurement position information 27 shows an example of measurement position information. Here, the setting unit 3 sets the index position of index 25 and the measurement position of measurement position information 27. As described above, points 15 and 16 show examples of designated positions specified by the user. If the specified position is the center of the image, the index position of index 25 is located above the specified position, so the setting unit 3 sets the measurement position where the measurement position information 27 is placed to be below the index position as exemplified in Figure 5. In Figure 5 and Figure 6, which will be described later, the setting unit 3 sets the position adjacent to the scale of the index value as the measurement position. Note that examples of the index and an example of a process for changing the display position of the scale on the index will be described later.

Figure 6 is an example of an image in which indicators are placed when measuring the rebar spacing for vertical rebars. In Figure 6, measurement position information 26 shows an example of measurement position information. Points 36 and 37 show examples of designated positions specified by the user. Here, the setting unit 3 sets the indicator position of indicator 25 and the measurement position of measurement position information 26. If the position is the center of the image, the indicator position is located below the specified position, so the setting unit 3 sets the measurement position where measurement position information 26 is placed to be above the indicator position, as exemplified in Figure 6.

In addition, when the index position is set to the left of a predetermined position in the image, the setting unit 3 may set the measurement position to the right of the index position. In addition, when the index position is set to the right of the predetermined position, the setting unit 3 may set the measurement position to the left of the index position. This makes it easier to position the index on the left or right side of the image, preventing the index from blocking the center of the image, where the rebar to be measured is likely to be located, and improving the visibility of the image.

Figure 7 is an example of an image in which indicators are placed when measuring the rebar spacing for horizontal rebars. In Figure 7, measurement position information 29 shows an example of measurement position information. Here, the setting unit 3 sets the indicator position of indicator 25 and the measurement position of measurement position information 28. Also, points 38 and 39 show examples of designated positions specified by the user. If the specified position is the center of the image, the indicator position is located to the left of the specified position, so the setting unit 3 sets the measurement position where measurement position information 28 is placed to the right of the index position, as exemplified in Figure 7.

Also, Fig. 8 is an example of an image in which indicators are placed when measuring the rebar spacing for horizontal rebars. In Fig. 8, measurement position information 29 shows an example of measurement position information. Here, the setting unit 3 sets the indicator position of the indicator 25 and the measurement position of the measurement position information 29. Also, points 40 and 41 show examples of designated positions specified by the user. If the specified position is the center of the image, the indicator position is located to the right of the specified position, so the setting unit 3 sets the measurement position where the measurement position information 29 is placed to the left of the index position, as exemplified in Fig. 8.

Here, the above-mentioned predetermined position is not limited to a specific position in the image, but may be, for example, the center of the image, or may be a position that can be arbitrarily set by the user via the input unit 2.

The above-mentioned predetermined positions may be provided for each direction of the rebar. For example, the setting unit 3 may be configured to compare the index position with a first predetermined position when placing an index for vertical rebars, and to compare the index position with a second predetermined position when placing an index for horizontal rebars. This allows an appropriate index position to be set for each direction of the rebars. In addition, in the above configuration, when placing an index for vertical rebars, if the index position is above the first predetermined position in the image, the setting unit 3 places the measurement position information below the index position and ensures that the scale is below the index. In addition, when the index position is below the first predetermined position in the image, the setting unit 3 places the measurement position information above the index position and ensures that the scale is above the index.

In addition, in the above configuration, when placing an indicator with respect to a horizontal rebar, if the indicator position is to the left of the second predetermined position on the screen, the setting unit 3 places the measurement position information to the right of the indicator position and the scale is to the right of the indicator. Also, if the indicator position is to the right of the second predetermined position on the screen, the setting unit 3 places the measurement position information to the left of the indicator position and the scale is to the left of the indicator.

In addition, in the central region of the image, changing the orientation of the index may result in little change in the occluded region, so a position a specified distance away from the center may be set as the specified position. This allows different control of the index position in the central region of the image and the peripheral region of the image. For example, if the specified position is set to a position above and below the center of the image that is a distance α, when measuring vertical rebar, if the index position is above the center of the image by α, the setting unit 3 positions the measurement position below the index, and the image generating unit 4 generates an image with the index scale on the lower side.

On the other hand, if the index position is below α from the center of the image, the setting unit 3 places the measurement position above the index, and the image generating unit 4 generates an image with the index scale on the upper side.

In addition, in areas within ±α from the image center, it is possible to position the measurement position in any direction from the index position. For example, when the user makes adjustments, the direction of the measurement position may be changed when the index is in an area outside ±α from the image center, and the direction of the measurement position may not be changed from the initial setting direction when the index is in an area inside ±α from the image center. This makes it possible to control the direction of the measurement position to be changed only when, for example, the index position is in the peripheral area of the image.

According to the above-mentioned method for setting the measurement position, the relationship between the index position and the measurement position can be displayed more clearly by adjusting the measurement position on the screen where the rebar spacing, etc. is measured according to the index position. This is particularly preferable when the rebar has an inclination or joints, as the measurement position and the index position will roughly coincide.

The setting unit 3 may determine at least one of the size of the index and the interval of the scale of the index based on at least one of the layer of the rebar and the measurement position. This makes it easier to understand which rebar the index corresponds to, making it possible to read an appropriate value from the index.

Figure 9 is an example of an image in which indicators are placed when measuring the length of vertical reinforcing bars. In the example of Figure 9, vertical reinforcing bars 10, vertical reinforcing bars 11, horizontal reinforcing bars 12, horizontal reinforcing bars 13, and horizontal reinforcing bars 14 correspond to the first layer of reinforcing bars, and vertical reinforcing bars 31 and vertical reinforcing bars 32 correspond to the second layer of reinforcing bars. The reinforcing bars corresponding to the first layer are generally located on the first plane, and the reinforcing bars corresponding to the second layer are generally located on the second plane that is located further back than the first plane. Also, points 42 and 43 show an example of a specified position specified by the user.

The measurement position information 33 and the indicator 30 are arranged to indicate the length of the vertical rebar 32. Here, the setting unit 3 sets the indicator position of the indicator 30 and the measurement position of the measurement position information 33. The intervals between the scale marks of the indicator 30 are set more roughly than when indicating the length of the rebar corresponding to the first layer.

In FIG. 9, whether to measure the length of reinforcing bar 32 or the reinforcing bar spacing between reinforcing bars 12 and 13 is determined according to, for example, two designated positions when the user inputs the designated positions. Also, the user may be able to designate via the input unit 2 which reinforcing bar layer the reinforcing bar length to be measured for. Also, the setting unit 3 may be able to set a single index position and a measurement position for multiple reinforcing bars corresponding to different reinforcing bar layers.

In addition, the configuration in which the setting unit 3 detects multiple layers of reinforcing bars is not limited to a specific configuration, and the detection may be performed, for example, by the following process.

(1) The setting unit 3 determines the plane of the first layer that includes the nearest edge of the rebar that is fully visible.

(2) Exclude edges that are a certain distance in the normal direction from the plane of the first layer (i.e., the edge of the rebar in the first layer, the other edge on the far side).

(3) Determine the position of the second layer rebar and the plane of the second layer from the three-dimensional positions of the remaining edges.

As described above, the setting unit 3 sets the size of the index or the interval between the scale marks based on the layer of rebar to which the index corresponds or the measurement position, making it easier to know which rebar's length is being measured.

(Image Generation Unit 4)
The image generating unit 4 generates an image on which the index and measurement position information are superimposed based on the index positions and the measurement positions. The image data generated by the image generating unit 4 may be a signal to be displayed on a display or a file to be saved as an image.

The indices superimposed on the image are realized by converting and superimposing image data previously held by the image generating device 1 by the image generating unit 4, or by drawing the indices directly on the image. The indices are, for example, three-dimensional objects, such as the scale rod shown in FIG. 10. The scale rod in FIG. 10 is 56 cm long, 5 cm wide, has a scale interval of 1 mm, and has scales up to 50 cm, but other sizes and types may be used, and multiple image data may be stored and selected according to the situation. For example, the image generating unit 4 can superimpose indices with different scale intervals and widths based on the measured rebar interval and measurement range, which is preferable because it can superimpose an index suitable for the arrangement of the rebar to be measured. In other words, the image generating unit 4 uses a scale with 0.5 mm intervals when the rebar interval is small, a scale with 2 mm intervals when the measurement range is wide, and uses a narrow indicator when the rebar interval in the same direction as the measurement direction is narrow.

The image data conversion described above is performed based on three-dimensional information about the reinforcing bars to be measured. For example, the layers of the reinforcing bars are calculated from the three-dimensional straight lines of the reinforcing bars to be measured, the image data is converted so that they are positioned on the calculated three-dimensional plane, and then superimposed on the image of the reinforcing bars. Note that the image generation unit 4 may superimpose multiple indicators on one image, or may superimpose indicators for vertical and horizontal reinforcing bars on one image.

In addition, when the image generating unit 4 draws an object on the screen, it performs coordinate conversion of the shape, the start and end points of the scale, etc. so that the information of the indicators to be drawn is drawn on a three-dimensional plane on which the rebar to be measured exists, and draws it on the image based on that information, superimposing the indicators, etc.

In addition, it is preferable that the image generating unit 4 superimposes an index having a scale provided on the side closer to the measurement position on the image. That is, when the measurement position is set below the index position, it is preferable that the image generating unit 4 provide a scale below the index, and when the measurement position is set above the index position, it is preferable that the image generating unit 4 provide a scale above the index. In addition, when the measurement position is set to the right of the index position, it is preferable that the scale be provided to the right of the index, and when the measurement position is set to the left of the index position, it is preferable that the scale be provided to the left of the index. This makes it easier to grasp the measurement results at the measurement position. In addition, the position of the scale may be configured to be set by the setting unit 3.

The position of the scale does not need to be exactly the same as the measurement position, and may be a position where the user can recognize that the scale of the index and the measurement position are approximately the same. In addition, the index in FIG. 10 is a measuring rod with a scale on one side, but it is possible to use an index with scales on both sides, but it is necessary to make the scale corresponding to the measurement position clear. For example, if the auxiliary scale is shown in a light color, shown with a dashed line, or the length of the scale is shortened so that the user can intuitively recognize it as an auxiliary scale, the scale position of the index corresponding to the measurement position becomes clear, and the measurement position can be clearly visually recognized. This makes it possible to read an appropriate value from the index. In addition, especially in the case of a configuration in which scales are provided on both sides of the index, the image generation unit 4 may superimpose an object such as an arrow indicating the direction of the measurement position relative to the index position on the image. This makes it easy to identify the measurement position information corresponding to a certain index.

(Measurement unit 5)
The measuring unit 5 calculates the three-dimensional position of the reinforcing bar in the image and measures the length of the reinforcing bar at the measurement position. Here, the length of the reinforcing bar is, for example, the longitudinal length of the reinforcing bar, the reinforcing bar diameter, or the reinforcing bar spacing.

In relation to the process of calculating the three-dimensional position of the reinforcing bar, the reinforcing bar edge, which is the basis for measuring the reinforcing bar diameter or reinforcing bar spacing, can be detected by a conventional edge detection method. Also, the edge of the image can be detected using a Sobel filter or a Canny filter, and a group of straight lines can be detected from the detected edge by a Hough transform or the like, and a straight line indicating the reinforcing bar edge can be detected. Also, the three-dimensional coordinates of the reinforcing bar edge can be calculated by calculating the parallax of the detected reinforcing bar edge and based on the camera parameters of the imaging unit 8. The calculation of the parallax can also be calculated by a conventional method, and for example, it can be realized by calculating the corresponding points in the reference image with respect to the base image by block matching using an evaluation function such as SAD or SSD.

In addition, in the process of measuring the length of rebar, measurements are performed based on straight lines on an image showing rebar edges and the three-dimensional coordinates of the rebar edges, but conventional methods can be applied to each measurement. For example, the measurement unit 5 calculates a three-dimensional straight line based on the three-dimensional coordinates of an edge group whose distance from a straight line on an image showing the rebar edges is within a predetermined range, and calculates the rebar diameter from the distance between adjacent three-dimensional straight lines. For example, the measurement unit 5 may calculate the distance between the three-dimensional straight lines of two rebar edges that exist along each other among a combination of rebar edges as the rebar diameter. The measurement unit 5 may also calculate the three-dimensional coordinates of points around each of the two rebar edges, and calculate the distance between the points as the rebar diameter.

The measurement unit 5 also calculates a three-dimensional line indicating the position of the rebar, and calculates the rebar spacing from the three-dimensional line indicating the position of adjacent rebars. For example, the measurement unit 5 may calculate the axis passing through the center of the above-mentioned two rebar edges as the central axis of the rebar, and calculate the distance between the central axes of adjacent rebars as the rebar spacing. In this case, the measurement unit 5 may calculate the average rebar spacing for each horizontal rebar and vertical rebar.

When calculating the rebar spacing between rebars in different layers, the measurement unit 5 may calculate the distance between the planes corresponding to the layers of each rebar as the rebar spacing.

The measurement position can be set at various positions, such as the center of the captured image, the center between the rebars, or on the rebars themselves. However, if only the measurement results of the rebar diameter and rebar spacing are presented, it is not possible to know whether the measurement position assumed by the user matches the actual measurement position.

On the other hand, with the configuration shown in Figures 5 to 9, it is easy to know whether the measurement position expected by the user matches the actual measurement position. Since the measurement results for rebar diameter and rebar spacing may differ depending on the measurement position, as described below, by superimposing the index and measurement position information on the image, it is possible to easily check whether the actual measurement position is as expected by the user. In addition, a configuration in which a numerical value indicating the measurement result by the measurement unit 5 is displayed on the screen may also be used.

The configuration is not limited to one in which measurements are made using images captured by the imaging unit 8, and similar effects can be obtained by using a sensor that acquires distance information. For example, a camera that captures color images and a TOF sensor that acquires distance information can be used, and the image information and distance information can be input to the image generating device 1, and the measurement unit 5 can calculate three-dimensional coordinates to measure the rebar.

(Storage unit 6)
The storage unit 6 is a storage device that at least temporarily stores information. The storage unit 6 can be realized as a flash memory, a hard disk, or the like. For example, the storage unit 6 stores images generated by the image generating unit 4 and objects displayed on the screen. The storage unit 6 may be configured to be realized as a storage device connected to the measuring device 100.

(Display section 7)
The display unit 7 is a display that displays text, moving images, etc. The display unit 7 can be realized as an LCD (Liquid Crystal Display), an organic EL (Electro Luminescence) display, etc. When the input unit 2 is realized as a touch panel, the touch panel also operates as the display unit 7. The display unit 7 may be configured to be realized as a display device connected to the measurement device 100.

(Method of controlling the measuring device 100)
Next, a control method for the measuring device 100 according to this embodiment (a control method for the image generating device) will be described. Fig. 11 is a flowchart showing an example of a control method for the measuring device 100 executed by the image generating device 1 according to this embodiment. The process shown in the flowchart of Fig. 11 is started when an image of a rebar captured by the imaging unit 8 is input to the input unit 2, or when a predetermined instruction is input to the image generating device 1 in the measuring device 100 in the above case.

The image generating device 1 presents an image to a user via an external display device or the like, and the input unit 2 accepts input of a specified position specified by the user in the image in which the rebar is captured (S1). In addition, the measurement unit 5 calculates the three-dimensional position of the rebar in the image.

The setting unit 3 sets the index position in the image based on the specified position specified by the user (S2).

The setting unit 3 sets a measurement position in the image based on the index position (S3). Because the index position is based on the specified position, the measurement position is indirectly based on the specified position.

The image generation unit 4 generates an image on which the index and measurement position information are superimposed based on the index position and measurement position set by the setting unit 3 (S4). The image generation device 1 also displays the generated image on the display unit 7. Specifically, the image generation unit 4 first generates an index, then generates an image on which the index is superimposed on the index position and the measurement position information is superimposed on the measurement position, and stores the image in the memory unit 6. The measurement unit 5 also measures the length of the rebar at the measurement position. Next, the image generation device 1 displays the generated image, which appropriately includes the measurement results by the measurement unit 5, on the display unit 7.

(Method of setting measurement position)
Next, a process of setting the measurement position by the setting unit 3, which corresponds to step S3 in Fig. 11, will be described in detail. Fig. 12 is a flowchart showing an example of a method of setting the measurement position.

The setting unit 3 determines whether the indicator is arranged horizontally (S100). Here, the indicator is arranged horizontally, meaning that the indicator is arranged with the horizontal direction as the long direction, for example, so that a scale is provided in the horizontal direction of an image.

When the setting unit 3 determines that the indicator is arranged horizontally (YES in S100), it then determines whether the indicator position is located above a predetermined position (S101).

When the setting unit 3 determines that the index position is located above the predetermined position (YES in S101), it sets the measurement position below the index position (S102). Following the processing of step S102, the setting unit 3 sets the position of the index scale below the index, in alignment with the measurement position below the index position (S103). Here, FIG. 5 corresponds to the processing of steps S102 and S103. In this way, after calculating the measurement position, the setting unit 3 changes the position of the scale according to the index position and the measurement position, which is preferable because the index scale is displayed at a position closer to the measurement position.

When the setting unit 3 determines that the index position is located below the predetermined position (NO in S101), the setting unit 3 sets the measurement position above the index position (S104). Following the process of step S104, the setting unit 3 sets the position of the index scale above the index, aligning it with the measurement position above the index position (S105). Here, FIG. 6 corresponds to the processes of steps S104 and S105.

In addition, in the judgment of S100, if the setting unit 3 judges that the indicator is not arranged horizontally but arranged vertically (NO in S100), it then judges whether the indicator position is located to the left of the predetermined position (S106).

When the setting unit 3 determines that the index position is located to the left of the predetermined position (YES in S106), it sets the measurement position to the right of the index position (S107). Following the processing of step S107, the setting unit 3 aligns the measurement position to the right of the index position and sets the position of the index scale to the right of the index (S108). Here, FIG. 7 corresponds to the processing of steps S107 and S108.

When the setting unit 3 determines that the index position is located to the right of the predetermined position (NO in S106), the setting unit 3 sets the measurement position to the left of the index position (S109). Following the processing of step S109, the setting unit 3 sets the position of the index scale to the left of the index, aligning it with the measurement position to the left of the index position (S110). Here, FIG. 8 corresponds to the processing of steps S109 and S110.

[Embodiment 2]
Other embodiments of the present invention will be described below. For ease of explanation, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and redundant description will not be repeated.

<Measuring device 100X>
13 is a functional block diagram showing the configuration of a measurement device 100X according to the second embodiment. The measurement device 100X includes an imaging unit 8 and an image generating device 1X. The image generating device 1X differs from the image generating device 1 shown in FIG. 1 in that the image generating device 1X includes a setting unit 3X instead of the setting unit 3.

(Setting section 3X)
The setting unit 3X has the same function as the setting unit 3, and sets an index position of an index indicating the length of a rebar in the image and a measurement position for measuring the rebar based on a specified position in the image input to the input unit 2. However, the setting unit 3X sets a measurement position prior to the index position based on the specified position. The setting unit 3X also sets the index position based on the set measurement position. By automatically setting the index position based on the measurement position, the index position and the measurement position can be arranged as intended by the user without the user having to specify the index position and the measurement position individually. Also, for example, the setting unit 3X may set a position adjacent to the measurement position as the position of the scale of the index position. The index position may be set in the vicinity of the measurement position by a predetermined distance.

Furthermore, when the index in FIG. 10 is superimposed based on the measurement position, if the center of the short side of the index is aligned with the measurement position, the index scale position and the measurement position will differ, and the measurement value read by the user using the index will differ from the measurement value at the measurement position. Therefore, the setting unit 3X superimposes the index on the image so that the index scale is superimposed near the measurement position. This causes the measurement position and the position where the measurement value is read using the index to match, allowing the user to clearly read the measurement position.

Furthermore, when the measurement position is set above a predetermined position in the image, the setting unit 3X may set the index position above the measurement position, as exemplified in Fig. 5. That is, in the example of Fig. 5, the setting unit 3X may set the index position of the index 25 above the measurement position information 27. Furthermore, when the measurement position is set below the predetermined position, the setting unit 3X may set the index position below the measurement position, as exemplified in Fig. 6. That is, in the example of Fig. 6, the setting unit 3X may set the index position of the index 25 below the measurement position information 26. This makes it easier for the index to be placed at the top or bottom of the image, and prevents the center of the image, where the reinforcing bar to be measured is likely to be present, from being blocked by the index, thereby improving the visibility of the image.

Furthermore, when the measurement position is set to the left of a predetermined position in the image, the setting unit 3X may set the index position to the left of the measurement position, as exemplified in Fig. 7. That is, in the example of Fig. 7, the setting unit 3X may set the index position of the index 25 to the left of the measurement position information 28. Furthermore, when the measurement position is set to the right of the predetermined position, the setting unit 3X may set the index position to the right of the measurement position, as exemplified in Fig. 8. That is, in the example of Fig. 8, the setting unit 3X may set the index position of the index 25 to the right of the measurement position information 29. This makes it easier for the index to be placed on the left or right side of the image, and prevents the center of the image, where the reinforcing bar to be measured is likely to be present, from being blocked by the index, thereby improving the visibility of the image.

Here, the above-mentioned predetermined position is not limited to a specific position in the image, but may be, for example, the center of the image, or may be a position that can be arbitrarily set by the user via the input unit 2.

The above-mentioned predetermined positions may be provided for each direction of the rebar. For example, the setting unit 3X may be configured to compare the measurement position with a first predetermined position when arranging measurement position information for vertical rebars, and to compare the measurement position with a second predetermined position when arranging measurement position information for horizontal rebars. This allows a suitable measurement position to be set for each direction of the rebars. In addition, in the above configuration, when arranging measurement position information for vertical rebars, the setting unit 3X arranges an index above the measurement position and ensures that the scale is below the index when the measurement position is above the first predetermined position in the image. In addition, the setting unit 3X arranges an index below the measurement position and ensures that the scale is above the index when the measurement position is below the first predetermined position in the image.

In addition, in the above configuration, when placing measurement position information for a horizontal reinforcing bar, if the measurement position is to the left of the second predetermined position on the screen, the setting unit 3X places the indicator to the left of the measurement position and the scale is to the right of the indicator. Also, if the measurement position is to the right of the second predetermined position on the screen, the setting unit 3X places the indicator to the right of the measurement position and the scale is to the left of the indicator.

Depending on the position of the rebar, it may be difficult to place the rebar to be measured in the central area of the image. Therefore, for example, the predetermined position may be a position a predetermined distance away from the center of the image. This makes it possible to suitably improve the visibility of the image depending on the position of the rebar. For example, if the predetermined position is a position above or below the center of the image that is a distance α, when measuring vertical rebar, if the measurement position is above α from the center of the image, the setting unit 3X places the index position above the measurement position information, and the image generation unit 4 generates an image with the index scale on the lower side.

On the other hand, if the measurement position is located below α from the center of the image, the setting unit 3 places the index position on the upper side of the measurement position information, and the image generation unit 4 generates an image with the index scale on the upper side.

In addition, in the area within ±α from the center of the image, the index position can be positioned in any direction from the measurement position. For example, when the user makes adjustments, the direction of the index position can be changed when the measurement position information is in the area outside ±α from the center of the image, and the direction of the index position can be left unchanged from the initial setting direction when the measurement position information is in the area inside ±α from the center of the image. This can, for example, suitably improve the visibility of the image according to the position of the rebar. Also, it becomes possible to control the direction of the index position to be changed only when the measurement position is in the peripheral area of the image.

According to the above-mentioned method for setting the index position, the relationship between the index position and the measurement position can be displayed more clearly by adjusting the index position on the screen that measures the rebar spacing, etc., according to the measurement position. This is particularly preferable when the rebar has an inclination or joints, as the measurement position and the index position will roughly coincide.

(Method of controlling measuring device 100X)
Next, a control method for the measuring device 100X according to this embodiment (a control method for an image generating device) will be described. Fig. 14 is a flowchart showing an example of a control method for the measuring device 100X executed by the image generating device 1X according to this embodiment. The process shown in the flowchart of Fig. 14 is started when an image of a rebar is input to the input unit 2, or when a predetermined instruction is input to the image generating device 1X in the measuring device 100X in the above case.

The image generating device 1X presents an image to a user via an external display device or the like, and the input unit 2 accepts input of a specified position specified by the user in the image in which the rebar is captured (S11). In addition, the measurement unit 5 calculates the three-dimensional position of the rebar in the image.

The setting unit 3X sets the measurement position in the image based on the specified position specified by the user (S12).

The setting unit 3X sets the index position in the image based on the measurement position (S13). Because the measurement position is based on the specified position, the index position is indirectly based on the specified position.

Similar to step S4, the image generating unit 4 generates an image on which the index and measurement position information are superimposed based on the index position and measurement position set by the setting unit 3X (S14). The image generating device 1X also causes the display unit 7 to display the generated image. Specifically, the image generating unit 4 first generates an index, then generates an image on which the index is superimposed at the index position and the measurement position information is superimposed at the measurement position, and stores the image in the memory unit 6. The measurement unit 5 also measures the length of the rebar at the measurement position. Next, the image generating device 1 causes the display unit 7 to display the generated image, which appropriately includes the measurement results by the measurement unit 5.

(Method of setting measurement position)
Next, a process corresponding to step S13 in Fig. 14, in which the setting unit 3X sets the index position, will be described in detail. Fig. 15 is a flowchart showing an example of a method for setting the index position.

The setting unit 3X determines whether the measurement is performed horizontally (S200). Here, the measurement being performed horizontally means, for example, that the measurement position is set in the horizontal direction of the image.

If the setting unit 3X determines that the measurement is to be performed horizontally (YES in S200), it then determines whether the measurement position is located above a predetermined position (S201).

If the setting unit 3X determines that the measurement position is located above the predetermined position (YES in S201), it sets the index position above the measurement position (S202). Following the processing of S202, the setting unit 3X sets the position of the index scale below the index, aligning it with the measurement position below the index position (S203). Furthermore, if the setting unit 3X determines that the measurement position is located below the predetermined position (NO in S201), it sets the index position below the measurement position (S204). Following the processing of S204, the setting unit 3X sets the position of the index scale above the index, aligning it with the measurement position above the index position (S205).

In addition, in the judgment of S200, if the setting unit 3X judges that the measurement is not performed horizontally but vertically (NO in S200), it then judges whether the measurement position is located to the left of the predetermined position (S206).

If the setting unit 3X determines that the measurement position is located to the left of the predetermined position (YES in S206), it sets the index position to the left of the measurement position (S207). Following the process of S207, the setting unit 3X aligns the measurement position to the right of the index position and sets the position of the scale of the index to the right of the index (S208).
Furthermore, if the setting unit 3X determines that the measurement position is located to the right of the predetermined position (NO in S206), it sets the index position to the right of the measurement position (S209). Following the process of S209, the setting unit 3X aligns the measurement position to the left of the index position and sets the position of the scale of the index to the left of the index (S210).

Note that if the measurement direction is determined to be a diagonal direction exactly halfway between the horizontal and vertical directions in S200, or if the index position and a predetermined position are determined to be the same in S201 or S206, any of the branching processes may be executed next.

In this way, the setting unit 3X calculates the index position, and then changes the position of the scale depending on the index position and the measurement position, which is advantageous because the index scale is displayed at a position closer to the measurement position.

The processes in each embodiment can be realized by software processing using a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), or by hardware processing using an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

The method for realizing the functions described in each embodiment can also be provided as a program. The program can be recorded on a computer-readable recording medium, and the program recorded on the recording medium can be read into a computer system or downloaded from the Internet and executed to perform processing of each part. Note that the "computer system" referred to here includes hardware such as the OS and peripheral devices.

In addition, if the WWW system is used, the "computer system" also includes the homepage provision environment (or display environment).

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. The technical scope of the present invention also includes embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Furthermore, new technical features can be formed by combining the technical means disclosed in the respective embodiments.

[Software implementation example]
The functions of the image generating device (1, 1X) (hereinafter referred to as the "device") can be realized by a program for causing a computer to function as the device, and a program for causing a computer to function as each control block of the device (in particular, the input unit 2, the setting unit (3, 3X), the measurement unit 5 and the image generating unit 4).

In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The control device and storage device execute the program, thereby realizing each of the functions described in each of the above embodiments.

The program may be recorded on one or more computer-readable recording media, not on a temporary basis. The recording media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

In addition, some or all of the functions of each of the control blocks can be realized by a logic circuit. For example, an integrated circuit in which a logic circuit that functions as each of the control blocks is formed is also included in the scope of the present invention. In addition, it is also possible to realize the functions of each of the control blocks by, for example, a quantum computer.

Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may be executed by the control device or another device (for example, an edge computer or a cloud server).

〔summary〕
The image generating device of aspect 1 of the present invention is configured to include an input unit that accepts input of a specified position specified by a user in an image in which a reinforcing bar is captured, a setting unit that sets an index position of an index indicating the length of the reinforcing bar in the image and a measurement position for measuring the reinforcing bar based on the specified position in the image, and an image generating unit that generates an image on which the index and measurement position information indicating the measurement position are superimposed based on the index position and the measurement position.

The image generating device according to aspect 2 of the present invention may be configured in the above aspect 1 such that the setting unit sets the measurement position based on the index position, or sets the index position based on the measurement position.

An image generating device according to aspect 3 of the present invention may be configured in the above-mentioned aspect 2 such that, when setting the measurement position based on the index position, if the index position is set above a predetermined position in the image, the setting unit sets the measurement position below the index position, and when the index position is set below the predetermined position, the setting unit sets the measurement position above the index position; and, when setting the index position based on the measurement position, if the measurement position is set above a predetermined position in the image, the setting unit sets the index position above the measurement position, and when the measurement position is set below the predetermined position, the setting unit sets the index position below the measurement position.

An image generating device according to a fourth aspect of the present invention may be configured in the above-mentioned second aspect such that, when setting the measurement position based on the index position, if the index position is set to the left of a predetermined position in the image, the setting unit sets the measurement position to the right of the index position, and when the index position is set to the right of the predetermined position, the setting unit sets the measurement position to the left of the index position; and, when setting the index position based on the measurement position, if the measurement position is set to the left of the predetermined position in the image, the setting unit sets the index position to the left of the measurement position , and when the measurement position is set to the right of the predetermined position, the setting unit sets the index position to the right of the measurement position.

The image generating device according to aspect 5 of the present invention is any one of aspects 1 to 4 above, and the image generating unit may be configured to generate an image in which the index having a scale provided on the side closer to the measurement position is superimposed.

The image generating device according to aspect 6 of the present invention may be configured in any one of aspects 1 to 5 above, such that the setting unit determines at least one of the size of the index and the interval of the scale of the index based on at least one of the layer of the reinforcing bar and the measurement position.

The control method for an image generating device according to aspect 7 of the present invention includes the steps of: an image generating device receiving an input of a specified position specified by a user in an image in which a rebar is captured; the image generating device setting an index position of an index indicating the length of the rebar in the image and a measurement position for measuring the rebar based on the specified position in the image; and the image generating device generating an image in which the index and measurement position information indicating the measurement position are superimposed based on the index position and the measurement position.

The image generation program according to aspect 8 of the present invention is an image generation program for causing a computer to function as the image generation device according to any one of aspects 1 to 6 above, and is configured to cause a computer to function as the input unit, the setting unit, and the image generation unit.

The image generating device according to each aspect of the present invention may be realized by a computer. In this case, the image generating program of the image generating device that causes the computer to operate as each unit (software element) of the image generating device to realize the image generating device, and the computer-readable recording medium on which it is recorded, also fall within the scope of the present invention.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. The technical scope of the present invention also includes embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Furthermore, new technical features can be formed by combining the technical means disclosed in the respective embodiments.

1, 1X Image generating device 2 Input section 3, 3X Setting section 4 Image generating section 5 Measurement section 100, 100X Measurement device

Claims (5)

an input unit that receives an input of a specified position designated by a user in an image of the reinforcing bar;
a setting unit that sets, based on the specified position in the image, an indicator position of an indicator indicating a length of the reinforcing bar and a measurement position for measuring the reinforcing bar in the image;
an image generating unit that generates an image on which the index and measurement position information indicating the measurement position are superimposed based on the index position and the measurement position,
The setting unit is
setting the measurement position based on the index position, or setting the index position based on the measurement position;
an image generating device that performs one of the following when setting the measurement position based on the index position: when the index position is set above a predetermined position in the image, the measurement position is set below the index position, and when the index position is set below the predetermined position, the measurement position is set above the index position; and when setting the index position based on the measurement position, when the measurement position is set above a predetermined position in the image, the index position is set above the measurement position, and when the measurement position is set below the predetermined position, the index position is set below the measurement position. an input unit that receives an input of a specified position designated by a user in an image of the reinforcing bar;
a setting unit that sets, based on the specified position in the image, an indicator position of an indicator indicating a length of the reinforcing bar and a measurement position for measuring the reinforcing bar in the image;
an image generating unit that generates an image on which the index and measurement position information indicating the measurement position are superimposed based on the index position and the measurement position,
The setting unit is
setting the measurement position based on the index position, or setting the index position based on the measurement position;
an image generating device that performs one of the following when setting the measurement position based on the index position: when the index position is set to the left of a predetermined position in the image, the measurement position is set to the right of the index position, and when the index position is set to the right of the predetermined position, the measurement position is set to the left of the index position; and when the index position is set based on the measurement position, when the measurement position is set to the left of a predetermined position in the image, the index position is set to the left of the measurement position, and when the measurement position is set to the right of the predetermined position, the index position is set to the right of the measurement position. 3. The image generating device according to claim 1 , wherein the image generating unit generates an image on which the index, in which a scale is provided on a side closer to the measurement position, is superimposed. The image generating device according to any one of claims 1 to 3 , characterized in that the setting unit determines at least one of the size of the index and the interval of the scale of the index based on at least one of the layer of the reinforcing bar and the measurement position. 5. An image generating program for causing a computer to function as the image generating device according to claim 1 , the image generating program causing a computer to function as the input unit, the setting unit, and the image generating unit.

Images