JP6758236B2 - Reinforcing bar counting device, counting method, program - Google Patents

Description

Related to technology for counting reinforcing bars at construction sites.

At the construction site, images of the assembled rebar are taken to provide evidence that the construction is being done correctly. By counting the number of reinforcing bars from the captured image, it is possible to confirm whether or not the prepared reinforcing bars are correctly arranged by the number of reinforcing bars.

Generally, at a construction site, reinforcing bars are assembled over a wide area, so that they often do not fit in one image. Therefore, a method has been considered in which markers indicating the number of reinforcing bars are attached to the reinforcing bars, and an image is taken so that each marker includes the attached reinforcing bars. The marker is, for example, a marker indicating the first reinforcing bar, the tenth reinforcing bar, the twentieth reinforcing bar, and the like.

On the other hand, in the above method, in order to arrange a marker indicating the number of reinforcing bars, it is necessary to add a mark after counting the number of reinforcing bars between the markers, and there are many work processes, and when the number of reinforcing bars increases, the worker The burden will increase and it will take time.

As another known technique, there is a technique described in Patent Document 1 for automatically counting reinforcing bars. In Patent Document 1, a background bar is provided at the rear of the reinforcing bar, and the reinforcing bars overlapping the background bar are counted.

Japanese Unexamined Patent Publication No. 2016-003981

In the technique described in Patent Document 1, there is no mention of a method for discriminating the overlap of reinforcing bars between a plurality of images. When the image of the reinforcing bar is divided into a plurality of images and the number of reinforcing bars is counted, a technique capable of discriminating the overlapping of the reinforcing bars between the images and counting the number of reinforcing bars by removing the discriminated number of overlapping reinforcing bars is desired.

Based on the above circumstances, it is an object of the present invention to provide a reinforcing bar measurement technique capable of preventing duplicate counting between a plurality of images.

The rebar counting device according to one aspect of the present invention is a rebar counting device that counts the number of rebars based on a series of images of a plurality of rebars, and is a plurality of images including two rebars with markers. An image acquisition unit that acquires a plurality of images including a common marker between the two images of the plurality of images, a reinforcing bar detection unit that detects a reinforcing bar in each of the plurality of images, and the plurality of images. The number of reinforcing bars between the marker detecting unit that detects the marker in each of the above and the two reinforcing bars to which the marker is attached in each of the plurality of images is counted as the number of reinforcing bars between markers, and each of the plurality of images. The number of reinforcing bars to which the marker is attached is defined as the number of marker reinforcing bars, and the number of marker reinforcing bars is counted so as not to overlap between the plurality of images.

The reinforcing bar counting device according to another aspect of the present invention is a reinforcing bar counting device that counts the number of a plurality of reinforcing bars, and includes an image acquisition unit that acquires two images including reinforcing bars to which a common marker is assigned, and the above. In the first image of the two images, the reinforcing bar detecting unit that detects the reinforcing bar from the two images, the marker detecting unit that detects the marker from the two images, and the reinforcing bar included in the first image. The number of reinforcing bars from the reinforcing bar at the edge of the screen to the reinforcing bar to which the marker is attached is counted, and in the second image of the two images, the marker is attached to the reinforcing bar included in the second image. The number of reinforcing bars from the reinforcing bars to the reinforcing bars at the edge of the screen is counted, and the number obtained by subtracting 1 from the total of the numbers counted in the first image and the second image is counted as the number of reinforcing bars. It is characterized by having a part and.

The counting method in one aspect of the present invention is a reinforcing bar counting method for counting the number of reinforcing bars based on a series of images in which a plurality of reinforcing bars are taken, and is a plurality of images including two reinforcing bars with markers. This is, a plurality of images including a common marker are acquired between the two images of the plurality of images, a reinforcing bar is detected in each of the plurality of images, and the marker is detected in each of the plurality of images. , The number of reinforcing bars between the two reinforcing bars to which the marker is attached in each of the plurality of images is counted as the number of reinforcing bars between markers, and the number of reinforcing bars to which the marker is attached in each of the plurality of images is a marker. The number of reinforcing bars is defined, and the number of marker reinforcing bars is counted so as not to overlap between the plurality of images.

The counting method in another aspect of the present invention is a counting method for counting the number of a plurality of reinforcing bars, and obtains two images including the reinforcing bars to which a common marker is assigned, and obtains the reinforcing bars from the two images. Detected, the marker was detected from the two images, and in the first image of the two images, the marker was added from the reinforcing bar at the edge of the screen with the reinforcing bar included in the first image. The number of reinforcing bars to the reinforcing bars is counted, and in the second image of the two images, the reinforcing bars included in the second image from the reinforcing bars to which the marker is attached to the reinforcing bars at the edge of the screen. The number of reinforcing bars is counted, and the number obtained by subtracting 1 from the total of the numbers counted in the first image and the second image is counted as the number of reinforcing bars.

The program according to one aspect of the present invention is a program that causes a computer to execute a process of counting the number of reinforcing bars based on a series of images of a plurality of reinforcing bars, and includes two reinforcing bars with markers. A plurality of images including a common marker are acquired between the two images of the plurality of images, reinforcing bars are detected in each of the plurality of images, and the marker is used in each of the plurality of images. The number of reinforcing bars between the two reinforcing bars that have been detected and given the marker in each of the plurality of images is counted as the number of reinforcing bars between markers, and the number of reinforcing bars to which the marker is given in each of the plurality of images. Is the number of marker reinforcing bars, and the computer is made to execute a process of counting the number of marker reinforcing bars so as not to overlap between the plurality of images.

The program in another aspect of the present invention is a program that causes a computer to execute a process of counting the number of a plurality of reinforcing bars, obtains two images including reinforcing bars with a common marker, and obtains the above two images. The reinforcing bar is detected from the images, the marker is detected from the two images, and in the first image of the two images, the reinforcing bar included in the first image, the marker is detected from the reinforcing bar at the edge of the screen. The number of reinforcing bars up to the reinforcing bar to which the marker is added is counted, and in the second image of the two images, the reinforcing bar included in the second image is located at the edge of the screen from the reinforcing bar to which the marker is added. It is characterized by having the computer execute a process of counting the number of reinforcing bars up to the reinforcing bars and counting the number obtained by subtracting 1 from the total of the numbers counted in the first image and the second image as the number of reinforcing bars. To do.

According to the present invention, it is possible to provide a reinforcing bar measurement technique capable of preventing duplicate counting between a plurality of images.

The figure which shows the functional structure of the reinforcing bar counting apparatus in 1st Embodiment. The figure which shows the hardware composition of the reinforcing bar counter. The figure which shows an example of a plurality of reinforcing bars which an image pickup apparatus makes an image | image. The figure which shows an example of the image which was imaged and acquired by the image pickup apparatus. A flowchart showing a series of procedures for acquiring a plurality of images by the rebar counting device according to the first embodiment and counting the number of rebars in the plurality of images without duplication. The flowchart which shows the processing procedure of the 1st counting process. The flowchart which shows the processing procedure of the 2nd counting process. The figure which shows the functional structure of the reinforcing bar counting apparatus in 2nd Embodiment. The figure which shows an example of a plurality of reinforcing bars which an image pickup apparatus makes an image | image. The figure which shows an example of the image which was taken by the image pickup apparatus and acquired. The flowchart which shows the processing procedure of the counting process in 2nd Embodiment. The flowchart which shows the processing procedure of the reinforcing bar number display processing. The figure which shows the functional structure of the reinforcing bar counting apparatus in 3rd Embodiment. FIG. 5 is a flowchart showing an example of a series of procedures for acquiring a plurality of images by the reinforcing bar counting device according to the third embodiment and counting the number of reinforcing bars in the plurality of images without duplication. FIG. 5 is a flowchart showing another example of a series of procedures in which a plurality of images are acquired by the reinforcing bar counting device according to the third embodiment and the number of reinforcing bars in the plurality of images is counted without duplication. A flowchart showing still another example of a series of procedures for acquiring a plurality of images by the reinforcing bar counting device according to the third embodiment and counting the number of reinforcing bars in the plurality of images without duplication. A flowchart showing still another example of a series of procedures for acquiring a plurality of images by the reinforcing bar counting device according to the third embodiment and counting the number of reinforcing bars in the plurality of images without duplication. A flowchart showing still another example of a series of procedures for acquiring a plurality of images by the reinforcing bar counting device according to the third embodiment and counting the number of reinforcing bars in the plurality of images without duplication. A flowchart showing still another example of a series of procedures for acquiring a plurality of images by the reinforcing bar counting device according to the third embodiment and counting the number of reinforcing bars in the plurality of images without duplication. The figure which showed the state which the detection marker is at the edge of an image. The figure which shows the functional structure of the reinforcing bar counting apparatus in 4th Embodiment. The figure which shows the image which the overlap determination part determines that it is an overlap image. FIG. 5 is a flowchart showing an example of a series of procedures for acquiring a plurality of images by the reinforcing bar counting device according to the fourth embodiment and counting the number of reinforcing bars in the plurality of images without duplication. The figure which shows an example of the duplication determination processing. The figure which shows the image which is not a duplicate image although the overlap determination part determines that it is a duplicate image. The figure which shows another example of the duplication determination processing.

<First Embodiment>
Hereinafter, the reinforcing bar counting device 10 according to the first embodiment will be described with reference to the drawings. The reinforcing bar counting device 10 counts the number of reinforcing bars based on a series of images of a plurality of reinforcing bars. FIG. 1 is a functional configuration diagram summarizing the functional configurations of the reinforcing bar counting device 10. The reinforcing bar counting device 10 is a computer that plays a role as a functional configuration shown in FIG. 1 by a CPU reading and executing various control programs. FIG. 2 is a diagram showing a hardware configuration in a computer. Regarding the hardware configuration, the same configuration is applied to the reinforcing bar counting device of each subsequent embodiment.

The reinforcing bar counting device 10 includes an image acquisition unit 2, a reinforcing bar detecting unit 3, a marker detecting unit 4, an indicating unit 5, a marker identification unit 6, a counting unit 7, a display control unit 8, and a storage unit 15.

The image acquisition unit 2 receives the image captured by the image pickup device 1. The image acquired by the image acquisition unit 2 is stored in the storage unit 15 as image data 16. The image pickup device 1 is a digital camera or the like. In the present embodiment, the image pickup device 1 for imaging is assumed to be outside the reinforcing bar counting device 10, but the reinforcing bar counting device 10 may have the image pickup device 1. Hereinafter, the images captured by the image pickup apparatus 1 will be described with reference to FIGS. 3 and 4.

FIG. 3 shows a plurality of reinforcing bars R to be imaged by the imaging device 1. Some of the plurality of reinforcing bars R are provided with pre-identifiable markers M (markers M1, M2, M3 ...). The user uses the imaging device 1 to take an image so as to include two reinforcing bars to which the markers are attached, and to include the reinforcing bars to which the common marker is attached. Therefore, at the time of imaging, the distance between the imaging device 1 and the reinforcing bar R is adjusted so that the two markers are within the field of view.

FIG. 4 is a diagram showing an example of an image acquired by performing imaging as described above. As described above, the plurality of images P1, P2, P3 ... Captured by the image pickup apparatus 1 are images including two reinforcing bars to which markers are added, and two different images among the plurality of images. It includes reinforcing bars with common markers among them.

Return to the description of the functional configuration diagram of FIG. The reinforcing bar detection unit 3 detects the reinforcing bar from the image acquired by the image acquisition unit 2. As a method of detecting the reinforcing bar, a known pattern matching or the like may be used. When a stereo camera is used as the image pickup device, a method of detecting by image processing such as straight line detection using depth information and shape information peculiar to the reinforcing bar is also useful. The marker detection unit 4 detects a marker from the image acquired by the image acquisition unit 2.

The instruction unit 5 instructs the marker position in the image by input from the user. For example, when the marker detection unit 4 fails to detect a marker in the image, the indicator unit 5 is used. The case where the marker is not detected in the image is the case where two markers are not detected in the image. When the marker detection fails, the user visually confirms the image displayed on the display medium 9 such as a monitor and inputs the marker position in the image. When the marker position is input from the user, the instruction unit 5 performs processing such as designating and narrowing the detection range of the marker detection unit 4. The indicator unit 5 limits the range of marker detection to facilitate marker detection.

The marker identification unit 6 identifies each marker detected by the marker detection unit 4 based on the marker information 17 stored in the storage unit 15 in advance. The marker information 17 is information for identifying the marker type and number based on information such as the shape of the marker and the characters of the marker.

The counting unit 7 performs a counting process of counting the number of reinforcing bars included in the plurality of images acquired by the image acquisition unit 2 excluding the overlapping reinforcing bars between the images. In the counting process, the reinforcing bars between the reinforcing bars to which the markers are attached, that is, the reinforcing bars located between the reinforcing bars to which the markers M1 and the marker M2 are attached are counted, taking the image P1 shown in FIG. 4 as an example. Then, the counting unit 7 counts the number of reinforcing bars to which the marker is attached. At this time, the counting unit 7 is characterized in that the number of reinforcing bars to which the marker is attached is counted so that the acquired images are not counted in duplicate.

An example of a method of counting the reinforcing bars included in a plurality of images in the counting unit 7 will be described. First, the reinforcing bars with markers are counted for each image. The number of rebars with markers counted here includes duplication between images. For example, since the marker M2 shown in FIG. 4 is counted in each of the image P1 and the image P2, it is counted one more than the overlapping portion. Therefore, among the markers identified by the marker identification unit 6, the multiple multiples, which is the number of markers duplicated and counted by the counting unit 7, are counted. For example, the number of reinforcing bars corresponding to the markers counted twice among the reinforcing bars to which the markers are attached is counted as multiple layers.

The multiple is equal to the number of reinforcing bars that overlap between images in the counting target. Therefore, to explain using the images P1 and P2 of FIG. 4 as an example, the number of reinforcing bars between the reinforcing bars with markers (3 + 4 in the example of FIG. 4) and the reinforcing bars with markers are shown for each image. From the total number (11 in the example of FIG. 4) obtained by adding the counted numbers (4 in the example of FIG. 4) (including duplication), the above multiple (1 in the example of FIG. 4) By subtracting, the number of reinforcing bars included in all the images (images P1 and P2 in the example of FIG. 4) can be calculated. The counting process for counting the number of reinforcing bars by removing the overlapping portion in this way is referred to as the first counting process.

Another example of a method of counting the number of reinforcing bars included in a plurality of images in the counting unit 7 will be described. In this example, the reinforcing bars to which the markers are added are counted for each image, and the reinforcing bars to which the counted markers are added are recorded. Then, when the image includes the reinforcing bar to which the already counted marker is added, the reinforcing bar to which the counted marker is added is excluded from the counting target.

By counting the reinforcing bars between the markers and the number of reinforcing bars to which the markers are attached in this way, the number of reinforcing bars included in all the images can be calculated. The counting process for counting the number of reinforcing bars by removing the overlapping portion in this way is referred to as the second counting process in order to distinguish it from the first counting process.

Further, the counting unit 7 may compare the number of reinforcing bars included in the plurality of images with the reinforcing bar information 18 previously stored in the storage unit 15. The reinforcing bar information 18 referred to here is the total number of reinforcing bars used. By comparing with the information recorded in advance, it is easy to confirm whether or not the prepared reinforcing bars are correctly arranged for the number of reinforcing bars.

The display control unit 8 displays the acquired image on a display medium 9 such as a monitor. As a result, the user visually confirms the reinforcing bar and the marker.

FIG. 2 is a hardware configuration diagram of the reinforcing bar counting device 10. The reinforcing bar counting device 10 includes a CPU 21, a DRAM 22, a ROM 23, a storage unit 15, and an input / output IF 25 as hardware configurations.

The CPU 21 reads and executes various control programs (processing program of the reinforcing bar detection unit, processing program of the counting unit, etc.) stored in the ROM 23.

The DRAM 22 provides a working area for temporarily storing control programs and various data. The ROM 23 is a storage medium that non-volatilely stores various control programs.

As described above, the storage unit 15 stores image data, marker information, reinforcing bar information, and the like, and is composed of a flash memory, a hard disk, and the like. The input / output IF25 transmits / receives data to / from the outside of the device. Each configuration is connected by a bus 26.

A series of procedures in which the reinforcing bar counting device 10 having the above configuration acquires a plurality of images and counts the number of reinforcing bars in the plurality of images without duplication will be described with reference to the flowchart of FIG.

First, in step S1, the image acquisition unit 2 acquires a plurality of images including the two reinforcing bars to which the markers are attached. Here, as described above, an image including a reinforcing bar to which a common marker is assigned between two different images is acquired.

In step S2, the reinforcing bar detection unit 3 detects the reinforcing bar in each of the plurality of images. In step S3, the marker detection unit 4 detects the marker in each of the plurality of images.

In step S4, the marker identification unit 6 identifies the markers detected from the plurality of images.

In step S5, the counting unit 7 performs a counting process of counting the number of reinforcing bars included in the plurality of images by excluding the overlapping reinforcing bars between the images. The counting process in step S5 corresponds to the above-mentioned first counting process or the second counting process described for the counting unit 7.

Hereinafter, a specific example of the processing procedure of the counting process will be described with reference to FIGS. 6 and 7. FIG. 6 is a flowchart showing a processing procedure of the first counting process. FIG. 7 is a flowchart showing a processing procedure of the second counting process. It is assumed that the counting unit 7 executes each of the procedures of FIGS. 6 and 7.

In step S11 of FIG. 6, the number of reinforcing bars between the reinforcing bars with markers in the image is counted in each image.

In step S12, the number of reinforcing bars to which the marker is attached is counted in each image.

In step S13, the multiples, which is the number of overlapping markers, are counted.

In step S14, from the sum of the number of reinforcing bars between the reinforcing bars with markers for each image calculated in steps S11 and S12 and the number of reinforcing bars with markers, the multiple layers calculated in step S13 are obtained. Subtract. Then, the flowchart of FIG. 6 ends.

Step S21 of FIG. 7 is the same as step S11 of FIG. 6, and the number of reinforcing bars between the reinforcing bars with markers in the image is counted in each image.

The loop processing of steps S22 to S25 is a process of counting the reinforcing bars to which the markers are added, excluding the overlapping count between the images.

In step S22, the reinforcing bar to which the Nth marker is attached is targeted, and it is determined whether or not to count the reinforcing bar. The N-th N indicated here is a number provided for convenience, and indicates the order in which the reinforcing bars to which the markers are added are counted for each of a plurality of images. Here, the images for counting the reinforcing bars are not necessarily in the order in which they were taken, and the reinforcing bars with the two markers in the image may be counted from the right or from the left. That is, the order N of counting changes depending on the situation and is not defined.

In step S23, it is determined whether or not the reinforcing bar (Nth reinforcing bar) to which the marker to be counted is added has already been counted. If step S23 is NO, the marker has not been counted yet, so the process proceeds to step S24 and 1 is added to the number of reinforcing bars to which the marker is attached. If step S23 is YES, the marker is a already counted marker, so counting is not performed and the process proceeds to step S25.

In step S25, it is determined whether or not all the reinforcing bars to which the markers have been added have been counted. If step S25 is NO, the process returns to step S22 and loops from step S22 to step S25. If step S25 is YES, the flowchart of FIG. 7 ends.

As described above, according to the reinforcing bar counting device 10 in the first embodiment, the counting process is performed by removing the overlapping reinforcing bars from the acquired image. Therefore, even when the reinforcing bars are assembled over a wide range and a large number of reinforcing bar images are acquired, it is possible to accurately count the reinforcing bars.

Further, according to the reinforcing bar counting device 10 of the first embodiment, the number of reinforcing bars is automatically calculated only by acquiring a plurality of images including two reinforcing bars to which a marker is attached, so that the user takes the action. There are few work processes, and the work load on the user can be greatly reduced.
The reinforcing bar counting device 10 according to the first embodiment has the above-mentioned effect even if the marker identification unit 6 is not provided as a configuration when the order of the images to be counted is the order of the captured images. Is. When the reinforcing bar counting device 10 does not include the marker identification unit 6, for example, the overlapping marker in the first counting process and the counted marker in the second counting process may be used as processed markers to distinguish them from other markers. Further, the reinforcing bar counting device 10 may not be provided with the indicator unit 5.

<Second embodiment>
Next, the reinforcing bar counting device 20 in the second embodiment will be described. FIG. 8 is a functional configuration diagram of the reinforcing bar counting device 20. The reinforcing bar counting device 20 is different from the reinforcing bar counting device 10 in that it does not have the marker identification unit 6 and that the counting unit 7 performs a new process, but the other configurations are the same as those in FIG. The reinforcing bar counting device 20 is also a reinforcing bar counting device that counts the number of a plurality of reinforcing bars.

In the second embodiment, since there is only one type of marker used to detect the overlap, it is not necessary to identify the marker. That is, it is assumed that if two images are acquired, all the arranged reinforcing bars can be photographed.

FIG. 9 shows a plurality of reinforcing bars R to be imaged by the imaging device 1. A marker M is provided in advance near the center of the plurality of reinforcing bars R. The imaging device 1 performs imaging so as to include the reinforcing bar to which the marker M is attached. At the time of imaging, it is desirable to adjust the distance between the reinforcing bar at the end and the reinforcing bar R between the imaging device 1 and the reinforcing bar R so that the marker M is within the field of view.

FIG. 10 is a diagram showing an example of an image acquired by performing imaging as described above. In this way, the images P1 and P2 are imaged so as to include the reinforcing bars at the ends and the marker M.

A series of procedures for acquiring a plurality of images (two images in the present embodiment) by the reinforcing bar counting device 20 and counting the number of reinforcing bars in the images without duplication is shown in FIG. 5 except for the counting process in step S5. It is the same as the flowchart of. Further, in step S1, an image is taken by the image pickup apparatus 1 by the method described with reference to FIGS. 9 and 10, and the image acquisition unit 2 acquires an image.

Hereinafter, the counting process (process corresponding to step S5 in FIG. 5) in the reinforcing bar counting device 20 will be described. FIG. 11 is a flowchart showing a procedure of counting processing in the reinforcing bar counting device 20.

In step S31, the number from the reinforcing bar located at the edge of the screen of one of the two acquired images to the reinforcing bar to which the marker is attached is counted (in the example of FIG. 10, five bars). Here, the reinforcing bar located at the edge of the screen corresponds to any of the reinforcing bars at both ends of the screen. The reinforcing bar located at the end where counting is first started is referred to as the reinforcing bar Re1 at the first end (see FIG. 10).

In step S32, in the other image of the two acquired images, the front of the reinforcing bar to which the marker is added from the reinforcing bar located at the edge of the screen (referred to as the reinforcing bar Re2 at the second end (see FIG. 10)). Count up to the reinforcing bars of (5 in the example of FIG. 10). In step S32, the method of excluding and counting the reinforcing bars to which the marker is added may be excluded as having already been counted, for example, as described in the flowchart of FIG. 7.

In step S33, the number of reinforcing bars counted in steps S31 and S32 is added (10 in the example of FIG. 10).

The counting process in the reinforcing bar counting device 20 is not limited to the process shown in FIG. 11, and as described in the flowchart of FIG. 6, after overlapping counting between images, the overlapping portion (here, one overlapping plurality) is subtracted. You may.

As described above, the reinforcing bar counting device 20 does not have to have a marker identification unit as long as it is possible to capture all the arranged reinforcing bars by acquiring two images. Also in this embodiment, the same effect as that of the first embodiment is obtained.

Next, as a modification of the first and second embodiments, an example of an image display method by the display control unit 8 will be described. Although the counting of the reinforcing bars itself is performed in the computer, it is desirable that each image including the reinforcing bars is displayed on the display medium 9 so that the user can easily check it.

FIG. 12 is a flowchart showing a procedure of processing for classifying the information of the reinforcing bars and displaying the information on the display medium 9 when the plurality of reinforcing bars are present over many layers. It is assumed that the display control unit 8 executes each procedure of FIG. 12.

In step S35, the reinforcing bars are classified for each plane. The plane refers to the reinforcing bars of each layer existing from the front to the rear. For example, the reinforcing bars are classified by adding symbols such as A layer, B layer, etc. to each layer in which the reinforcing bars exist.

In step S36, the classified reinforcing bars are numbered. For example, the reinforcing bars existing in the A layer are assigned numbers such as 1, 2, 3, ... From the left end. Such a number indicates the order of arrangement, and also serves as information indicating the position of the reinforcing bar to which the marker is attached.

According to steps S35 and S36, each reinforcing bar has layer and number information (such as the first reinforcing bar in layer A). Therefore, in step S37, by displaying the symbols and numbers related to the given information on the display medium 9 together with the reinforcing bars in the image, the user can easily determine the reinforcing bars to be counted.

Generally, depending on how the reinforcing bars are assembled at the construction site, they are arranged not only in one direction but also in the depth direction, and may have multiple layers from the front to the rear. In this case, if the user can confirm the layer of the reinforcing bar to be counted (for example, the layer in front), the indicating unit 5 can select the reinforcing bar to be counted.

<Third embodiment>
Hereinafter, the reinforcing bar counting device 30 of the third embodiment will be described. The reinforcing bar counting device 30 is different from the reinforcing bar counting device 10 in that it newly has a notification unit 31, but the other configurations are the same. FIG. 13 is a functional configuration diagram of the reinforcing bar counting device 30.

In the reinforcing bar counting device 30 according to the third embodiment, the notification unit 31 determines whether or not the acquired image can be normally counted, and can perform the counting normally. Notify the user when it is not possible. The case where normal counting cannot be performed is a case where an image that cannot be counted is acquired, for example, the image captured by the imaging device 1 does not include a marker.

Hereinafter, a series of procedures for acquiring a plurality of images by the reinforcing bar counting device 30 and counting the number of reinforcing bars in the plurality of images without duplication will be described with reference to the flowchart of FIG. The counting processes of steps S41 to S44 and steps S46 are the same as those of steps S1 to S5 of FIG.

In step S44, the marker identification unit 6 identifies the marker for each image. After that, in step S45, the notification unit 31 determines whether or not a marker is present in each image. Here, if there is an image in which the marker does not exist, the determination in step S45 becomes NO, and the process proceeds to step S47.

In step S47, the notification unit 31 notifies the user that it is impossible to perform normal counting because there is an image in which the marker does not exist. As the method of transmission, an error message may be combined with an image in which the marker does not exist and displayed on the display medium 9, or may be notified by voice. It is not particularly limited to specific means. In this way, when any of the plurality of images includes an image in which the marker does not exist, the notification unit 31 that notifies the user is also referred to as the first notification unit.

If it is determined in step S45 that the markers are present in all the images, the determination in step S45 is YES, and the process proceeds to the counting process in step S46.

As described above, according to the reinforcing bar counting device 30, even if the imaging by the imaging device 1 fails and an image without a marker is acquired, the user is notified before moving to the counting process. By doing so, it is possible to encourage the image to be retaken. Further, even when the marker is not assigned to a predetermined position or the marker interval is too wide, an image in which the marker does not exist may be acquired. Therefore, the notification unit 31 notifies the user. This is also effective in pointing out misplacement of markers.

Further, in the example of FIG. 14, all the images are acquired first, and the determination in step S45 is performed for all the images, but the present invention is not particularly limited to this example. For example, steps S42 to S45 may be performed each time one image is acquired. In that case, the counting process may be executed after repeating steps S42 to S45 for each image until all the images are acquired.

15 to 19 are flowcharts showing another example of a series of procedures from image acquisition to counting processing by the reinforcing bar counting device 30 according to the third embodiment. The flowcharts of FIGS. 15 to 19 will be described respectively. .. The counting process shown in FIGS. 15 to 19 is the same as the counting process in step S5 of FIG.

In the third embodiment, the image acquired by the image acquisition unit 2 includes a live view image. The process shown in the flowchart of FIG. 15 is to determine whether or not there is a marker in the image for the live view image.

In step S51 of FIG. 15, the image acquisition unit 2 acquires a live view image by the image pickup device 1. In step S52, the marker detection unit 4 detects the marker.

In step S53, the marker identification unit 6 determines whether or not there is a marker in the image. When the determination in step S53 is NO, the notification unit 31 notifies the user that the marker does not exist in the field of view (step S57), thereby prompting the adjustment of the imaging position. After that, steps S51 to S57 are repeated until the marker is present in the live view image.

If YES is determined in step S53, the process proceeds to step S54, and the image acquisition unit 2 acquires a still image.

In step S55, based on the determination result of whether or not all the images have been acquired, if the determination is NO, the process returns to step S51, and then steps S51 to S55 are repeated until YES is determined in step S55. ..

If YES is determined in step S55, the counting unit 7 performs the counting process in step S55 and ends the process.

By executing the determination of the presence or absence of the marker and notifying the user at the stage of acquiring the live view image in this way, it is possible to prevent the image itself in which the marker does not exist from being acquired.

The flowchart shown in FIG. 16 will be described. The counting process of steps S61 to S64 and step S66 of FIG. 16 is the same as that of steps S41 to S44 and S46 of FIG.

In step S64, the marker identification unit 6 identifies the marker for each image. In step S65, the notification unit 31 determines whether or not all the images have two images including the reinforcing bar to which the same marker is attached. The two images (image set) including the reinforcing bars to which the same marker is attached refer to a set of images such as the image P1 and the image P2 shown in FIG. The image P1 and the image P2 each include a reinforcing bar to which the same marker, the marker M2, is attached. If the determination in step S65 is NO, the process proceeds to step S67.

In step S67, the notification unit 31 informs the user that it is impossible to perform normal counting because some images do not form a set of images including the same marker. As described above, when there is no image including the reinforcing bar to which the same marker is assigned among the plurality of images, the notification unit 31 that notifies the user is also referred to as a second notification unit.

If the determination in step S65 is YES, the process proceeds to step S66.

According to the above method, even if an image is omitted due to misunderstanding that the user has imaged a part of the section to be imaged and capturing the next image, such an image. By detecting the omission of the image and notifying the user, it is possible to prompt the user to retake the image.

Further, according to this example, since the image without the marker is also the notification target, the user is notified of the image which is wider than the processing shown in FIGS. 14 and 15 and cannot be counted normally. can do.

The flowchart shown in FIG. 17 will be described. In the process of FIG. 16, after all the images are acquired, the determination in step S65 is performed for all the images, but in the process of FIG. 17, the same marker is assigned between the images each time the images are acquired. Determine if it contains the reinforcing bars.

In step S71, the image acquisition unit 2 acquires the nth image. n is an image number in the shooting order, and n = 1, 2, ... At the start, n = 1. Reinforcing bar detection (step S72), marker detection (step S73), and marker identification (step S74) are executed from the acquired image.

Next, in step S75, the image acquisition unit 2 acquires the n + 1th image. At the start, n = 2. The process from step S76 to step S78 is the same as the process from step S71 to step S74.

In step S79, the notification unit 31 determines whether or not the nth image acquired in step S71 and the n + 1th image acquired in step S75 include a reinforcing bar to which the same marker is added. If the determination in step S79 is NO, the notification unit 31 notifies the user and reacquires the n + 1th image.

If the determination in step S79 is YES, it is determined whether or not all the images have been acquired in step S80. When all the images have been acquired (the determination in step S80 is YES), the process proceeds to the counting process in step S81, and when all the images have not been acquired (the determination is NO), n = n + 1 of the image. The number is incremented by +1 and the process returns to step S75.

According to the above method, each time one image is acquired, it is determined whether or not the reinforcing bars with the same marker are included between the images. As a result, it is possible to notify the user of an image that cannot be counted normally at the stage of capturing and acquiring the image.

The flowchart shown in FIG. 18 will be described. In FIG. 18, when acquiring the second and subsequent (still image) images, the live view image was acquired before the image acquisition was performed, and the same marker was added to the previous (still image) image. It differs from the flowchart of FIG. 17 in that it is determined whether or not the reinforcing bar is included. The processes from steps S91 to S94 are the same as the processes from steps S71 to S74 in FIG.

In step S95, the image acquisition unit 2 acquires the live view image, detects the reinforcing bar (step S96), detects the marker (step S97), and identifies the marker (step S98) on the live view image. Proceed to S99.

In step S99, the notification unit 31 determines whether or not the nth image acquired in step S91 and the live view image include a reinforcing bar to which the same marker is added.

If the determination in step S99 is YES, the image acquisition unit 2 acquires the (still image) image corresponding to the live view image as the n + 1th image (step S100).

If the determination in step S99 is NO, the notification unit 31 notifies the user and returns to step S95 while urging the user to adjust the imaging position.

In step S101, if the determination is NO based on the determination as to whether or not all the images have been acquired, the image number is incremented by 1 with n = n + 1, and the process returns to step S95. After that, steps S95 to S101 are repeated until YES is obtained in step S101. If the determination is YES, the process proceeds to the counting process in step S102.

At the stage of acquiring the live view image in this way, it is determined whether or not the reinforcing bars with the same marker are included between the images. Therefore, it is possible to notify the user of an image that cannot be accurately counted before the image is captured.

The flowchart of FIG. 19 will be described below.

In step S110, the image acquisition unit 2 acquires a live view image. In step S111, the marker is detected from the live view image.

After that, the user adjusts the position of capturing the image while checking the live view image displayed on the display medium 9. Specifically, adjustments are made so that the captured image contains two markers. For example, when only one marker is displayed in the live view image, the image pickup position is adjusted while moving so that the other marker is included in the live view image.

In step S112, the notification unit 31 determines whether or not there are two markers in the live view image. If the determination in step S112 is NO, the process proceeds to step S113.

In step S113, the notification unit 31 determines whether or not the detection marker is at the edge of the image. If the determination in step S113 is NO, there is still room for moving the imaging position so that two markers are included, so the process returns to step S111.

On the other hand, if the determination in step S113 is YES, when the imaging position is further moved, the marker that has moved to the live view image also moves out of the image, so the notification unit 31 warns the user. (Step S114).

FIG. 20 is a diagram showing a state in which the detection marker is at the edge of the image. In the image P which is a live view image, a state in which a reinforcing bar to which a marker MN represented by N is added is present at the edge of the image is shown. In this state, when the marker is not attached to the reinforcing bar at the other end (when the marker is not attached to the reinforcing bar indicated by B), when the imaging position is moved to the right, the marker MN also moves out of the image P. Therefore, it is difficult to make the two markers appear in the image P. The content of the notification in step S114 may be, for example, urging the user to increase the distance between the image pickup device 1 and the reinforcing bar, or may notify the user that a measurable image cannot be acquired. As described above, when the marker in the live view image is at the end of the image and no other marker is present in the live view image, the notification unit 31 that notifies the user is also referred to as a third notification unit.

If the determination in step S112 is YES, the image acquisition unit 2 acquires a (still image) image from the live view image (step S115).

In step S116, based on the determination as to whether or not all the images have been acquired, if the determination is NO, the process returns to step S110, and the steps S110 to S116 are repeated until all the images are acquired thereafter. If the determination in step S116 is YES, the process proceeds to the counting process in step S117.

As described above, when the live view image is acquired, the user is notified when the reinforcing bar with the two markers is not included in the image and the marker in the image is at the edge of the screen. As a configuration, the user is notified that the position of the image pickup device 1 or the arrangement of the reinforcing bars is in a state where an image capable of accurately counting the reinforcing bars cannot be acquired. Therefore, it is possible to support the user for imaging and reduce the possibility of acquiring an image that cannot be accurately counted.

<Fourth Embodiment>
Hereinafter, the reinforcing bar counting device 40 according to the fourth embodiment will be described. The reinforcing bar counting device 40 is different from the reinforcing bar counting device 10 in that it has a marker position detecting unit 41 and an overlap determination unit 42 in addition to the notification unit 31, but the other configurations are the same. FIG. 21 is a diagram showing a functional configuration of the reinforcing bar counting device 40.

The marker position detection unit 41 detects the position of the marker detected by the marker detection unit 4 in the image.

The duplication determination unit 42 selects duplicate images among the plurality of images acquired by the image acquisition unit 2 based on the marker identification result by the marker identification unit 6 and the marker position detected by the marker position detection unit 41. judge. The duplicated image means an image in which the captured reinforcing bars are the same. Specifically, an image in which the identified marker types are the same and the marker positions between images are within a specified range is determined as a duplicate image. The specified range is a preset range, and may be a range in which an image in which the marker positions are substantially the same (including those slightly misaligned) can be determined. It should be noted that it may be determined whether or not the image is a duplicate image using only the type of the identified marker. In that case, the duplication determination unit 42 determines an image having the same type of identified markers as an duplication image.

FIG. 22 is a diagram showing images Pa and images Pb that the overlap determination unit 42 determines to be duplicate images. The image Pa and the image Pb include reinforcing bars to which the markers M1 and M2 of the same type are attached, and the positions of the markers are substantially the same.

FIG. 23 is a flowchart showing a series of procedures for acquiring a plurality of images by the reinforcing bar counting device 40 in the present embodiment and counting the number of reinforcing bars in the plurality of images without duplication.

Steps S121 to S124 and steps S127 in FIG. 23 are the same as steps S1 to S5 in FIG. 5 of the first embodiment.

After the marker is identified in step S124, the marker position detection unit 41 detects the position of the marker in step S125.

In the duplication determination process of step S126, the duplication determination unit 42 determines the duplication image from the image acquired in step S121 by using the type and position of the marker. Hereinafter, a procedure for performing the duplication determination process in step S126 will be described with reference to FIG. 24.

FIG. 24 is a diagram showing an example of the duplication determination process in the present embodiment.

In step S131, an image to be subjected to the duplication determination is selected. Here, a plurality of images acquired by the image acquisition unit 2 are set as images to be determined.

In step S132, the marker position and the marker type are compared for each image.

In step S133, the duplication determination unit 42 determines whether or not there is an image having the same marker type and the marker position within the specified range. If the duplication determination unit 42 is configured to determine only the marker type, in step S133, it is determined whether or not there are images having the same marker type. If the determination in step S133 is NO, the duplication determination process ends.

If the determination in step S133 is YES, in step S134, images having the same marker type and marker positions within the specified range are regarded as duplicate images, and only one of the duplicate images is counted. Then, the duplication determination process is terminated.

By performing the duplication determination process as described above, even if a duplicate image is erroneously acquired by the continuous shooting function of the imaging device 1, it is possible to prevent the counting of the overlapping reinforcing bars.

On the other hand, in the duplication determination process of FIG. 24 by the duplication determination unit 42, for example, the image Pa and the image Pb as shown in FIG. 25 are also determined to be duplicate images. This is because the image Pa and the image Pb have different numbers of reinforcing bars, but the marker positions (positions of the markers M1 and M2 in the image) are within the specified range and the types of the markers are the same.

FIG. 26 is a diagram showing another example of the duplication determination process in the fourth embodiment. By performing the duplication determination process shown in FIG. 26, it is possible to prevent images having different numbers of reinforcing bars without markers as shown in FIG. 25 from being processed as duplicate images.

Steps S141 to S143 of FIG. 26 are the same as steps S131 to S133 of FIG. 25.

If the determination in step S143 is YES, in step S144, the counting unit 7 counts the number of reinforcing bars between the markers in the image as the overlapping image.

In step S145, the duplication determination unit 42 determines whether or not there are images having different numbers of reinforcing bars among the markers among the images that are regarded as duplication images. If the determination in step S145 is YES, the notification unit 31 notifies the user of an error or informs the user of an error because an image having an actually different number of reinforcing bars in the image is erroneously determined as a duplicate image. Notify you to confirm the situation. As a result of counting the number of reinforcing bars in the images made into duplicate images by the counting unit 31 in this way, when the number of reinforcing bars is different between the images made into duplicate images, the notification unit 31 that notifies the user is the first. 4 Also referred to as the notification section.

If the determination in step S145 is NO, in step S146, images having the same marker type and marker positions within the specified range are regarded as duplicate images, and only one of the duplicate images is counted. set to target.

According to the above duplication determination processing, it is possible to prevent an image that is not the duplication image as shown in FIG. 25 from being processed as the duplication image. Therefore, it is possible to more accurately determine the duplicate image.

The above-described embodiments show specific examples in order to facilitate understanding of the invention, and the present invention is not limited to these embodiments. The above-mentioned reinforcing bar counting device, method, and program can be variously modified and modified without departing from the present invention described in the claims.

10, 20, 30, 40 Reinforcing bar counting device 21 CPU
22 DRAM
23 ROM
25 I / O IF
26 Bus 1 Imaging device 2 Image acquisition unit 3 Reinforcing bar detection unit 4 Marker detection unit 5 Instruction unit 6 Marker identification unit 7 Counting unit 8 Display control unit 9 Display medium 15 Storage unit 16 Image data 17 Marker information 18 Reinforcing bar information 31 Notification unit 41 Marker 1 detection unit 42 Duplicate determination unit R, Re1, Re2, B Reinforcing bar M, M1, M2, MN Marker P, P1, P2, P3, Pa, Pb image

Claims (17)

A rebar counting device that counts the number of rebars based on a series of images of multiple rebars.
An image acquisition unit that acquires a plurality of images including two reinforcing bars to which markers are attached, and each of the two images of the plurality of images includes a common marker.
A reinforcing bar detection unit that detects reinforcing bars in each of the plurality of images,
A marker detection unit that detects the marker in each of the plurality of images,
The number of reinforcing bars between the two reinforcing bars to which the marker is attached in each of the plurality of images is counted as the number of reinforcing bars between markers, and the number of reinforcing bars to which the marker is attached in each of the plurality of images is the marker reinforcing bar. A reinforcing bar counting device, characterized in that it has a counting unit that counts the number of marker reinforcing bars so as not to overlap between the plurality of images. The reinforcing bar counting device according to claim 1.
A reinforcing bar counting device having a marker identification unit for identifying the marker. The reinforcing bar counting device according to claim 2.
The counting unit counts the number of reinforcing bars between the two reinforcing bars to which the marker is attached in each of the plurality of images and the number of reinforcing bars to which the marker is attached, and totals the total number of the reinforcing bars. A reinforcing bar counting device for calculating and counting the number of reinforcing bars to which the marker is attached, characterized in that the reinforcing bars to which the already counted marker is attached are not included in the counting target. The rebar counting device according to claim 2 or 3, further comprising.
A reinforcing bar counting device comprising a first notification unit that notifies a user when any of the plurality of images includes an image in which the marker does not exist. The reinforcing bar counting device according to claim 2 or 3.
A reinforcing bar counting device comprising a second notification unit that notifies a user when there is no image including a reinforcing bar to which the same marker is assigned among the plurality of images. The rebar counting device according to any one of claims 2 to 5.
A reinforcing bar counting device characterized in that the image acquired by the image acquisition unit includes a live view image. The rebar counting device according to claim 6, further
A reinforcing bar counting device comprising a third notification unit that notifies the user when the marker in the live view image is at the edge of the image and no other marker is present in the live view image. The rebar counting device according to claim 2 or 3, further comprising.
A reinforcing bar counting device including a duplication determination unit that determines duplicate images in the plurality of images based on the identification result of the marker. The rebar counting device according to claim 8, further
It has a marker position detection unit for detecting the position of the marker in the image, and
The rebar counting device is characterized in that the duplication determination unit determines the duplication image in the plurality of images based on the identification result of the marker and the position of the marker in the image. The rebar counting device according to claim 8 or 9.
The counting unit is a reinforcing bar counting device, characterized in that only the reinforcing bars included in any one of the duplicate images are counted. The rebar counting device according to claim 8 or 9.
The counting unit counts the number of reinforcing bars in the duplicated image, and when the number of the reinforcing bars is the same between the images made as the duplicated image, among the images made as the duplicated image. Only the reinforcing bars included in any one image are counted.
Further having a fourth notification unit that notifies the user when the number of the reinforcing bars differs between the images that are the overlapping images as a result of counting the number of reinforcing bars in the image that is the overlapping image by the counting unit. A rebar counting device characterized by this. The reinforcing bar counting device according to claim 2.
The counting unit specifies the order of the reinforcing bars based on the identification result of the marker, and when the reinforcing bar that is the starting end for counting by the counting unit is the first, the number of the reinforcing bars to which the marker is attached is. Calculate if it is located in
Further, the reinforcing bar counting device is characterized by having a display unit that displays information on the calculated reinforcing bar numbers. A rebar counting device that counts the number of multiple rebars.
An image acquisition unit that acquires two images including reinforcing bars with a common marker,
A reinforcing bar detection unit that detects reinforcing bars from the above two images,
A marker detection unit that detects the marker from the two images,
In the first image of the two images, the number of the reinforcing bars included in the first image from the reinforcing bar at the edge of the screen to the reinforcing bar to which the marker is attached is counted, and the two images are described. In the second image of the above, in the reinforcing bars included in the second image, the number of reinforcing bars from the reinforcing bar to which the marker is attached to the reinforcing bar at the edge of the screen is counted, and the first image and the first image are counted. A reinforcing bar counting device comprising a counting unit that counts a number obtained by subtracting 1 from the total number counted in the image of 2 as the number of reinforcing bars. It is a reinforcing bar counting method that counts the number of reinforcing bars based on a series of images in which a plurality of reinforcing bars are taken.
It is a plurality of images including two reinforcing bars to which markers are attached, and a plurality of images including a common marker are acquired between the two images of the plurality of images, and the reinforcing bars are detected in each of the plurality of images.
The marker is detected in each of the plurality of images,
The number of reinforcing bars between the two reinforcing bars to which the marker is attached in each of the plurality of images is counted as the number of reinforcing bars between markers, and the number of reinforcing bars to which the marker is attached in each of the plurality of images is the marker reinforcing bar. A counting method, characterized in that the number of marker reinforcing bars is counted so as not to overlap between the plurality of images. It is a counting method that counts the number of multiple reinforcing bars.
Get two images containing rebar with a common marker,
Reinforcing bars are detected from the above two images,
The marker is detected from the two images,
In the first image of the two images, the number of the reinforcing bars included in the first image from the reinforcing bar at the edge of the screen to the reinforcing bar to which the marker is attached is counted, and the two images are described. In the second image of the above, in the reinforcing bars included in the second image, the number of reinforcing bars from the reinforcing bars to which the marker is attached to the reinforcing bars at the edge of the screen is counted, and the first image and the first image are counted. A counting method characterized in that the number obtained by subtracting 1 from the total number counted in the image of 2 is counted as the number of reinforcing bars. A program that causes a computer to execute a process of counting the number of reinforcing bars based on a series of images of multiple reinforcing bars.
It is a plurality of images including two reinforcing bars to which a marker is attached, and a plurality of images including a common marker are acquired between the two images of the plurality of images.
Reinforcing bars are detected in each of the plurality of images,
The marker is detected in each of the plurality of images,
The number of reinforcing bars between the two reinforcing bars to which the marker is attached in each of the plurality of images is counted as the number of reinforcing bars between markers, and the number of reinforcing bars to which the marker is attached in each of the plurality of images is the marker reinforcing bar. A program characterized by causing the computer to execute a process of counting the number of marker reinforcing bars so as not to overlap between the plurality of images. A program that causes a computer to execute the process of counting the number of multiple reinforcing bars.
Get two images containing rebar with a common marker,
Reinforcing bars are detected from the above two images,
The marker is detected from the two images,
In the first image of the two images, the number of the reinforcing bars included in the first image from the reinforcing bar at the edge of the screen to the reinforcing bar to which the marker is attached is counted, and the two images are described. In the second image of the above, in the reinforcing bars included in the second image, the number of reinforcing bars from the reinforcing bars to which the marker is attached to the reinforcing bars at the edge of the screen is counted, and the first image and the first image are counted. A program characterized in that the computer executes a process of counting as the number of reinforcing bars by subtracting 1 from the total number counted in 2 images.