JP6758237B2 - Information processing equipment, information processing methods, and programs - Google Patents

Description

The present invention relates to an information processing device, an information processing method, and a program for recording information for measuring the arranged reinforcing bars.

Conventionally, in the construction of reinforced concrete buildings and the like, a bar arrangement inspection is performed to check whether the reinforcing bars are correctly arranged based on a bar arrangement diagram or the like. In such a bar arrangement inspection, the introduction of a system that supports the bar arrangement inspection (hereinafter referred to as "bar arrangement inspection support system") is being considered from the viewpoint of improving the efficiency of the inspection and reducing the burden on the inspector.

As an example of the bar arrangement inspection support system, the part where the reinforcing bar to be inspected and the background bar overlap is extracted from the image taken with the background bar provided with markers at both ends in the longitudinal direction installed behind the reinforcing bar to be inspected. A bar arrangement inspection support system that calculates the number of reinforcing bars to be inspected from the extracted portion is known (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2016-003981

The above system captures the rebar so that the markers at both ends of the background bar are imaged. If the entire reinforcing bar to be inspected does not fit between the markers, the background bar will be installed and the reinforcing bar will be photographed over and over again. Therefore, the user is asked to place the background bar little by little. Work to move will be required. This work imposes an extremely heavy burden on the user, especially in an environment where it is difficult to install the background bar behind the reinforcing bars.

Based on the above circumstances, an object of one aspect of the present invention is to provide a technique for recording information for measuring reinforcing bars while reducing the burden on the user.

The information processing apparatus according to one aspect of the present invention includes an acquisition unit that acquires a plurality of images of the reinforcing bar group taken while moving the photographing area so as to intersect the arranged reinforcing bar group, and the acquisition unit. A detection unit that detects a tracking target from a first peripheral portion that is a peripheral portion of the image acquired by the unit and is a peripheral portion in the movement direction in which the reinforcing bar group moves in the image, and the detection unit is the first. 1 When the tracking target is detected from the peripheral portion, the detection image which is the image in which the tracking target is detected, the captured image which is the image of the reinforcing bar group newly taken after the detection of the tracking target, or the detection image. Alternatively, recording control in which the substitute information generated based on the captured image is recorded in the recording device in association with the identification information that identifies the reinforcing bars constituting the reinforcing bar group and existing within a predetermined range from the tracking target. It has a part.

In the information processing method according to one aspect of the present invention, a plurality of images of the reinforcing bar group taken while moving the photographing area so as to intersect the arranged reinforcing bar group are acquired in the shooting order, and the periphery of the acquired image is acquired. When the tracking target is detected from the first peripheral portion, which is a peripheral portion in the moving direction, which is the portion in the image in which the reinforcing bar group moves, and the tracking target is detected from the first peripheral portion, A detection image that is an image in which the tracking target is detected, a captured image that is an image of the reinforcing bar group newly captured after the detection of the tracking target, or a captured image or substitute information generated based on the detected image or the captured image. , Reinforcing bars constituting the reinforcing bar group and existing within a predetermined range from the tracking target are recorded in a recording device in association with identification information.

In the program according to one aspect of the present invention, a computer acquires a plurality of images of the reinforcing bar group taken while moving the photographing area so as to intersect the arranged reinforcing bar group, and the acquired images are obtained. When the tracking target is detected from the first peripheral portion, which is the peripheral portion and is the peripheral portion in the moving direction in which the reinforcing bar group moves in the image, and the tracking target is detected from the first peripheral portion. , The detected image which is the image in which the tracking target is detected, or the captured image which is the image of the reinforcing bar group newly captured after the detection of the tracking target, or the detected image or the substitute information generated based on the captured image. Is associated with the identification information that identifies the reinforcing bars constituting the reinforcing bar group and existing within a predetermined range from the tracking target, and is recorded in the recording device.

According to the above aspect, it is possible to record information for measuring the reinforcing bar while reducing the burden on the user.

It is a figure which illustrated the structure of the bar arrangement inspection support system 1. It is a figure for demonstrating the photographing method of the subject Rs. It is a figure for demonstrating the moving direction of a subject in an image. It is a figure which illustrated the hardware configuration of the information processing apparatus 100. It is a figure which illustrated the functional structure of the information processing apparatus 100. It is a figure which illustrated the functional structure of the detection part 120. It is a flowchart which shows an example of information processing. It is a flowchart which shows an example of the detection process. It is a figure for demonstrating the detection process shown in FIG. It is a flowchart which shows an example of a record control process. It is a figure which illustrated the functional structure of the detection part 220. It is a flowchart which shows another example of the detection process. It is a figure for demonstrating the detection process shown in FIG. It is a figure which illustrated the functional structure of the information processing apparatus 300. It is a flowchart which shows still another example of a detection process. It is a figure which illustrated the functional structure of the detection unit 420. It is a flowchart which shows still another example of a detection process. It is a figure which illustrated the functional structure of the information processing apparatus 500. It is a figure which illustrated the structure of the bar arrangement inspection support system 2. It is a figure which illustrated the functional structure of the information processing apparatus 600. It is a figure which illustrated the structure of the bar arrangement inspection support system 3. It is a figure which illustrated the functional structure of the information processing apparatus 800.

[First Embodiment]
FIG. 1 is a diagram illustrating the configuration of the bar arrangement inspection support system 1. FIG. 2 is a diagram for explaining a method of photographing the subject Rs. FIG. 3 is a diagram for explaining the moving direction of the subject in the image. FIG. 4 is a diagram illustrating the hardware configuration of the information processing device 100.

The bar arrangement inspection support system 1 is a system for inspecting a group of reinforcing bars arranged as subjects Rs, and for example, inspecting the arrangement of reinforcing bars and the number of reinforcing bars. The bar arrangement inspection support system 1 includes a digital camera 10 and an information processing device 100.

In FIG. 1, the digital camera 10 and the information processing device 100 are connected by a wired cable. The digital camera 10 and the information processing device 100 may be configured so as to be able to exchange data with each other, and may be connected not only by wire but also by wireless communication. Further, the digital camera 10 and the information processing device 100 may exchange data via a portable recording medium such as a USB (Universal Serial Bus) memory.

The digital camera 10 is a photographing device for photographing the subject Rs. The digital camera 10 is a digital video camera having a moving image shooting function, and it is desirable that the digital camera 10 has a still image shooting function in addition to the moving picture shooting function. That is, it is desirable that the digital camera 10 is at least a digital video camera and further a digital still camera.

As shown in FIG. 2, the digital camera 10 shoots a moving image of the subject Rs while moving the shooting area SA so as to intersect the reinforcing bar group to be inspected, which is the subject Rs, and outputs a moving image to the information processing device 100. To do. The digital camera 10 itself may not be moved, but the shooting area SA may be moved by changing the orientation. As shown in FIG. 3, the direction in which the photographing region SA moves (hereinafter referred to as the first direction) and the direction in which the subject moves in the image (hereinafter referred to as the second direction) are opposite to each other. .. In the following, the second direction in which the subject moves in the image will be simply referred to as the moving direction or the moving direction of the image.

The information processing device 100 is a recording control device that records information used for reinforcing bar measurement in a bar arrangement inspection (hereinafter, referred to as reinforcing bar measurement information) in a recording device by processing a moving image. The information recording device 100 is, for example, a standard computer, and as shown in FIG. 4, the portable recording medium into which the processor 101, the memory 102, the storage 103, the interface device 104, and the portable recording medium 106 are inserted is inserted. A drive device 105 is provided, which are connected to each other by a bus 107.

The processor 101 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a DSP (Digital Signal Processor), or the like, and executes a program to perform programmed processing.

The memory 102 is, for example, a RAM (Random Access Memory). The memory 102 temporarily stores the program or data stored in the storage 103 or the portable recording medium 106 when the program is executed. The storage 103 is an example of the recording device described above, and is, for example, a hard disk or a flash memory. The storage 103 is used for storing various data including information for measuring reinforcing bars, programs, and the like.

The interface device 104 is a circuit that exchanges data with a device other than the information processing device 100 (for example, a digital camera 10). The portable recording medium driving device 105 accommodates a portable recording medium 106 such as an optical disk or a compact flash (registered trademark). The portable recording medium 106 has a role of assisting the storage 103. The storage 103 and the portable recording medium 106 are examples of non-transient computer-readable storage media that store programs, respectively.

The configuration shown in FIG. 4 is an example of the hardware configuration of the information processing device 100, and the information processing device 100 is not limited to this configuration. The information processing device 100 may be a dedicated device instead of a general-purpose device. The information processing apparatus 100 may include an electric circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) in place of or in addition to the processor that executes the program, and the electric circuit thereof will be described later. Processing may be performed.

In the bar arrangement inspection support system 1, the information processing device 100 processes the moving image output from the digital camera 10 to record the reinforcing bar measurement information in the recording device. Hereinafter, information processing for recording information for reinforcing bar measurement performed by the information processing apparatus 100 will be described.

FIG. 5 is a diagram illustrating the functional configuration of the information processing device 100. FIG. 6 is a diagram illustrating the functional configuration of the detection unit 120. The functional configuration of the information processing apparatus 100 related to information processing will be described with reference to FIGS. 5 and 6.

As shown in FIG. 5, the information processing apparatus 100 includes an acquisition unit 110, a detection unit 120, a recording control unit 130, a recording unit 140, and a reinforcing bar measurement unit 150.

The acquisition unit 110 acquires a plurality of images of the rebar group photographed while moving the photographing area in the first direction so as to intersect the rebar group arranged in the rebar arrangement. More specifically, the acquisition unit 110 acquires a plurality of still images in the order of shooting by repeating the process of cutting out a still image from the moving image output from the digital camera 10. Further, the acquisition unit 110 outputs the acquired still images to the detection unit 120 in the order of shooting.

The acquisition unit 110 may cut out a still image for each frame of a moving image, or may selectively cut out a still image at an arbitrary frame. In the case of selective cutting, the cutting timing may be determined so that at least a part of the shooting area overlaps between the still image cut out first and the still image cut out next. Hereinafter, the still image cut out from the moving image will be referred to as a frame image. In addition, a still image taken by the still image shooting function is described as a shot image to distinguish it from a frame image.

The detection unit 120 detects the tracking target from the peripheral portion of the frame image acquired by the acquisition unit 110, and outputs the detection result to the recording control unit 130. More specifically, the detection unit 120 detects the tracking target from a peripheral portion (hereinafter, referred to as a first peripheral portion) in a moving direction opposite to the first direction.

As shown in FIG. 6, the detection unit 120 includes a setting unit 121, a target detection unit 122, a peripheral determination unit 123, and an identification information generation unit 124.

The setting unit 121 sets the tracking target. The tracking target is not particularly limited to this, but is a reinforcing bar included in the reinforcing bar group. The setting unit 121 may set any of the reinforcing bars included in the reinforcing bar group as the tracking target.

When the user instructs the tracking target, the setting unit 121 may set the tracking target according to the instruction of the user. Further, when the user specifies the frame image, the setting unit 121 may analyze the designated frame image and set the tracking target based on the analysis result. Further, the setting unit 121 may set the tracking target without any instruction from the user. The setting unit 121 may set the tracking target based on the result of analyzing the frame image first input to the detection unit 120, for example.

The target detection unit 122 detects the tracking target from the frame image acquired by the acquisition unit 110. Specifically, the target detection unit 122 detects the tracking target from the frame image input after that by using the information of the tracking target detected in the previously input frame image. That is, the tracking target is detected by tracking the tracking target using a tracking algorithm. Hereinafter, the frame image in which the tracking target is detected by the target detection unit 122 will be referred to as a detection image.

The target detection unit 122 may apply any tracking algorithm. For example, a template matching method for an area, an update template matching method, an active search method, a Mean-shift method, a Particle Filter method, or the like may be used. In addition, a TLD (Tracking-Learning-Detection) method may be used in which a tracking target is robustly tracked by learning in a region. In addition, when the tracking target is a reinforcing bar, the target area becomes elongated, so feature points such as the KLT method, which is a feature point-based tracking method, SIFT (Scale-Invariant Feature Transform), and SURF (Speeded Up Robust Feature). Techniques for tracking are also useful.

The peripheral determination unit 123 determines whether or not the position of the tracking target detected by the target detection unit 122 in the detected image belongs to the first peripheral portion. Then, when it is determined that it belongs to the first peripheral portion, the peripheral determination unit 123 outputs a detection result indicating that the tracking target has been detected from the first peripheral portion to the recording control unit 130.

The first peripheral portion is a portion where an object that will be located outside the photographing area at a relatively early stage due to the movement of the photographing area is photographed. More specifically, as described above, the first peripheral portion is a peripheral portion in the moving direction of the image.

When the peripheral determination unit 123 determines that the position in the detection image of the tracking target belongs to the first peripheral portion, the identification information generation unit 124 generates identification information based on the detected image. The identification information is information for identifying the reinforcing bars that constitute the reinforcing bar group that is the subject Rs and that exists within a predetermined range from the tracking target. Specifically, the identification information is, for example, coordinate information indicating a position in a detection image of a reinforcing bar identified by the identification information (hereinafter referred to as an identification target reinforcing bar), posture information of the identification target reinforcing bar, or an identification target. Includes information such as the rotation of reinforcing bars.

When the tracking target is a reinforcing bar, the identification target reinforcing bar may be the same as the tracking target reinforcing bar (hereinafter referred to as the tracking target reinforcing bar). Further, the predetermined range means a range not far from the tracking target, and is, for example, a range within a distance several times the pitch of the reinforcing bars arranged from the tracking target.

When the detection unit 120 detects the tracking target from the first peripheral unit, the recording control unit 130 records the detected image or the substitute information generated based on the detected image in the recording unit 140 in association with the identification information. The above-mentioned reinforcing bar measurement information is information recorded by the recording control unit 130 in association with the recording unit 140, and in the present embodiment, it is a detection image or substitute information and identification information recorded in association with each other.

Further, the substitute information is information that can be used instead of the detected image when measuring the reinforcing bar. The substitute information is information that can count the number of reinforcing bars if the number of reinforcing bars is counted at the time of measuring the reinforcing bars. For example, even if the line drawing shows the portion of the reinforcing bars included in the detected image as a line. Often, it may be coordinate information indicating the position of the reinforcing bar included in the detected image. When the substitute information is recorded in the recording unit 140, the recording control unit 130 generates the substitute information based on the detected image.

The recording unit 140 is the recording device described above, and is, for example, the storage 103 shown in FIG. Although FIG. 5 shows an example in which the recording unit 140 is built in the information recording device 100, the recording unit 140 may be an external device connected to the information recording device 100. Further, the recording unit 140 may be a file server, a database server, or the like that is installed at a location different from the information recording device 100 and can communicate via a communication network.

The reinforcing bar measurement unit 150 performs the reinforcing bar measurement process based on the reinforcing bar measurement information recorded in association with the recording unit 140. The reinforcing bar measurement process includes, for example, a process of counting the number of reinforcing bars, a process of measuring the diameter of the reinforcing bars, a process of measuring the pitch of the arranged reinforcing bars, and the like. The reinforcing bar measuring unit 150 may further perform an inspection process of comparing the measurement result (including the counting result) with the design information and inspecting whether or not the reinforcing bars are arranged according to the design information. The reinforcing bar measuring unit 150 may be provided in a device different from the information recording device 100.

FIG. 7 is a flowchart showing an example of information processing. FIG. 8 is a flowchart showing an example of the detection process. FIG. 9 is a diagram for explaining the detection process shown in FIG. FIG. 10 is a flowchart showing an example of recording control processing. Information processing will be specifically described with reference to FIGS. 7 to 10.

In the information recording device 100, when the moving image of the rebar group arranged is input, the processor 101 starts the information processing shown in FIG. 7.

First, the processor 101 performs an image acquisition process (step S100). In the image acquisition process, the processor 101 cuts out a frame image from the moving image. The cut out frame image is temporarily stored in, for example, the memory 102.

When the image acquisition process is completed, the processor 101 performs a detection process (step S200) and a recording control process (step S300). The detection process and the record control process will be described later.

When the recording control process is completed, the processor 101 performs the end determination process (step S400). In the end determination process, the processor 101 determines whether or not the preset end conditions are satisfied. If it is determined that the end condition is not satisfied, the processor 101 repeats the processes of steps S100 to S400. Then, if it is determined that the end condition is satisfied, the processor 101 ends the information processing shown in FIG. 7.

The termination conditions are not particularly limited, but typical termination conditions will be described below. When the processor 101 detects a marker indicating the end from the frame image acquired in the image acquisition process, it may determine that the end condition is satisfied. Further, the processor 101 may determine that the termination condition is satisfied when the user inputs the termination instruction to the information recording device 100. Further, the processor 101 may detect the posture of the digital camera 10 and determine that the termination condition is satisfied when the information recording device 100 is in a predetermined posture (for example, a posture facing downward).

In the information recording device 100, when the image acquisition process is completed, the processor 101 starts the detection process shown in FIG.

First, the processor 101 determines whether or not the tracking target has been set (step S201), and if not, sets the tracking target (step S202). After that, the processor 101 detects the tracking target from the frame image (step S203), and determines whether or not the position of the detected tracking target belongs to the first peripheral portion of the frame image (step S204). If the position to be tracked does not belong to the first peripheral portion, the processor 101 ends the detection process. On the other hand, when the position of the tracking target belongs to the first peripheral portion, the processor 101 generates identification information based on the frame image (step S205), and then ends the detection process.

In the information recording device 100, the detection process shown in FIG. 8 is repeatedly performed for each frame image. As a result, as shown in FIG. 9, the tracking target T1 is set on, for example, the reinforcing bar R1 based on the initially input image P1. Further, an image P2 in which the tracking target T1 is located in the first peripheral portion is specified from the images input thereafter, and identification information is generated based on the image P2.

In the information recording device 100, when the detection process is completed, the processor 101 starts the recording control process shown in FIG.

First, the processor 101 determines whether or not the tracking target is detected from the first peripheral portion in the detection process of step S200 (step S301). If the tracking target is not detected from the first peripheral portion, the processor 101 ends the recording control process. On the other hand, when the tracking target is detected from the first peripheral portion, the processor 101 associates the frame image (detection image) or the substitute information for the frame image with the identification information generated in step S205, and stores 103. (Step S302), and then the recording control process is terminated.

According to the information recording device 100 according to the present embodiment, it is possible to generate and record the reinforcing bar measurement information from the moving image of the reinforcing bar group taken without attaching a marker to the subject. Therefore, it is possible to record the reinforcing bar measurement information while reducing the burden on the user.

[Second Embodiment]
The hardware configuration of the information recording device according to the present embodiment is the same as the hardware configuration of the information recording device 100. The functional configuration of the information recording device according to the present embodiment is different from the functional configuration of the information recording device 100 in that the detection unit 220 is provided instead of the detection unit 120, and other functional configurations are the same.

FIG. 11 is a diagram illustrating the functional configuration of the detection unit 220. Similar to the detection unit 120 according to the first embodiment, the detection unit 220 detects the tracking target from the first peripheral portion of the frame image acquired by the acquisition unit 110 and outputs the detection result to the recording control unit 130. Is.

As shown in FIG. 11, the detection unit 220 is different from the detection unit 120 in that the setting unit 221 is provided instead of the setting unit 121 and the peripheral determination unit 223 is provided instead of the peripheral determination unit 123.

The setting unit 221 is the same as the setting unit 121 in that the tracking target is set. The setting unit 221 is different from the setting unit 121 in that when the detection unit 220 detects the tracking target from the first peripheral portion, the tracking target is updated based on the detected image.

When the detection unit 220 detects the tracking target from the first peripheral portion, the setting unit 221 tracks the tracking target based on the peripheral portion (hereinafter referred to as the second peripheral portion) in the direction opposite to the moving direction of the detected image. To update. Specifically, the setting unit 221 may update the tracking target by setting, for example, any of the reinforcing bars located in the second peripheral portion of the detected image as the tracking target.

The peripheral determination unit 223 is different from the peripheral determination unit 123 in that it notifies the setting unit 221 of the timing for updating the tracking target. Other points are the same as those of the peripheral determination unit 123.

FIG. 12 is a flowchart showing an example of the detection process according to the present embodiment. FIG. 13 is a diagram for explaining the detection process shown in FIG.

In the information recording device according to the present embodiment, when the image acquisition process is completed, the processor 101 starts the detection process shown in FIG. The processing of steps S501 to S505 is the same as the processing of steps S201 to S205 of FIG.

When the processor 101 determines that the detected position of the tracking target belongs to the first peripheral portion of the frame image (step S504YES) and generates identification information based on the frame image (step S505), the processor 101 updates the detection target. (Step S506), after that, the detection process is terminated. In addition, the processing of step S505 and step S506 may be performed first, or may be performed in parallel in time.

In the information recording device according to the present embodiment, as shown in FIG. 13, when an image (image P2, image P3) whose tracking target is located in the first peripheral portion is specified, identification information is generated based on the image. At the same time as being generated, new tracking targets (tracking target T2, tracking target T3) are set, and the tracking target is updated. As a result, the tracking process can be continued semi-permanently while updating the tracking target.

Similar to the information recording device 100, the information recording device according to the present embodiment can also generate and record reinforcing bar measurement information from a moving image of a reinforcing bar group taken without attaching a marker to the subject.

Further, according to the information recording device according to the present embodiment, it is possible to generate the reinforcing bar measurement information for each tracking target by updating the tracking target, and it is possible to obtain more reinforcing bar measurement information. it can. Further, when the tracking target is detected from the first peripheral portion of the detected image, the object included in the detected image is set as a new detection target, so that the photographing area of the reinforcing bar measurement information generated for each tracking target can be obtained. Some can be duplicated. As a result, it is possible to record the reinforcing bar measurement information of the entire reinforcing bar group arranged without omission. In particular, by setting the object in the second peripheral portion as a new detection target, it is possible to reduce the overlap of the imaging areas, so that the information for measuring the reinforcing bars of the entire reinforcing bar group arranged can be efficiently recorded. Can be done.

Therefore, the information recording device according to the present embodiment can also record the reinforcing bar measurement information while reducing the burden on the user.

[Third Embodiment]
The information recording device 300 according to the present embodiment is a recording control device that records information for reinforcing bar measurement in the recording device by processing a moving image, and the point is the same as that of the information recording device 100. The information processing device 300 has the same hardware configuration as the information recording device 100, but differs from the information recording device 100 in the functional configuration.

FIG. 14 is a diagram illustrating the functional configuration of the information processing device 300. The information processing device 300 includes a detection unit 320 instead of the detection unit 120, a recording control unit 330 instead of the recording control unit 130, and a reinforcing bar measuring unit 350 instead of the reinforcing bar measuring unit 150. It is different from the information recording device 100.

Similar to the detection unit 120, the detection unit 320 outputs the detection result to the recording control unit 330 when the tracking target is detected from the first peripheral unit. The detection unit 320 is different from the detection unit 120 in that when the tracking target is detected from the first peripheral portion, the detection unit 320 outputs a shooting instruction instructing the digital camera 10 to shoot a captured image. The digital camera 10 captures a captured image of the reinforcing bar group according to the imaging instruction output from the detection unit 320, and outputs the captured image to the information processing device 300 (acquisition unit 110).

When the detection unit 320 detects the tracking target from the first peripheral portion, the recording control unit 330 is based on a captured image or a captured image which is a still image of the reinforcing bar group newly captured after the detection instead of the detected image. The substitute information generated is recorded in the recording unit 140 in association with the identification information, which is different from the recording control unit 130.

The reinforcing bar measuring unit 350 is the same as the reinforcing bar measuring unit 150 in that the reinforcing bar measuring unit 350 performs the reinforcing bar measuring process based on the reinforcing bar measuring information recorded in association with the recording unit 140. The reinforcing bar measuring unit 350 is different from the reinforcing bar measuring unit 150 in that the reinforcing bar measuring information includes a captured image or substitute information and identification information generated based on the captured image.

FIG. 15 is a flowchart showing an example of the detection process according to the present embodiment. In the information recording device according to the present embodiment, when the image acquisition process is completed, the processor 101 starts the detection process shown in FIG. The processing of steps S601 to S604 is the same as the processing of steps S201 to S204 of FIG.

When the processor 101 determines that the detected position of the tracking target belongs to the first peripheral portion of the frame image (step S604YES), the processor 101 instructs the digital camera 10 to shoot the captured image (step S605). Then, a captured image which is a still image of the reinforcing bar group newly captured by the digital camera 10 is acquired (step S606). Further, the processor 101 generates identification information based on the captured image acquired in step S606 (step S607), updates the detection target (step S608), and then ends the detection process. It should be noted that either of the series of processes from step S605 to step S607 and the process of step S608 may be performed first, or may be performed in parallel in time.

Similar to the information recording devices according to the first and second embodiments, the information recording device according to the present embodiment also obtains information for measuring the reinforcing bars from the moving images of the reinforcing bars taken without attaching a marker to the subject. It can be generated and recorded. Further, similarly to the information recording device according to the second embodiment, it is possible to obtain more rebar measurement information and record the rebar measurement information of the entire rebar group arranged without omission. Therefore, it is possible to record the reinforcing bar measurement information while reducing the burden on the user.

Further, according to the information recording device according to the present embodiment, when the tracking target is detected from the first peripheral portion, the digital camera 10 is instructed to shoot the captured image, so that the reinforcing bar using the captured image which is a still image is used. Measurement information can be recorded. The captured image captured by using the still image capturing function is generally a high-definition image as compared with the frame image (detected image) cut out from the moving image, and does not include the rolling shutter distortion that occurs in the moving image. Unlike the detection process in which it is sufficient to know at which position in the two-dimensional plane the tracking target exists, in the reinforcing bar measurement process, the adverse effect of strain is relatively large. Therefore, by recording the reinforcing bar measurement information using the captured image, it is possible to contribute to the improvement of the accuracy of the reinforcing bar measurement as compared with the case where the reinforcing bar measurement information using the detected image is recorded.

[Fourth Embodiment]
The hardware configuration of the information recording device according to the present embodiment is the same as the hardware configuration of the information recording device 100. The functional configuration of the information recording device according to the present embodiment is different from the functional configuration of the information recording device 100 in that the detection unit 420 is provided instead of the detection unit 120, and other functional configurations are the same.

FIG. 16 is a diagram illustrating the functional configuration of the detection unit 420. The detection unit 420 is similar to the detection unit 120 in that the detection unit 420 detects the tracking target from the first peripheral portion of the frame image acquired by the acquisition unit 110.

As shown in FIG. 15, the detection unit 420 includes a setting unit 221 instead of the setting unit 121, a peripheral determination unit 223 instead of the peripheral determination unit 123, and a recording condition determination unit 421. It differs from the detection unit 120 in that the identification information generation unit 422 is provided instead of the information generation unit 124.

Further, comparing the detection unit 420 and the detection unit 220, the detection unit 420 includes the recording condition determination unit 421 and the identification information generation unit 422 instead of the identification information generation unit 124. Is different.

The recording condition determination unit 421 determines whether or not the recording condition, which is a condition for the length of the reinforcing bar included in the detected image, is satisfied.

The recording condition may be, for example, a condition that the length of the reinforcing bar included in the first peripheral portion of the detected image is a predetermined length or more. Here, the predetermined length is a length short enough to be judged as a reinforcing bar not to be measured. In a group of reinforcing bars arranged, usually, reinforcing bars of approximately a certain length are continuously arranged. Considering this point, when a reinforcing bar that does not satisfy the condition is detected in the first peripheral portion, the reinforcing bar that does not satisfy the condition is similarly lined up thereafter (that is, from the first peripheral portion to the first direction side). It is assumed that it is. Therefore, by setting the condition regarding the length of the reinforcing bar included in the first peripheral portion as the recording condition, it is possible to avoid recording unnecessary information as the reinforcing bar measurement information.

Further, the recording condition is also a condition that at least one of the length of the reinforcing bar included in the first peripheral portion of the detected image and the length of the reinforcing bar included in the second peripheral portion of the detected image is a predetermined length or more. Good. In rare cases, the rebars arranged are partially short rebars. By setting the conditions for both the length of the reinforcing bar included in the first peripheral portion and the length of the reinforcing bar included in the second peripheral portion as recording conditions, it is possible to avoid the erroneous judgment that the above rare cases may occur in the case. can do.

Further, the recording condition is that, for example, the ratio of the reinforcing bars having a predetermined length or more among the reinforcing bars existing between the reinforcing bars to be tracked before the update and the reinforcing bars to be tracked after the update is a predetermined ratio or more. It may be a condition. By setting such recording conditions, it is possible to more reliably avoid the erroneous determination that the above-mentioned rare cases may occur in the case.

The identification information generation unit 422 generates identification information when the recording condition determination unit 421 determines that the recording condition is satisfied.

In the information recording device according to the present embodiment, when the detection unit 420 detects the tracking target from the first peripheral unit and the recording condition determination unit 421 determines that the recording condition is satisfied, the recording control unit 130 determines. , The detected image or the substitute information is recorded in the recording device in association with the identification information.

FIG. 17 is a flowchart showing an example of the detection process according to the present embodiment. In the information recording device according to the present embodiment, when the image acquisition process is completed, the processor 101 starts the detection process shown in FIG. The processing of steps S701 to S704 is the same as the processing of steps S201 to S204 of FIG.

When the processor 101 determines that the detected position of the tracking target belongs to the first peripheral portion of the frame image (step S704YES), the processor 101 updates the detection target (step S705) and analyzes the frame image (detection image). (Step S706), and it is determined whether or not the recording conditions are satisfied (step S707). If the recording condition is not satisfied, the processor 101 ends the detection process. On the other hand, when the recording condition is satisfied, the processor 101 generates identification information based on the detected image (step S708), and then ends the detection process. The process of step S705 and the series of processes from step S706 to step S708 may be performed first, or may be performed in parallel in time.

Similar to the information recording devices according to the first to third embodiments, the information recording device according to the present embodiment also obtains information for reinforcing bar measurement from a moving image of a reinforcing bar group taken without attaching a marker to the subject. It can be generated and recorded. Further, similarly to the information recording device according to the second embodiment, it is possible to obtain more rebar measurement information and record the rebar measurement information of the entire rebar group arranged without omission. Therefore, it is possible to record the reinforcing bar measurement information while reducing the burden on the user.

Further, according to the information recording device according to the present embodiment, when the recording condition is not satisfied, the information for measuring the reinforcing bar is recorded even if the tracking target is detected from the first peripheral portion. Only update the tracking target without doing so. As a result, it is possible to avoid recording unnecessary information as reinforcing bar measurement information.

[Fifth Embodiment]
The information processing device 500 according to the present embodiment has the same hardware configuration as the information recording device 100, but differs from the information recording device 100 in the functional configuration.

FIG. 18 is a diagram illustrating the functional configuration of the information processing device 500. The information processing device 500 is different from the information recording device 100 in that it includes a second recording unit 510 that records moving images. Although the second recording unit 510 is described as a functional component different from the recording unit 140 in FIG. 18, it may be the same hardware as the recording unit 140 (for example, the storage 103).

For example, the user can record a moving image of a group of reinforcing bars taken by a digital camera 10 at the site via a portable recording medium in a second record of an information processing device 500 installed at a location different from the site such as an office. Copy to part 510. As a result, the information processing device 500 can appropriately read the moving image from the second recording unit 510, and thus can operate in the same manner as the information recording device 100.

Therefore, the information processing device 500 according to the present embodiment can also obtain the same effect as the information recording device 100. The information processing device 500 may be brought to the same site as the digital camera 10 for use. Even in this case, by recording the moving image in the second recording unit 510, there is an advantage that the information processing for recording the reinforcing bar measurement information can be performed without being limited by the shooting timing of the moving image.
[Sixth Embodiment]

FIG. 19 is a diagram illustrating the configuration of the bar arrangement inspection support system 2 according to the present embodiment. FIG. 20 is a diagram illustrating the functional configuration of the information processing device 600 included in the bar arrangement inspection support system 2.

As shown in FIG. 19, the bar arrangement inspection support system 2 includes a digital camera 10, an information processing device 600, and a reinforcing bar inspection device 700. Both the information processing device 600 and the reinforcing bar inspection device 700 are, for example, standard computers. The digital camera 10 and the information processing device 600 are used in the same location as the subject Rs (that is, in the field), whereas the reinforcing bar inspection device 700 is installed in a location different from the subject Rs (for example, an office or a data center). Has been done.

As shown in FIG. 20, the information processing device 600 is different from the information recording device 100 according to the first embodiment in that it does not include the reinforcing bar measuring unit 150. Other points are the same as those of the information recording device 100. On the other hand, the reinforcing bar inspection device 700 has a function corresponding to the reinforcing bar measuring unit 150.

In the bar arrangement inspection support system 2 according to the present embodiment, the above-mentioned information processing for recording the rebar measurement information is performed on-site by using the information processing device 600, and the rebar measurement process is performed by the rebar inspection device 700.

The bar arrangement inspection support system 2 according to the present embodiment can also obtain the same effect as the bar arrangement inspection support system 1. Further, in the bar arrangement inspection support system 2, the information processing device 600 is relatively low because the reinforcing bar measurement process, which is a process that places a relatively heavy burden on the computer, can be performed by a device different from the information processing device 600. It can be configured with a computer with specifications.

[7th Embodiment]
FIG. 21 is a diagram illustrating the configuration of the bar arrangement inspection support system 3 according to the present embodiment. FIG. 22 is a diagram illustrating the functional configuration of the information processing device 800 included in the bar arrangement inspection support system 3.

As shown in FIG. 21, the bar arrangement inspection support system 3 includes an information processing device 800. The information processing device 800 is, for example, a tablet-type computer, and has the functions of both the digital camera 10 and the information recording device 100 of the bar arrangement inspection support system 1 according to the first embodiment.

As shown in FIG. 22, the information processing device 800 is different from the information recording device 100 in that it includes a photographing unit 810. Other points are the same as those of the information recording device 100.

The bar arrangement inspection support system 3 according to the present embodiment can also obtain the same effect as the bar arrangement inspection support system 1. Further, since the bar arrangement inspection support system 3 has a digital camera incorporated in the information processing device 800, the bar arrangement inspection support system 3 is superior in portability as compared with the bar arrangement inspection support system 1. Therefore, it is suitable for use in an outdoor environment such as a construction site.

The above-described embodiments show specific examples for facilitating the understanding of the invention, and the embodiments of the present invention are not limited thereto. The information processing apparatus, information processing method, and program can be variously modified and changed without departing from the description of the claims.

For example, in the above-described embodiment, the tracking target is detected based on the frame image cut out from the moving image, but the image used for tracking is not limited to the moving image. For example, it may be a plurality of still images (photographed images) continuously photographed while moving the photographing area.

Further, in the above-described embodiment, an example of recording the reinforcing bar measurement information when the tracking target is detected from the first peripheral portion is shown, but for example, at the start of tracking (that is, when the tracking target is set first). ) And at the end of tracking (that is, when the end determination is satisfied), the reinforcing bar measurement information may be recorded. In that case, it is desirable to record the coordinate information of the start point and end point of the reinforcing bar to be measured as identification information. The start point and end point of the reinforcing bar to be measured may be specified by a marker provided on the subject, or may be specified by the input of the user. Further, when the coordinate information of the start point and the end point of the reinforcing bar to be measured is not recorded, the start point and the end point of the reinforcing bar may be determined from the image during the reinforcing bar measurement process.

Further, in the above-described embodiment, as the identification information, coordinate information indicating the position of the identification target reinforcing bar in the detection image, posture information of the identification target reinforcing bar, or rotation information of the identification target reinforcing bar is exemplified. Other information for identification may be further included. For example, the moving speed and moving amount of the shooting area, a partial image around the tracking target, and the like may be included.

Further, in the above-described embodiment, an example of tracking one tracking target is shown, but a plurality of tracking targets may be set on the same reinforcing bar. By setting in this way, the rebar to be tracked can be tracked more reliably.

Further, in the above-described embodiment, the tracking target is set to the reinforcing bar arranged in the direction intersecting the first direction, but even on the reinforcing bar arranged in the direction intersecting the first direction, the tracking target is set. It is desirable not to set it in the area that overlaps with the reinforcing bars arranged along the first direction. This is because setting a tracking target in such an area increases the difficulty of tracking.

Further, in the above-described embodiment, the example of recording the reinforcing bar measurement information when the tracking target is detected from the first peripheral portion is shown, but the reinforcing bar measurement information may be recorded according to different criteria. For example, the reinforcing bar measurement information may be recorded every time the photographing area moves by a predetermined number of reinforcing bars to be measured.

Further, in the above-described embodiment, an example of recording an image or substitute information in association with the identification information is shown, but when displaying the recorded image, a virtual marker is added to the reinforcing bar identified by the identification information. May be displayed. As a result, the overlapping recorded shooting areas can be easily visually recognized.

Further, in the above-described embodiment, the bar arrangement inspection support system may include a stereo camera, and the information processing device included in the bar arrangement inspection support system performs information processing using an image acquired by the stereo camera. May be good. For example, the above-mentioned image acquisition processing and detection processing are performed on one moving image acquired by a stereo camera, and when a tracking target is detected from the first peripheral portion, two captured images having parallax are acquired. You may. This method is particularly suitable when a reinforcing bar measurement process that requires depth information is performed. Further, the above-mentioned image acquisition processing and detection processing may be performed on both moving images acquired by the stereo camera. As a result, the tracking target can be tracked more reliably.

1, 2, 3 ... Reinforcement inspection support system, 10 ... Digital camera, 100, 300, 500, 600, 700, 800 ... Information processing device, 101 ... Processor, 102 ... Memory , 103 ... Storage, 104 ... Interface device, 105 ... Portable recording medium drive device, 106 ... Portable recording medium, 107 ... Bus, 110 ... Acquisition unit, 120, 220 , 320, 420 ... Detection unit, 121, 221 ... Setting unit, 122 ... Target detection unit, 123, 223 ... Peripheral determination unit, 124, 422 ... Identification information generation unit, 130, 330 ... Recording control unit, 140 ... Recording unit, 150, 350 ... Reinforcing bar measurement unit, 421 ... Recording condition judgment unit, 510 ... Second recording unit, 810 ... Imaging unit, P1, P2, P3 ... Image, R1, R2, R3 ... Reinforcing bar, Rs ... Subject, SA ... Shooting area, T1, T2, T3 ... Tracking target

Claims (10)

An acquisition unit that acquires a plurality of images of the reinforcing bar group taken while moving the shooting area so as to intersect the rebar group arranged in the shooting order, and an acquisition unit.
A detection unit that detects a tracking target from a first peripheral portion that is a peripheral portion of the image acquired by the acquisition unit and is a peripheral portion in the movement direction in which the reinforcing bar group moves in the image.
When the detection unit detects the tracking target from the first peripheral portion, it is a detection image that is an image in which the tracking target is detected, or an image of the reinforcing bar group newly taken after the detection of the tracking target. The captured image or the detected image or the substitute information generated based on the captured image is recorded in association with the identification information that identifies the reinforcing bars constituting the reinforcing bar group and existing within a predetermined range from the tracking target. An information processing device including a recording control unit for recording on the device. In the information processing apparatus according to claim 1,
The detection unit
A target detection unit that detects the tracking target from the image acquired by the acquisition unit, and
An information processing device including a peripheral determination unit for determining whether or not a detected position of the tracking target in the detected image belongs to the first peripheral portion. In the information processing apparatus according to claim 1 or 2.
The detection unit includes a setting unit for setting the tracking target.
The setting unit is an information processing device characterized in that when the detection unit detects the tracking target from the first peripheral portion, the tracking target is updated based on the detected image. In the information processing apparatus according to claim 1 or 2.
The detection unit includes a setting unit for setting the tracking target.
When the detection unit detects the tracking target from the first peripheral portion, the setting unit is based on the second peripheral portion which is the peripheral portion in the direction opposite to the moving direction of the detected image. An information processing device characterized by updating. In the information processing apparatus according to claim 3 or 4.
The setting unit is an information processing device characterized in that any of the reinforcing bars included in the reinforcing bar group is set as the tracking target. In the information processing apparatus according to any one of claims 1 to 5, further
A recording condition determination unit for determining whether or not the recording condition, which is a condition for the length of the reinforcing bar included in the detection image, is satisfied is provided.
When the detection unit detects the tracking target from the first peripheral portion and the recording condition determination unit determines that the recording condition is satisfied, the recording control unit obtains the detected image or the photographing. An information processing device characterized in that an image or the substitute information is recorded in the recording device in association with the identification information. In the information processing apparatus according to claim 6,
The information processing apparatus is characterized in that the recording condition is a condition that the length of the reinforcing bar included in the first peripheral portion of the detected image is a predetermined length or more. In the information processing apparatus according to claim 6,
The recording conditions are
The condition is that at least one of the length of the reinforcing bar included in the first peripheral portion of the detected image or the length of the reinforcing bar included in the second peripheral portion of the detected image is a predetermined length or more. Information processing device. A plurality of images of the reinforcing bar group photographed while moving the photographing area so as to intersect the arranged reinforcing bar group are acquired in the order of photographing.
The tracking target is detected from the first peripheral portion, which is the peripheral portion of the acquired image and is the peripheral portion in the moving direction, which is the direction in which the reinforcing bar group moves in the image.
When the tracking target is detected from the first peripheral portion, the detection image which is the image in which the tracking target is detected or the captured image which is the image of the reinforcing bar group newly taken after the detection of the tracking target or The substitute information generated based on the detected image or the photographed image is recorded in the recording device in association with the identification information for identifying the reinforcing bars constituting the reinforcing bar group and existing within a predetermined range from the tracking target. An information processing method characterized by doing. On the computer
A plurality of images of the reinforcing bar group photographed while moving the photographing area so as to intersect the arranged reinforcing bar group are acquired in the order of photographing.
The tracking target is detected from the first peripheral portion, which is the peripheral portion of the acquired image and is the peripheral portion in the moving direction, which is the direction in which the reinforcing bar group moves in the image.
When the tracking target is detected from the first peripheral portion, the detection image which is the image in which the tracking target is detected or the captured image which is the image of the reinforcing bar group newly taken after the detection of the tracking target or The substitute information generated based on the detected image or the photographed image is recorded in the recording device in association with the identification information for identifying the reinforcing bars constituting the reinforcing bar group and existing within a predetermined range from the tracking target. A program characterized by executing the processing to be performed.