JP7362680B2 - Passenger conveyor confirmation system and passenger conveyor confirmation method - Google Patents

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention generally relates to techniques for assisting in verifying bolts securing steps to chains on passenger conveyors.

The passenger conveyor includes a frame installed in a building structure, and a plurality of endlessly connected steps that are provided within the frame and move in circulation. An endless chain is connected to the plurality of steps, and when this chain is rotated, the plurality of steps circulate along a rail installed in the frame. Through this circular movement, the passenger conveyor transports passengers on the steps from one entrance to the other. The plurality of steps are connected to an endless chain by a plurality of bolts (hereinafter referred to as step fixing bolts). A tongue washer (hereinafter referred to as a red washer) having only one side painted red and having three tongues is inserted into the step fixing bolt.

In a passenger conveyor having such a configuration, during maintenance and inspection work inside the frame and replacing the steps, the steps are removed and attached by attaching and detaching the step fixing bolts. Conventionally, when installing a step, the tightening state of the step fixing bolt is checked. After tightening the step fixing bolt to the specified torque using a tightening tool, the worker vertically bends one of the three tongues of the inserted red washer to display the red color painted on only one side. do. Visually check the red display caused by bending the red washer and double check with the person in charge of the work. After that, the person in charge of the work visually checks the red display caused by bending the red washer at every step with the passenger conveyor in operation, and confirms the fastening state of the step fixing bolts. Complete the confirmation work of the fastening status. The person in charge of the work inputs the confirmation results into the check sheet each time the above-mentioned confirmation work is performed.

In recent years, a screw tightening prevention device has been disclosed that prevents forgetting to tighten screws such as a plurality of bolts that have been tightened with a torque wrench with a marker (see Patent Document 1). The device for preventing forgetting to tighten screws uses a photographing means to photograph multiple screw members, and then binarizes the images of marks attached to the heads of the screw members using the photographing means to calculate the total area of the marks. The position of the center of gravity of the mark is calculated, and compared with the center of gravity of all the screw members within the photographing range registered in advance to determine whether all the screw members are tightened.

JP2004-249388A

In the technique described in Patent Document 1, it is necessary to photograph the mark attached to the head of the screw member using a photographing means. However, due to the structure of the step of the passenger conveyor, it is not possible to photograph the head of the step fixing bolt, and therefore, with the technique described in Patent Document 1, it is not possible to confirm the fastened state of the step fixing bolt.

The present invention has been made in consideration of the above points, and aims to propose a passenger conveyor confirmation system etc. that can confirm whether the bolts for fixing the steps to the chain on the passenger conveyor are properly installed. It is.

In order to solve this problem, the present invention provides a passenger conveyor confirmation system that can check the fastening state of each bolt that fixes each step to the chain in a passenger conveyor that includes a plurality of steps that can be connected to a circulating chain. If a washer with a bent part whose first side is colored in a predetermined color is attached, the bolt is tightened, and the bent part is bent so that the first side is exposed, the image cannot be photographed. A detection unit that detects the predetermined color for each bolt from an image taken of each bolt by a terminal, and whether or not each bolt is properly installed based on the detection result by the detection unit. The present invention includes a determination unit that determines the determination unit, and an output unit that outputs the result determined by the determination unit.

In the above configuration, for example, if a predetermined color can be detected for the bolt of the step where the bolt was installed, a result indicating that the bolt is properly installed is output, and the predetermined color cannot be detected. In this case, a result indicating that the bolt is not properly installed is output. According to the above configuration, for example, the person in charge of work can accurately and easily confirm the fastening state of the bolt of the step to which the step has been installed.

According to the present invention, it is possible to determine whether a bolt for fixing a step to a chain is properly attached.

1 is a diagram showing an example of a configuration related to a passenger conveyor confirmation system according to a first embodiment; FIG. FIG. 3 is a diagram showing a schematic configuration of steps according to the first embodiment. FIG. 3 is a diagram showing an example of a step connection section according to the first embodiment. FIG. 3 is a diagram showing an example of a step connection section according to the first embodiment. It is a figure showing an example of the red washer by a 1st embodiment. 1 is a diagram showing an example of a hardware configuration of a photographing terminal according to a first embodiment; FIG. 1 is a diagram showing an example of a functional configuration of a photographing terminal according to a first embodiment; FIG. It is a figure showing an example of confirmation processing by a 1st embodiment. It is a figure showing an example of confirmation processing by a 1st embodiment. FIG. 3 is a diagram showing an example of a guide according to the first embodiment. FIG. 3 is a diagram illustrating an example of an automatic extraction method for a bolt extraction image according to the first embodiment.

(I) First Embodiment An embodiment of the present invention will be described in detail below. However, the present invention is not limited to the embodiments.

The passenger conveyor confirmation system of this embodiment supports confirmation of the fastening state of the step fixing bolts of the passenger conveyor. For example, a passenger conveyor confirmation system photographs the steps of a passenger conveyor in operation, extracts a still image showing the step fixing bolts from the photographed video of the step, and then extracts a still image showing the step fixing bolts from the image. The fastening state of the step fixing bolt is determined based on the detected result, and the still image and the determination result of the fastening state of the step fixing bolt are accumulated.

According to the above configuration, the fastening state of the step fixing bolt of the passenger conveyor can be accurately and easily confirmed.

In this specification and the like, expressions such as "first," "second," and "third" are used to identify constituent elements, and do not necessarily limit the number or order. Further, numbers for identifying components are used for each context, and a number used in one context does not necessarily indicate the same configuration in another context. Furthermore, this does not preclude a component identified by a certain number from serving the function of a component identified by another number.

Next, embodiments of the present invention will be described based on the drawings. The following description and drawings are examples for explaining the present invention, and are omitted and simplified as appropriate for clarity of explanation. The present invention can also be implemented in various other forms. Unless specifically limited, each component may be singular or plural.

In the following description, the same elements in the drawings are designated by the same numbers, and the description will be omitted as appropriate. In addition, when explaining elements of the same type without distinguishing them, use the common part (excluding the branch number) of the reference numbers including the branch number, and when explaining elements of the same type separately, use the branch number. Reference signs including may be used. For example, when describing the step fixing bolts without making any particular distinction, it is written as "step fixing bolt 303", and when explaining the individual step fixing bolts separately, "step fixing bolt 303-1", " It may be written as "Step fixing bolt 303-2".

FIG. 1 is a diagram showing an example of the configuration of a passenger conveyor confirmation system 100. The passenger conveyor confirmation system 100 is a system that supports confirmation of the fastening state of step fixing bolts that fix the steps of passenger conveyors such as escalators and moving walkways. More specifically, the passenger conveyor confirmation system 100 is a system that automatically detects bending of a red washer inserted with a step fixing bolt from an image, and determines whether the fastening state of the step fixing bolt is good or bad. The escalator 101 will be described below as an example of the passenger conveyor.

The escalator 101 includes a frame 102 installed in a building structure (not shown), a control panel 103, a handrail 104, a step 105, a rail 106, a handrail 107, a drive mechanism 108, and a transmission chain 109. , a driving chain 110, a handrail drive device 111, a driving sprocket 112, and a driven sprocket 113. In the following description, a coordinate system may be used in which the horizontal direction is the x-axis, the width direction of the step 105 is the y-axis, and the vertical direction is the z-axis.

A control panel 103, a drive mechanism 108, and a drive sprocket 112 are arranged on the upper floor side 114 of the frame 102. A driven sprocket 113 is arranged on the lower floor side 115.

The drive mechanism 108 is composed of an electric motor and a speed reducer. Electric power is supplied to the electric motor from the control panel 103, and the operation of the electric motor is controlled by the control panel 103. A belt member 116 is wound around the electric motor and the reduction gear, and the rotational force of the electric motor is transmitted to the reduction gear via the belt member 116.

A transmission chain 109 is wound around the reducer and drive sprocket 112. The driving force of the drive mechanism 108 is transmitted to the drive sprocket 112 via the transmission chain 109, and the drive sprocket 112 rotates.

A pair of driving chains 110 are wound around the driving sprocket 112 and the driven sprocket 113. Rotation of drive sprocket 112 causes driven sprocket 113 and driving chain 110 to rotate.

Further, a handrail drive chain 117 is wound around the drive sprocket 112 . The handrail drive chain 117 is wound around a plurality of transmission pulleys 118 and also around the handrail drive device 111 .

A pair of rails 106 are arranged in the width direction of the frame 102, and the plurality of steps 105 are movably supported by the pair of rails 106. Further, the plurality of steps 105 are connected in an endless manner via a pair of driving chains 110, and are guided by rails 106 to circulate between the outbound side and the inbound side.

The balustrade portions 104 are supported by the upper part of the frame 102 and are arranged on both sides of the frame 102 in the width direction. An endless handrail 107 is attached to the parapet 104. The handrail 107 is movably supported by the parapet 104 and circulated in synchronization with the plurality of steps 105 in the same direction by a handrail drive device 111. As a result, the escalator 101 can safely transport passengers who are riding on the step 105 and holding the handrail 107.

Further, the escalator 101 includes a board 119 for getting on and off. The boarding board 119 is provided at the boarding entrance toward the step 105 from inside the building. The boarding board 119 serves as a lid for the upper floor side 114 (a machine room located within the floor surface) and also serves as a passage for passengers. However, FIG. 1 shows an example in which the board 119 is removed for the removal and installation work in step 105.

The passenger conveyor confirmation system 100 includes a photographing terminal 120. The photographing terminal 120 is installed on a fixing jig 121 that is installed so as to face the step fixing bolt of step 105 at a certain distance during the confirmation work. Note that the photographing terminal 120 may be attached to the fixture 121 at all times. In other words, the photographing terminal 120 may be of a portable type that is carried by a worker or a person in charge each time a confirmation work is performed, or it may be of a permanent type that is fixed to the frame 102. Further, instead of the fixing jig 121, a mark may be provided at a position where it can be installed so as to directly face the step fixing bolt of the step 105 at a certain distance. Further, the installation location of the photographing terminal 120 is any location where the step fixing bolt in step 105 can be photographed, and is not limited to the inside of the machine room. Furthermore, the fixing jig 121 may be a stand such as a tripod.

Next, the structure of step 105 will be specifically explained.

FIG. 2 is a diagram showing a schematic configuration of step 105. Step 105 includes a frame 201 serving as a skeleton and a footboard 202 on which a passenger rides. The footboard 202 is fixed to the top of the frame 201. Demarcations 203 colored yellow or the like are provided at the front, rear, left and right ends of the footboard 202. Demarcation 203 guides the passenger to board near the center of step 105. Note that the mode of demarcation 203 is not limited to the mode shown in FIG. 2. For example, the demarcation 203 behind the treadle 202 (on the riser side) may not be provided, or the demarcation 203 before and behind the treadle 202 may not be provided.

3 and 4 are diagrams illustrating an example of the connecting portion in step 105. As shown in FIGS. 3 and 4, the step 105 is rotatably fitted around both ends of the front wheel axle 301 connected to the driving chain 110 through a hole (not shown) provided in the frame 201. A plurality of step fixing bolts 303 (for example, a first step fixing bolt 303-1 and a second step fixing bolt 303-2) are fastened to the collar 302. A red washer 304 is inserted between the step fixing bolt 303 and the frame 201.

Next, the red washer 304 will be specifically explained.

FIG. 5 is a diagram showing an example of the red washer 304. A first aspect 510 shows the red washer 304 before the step fixing bolt 303 has been fastened. In the first aspect 510, the three tongues of the red washer 304 are parallel to the x direction and the y direction (horizontal), and have a metallic surface. On the other hand, the second aspect 520 shows the red washer 304 after the step fixing bolt 303 has been fastened. The operator displays the red color 521 painted on the back surface of the red washer 304 by bending one of the three tongues of the red washer 304 in a direction parallel (perpendicular) to the z direction. Note that it is preferable that the tongue to be bent is the tongue that is most easily visible to the operator.

Here, the washer inserted between the step fixing bolt 303 and the frame 201 is not limited to the red washer 304. For example, the back side of the washer may be a predetermined color (e.g., a color not found on the component in step 105, such as green). Further, for example, the number of tongues (bent portions) of the washer is not limited to three, and may be one or two or more.

The passenger conveyor confirmation system 100 detects the red color 521 of the red washer 304 using the photographing terminal 120, and determines whether the fastened state is good or bad. Next, the configuration of the photographing terminal 120 will be explained using FIGS. 6 and 7.

FIG. 6 is a diagram illustrating an example of the hardware configuration of the photographing terminal 120. As shown in FIG. 6, the passenger conveyor confirmation system 100 includes a photographing terminal 120 and a storage device 610. The photographing terminal 120 and the storage device 610 are communicably connected via a network 620.

The photographing terminal 120 may be a smartphone, a tablet terminal, a notebook computer, etc., which has an imaging function and an information processing function, and may include an imaging means such as a digital camera or a digital video camera, an information processing means such as a processor, It may be realized by combining.

For example, the photographing terminal 120 includes a processor 601, a main storage device 602, an auxiliary storage device 603, an input device 604, an output device 605, a communication device 606, and an imaging device 607.

The processor 601 is a device that performs arithmetic processing. The processor 601 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), an AI (Artificial Intelligence) chip, or the like.

The main storage device 602 is a device that stores programs, data, and the like. The main storage device 602 is, for example, a ROM (Read Only Memory) or a RAM (Random Access Memory). The ROM includes SRAM (Static Random Access Memory), NVRAM (Non Volatile RAM), Mask ROM (Mask Read Only Memory), PROM (Programmable ROM), and the like. The RAM is a DRAM (Dynamic Random Access Memory) or the like.

The auxiliary storage device 603 is an HDD (Hard Disk Drive), a flash memory, an SSD (Solid State Drive), an optical storage device, or the like. Optical storage devices include CDs (Compact Discs) and DVDs (Digital Versatile Discs). Programs, data, etc. stored in the auxiliary storage device 603 are read into the main storage device 602 at any time.

The input device 604 is a user interface that accepts information from the user. The input device 604 is, for example, a keyboard, mouse, card reader, touch panel, or the like.

The output device 605 is a user interface that outputs various information (display output, audio output, print output, etc.). The output device 605 is, for example, a display device that visualizes various information, an audio output device (speaker), a printing device, or the like. The display device is an LCD (Liquid Crystal Display), a graphic card, or the like.

Communication device 606 is a communication interface that communicates with other devices via a communication medium. The communication device 606 is, for example, a NIC (Network Interface Card), a wireless communication module, a USB (Universal Serial Interface) module, a serial communication module, or the like. Communication device 606 can also function as an input device to receive information from other devices with which it is communicatively connected. Communication device 606 can also function as an output device that transmits information to other devices with which it is communicatively connected.

The imaging device 607 is a device that includes an imaging lens, an imaging element, and the like, and converts an optical image formed by the imaging lens into an electrical signal using the imaging element. The imaging device 607 includes a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, and the like.

The storage device 610 is an HDD, SSD, or the like that stores data. Note that the storage device 610 may be included in the photographing terminal 120, may be connected to the photographing terminal 120 without going through the network 620, or may not be provided.

FIG. 7 is a diagram illustrating an example of the functional configuration of the photographing terminal 120. The photographing terminal 120 includes an imaging section 710, a pre-processing section 720, and a post-processing section 730.

The imaging unit 710 performs processing related to imaging in the imaging device 607 to obtain an image 711.

The preprocessing section 720 includes a detection section 721 and an area measurement section 722. The detection unit 721 performs image processing on the video 711 to obtain a still image 723, and extracts a bolt extraction image 724 showing the step fixing bolt 303 from the still image 723. Further, the detection unit 721 extracts (detects) the red color 521 of the red washer 304 from the extracted bolt extraction image 724. The area measurement unit 722 calculates the area of the red color 521 detected by the detection unit 721 (hereinafter referred to as red area).

The post-processing section 730 includes a determination section 731, an output section 732, and a guide section 733. The determination unit 731 determines whether the fastening state of the step fixing bolt 303 is good or bad. For example, the determining unit 731 determines that the step fixing bolt 303 for which the detecting unit 721 detects the red color 521 is properly installed (passed), and determines that the step fixing bolt 303 for which the detecting unit 721 does not detect the red color 521 is properly installed (passed). It is determined that the bolt 303 is not properly attached (fails). The output unit 732 outputs the result of the determination by the determination unit 731 to the output device 605, the maintenance DB 740 included in the storage device 610, and the like. Further, the output unit 732 instructs the escalator 101 (control panel 103) to circulate the step 105 to a position where the step fixing bolt 303 determined by the determination unit 731 to be not properly attached can be visually recognized. The guide unit 733 is a guide that is acquired by the photographing terminal 120 and is capable of guiding the photographing terminal 120 at a certain distance with respect to the step fixing bolt 303 and guiding the photographing terminal 120 so that it directly faces the step fixing bolt 303. The displayed image is displayed on the output device 605 superimposed on the captured image.

The functions of the photographing terminal 120 (imaging section 710, pre-processing section 720, post-processing section 730, etc.) include, for example, the processor 601 reading a program stored in the auxiliary storage device 603 into the main storage device 602 and executing it (software). ), hardware such as a dedicated circuit, or a combination of software and hardware. Note that one function of the photographing terminal 120 may be divided into a plurality of functions, or a plurality of functions may be combined into one function. Further, some of the functions of the photographing terminal 120 may be provided as separate functions or may be included in other functions. Furthermore, some of the functions of the photographing terminal 120 may be realized by another computer that can communicate with the photographing terminal 120.

The storage device 610 includes a maintenance DB 740. The maintenance DB 740 stores information indicating the plan of the confirmation work (work plan information), the bolt extraction image 724 extracted by the pre-processing section 720, the results of the quality determination by the post-processing section 730, and the like.

Next, confirmation processing in the passenger conveyor confirmation system 100 will be explained.

8 and 9 are diagrams illustrating an example of confirmation processing.

In S801, the photographing terminal 120 receives from the maintenance DB 740 information indicating the plan for the current confirmation work (work plan information), and the red area and pass/fail determination results from the previous time the confirmation work was performed (previous implementation information). get.

In S802, the person in charge of the work uses a guide 1010, which will be described later with reference to FIG. to fix (install).

In S803, the person in charge of work starts photographing in step 105. At this time, the preprocessing unit 720 obtains information (total number of steps 105, number of the step 105 at which shooting started, etc.) inputted by the person in charge of the work via the input device 604.

In S804, the work supervisor operates the escalator 101 once in maintenance mode.

In S805, the work supervisor ends the photographing in step 105. At this time, the imaging unit 710 transmits an image 711 when the escalator 101 (step 105) makes one revolution to the preprocessing unit 720.

In S806, the preprocessing unit 720 divides the video 711 into still images 723 per unit time.

In S807, the preprocessing unit 720 extracts a bolt extraction image 724 in which the step fixing bolt 303 is shown from each of the plurality of still images 723 using an automatic extraction method described later with reference to FIG.

In S808, the preprocessing unit 720 detects bending of the red washer 304. For example, the preprocessing unit 720 extracts red pixels from the bolt extraction image 724 for each step fixing bolt 303 using an image processing technique such as RGB detection, detects the red color 521 of the red washer 304, and calculates the red area. Note that the preprocessing unit 720 detects the break of step 105 using object matching based on shape, the break of demarcation 203, etc., and counts the number of step 105. Since the preprocessing unit 720 can identify each step fixing bolt 303 by specifying the number of step 105, it can manage the red area for each step fixing bolt 303.

Further, the preprocessing unit 720 determines the red color based on the total number of steps 105 (that is, the total number of step fixing bolts 303 required to fix all the steps 105) and the detected number of bent red washers 304. The number of step fixing bolts 303 in which bending of the washer 304 is not detected (the number of bolts without bending) is counted, and the counted result is transmitted to the post-processing unit 730.

In S809, the post-processing unit 730 determines whether the number of unfolded pieces is "0". If the post-processing unit 730 determines that the number of unfolded pieces is "0", it moves the process to S810, and if it determines that the number of unfolded pieces is not "0", it moves the process to S812.

In S810, the post-processing unit 730 performs additional confirmation processing. In the additional confirmation process, a pass/fail determination is made regarding the tightening state of all step fixing bolts 303 based on the work plan information, previous implementation information, and current implementation information, and a pass/fail determination result indicating the result of the pass/fail determination is made. generated.

Here, since the red washer 304 rotates to some extent around the step fixing bolt 303 when the step fixing bolt 303 is tightened, the bending position is not necessarily the same. Therefore, the red area detected by the passenger conveyor confirmation system 100 changes. By performing additional confirmation processing based on this feature, the following two points can be achieved.

The first is that if there is no difference between the red area of the red washer 304 in step 105 that is scheduled to be removed in the work plan and the red area of the red washer 304 in step 105 that is saved in the maintenance DB 740, the work plan It is possible to notify the administrator, manage the history, etc. if the event has not been implemented. Note that history management refers to managing steps 105 in which removal and attachment were performed, and managing steps 105 that were scheduled to be removed but were not removed.

Second, similarly compare the step 105 that is not scheduled to be removed in the work plan, and if there is a difference in the red area, it is assumed that the step fixing bolt 303 is loosened, and the person in charge of the work is asked to increase the number of steps. By issuing a tightening instruction, it is possible to prevent the step fixing bolt 303 from coming off due to loosening. Details of the additional confirmation process will be described later using FIG. 9.

In S811, the post-processing unit 730 stores in the maintenance DB 740 the red area of each step fixing bolt 303 and the pass/fail determination result (current implementation information) when the confirmation process is performed, and ends the confirmation process.

In S812, the post-processing unit 730 operates the escalator 101 in maintenance mode and controls the step fixing bolts 303 (step 105) whose bending is not detected to stop at a visible position (for example, a photographing position). Instruct the board 103. Note that the escalator 101 may be operated and the step fixing bolts 303 whose bending has not been detected may be stopped at a position where the step fixing bolts 303 whose bending is not detected can be stopped by giving instructions from the work supervisor instead of the post-processing unit 730.

Further, in S812, if the post-processing unit 730 cannot detect the red color 521 (bending), the post-processing unit 730 may display the result of determining that the step fixing bolt 303 is not properly attached on the output device 605. Further, in S810, if the post-processing unit 730 can detect the red color 521, the post-processing unit 730 may display the result of determining that the step fixing bolt 303 is properly attached on the output device 605.

In S813, the person in charge of the work checks the fastening state of the step fixing bolt 303, and takes measures such as inserting the red washer 304 or bending the red washer 304 as necessary.

In this way, the person in charge of work visually checks the step fixing bolt 303 of step 105 that failed based on the result of the pass/fail judgment by the post-processing unit 730, and performs fastening work as the case may be. It is possible to avoid forgetting to tighten the step fixing bolt 303.

This embodiment is not limited to the above-described processing. For example, in S808, outputting the results of the quality determination on a check sheet makes it possible to create the work completion report more efficiently. Further, in S808, the post-processing unit 730 may store the bolt extraction image 724 in the maintenance DB 740. In this case, the administrator can perform history management by checking all of the plurality of bolt extraction images 724 stored in the maintenance DB 740 and the results of the quality determination.

FIG. 9 is a diagram illustrating an example of an additional confirmation process. In the additional confirmation process, one unprocessed step 105 out of all steps 105 is selected as a processing target, and the processes of S901 to S910 are performed for each step 105.

In S901, the post-processing unit 730 determines whether the step 105 to be processed is the step 105 of the work plan (planning target) based on the work plan information. If the post-processing unit 730 determines that the step 105 to be processed is the step 105 to be planned, it moves the process to S902, and if it determines that the step 105 to be processed is not the step 105 to be planned, it moves the process to S906. move.

In S902, the post-processing unit 730 uses the previous implementation information and the current implementation information to determine the difference between the current red area and the previous red area for the red washer 304 in step 105 to be processed.

In S903, the post-processing unit 730 determines whether the difference is "0". If the post-processing unit 730 determines that the difference is "0" (determines that the removal has not been performed), it moves the process to S904, and determines that the difference is not "0" (determines that the removal has been performed). If so, the process moves to S905.

In S904, the post-processing unit 730 generates a pass/fail determination result indicating that the work plan has not been implemented, and notifies the administrator that the work plan has not been implemented for the step 105 to be processed. Note that the post-processing unit 730 may display on the output device 605 (notify the person in charge of the work) that the work plan has not been implemented for the step 105 to be processed.

In S905, the post-processing unit 730 generates a quality determination result indicating that the work plan has been implemented.

In S906, the post-processing unit 730 uses the previous implementation information and the current implementation information to determine the difference between the current red area and the previous red area for the red washer 304 in step 105 to be processed.

In S907, the post-processing unit 730 determines whether the difference is "0". If the post-processing unit 730 determines that the difference is "0" (determines that the step fixing bolt 303 is not loose), it moves the process to S908, and determines that the difference is not "0" (determines that the step fixing bolt 303 is not loose). If it is determined that there is looseness), the process moves to S909.

In S908, the post-processing unit 730 generates a quality determination result indicating that the step fixing bolt 303 of the step 105 to be processed is not loosened.

In S909, the post-processing unit 730 generates a quality determination result indicating that the step fixing bolt 303 of the step 105 to be processed is loose.

In S910, the post-processing unit 730 displays on the output device 605 (notifies the person in charge of the work) that the step fixing bolt 303 of the step 105 to be processed needs to be retightened. In response to this notification, the person in charge of the work retightens the step fixing bolt 303 of the step 105 to be processed.

Note that the post-processing unit 730 extracts a bolt extraction image 724 that shows the step fixing bolt 303 extracted in the current confirmation process, and a bolt extracted image 724 that shows the step fixing bolt 303 stored in the maintenance DB 740. , it may be determined whether the work plan has not been implemented and/or whether the step fixing bolt 303 is loose. Further, the post-processing unit 730 may perform S902 to S905 without performing S901. That is, the post-processing unit 730 calculates the current red area and the previous red area for the red washer 304 of the step 105 to be processed, without determining whether the step 105 to be processed is the step 105 to be planned. It is also possible to calculate the difference between the two and determine whether or not the installation and removal in step 105 have been performed based on the calculated difference.

FIG. 10 is a diagram showing an example of a guide (guide 1010) displayed on the output device 605 of the photographing terminal 120. The guide 1010 is configured by a vertical guide 1010-1 and a horizontal guide 1010-2 crisscrossing each other.

The person in charge of the work takes a photograph so that the intersection of the vertical guide 1010-1 and the horizontal guide 1010-2 displayed on the output device 605 is superimposed on the bolt image 1020 representing the step fixing bolt 303, which is the target object. By doing so, it becomes possible to directly face the object at a certain distance and photograph the object in parallel.

The configuration of the guide 1010 is not limited to the example shown in FIG. 10, and may be configured to have a rectangular shape, a circular shape, or a plurality of points, for example.

Note that, as described above, inside the upper floor side 114, for example, a fixing jig 121 is fixed to the frame 102 using a clamp (not shown), and the photographing terminal 120 is fixed to the fixing jig 121 each time confirmation work is performed. By doing so, it is possible to always directly face the object at a certain distance and to take images parallel to the object, or the fixing jig 121 and the photographing terminal 120 may be permanently installed.

FIG. 11 is a diagram illustrating an example of an automatic extraction method for a bolt extraction image 724 showing the step fixing bolt 303. FIG. 11 shows an example in which the escalator 101 is operated upward. In the still images 723-1 to 723-4 arranged in chronological order, a step image 1110 representing the step 105 to be processed and a step image 1120 representing the step 105 immediately before the step 105 to be processed are It is gradually moving in the opposite direction (downward) to the z direction. Further, a rectangular area at the center of the still image 723 and long in the y direction is a detection area 1130 for detecting the demarcation 203 (demarcation image 1170).

In the still image 723-1 and the still image 723-2, a bolt image 1140 representing the step fixing bolt 303 provided in the step 105 to be processed and a red washer 304 provided in the step 105 to be processed are shown. The washer image 1150 is partially or completely hidden by the step image 1120 representing the previous step 105. Therefore, the photographing terminal 120 cannot detect everything. In the still image 723-3, the photographing terminal 120 can completely detect the bolt image 1140 and the washer image 1150, but in the still image 723-4, since they are hidden again by the step image 1110, the photographing terminal 120 detects them all. I can't.

Therefore, the photographing terminal 120 needs to extract the bolt extraction image 724 that includes the step fixing bolt 303 from the still image 723-3. Here, the location where the step fixing bolt 303 is attached is always between the step 105 to be processed and the previous step 105. Therefore, in the detection area 1130, an image in which both the demarcation image 1160 representing the demarcation 203 of the step 105 to be processed and the demarcation image 1170 representing the demarcation 203 of the previous step 105 cannot be detected is created. By extracting, the bolt extraction image 724 can be automatically extracted.

The demarcation 203 can be detected using, for example, color extraction such as RGB detection or object matching based on shape.

In the automatic extraction method of the bolt extraction image 724 showing the step fixing bolts 303, an example has been shown in which the escalator 101 is operated upward and the left and right step fixing bolts 303 are photographed at once, but the method is not limited to this. The image may be taken while the escalator 101 is being driven downward, or the image may be taken of either the left or right step fixing bolts 303 individually. Furthermore, the image may be photographed in two patterns: when the escalator 101 is operated upward and when it is operated downward. In this case, the photographing terminal 120 can eliminate the influence of disturbance due to illumination and the like by comparing the images acquired in these photographing operations, and can further improve the determination accuracy. Further, in order to improve the determination accuracy, when photographing with the photographing terminal 120, a guide may be displayed on the output device 605 that guides the photographing terminal 120 to directly face the object at a certain distance and take the image in parallel. Similarly, for the still image 723 extracted after shooting, the shape is corrected using techniques such as trapezoidal correction, the angle is corrected to make it parallel, and the brightness within the image is made uniform by referring to the brightness of multiple points from the initial image. You may also use brightness correction, etc. Further, in this embodiment, an example is shown on the upper floor side 114, but it may be implemented on the lower floor side 115.

The present invention is not limited to the above-mentioned contents, and materials, shapes, configurations, etc. can be appropriately selected, combined, or changed as appropriate without changing the gist of the invention.

(II) Additional Notes The above-described embodiment includes, for example, the following contents.

In the above-described embodiment, a case has been described in which the present invention is applied to a passenger conveyor confirmation system, but the present invention is not limited to this, but can be widely applied to various other systems, devices, methods, and programs. be able to.

Furthermore, in the above-described embodiment, when it is determined that the number of unfolded pieces is "0" (Yes) in the determination of S809, the case is described in which S810 (additional confirmation process) is performed. Not exclusively. For example, S810 (additional confirmation process) may not be performed.

Furthermore, in the above-described embodiment, in S904, the post-processing unit 730 notifies the administrator that the work plan has not been implemented for the step 105 to be processed. Not exclusively. For example, instead of or in addition to the above notification, the post-processing unit 730 may operate the escalator 101 in maintenance mode and stop the step 105 where the work plan is not being implemented at a visible position (for example, a photographing position). The control panel 103 may be instructed to do so.

Further, in the above-described embodiment, in S910, the post-processing unit 730 displays on the output device 605 (notifies the person in charge of the work) that the step fixing bolt 303 of the step 105 to be processed needs to be retightened. Although the case is described above, the present invention is not limited to this. For example, instead of or in addition to the above notification, the post-processing unit 730 operates the escalator 101 in maintenance mode and stops the step 105 where retightening is required at a visible position (e.g., photographing position). An instruction may be given to the control panel 103.

Further, in the above-described embodiment, the photographing terminal 120 may include an illumination device, and the illumination device may illuminate an object with light to take a photograph.

Furthermore, in the embodiments described above, the output of information is not limited to displaying on a display. The information may be output as audio from a speaker, output to a file, printed on a paper medium using a printing device, or projected onto a screen using a projector. or other embodiments may be used.

In addition, in the above explanation, information such as programs, tables, files, etc. that realize each function is stored in memory, storage devices such as hard disks, SSDs (Solid State Drives), or records such as IC cards, SD cards, DVDs, etc. Can be placed on medium.

The embodiment described above has, for example, the following characteristic configuration.

(1)
In a passenger conveyor (e.g. escalator 101, moving walkway, passenger conveyor) comprising a plurality of steps (e.g. step 105) connectable to a circulating chain (e.g. driving chain 110), each step is fixed to said chain. A passenger conveyor confirmation system (for example, passenger conveyor confirmation system 100) that can confirm the fastening state of each bolt (for example, step fixing bolt 303) has one side (for example, the back side) of a predetermined color (for example, red 521). When a washer (e.g., red washer 304) having a colored bent portion (e.g. tongue) is attached and the bolt is tightened, and the bent portion is bent so that the first side is exposed. , a detection unit that detects the predetermined color of each bolt from an image (for example, video 711, still image 723, bolt extraction image 724) of each bolt taken by a photographing terminal (for example, photographing terminal 120); For example, it is determined whether or not each of the bolts is properly installed based on the results of detection by the detection section 721, the photographing terminal 120, a computer communicably connected to the photographing terminal 120), and the detection section. A determination unit (for example, a determination unit 731, a photographing terminal 120, a computer communicably connected to the photographing terminal 120), and an output unit (for example, an output unit 732, a computer communicatively connected to the photographing terminal 120) that outputs the result determined by the determination unit. , a computer communicatively connected to the photographing terminal 120).

In the above configuration, for example, if a predetermined color can be detected for the bolt of the step where the bolt was installed, a result indicating that the bolt is properly installed is output, and the predetermined color cannot be detected. In this case, a result indicating that the bolt is not properly installed is output. According to the above configuration, for example, the person in charge of work can accurately and easily confirm the fastening state of the bolt of the step to which the step has been installed.

(2)
The passenger conveyor confirmation system includes a guide (for example, guide 1010) capable of guiding the photographing terminal at a certain distance with respect to the bolt and directing the photographing terminal so that the photographing terminal directly faces the bolt. A guide unit (for example, a guide unit 733, a photographing terminal 120, and a computer communicably connected to the photographing terminal 120) is provided to display the image on a display device (for example, the output device 605) superimposed on the image acquired by the camera.

According to the above configuration, a guide for directing the bolt to face the bolt at a certain distance is displayed superimposed on the image captured by the photographing terminal. By matching with the bolt image, the shooting terminal can be easily and appropriately installed.

(3)
A demarcation line (for example, demarcation 203) is provided on the step board of the step, and the detection unit detects a predetermined range in the video acquired by the photographing terminal while the steps are circulating. When the demarcation line of the step is no longer displayed, the next step of the step is detected (for example, see FIG. 11).

With the above configuration, the next step can be detected when the demarcation line provided on the treadle is interrupted, so that, for example, bolts and predetermined colors can be easily detected.

(4)
The passenger conveyor confirmation system calculates the area of the predetermined color (for example, red area) detected by the detection unit for each bolt, and stores the calculated area in a storage device (for example, maintenance DB 740, storage device 610, etc.). The determining unit includes an area measuring unit (for example, an area measuring unit 722, a photographing terminal 120, and a computer communicably connected to the photographing terminal 120) stored in an auxiliary storage device 603), and the determining unit determines whether installation or removal is planned. It is determined whether or not the bolt is loose based on the area currently determined by the area measuring section for the bolt with no step and the area previously determined for the bolt by the area measuring section (for example, (See S906 and S907).

In the above configuration, the detected area of a predetermined color is memorized, and based on the current area and the previous area, it is determined whether bolts of steps that are not planned to be installed or removed are loose. . According to the above configuration, for example, the person in charge of work can grasp the loosening of bolts in steps that are not planned to be installed or removed.

(5)
The passenger conveyor confirmation system calculates the area of the predetermined color (for example, red area) detected by the detection unit for each bolt, and stores the calculated area in a storage device (for example, maintenance DB 740, storage device 610, etc.). The determining unit includes an area measuring unit (e.g., an area measuring unit 722, a photographing terminal 120, and a computer communicably connected to the photographing terminal 120) that stores the information in an auxiliary storage device 603), and the determination unit performs the area measuring unit for the step bolt. Based on the area currently determined by the unit and the area previously determined for the bolt by the area measuring unit, it is determined whether the step has been attached and removed (for example, see S902 and S903). .

In the above configuration, the detected area of a predetermined color is stored, and based on the current area and the previous area, it is determined whether or not the installation and removal have been performed for the step in which installation and removal are planned. Ru. According to the above configuration, for example, the administrator can understand that the steps for which installation and removal are planned have not been performed yet.

(6)
In the above configuration, since the predetermined color is red, which is a color that is not present in the component parts of the passenger conveyor, for example, the detection unit can detect the predetermined color more accurately, and the accuracy of the determination by the determination unit can be improved. can be improved.

(7)
In a passenger conveyor (e.g. escalator 101, moving walkway, passenger conveyor) comprising a plurality of steps (e.g. step 105) connectable to a circulating chain (e.g. driving chain 110), each step is fixed to said chain. A passenger conveyor confirmation method for confirming the fastening state of each bolt (for example, the step fixing bolt 303) includes a bent portion (for example, , tongue) is attached, the bolt is tightened, and the bending portion is bent so that the first surface is exposed, so that the detection unit detects the photographing terminal ( For example, detecting the predetermined color for each bolt from an image (for example, video 711, still image 723, bolt extraction image 724) of each bolt photographed by the photographing terminal 120 (for example, S808); , a determination unit determines whether or not each of the bolts is properly installed based on the detection result by the detection unit (for example, see S809); and instructing the passenger conveyor to circulate through the plurality of steps to a position where the bolt determined by the determination unit can be visually recognized (for example, see S812).

In the above configuration, the steps are moved in a circular manner so that bolts that are not properly installed can be visually recognized, so, for example, the person in charge of work can easily recognize bolts that are not properly installed.

Furthermore, the above-described configurations may be modified, rearranged, combined, or omitted as appropriate without exceeding the gist of the present invention.

Items included in a list in the format "at least one of A, B, and C" are (A), (B), (C), (A and B), (A and C), (B and C) or (A, B, and C). Similarly, items listed in the format "at least one of A, B, or C" are (A), (B), (C), (A and B), (A and C), It can mean (B and C) or (A, B, and C).

100...Passenger conveyor confirmation system, 120...Photography terminal, 303...Step fixing bolt, 304...Red washer.

Claims (7)

A passenger conveyor confirmation system that is capable of confirming the fastening state of each bolt that fixes each step to the chain in a passenger conveyor that includes a plurality of steps that can be connected to a circulating chain, the system comprising:
When a washer with a bent part whose one side is colored in a predetermined color is attached, a bolt is tightened, and the bent part is bent so that the first side is exposed, the image capturing terminal detects the bending part. a detection unit that detects the predetermined color for each bolt from an image of each bolt;
a determination unit that determines whether each of the bolts is properly installed based on a result of detection by the detection unit;
an output unit that outputs the result determined by the determination unit;
Passenger conveyor confirmation system equipped with A guide capable of guiding the photographing terminal to a certain distance with respect to the bolt and guiding the photographing terminal so that it directly faces the bolt is displayed on a display device, superimposed on the image acquired by the photographing terminal. Equipped with a guide part,
The passenger conveyor confirmation system according to claim 1. A demarcation line is provided on the tread of the step,
When the demarcation line of a step is no longer displayed within a predetermined range in the video acquired by the photographing terminal while the steps are moving in a circular manner, the detection unit is configured to detect the next demarcation line of the step. detect steps,
The passenger conveyor confirmation system according to claim 1. an area measuring unit that calculates the area of the predetermined color detected by the detection unit for each bolt and stores the calculated area in a storage device;
The determining unit is configured to determine the area of the bolt based on the area currently determined by the area measuring unit for the bolt in the step for which installation and removal are not planned, and the area previously determined for the bolt by the area measuring unit. Determine whether there is any looseness,
The passenger conveyor confirmation system according to claim 1. an area measuring unit that calculates the area of the predetermined color detected by the detection unit for each bolt and stores the calculated area in a storage device;
The determining unit determines whether or not the step has been attached and removed, based on the area currently determined by the area measuring unit for the bolt of the step and the area previously determined for the bolt by the area measuring unit. determine whether
The passenger conveyor confirmation system according to claim 1. the predetermined color is red;
The passenger conveyor confirmation system according to claim 1. A passenger conveyor confirmation method for confirming the fastening state of each bolt fixing each step to the chain in a passenger conveyor including a plurality of steps connectable to a circulating chain, the method comprising:
A washer having a bent portion with one side colored in a predetermined color is attached, a bolt is tightened, and the bent portion is bent so that the first side is exposed, so that the detection unit can Detecting the predetermined color for each bolt from an image taken of each bolt by a photographing terminal;
a determining unit determining whether each of the bolts is properly attached based on a result of detection by the detecting unit;
an output unit instructing the passenger conveyor to cycle through the plurality of steps to a position where the bolt determined by the determining unit as not being properly installed is visible;
Including passenger conveyor confirmation method.

Images