JP7327962B2 - WORK MONITORING DEVICE, WORK MONITORING SYSTEM, WORK MONITORING METHOD, AND PROGRAM - Google Patents

Description

The present invention relates to a work monitoring device, a work monitoring system, a work monitoring method, and a program.

2. Description of the Related Art A work monitoring technique is known that analyzes a captured image of a work site and automatically monitors work performed by a worker. For example, Patent Literature 1 discloses a work monitoring system that determines the start and end of work from captured images. This work monitoring system detects the movement of articles based on the difference in the rate of passage through various filters, in addition to analyzing the line of flow of workers in captured images.

JP 2019-16258 A

However, the work monitoring system disclosed in Patent Document 1 can only determine the start and end of movement work, and it is difficult to accurately determine various work performed by the worker. It cannot be said that it can be monitored.

SUMMARY OF THE INVENTION The present invention has been made in view of the circumstances described above, and provides a work monitoring device, a work monitoring system, a work monitoring method, and a program capable of accurately determining work performed by a worker. intended to

In order to achieve the above object, the work monitoring device according to the present invention includes:
position information acquisition means for acquiring position information indicating the position of the worker within a predetermined monitoring area;
a captured image acquiring means for acquiring a captured image of the worker;
Process area information that indicates the range of each process area that is predetermined as an area to be used in each process, and work master information that defines the work included in each process and the posture when the work is performed. and a storage means for storing
Posture determination means for determining a posture of the worker based on the captured image;
a process determination means for determining a process in which the worker is involved based on the position information and the process area information;
and work determination means for determining work performed by the worker based on the process in which the worker is involved , the posture of the worker, and the work master information .

Further, in order to achieve the above object, the work monitoring system according to the present invention includes:
A position specifying device that specifies the position of a worker within a predetermined monitoring area, an imaging control device that acquires a captured image of the worker, and a work monitoring device that determines the work performed by the worker. including
The work monitoring device
Posture determination means for determining a posture of the worker based on the captured image acquired from the imaging control device;
Process determination means for determining a process in which the worker is involved based on position information obtained from the position specifying device and process area information indicating the range of each process area predetermined as an area to be used in each process. and,
Based on work master information that defines the process in which the worker is involved, the posture of the worker, the work included in each process, and the posture during the work, the worker performs a work determination means for determining the work being performed.

Further, in order to achieve the above object, the work monitoring method according to the present invention comprises:
the computer
Acquiring position information indicating the position of the worker within a predetermined monitoring area,
Acquiring a captured image that captures the worker,
Determining the posture of the worker based on the captured image,
Based on the position information and process area information indicating the range of each process area predetermined as an area to be used in each process, determine the process in which the worker is engaged,
Based on work master information that defines the process in which the worker is involved, the posture of the worker, the work included in each process, and the posture during the work, the worker performs Determine what you are doing.

Further, in order to achieve the above object, the program according to the present invention is
the computer,
position information acquisition means for acquiring position information indicating the position of the worker within a predetermined monitoring area;
Captured image acquisition means for acquiring a captured image of the worker;
Process area information that indicates the range of each process area that is predetermined as an area to be used in each process, and work master information that defines the work included in each process and the posture when the work is performed. and storage means for storing
Posture determination means for determining the posture of the worker based on the captured image;
process determination means for determining a process in which the worker is involved based on the position information and the process area information;
It functions as work determination means for determining the work being performed by the worker based on the process in which the worker is involved , the posture of the worker , and the work master information .

ADVANTAGE OF THE INVENTION According to this invention, the operation|work which the worker is implementing can be accurately determined.

1 is a schematic diagram of a work monitoring system according to Embodiment 1 of the present invention; FIG. It is a figure for demonstrating the state in a factory. It is a block diagram which shows an example of the hardware constitutions of a work monitoring apparatus. It is a block diagram showing an example of functional composition of a work monitoring device. It is a figure which shows an example of worker / beacon correspondence information. It is a figure which shows an example of work log|history information. It is a figure which shows an example of a posture master. It is a figure which shows an example of a process master. FIG. 4 is a diagram for explaining determination of a process area to which a worker's position belongs; It is a figure which shows an example of a work master. 4 is a flowchart showing the flow of work determination processing; It is a figure which shows an example of a work display image. It is a figure for demonstrating the state in the factory which concerns on Embodiment 2 of this invention. It is a block diagram showing another example of the functional configuration of the work monitoring device. It is a figure which shows an example of semi-finished product and beacon correspondence information. It is a figure which shows an example of semi-finished product work log|history information. It is a figure which shows an example of a work master classified by product. It is a figure which shows an example of semi-finished product process information. 7 is a flow chart showing the flow of work adequacy determination processing. FIG. 10 is a diagram showing another example of a work display image;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(Embodiment 1)
A work monitoring system 1 according to Embodiment 1 of the present invention is a system for determining work performed by a worker at a work site. In the present embodiment, an example will be described in which the work monitoring system 1 is used to monitor a worker who manufactures products in a factory and the work being performed by the worker.

The work monitoring system 1 includes a position specifying device 100, a signal measuring device 101, a beacon device 102, an imaging control device 200, an imaging device 201, and a work monitoring device 300, as shown in FIG. The position specifying device 100, the imaging control device 200, and the work monitoring device 300 are communicably connected via a network NW. The network NW is any communication network, whether wired or wireless, such as the Internet, LAN (Local Area Network), VPN (Virtual Private Network), or the like. In addition, the position identifying device 100 receives measurement information from a plurality of signal measuring devices 101 that are communicably connected. The signal measurement device 101 receives radio signals transmitted from the beacon device 102 . The imaging control device 200 transmits imaging control signals to the plurality of communicably connected imaging devices 201 and receives captured images from the imaging devices 201 in response. The number of devices included in the work monitoring system 1 is arbitrary.

(Beacon device 102)
The beacon device 102 has a function of periodically (for example, at intervals of several seconds) transmitting a radio signal (radio signal) including identification information (beacon ID) of its own device. As shown in FIG. 2, it is assumed that each worker W always possesses a beacon device 102 in the factory. The beacon device 102 may be embedded in a mobile phone, smart phone, security card, or the like possessed by the worker. Note that the radio signal transmitted by the beacon device 102 may be a signal that is transmitted at regular intervals to notify the existence of itself. (BLE beacon) or the like can be used. Beacon device 102 is an example of the transmitting device of the present invention.

(Signal measuring device 101)
The signal measurement device 101 has a function of receiving a radio signal periodically transmitted from the beacon device 102 and measuring a reception mode at that time. As shown in FIG. 2, the signal measuring devices 101 are installed in a mesh pattern at regular intervals (for example, intervals of several meters) on the ceiling surface or wall surface that defines the monitoring area (space) in the factory FA. The signal measuring device 101 measures the radio wave arrival angle, received signal strength, arrival time, etc. of the received radio signal according to a predetermined positioning method used by the position identifying device 100 . After measuring the reception mode of the received radio signal, the signal measurement device 101 generates measurement information indicating the measurement result and transmits the measurement information to the position determination device 100 . The signal measuring device 101 is an example of the receiving device of the present invention.

(Positioning device 100)
Based on the measurement information acquired from the signal measuring device 101, the position identifying device 100 identifies the location of the beacon device 102, which is a positioning target, using a predetermined positioning method. The position specifying device 100 holds signal measuring device installation information indicating the installation position of each signal measuring device 101, and specifies the location of the beacon device 102 to be positioned using a predetermined positioning method. Positioning methods include an angle of arrival (AOA) method, a received signal strength indicator (RSSI) method, a time of arrival (TOA) method, and a time difference of arrival (TDOA) method. ) method, etc., or a combination thereof. After specifying the location of the beacon device 102, the position specifying device 100 generates position information including the beacon ID of the beacon device 102, and transmits the position information to the work monitoring device 300 via the network NW. The location of the beacon device 102 is represented, for example, by coordinate values in a two-dimensional orthogonal coordinate system or a three-dimensional orthogonal coordinate system.

(Imaging device 201)
The imaging device 201 is a camera that captures the situation in the factory, and as shown in FIG. 2, a plurality of imaging devices 201 are installed at predetermined positions such as the ceiling surface and the wall surface of the factory FA. The imaging device 201 generates a captured image of the worker to be imaged based on the imaging control signal acquired from the imaging control device 200 , and supplies the captured image to the imaging control device 200 . For the imaging device 201, for example, a PTZ (Pan Tilt Zoom) camera having a pan mechanism and a tilt mechanism for changing the imaging direction and a zoom mechanism for changing the imaging angle of view may be used. An omnidirectional camera without a PTZ function may be used if a narrow area is targeted.

(Imaging control device 200)
The imaging control device 200 is a device for controlling the imaging device 201 . The imaging control device 200 holds imaging device installation information indicating the installation position of the imaging device 201 in the factory FA, and based on the position information of the worker who is the imaging target included in the imaging request received from the work monitoring device 300 An imaging control signal for controlling the operation of the imaging device 201 is generated and transmitted to the imaging device 201 . The imaging control signal includes, for example, information indicating an imaging direction, an imaging angle of view, and the like calculated based on the worker's position information. In addition, in order to obtain captured images of the worker to be monitored from multiple directions, the imaging control device 200 causes each of the plurality of imaging devices 201 around the position of the worker to be imaged to acquire images according to their installation positions. It is assumed that an imaging control signal for instructing the imaging direction, the imaging angle of view, and the like is transmitted.

(Work monitoring device 300)
Based on the position information acquired from the position specifying device 100 and the captured image acquired from the imaging control device 200, the work monitoring device 300 detects the process in which the worker W is engaged, the posture of the worker W, and the work performed by the worker W. A display image showing the determination result is displayed.

(Hardware configuration of work monitoring device 300)
Next, the hardware configuration of the work monitoring device 300 will be described with reference to FIG. As shown in FIG. 3, the work monitoring device 300 includes a CPU (Central Processing Unit) 301, ROM (Read Only Memory) 302, RAM (Random Access Memory) 303, HDD (Hard Disk Drive) 304, display 305, input device 306 and a communication I/F 307 . These units are electrically connected to each other via a bus line BL.

The CPU 301 is an arithmetic unit that controls the entire work monitoring apparatus 300 by reading programs and data from the ROM 302 and HDD 304 onto the RAM 303 and executing processing.

The ROM 302 is a non-volatile memory that stores programs executed by the CPU 301 and data used in executing the programs. The ROM 302 stores, for example, control programs and data used for position specifying processing, which will be described later.

A RAM 303 is a volatile memory that temporarily holds various programs and various data read from the ROM 302 and HDD 304 , and is used as a work area for the CPU 301 .

The HDD 304 is a large-capacity, non-volatile memory device whose memory contents are rewritable. The HDD 304 stores various programs executed by the CPU 301 and various data. The HDD 304 stores, for example, various kinds of master information for determining the worker W's process, posture, work, and the like. The work monitoring device 300 may include a rewritable non-volatile storage device such as an SSD (Solid State Drive) in place of or in addition to the HDD 304 .

A display 305 is a display device such as an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), or an organic EL (Electro-Luminescence) display, and displays various images under the control of the CPU 301 .

The input device 306 is a keyboard, mouse, operation buttons, etc., and receives user operations, input of various data, and the like. The input device 306 receives, for example, user operations and data input. Note that the input device 306 may be configured by a touch panel including a display screen of the display 305 and a touch sensor superimposed thereon.

The communication I/F 307 is an interface for transmitting and receiving data between the position identifying device 100 and the imaging control device 200 via the network NW.

(Functional configuration of work monitoring device 300)
Next, the functional configuration of the work monitoring device 300 will be described with reference to FIG. 4 . The work monitoring device 300 includes a control section 310, a storage section 320, a display section 330, an input section 340, and a communication section 350, as shown in FIG.

The control unit 310 is configured by a CPU 301 , a ROM 302 , a RAM 303 and the like, and controls each component of the work monitoring device 300 . The control unit 310 functionally includes a position information acquisition unit 311 , a captured image acquisition unit 312 , a posture determination unit 313 , a process determination unit 314 , a work determination unit 315 and a display image generation unit 316 . These functional units are implemented by the CPU 301 executing control programs stored in the ROM 302 .

The position information acquisition unit 311 acquires position information from the position specifying device 100 via the communication unit 350 . The position information acquisition unit 311 refers to the worker/beacon correspondence information 321 to be described later, and specifies the worker ID associated with the beacon ID included in the position information acquired from the position specifying device 100 . Each component included in the control unit 310 including the position information acquisition unit 311 assigns the position of the beacon device 102 indicated by the position information acquired from the position specifying device 100 to the worker ID specified by the position information acquisition unit 311 It is regarded as the position of the worker W who was found and processed. The positional information acquiring section 311 is an example of the positional information acquiring means of the present invention.

The captured image acquisition unit 312 acquires a captured image of a specific worker W from the imaging control device 200 via the communication unit 350 . Based on the position information acquired by the position information acquisition unit 311, the captured image acquisition unit 312 generates an image capture request including the position information of the specific worker W and transmits it to the imaging control device 200. A captured image capturing the worker W is acquired from the imaging control device 200 . For example, if the camera to be controlled is a PTZ camera, the pan mechanism, tilt mechanism, and zoom mechanism are controlled based on the position information acquired by the position information acquisition unit 311 to acquire a photographed image at that position, and the target image is captured. get If the camera to be controlled is an omnidirectional camera, the image of the corresponding area is extracted based on the position information acquired by the position information acquisition unit 311 to obtain the target image. The captured image acquisition unit 312 is an example of the captured image acquisition unit of the present invention.

The posture determination unit 313 determines the posture of the worker W based on the captured image acquired by the captured image acquisition unit 312 . In addition, the attitude|position determination part 313 should just determine the attitude|position of the worker W using a well-known attitude|position determination technique. The posture determination unit 313 detects, for example, parts of the worker W's body (head, upper arm, forearm, trunk, upper leg, lower leg, etc.) from the captured image acquired by the captured image acquisition unit 312, and connects these parts. The posture of the worker W is determined using the joint portion as the joint portion. Posture determination unit 313 identifies posture ID of worker W by referring to posture master 323 stored in storage unit 320 . Posture determination unit 313 is an example of posture determination means of the present invention.

The process determination unit 314 determines the process in which the worker W is involved (hereinafter also referred to as "worker W's process"). The process determination unit 314 refers to the process master 324 stored in the storage unit 320 and identifies the process area to which the position of the beacon device 102 indicated by the position information acquired by the position information acquisition unit 311 belongs. The process determination unit 314 determines that the process corresponding to the process area specified in the process master 324 is the worker W's process. The process determination unit 314 is an example of the process determination means of the present invention.

The work determination unit 315 determines the work performed by the worker W (hereinafter also referred to as "work of the worker W"). The work determination unit 315 determines the work of the worker W based on the posture of the worker W determined by the posture determination unit 313 and the process of the worker W determined by the process determination unit 314 . The work determination unit 315 refers to the work master 325 stored in the storage unit 320 to identify the work ID associated with the combination of the posture ID and the process ID. The work determination unit 315 is an example of work determination means of the present invention.

The display image generation unit 316 generates various display images and controls the display unit 330 to display them. The display image generation unit 316 generates, for example, a work display image in which the position and work of the worker W, date and time information, etc. are reflected in the floor map and work management table of the factory FA, and controls the display unit 330 to display it. .

Storage unit 320 is configured by HDD 304 and stores various data such as various programs executed by control unit 310, input data, and transmission/reception data. The storage unit 320 stores worker/beacon correspondence information 321, work history information 322, attitude master 323, process master 324, and work master 325, for example. The storage unit 320 is an example of storage means of the present invention.

The worker/beacon correspondence information 321 is, as shown in FIG. This information is associated with the beacon ID. Control part 310 can grasp correspondence of worker W and beacon device 102 easily by this information.

The work history information 322 is information indicating the history of work performed by the worker W. FIG. In the work history information 322, as shown in FIG. 6, for each worker ID of the worker W, a process ID, a work ID, and a work date and time are associated with each other. The work history information 322 is updated each time the work determination unit 315 determines the work of the worker W. FIG.

The posture master 323 is master information that defines postures that the worker W can take during work. For example, as shown in FIG. 7, posture IDs and posture names are associated with each other. For example, the posture names include "closed leg standing" standing with legs closed, "spread leg standing" standing with legs spread to the left and right, "half bent", sitting on a chair This includes “sitting on a chair,” where the body is curled and squatting, and “sonkyo.”

The process master 324 is master information that defines each process area that is predetermined as an area to be used in each process and its range. For example, as shown in FIG. , a process area range indicating the range of the process area, a process ID, and a process name are associated with each other. The process area range is represented by coordinate values in, for example, a two-dimensional orthogonal coordinate system or a three-dimensional orthogonal coordinate system. The process master 324 is an example of process area information of the present invention.

Here, the process area range is represented only by the coordinate values of the vertices of the outline of the process area, and each process area range is an area surrounded by continuous line segments obtained by sequentially connecting each representative point. , as shown in FIG. 9, the process area C includes the process area B and the process area A, and the process area B includes the process area A. , determine whether the position of the worker W belongs to the process area A. If not, determine if it belongs to the process area B. If not, it belongs to the process area C. determine whether As a result, the number of determinations of the area to which the worker W's position belongs can be minimized. Note that the range of the process area may be a circle, a polygon, or the like, in addition to the rectangle.

The work master 325 is master information that defines the work included in each process and the posture when the work is performed. For example, as shown in FIG. The name is associated with the posture ID of the posture when the work is being performed. The work determination unit 315 determines the work (work ID and work name) associated with the combination of the process ID and the posture ID as the work of the worker W subject to work determination.

The display unit 330 is configured by the display 305, and according to the control of the control unit 310, performs analog signal conversion processing and the like on image data for display and displays various images. The display unit 330 displays the work display image generated by the display image generation unit 316, for example.

The input unit 340 is configured by the input device 306 and receives user operations, input of various data, and the like. The input unit 340 , for example, generates an operation signal according to the received operation and supplies it to the control unit 310 .

The communication unit 350 is configured by the communication I/F 307 and performs data transmission/reception with the position specifying device 100 and the imaging control device 200 via the network NW under the control of the control unit 310 . The communication unit 350 , for example, transmits the imaging request generated by the captured image acquiring unit 312 to the imaging control device 200 and receives the captured image corresponding to the imaging request from the imaging control device 200 .

Next, the work determination process executed by the control unit 310 of the work monitoring device 300 will be described with reference to the flowchart shown in FIG. 11 . The work determination process is a process of determining the work of the worker W whose work is to be determined based on the position information acquired from the position specifying device 100 and the captured image acquired from the imaging control device 200 . The control unit 310 starts work determination processing in response to the work monitoring device 300 being powered on.

When the work determination process is started, the control unit 310 first determines whether or not position information has been acquired (step S101). The position information acquisition unit 311 of the control unit 310 determines whether or not position information has been acquired from the position specifying device 100 via the communication unit 350 . If it is determined that the position information has not been acquired (step S101: NO), the position information acquisition unit 311 repeats the process of step S101 until the position information is acquired.

When determining that the position information has been acquired (step S101: YES), the control unit 310 determines the process of the worker W from the acquired position information (step S102). The position information acquisition unit 311 of the control unit 310 refers to the worker/beacon correspondence information 321 to identify the worker ID associated with the beacon ID included in the position information acquired by the position information acquisition unit 311, The position of the beacon device 102 indicated by the position information acquired from the position specifying device 100 is regarded as the position of the worker W to whom the identified worker ID is assigned. Then, the process determination unit 314 of the control unit 310 refers to the process master 324 to identify the process area to which the worker W's position belongs. The process determination unit 314 determines that the process (process ID) associated with the specified process area is the process (process ID) of the worker W. FIG.

Next, the control unit 310 determines whether or not the process (process ID) of the worker W is subject to work determination (step S103). If the process (process ID) of the worker W determined in step S102 is defined in the work master 325, the process determination unit 314 of the control unit 310 determines that the process is subject to work determination. It is determined that it is not subject to work determination. If it is determined that the task is not subject to work determination (step S103: NO), the control unit 310 returns to the process of step S101. By such processing, it is possible to omit the work determination of the worker W engaged in, for example, a simple process. In addition to the format shown in FIG. 10, the work master 325 may indicate that there is no work ID corresponding to the process ID in a metadata format such as work ID "W999".

On the other hand, when it is determined that the worker W is a work determination target (step S103: YES), the control unit 310 acquires a captured image of the worker W who is a work determination target (step S104). The captured image acquisition unit 312 of the control unit 310 generates an imaging request including the position information of the worker W subject to work determination based on the position of the worker W subject to work determination, and controls the communication unit 350 to capture the image. A request is sent to the imaging control device 200 . Upon receiving the imaging request, the imaging control device 200 generates an imaging control signal including information for instructing the imaging direction, the imaging angle of view, etc. based on the position information of the worker W whose work is to be determined, and transmits the imaging control signal to the imaging device 201. . The imaging control device 200 transmits the captured image captured by the imaging device 201 to the work monitoring device 300 according to the imaging control signal. Accordingly, the captured image acquisition unit 312 acquires a captured image of the worker W whose work is to be determined. In addition, when the space in the factory FA is limited, the position information acquisition unit 311 transmits an imaging request including an imaging instruction of predetermined coordinates (area) instead of the position information of the worker W, and performs imaging. The controller 200 may be controlled.

Next, the control unit 310 determines the posture of the worker W whose work is to be determined (step S105). The posture determination unit 313 of the control unit 310 determines the posture of the worker W whose work is to be determined based on the captured image acquired by the captured image acquisition unit 312 . The posture determination unit 313 refers to the posture master 323 and sets the posture ID associated with the determined posture as the posture ID of the worker W whose work is to be determined.

Next, the control unit 310 determines the work of the worker W whose work is to be determined (step S106). The work determination unit 315 of the control unit 310 refers to the work master 325 and corresponds to the combination of the process (process ID) of the worker W for work determination and the posture (posture ID) of the worker W for work determination. The assigned work (work ID) is determined to be the work (work ID) of the worker W whose work is to be determined.

Next, control unit 310 displays the determination result (step S107). The display image generation unit 316 of the control unit 310 generates a work display image in which the position and work of the worker W whose work is to be determined are reflected in the floor map and the work management table of the factory FA, and controls the display unit 330. to display. For example, the display image generation unit 316 arranges a predetermined figure (in the figure, ◯) at the location of the worker W on the floor map of the factory FA shown in FIG. A work display image that describes the name of the employee W and the work that is being performed may be generated. Also, the work display image may simply display the worker's processes, work and time information in a list form.

Subsequently, the control unit 310 updates the work history information 322 (step S108). The work determination unit 315 of the control unit 310 adds information that associates the worker ID, the process ID, the work ID, and the work date and time of the worker W whose work is to be determined to the work history information 322 stored in the storage unit 320. to update the work history information 322 . The work date and time may be, for example, the date and time when the work determination unit 315 determined the work of the worker W whose work is to be determined.

After executing the process of step S108, the control unit 310 returns the process to step S101 and repeatedly executes a series of processes from steps S101 to S108.

As described above, the work monitoring device 300 according to the present embodiment detects the process in which the worker W is engaged, The posture of the worker W and the work performed by the worker W are sequentially determined, and a display image showing the determination result is displayed. Accordingly, the work monitoring device 300 can accurately determine the work being performed by the worker.

(Embodiment 2)
In the first embodiment described above, an example in which the work monitoring device 300 determines the work performed by the worker W has been described. In Embodiment 2, an example in which the work monitoring device 300 determines the appropriateness of the work performed by the worker W will be described. Hereinafter, descriptions of configurations and functions similar to those of the work monitoring system 1 according to Embodiment 1 will be omitted, and only configurations and functions different from those of the work monitoring system 1 according to Embodiment 1 will be described.

In this Embodiment, as shown in FIG. 13, the beacon apparatus 102 shall be always possessed by the worker W, and shall be mounted|worn with half-finished product PS in the middle of manufacture. The position specifying device 100 locates the position of the beacon device 102 based on the information measured by the signal measuring device 101 of the radio signal transmitted from the beacon device 102 possessed by the worker W and the beacon device 102 attached to the semi-finished product PS. It is specified by a predetermined positioning method. The semi-finished product PS may be a large and heavy product that is moved by a crane or a vehicle instead of being conveyed by a belt conveyor as shown in FIG.

As shown in FIG. 14, the control unit 310 of the work monitoring device 300 according to the present embodiment further includes a work adequacy determination unit 317 in addition to the configuration of the first embodiment. The storage unit 320 further stores semi-finished product/beacon correspondence information 326 , semi-finished product work history information 327 , product-specific work master 328 , and semi-finished product process information 329 .

The process determination unit 314 determines the process of the worker W and the process to which the semi-finished product PS belongs (hereinafter also referred to as "process of the semi-finished product PS").

The work appropriateness determination unit 317 determines whether the work performed by the worker W whose work is to be determined is appropriate. Based on the position information of the semi-finished product PS, the work appropriateness determination unit 317 determines the process to which the semi-finished product PS belongs and the work performed on the semi-finished product PS, thereby determining the appropriateness of the work performed by the worker W. judge. In addition, the work monitoring device 300 determines omissions in work execution using semi-finished product work history information 327 that indicates the history of work performed on the semi-finished product PS. The work suitability determination unit 317 is an example of work suitability determination means of the present invention.

Semi-finished product/beacon correspondence information 326, as shown in FIG. This information is associated with the assigned beacon ID. The control part 310 can grasp|ascertain easily the correspondence of semi-finished product PS and the beacon apparatus 102 by this information.

The semi-finished product work history information 327 is information indicating the history of the work performed on the semi-finished product PS. As shown in FIG. 16, the semi-finished product work history information 327 associates a work ID with a work date and time for each semi-finished product ID of the semi-finished product PS.

The work master by product 328 is information indicating processes and work required to manufacture the product for each product type. As shown in FIG. 17, the work master by product 328 associates product type IDs, process IDs, and work IDs.
The product-specific work master 328 is an example of product-specific work information of the present invention.

The semi-finished product process information 329, as shown in FIG. 18, is information in which a semi-finished product ID is associated with the process ID of the process to which the semi-finished product PS belongs. The process ID of the process to which the semi-finished product PS belongs is updated each time the determination result of the process to which the semi-finished product PS belongs by the process determination unit 314 changes.

Next, the work adequacy determination process executed by the control unit 310 of the work monitoring device 300 will be described with reference to the flowchart shown in FIG. 19 . The work adequacy determination process is a process of determining the work appropriateness of the worker W whose work is to be determined based on the position information indicating the position of the semi-finished product PS acquired from the position specifying device 100 . The control unit 310 starts the work adequacy determination process when the power of the work monitoring device 300 is turned on or in response to an operation by the manager.

When the work suitability determination process is started, the control unit 310 first determines whether or not position information has been acquired (step S201). The position information acquisition unit 311 of the control unit 310 determines whether or not position information has been acquired from the position specifying device 100 via the communication unit 350 . If it is determined that the position information has not been acquired (step S201: NO), the position information acquisition unit 311 repeats the process of step S201 until the position information is acquired.

When determining that the position information has been acquired (step S201: YES), the control unit 310 determines whether or not the acquired position information indicates the position of the worker W (step S202). The position information acquisition unit 311 of the control unit 310 refers to the worker/beacon correspondence information 321 and determines whether or not the beacon ID included in the position information acquired by the position information acquisition unit 311 is registered. .

When determining that the position information acquired by the position information acquisition unit 311 is not the position information indicating the position of the worker W (step S202: NO), the control unit 310 determines the process of the semi-finished product PS (step S203). . The location information acquisition unit 311 of the control unit 310 refers to the semi-finished product/beacon correspondence information 326 to identify the semi-finished product ID associated with the beacon ID included in the location information acquired by the location information acquisition unit 311, The position of the beacon device 102 indicated by the position information acquired from the position specifying device 100 is regarded as the position of the semi-finished product PS to which the specified semi-finished product ID is assigned. Then, the process determination unit 314 of the control unit 310 refers to the process master 324 to determine the process area to which the position of the semi-finished product PS to be determined belongs, and the process (process ID) associated with the determined process area. is determined as the process (process ID) to which the semi-finished product PS to be determined belongs.

Next, it is determined whether the process to which the semi-finished product PS to be determined in step S203 belongs is the same process as the previous determination (step S204). The process determination unit 314 refers to the semi-finished product process information 329 to determine the process ID of the process to which the semi-finished product PS to be determined in step S203 belongs and the determination target registered in the semi-finished product process information 329. The determination is made according to the difference between the semi-finished product PS and the process ID associated with the semi-finished product ID. When determining that the process to which the semi-finished product PS subject to determination belongs is the same process as the previous determination (step S204: YES), the control unit 310 returns the process to step S201.

On the other hand, if it is determined that the process to which the semi-finished product PS to be determined belongs is different from the time of the previous determination (step S204: NO), that is, it is determined that the process to which the semi-finished product PS to be determined belongs has changed. If so, the control unit 310 determines whether or not all the tasks scheduled in the steps before the transition have been performed (step S205). The process determination unit 314 of the control unit 310 refers to the product-specific work master 328 and the semi-finished product work history information 327, and determines the process ID of the pre-migration process of the semi-finished product PS to be determined in the product-specific work master 328. It is determined according to whether or not all associated work IDs are registered in the semi-finished product work history information 327 .

When it is determined that all the work scheduled in the pre-transition process has not been performed (step S205: NO), the control unit 310 warns that the work that should be performed in the pre-transition process has not been performed. Notify (step S206). For example, as shown in FIG. 20, the display image generation unit 316 of the control unit 310 arranges a predetermined figure (□ in the figure) at the location of the semi-finished product PS on the floor map of the factory FA, and displays the figure (a hatched balloon extending from the leftmost □ in the drawing) is generated a work display image in which a message notifying that there is work that has not been performed is generated and displayed on the display unit. In addition, a configuration may be adopted in which the patrol lamp in the factory sounds a warning display (blinking red, etc.) or sounds a warning sound, or the process manager is notified by e-mail.

Next, the control unit 310 updates the product process information (step S207). The process determination unit 314 of the control unit 310 updates the process of the semi-finished product PS to be determined in the product process information to the process determined in step S203. After executing the process of step S207, control unit 310 returns the process to step S201.

In step S202, when it is determined that the position information acquired by the position information acquisition unit 311 is the position information indicating the position of the worker W (step S202: YES), the control unit 310 determines the position of the worker W from the acquired position information. (step S208). The position information acquisition unit 311 of the control unit 310 refers to the worker/beacon correspondence information 321 to identify the worker ID associated with the beacon ID included in the position information acquired by the position information acquisition unit 311, The position of the beacon device 102 indicated by the position information acquired from the position specifying device 100 is regarded as the position of the worker W to whom the identified worker ID is assigned. Then, the process determination unit 314 of the control unit 310 refers to the process master 324 to identify the process area to which the worker W's position belongs. The process determination unit 314 determines that the process (process ID) associated with the specified process area is the process (process ID) of the worker W. FIG.

Next, the control unit 310 determines whether or not the process (process ID) of the worker W is subject to work determination. (Step S209). The process determination unit 314 of the control unit 310 determines that the process (process ID) of the worker W determined in step S202 is subject to work determination if the process (process ID) is defined in the work master 325, and if not defined. , is determined to be outside the scope of work determination. When it is determined that the work is not subject to work determination (step S209: NO), the control unit 310 repeats the processing of step S201 until the position information is acquired.

On the other hand, when it is determined that the worker W is a work determination target (step S209: YES), the control unit 310 acquires a captured image of the worker W who is a work determination target (step S210). Here, since the processing of steps S210 to S214 is the same as the processing of steps S104 to S108 in the flowchart of FIG. 11 described in the first embodiment, description thereof will be omitted.

After executing the process of step S214, the control unit 310 acquires the same semi-finished product ID as the process of the worker W whose work is to be determined (step S215). The control unit 310 refers to the semiconductor process information and acquires the semi-finished product ID associated with the process ID of the process of the worker W whose work is to be determined.

Next, control unit 310 updates semi-finished product work history information 327 (step S216). The control unit 310 stores semi-finished product work history information stored in the storage unit 320 in which the semi-finished product ID acquired in step S215 is associated with the work ID of the worker W whose work is to be determined in step S202 and the work date and time. 327 to update semi-finished product work history information 327 . The work date and time may be, for example, the date and time when the work determination unit 315 determined the work of the worker W whose work is to be determined.

Next, the control unit 310 reads the product-specific work master 328 stored in the storage unit 320 into the RAM 303 (step S217), and determines whether the work of the worker W whose work is to be determined is defined in the product-specific work master 328. is determined (step S218). In the product-specific work master 328, the control unit 310 assigns the product type ID of the product that is the finished product of the semi-manufactured product PS to be determined to the process of the worker W to be determined in step S208 and the process of the worker W to be determined in step S212. It is determined according to whether or not the work of the worker W whose work is to be determined is associated.

When it is determined that the work of the worker W whose work is to be determined is not defined in the product-specific work master 328 (step S218: NO), the control unit 310 issues a warning (step S219). For example, as shown in FIG. 20, the display image generation unit 316 generates a balloon extending from a figure indicating the worker W to be subjected to work determination placed on the floor map of the factory FA (hatching extending from the upper right circle in the figure is applied). A work display image is generated in which a message to the effect that the work being performed is activated is written in a speech bubble that is displayed. In addition, as in the case of the semi-finished product PS that has work that has not been performed in the previous process, the patrol lamp in the factory is displayed with a warning display (red blinking, etc.) or a warning sound is sounded, and the process manager is notified by e-mail. It may be configured as After executing step S219, control unit 310 returns the process to step S201.

On the other hand, if it is determined that the work of the worker W subject to work determination is defined in the product-specific master 328 (step S218: YES), the control unit 310 determines the work included in the process of the worker W subject to work determination. are all completed (step S220). The control unit 310 refers to the work master 325 and the work history information 322, and all the work associated with the process of the worker W whose work is to be determined defined in the work master 325 is checked in the work history information 322. It is judged by confirming whether it is registered.

When it is determined that all the work included in the process of the worker W subject to work determination has been completed (step S220: YES), the completion of the process is notified (step S221). For example, as shown in FIG. 20, the display image generation unit 316 of the control unit 310 arranges a predetermined figure (□ in the figure) at the location of the semi-finished product PS on the floor map of the factory FA, and from that figure A work display image is generated with a message notifying that there is work that has not been performed in an extending balloon (a hatched balloon extending from the leftmost square in the figure), and a message indicating that the process has been completed is displayed on the display unit. display. In addition, a configuration may be adopted in which a patrol lamp in the factory is operated with a display indicating normality (green lighting, etc.), or the process manager is notified by e-mail. After notification, control unit 310 returns the process to step 201 .

On the other hand, when determining that all the work included in the process of the worker W subject to work determination has not been completed (step S220: NO), the control unit 310 returns the process to step S201.

As described above, the work monitoring device 300 according to the second embodiment determines the process to which the semi-finished product PS belongs and the work performed on the semi-finished product PS based on the position information of the semi-finished product PS. Judges the appropriateness of the work performed by the worker W. In addition, the work monitoring device 300 determines omissions in work execution using semi-finished product work history information 327 that indicates the history of work performed on the semi-finished product PS. In this way, the work monitoring device 300 according to Embodiment 2 makes the work of the worker W more efficient by determining the appropriateness of the work performed by the worker W and the omission of the work performed on the semi-finished product PS. can be monitored accurately.

The present invention is not limited to the above-described embodiments, and various modifications and applications are possible without departing from the gist of the present invention.

In the above embodiment, the work monitoring device 300 receives the positioning result obtained by positioning the position of the beacon device 102 based on the measurement information of the radio signal transmitted from the beacon device 102 in the factory FA by the position specifying device 100. , the positions of the worker W and the semi-finished product PS are obtained. However, means for the work monitoring device 300 to acquire the positions of the worker W and the semi-finished product PS are not limited to this, and include GPS (Global Positioning System), PDR (Pedestrian Dead-Reckoning), ultrasonic waves, RFID (Radio Frequency Identifier) or the like may be used.

Further, the functions provided by each of the work monitoring device 300, the position specifying device 100, and the imaging control device 200 included in the work monitoring system 1 in the above embodiment may be provided by other devices. For example, the work monitoring device 300 may have the positioning function of the position specifying device 100 and the imaging control function of the imaging control device 200 . In this case, although the processing load of the work monitoring device 300 increases, the work monitoring system 1 can be slimmed down and the cost can be reduced.

In the above embodiment, the control program that defines the operation of work monitoring device 300 is stored in ROM 302 . However, the present invention is not limited to this, and the control program for executing the various processes described above can be implemented in an existing general-purpose computer, framework, workstation, or the like. , may function as a device corresponding to the work monitoring device 300 .

In addition, the functions of the work monitoring device 300, the position specifying device 100, and the imaging control device 200 included in the work monitoring system 1 in the above embodiment are not built on specific hardware, but are individually SaaS ( It may be provided as a cloud service such as Software as a Service).

The method of providing such a program is arbitrary, and for example, storing and distributing it in a computer-readable recording medium (flexible disc, CD (Compact Disc)-ROM, DVD (Digital Versatile Disc)-ROM), etc. Alternatively, the program may be stored in storage on a network such as the Internet, and provided by downloading the program.

Reference Signs List 1 Work monitoring system 100 Position specifying device 101 Signal measuring device 102 Beacon device 200 Imaging control device 201 Imaging device 300 Work monitoring device 301 CPU 302 ROM 303 RAM 304 HDD 305 Display 306 Input device 307 Communication I/F 310 Control unit 311 Position information acquisition unit 312 Captured image acquisition unit 313 Posture determination unit 314 Work Determination unit 315 Process determination unit 316 Display image generation unit 317 Work appropriateness determination unit 320 Storage unit 321 Worker/beacon correspondence information 322 Work history information 323 Posture master 324 Process master 325 Work master 326 Semi-finished product/beacon correspondence information 327 Semi-finished product work history information 328 Work master by product 329 Semi-finished product process information 330 Display unit 340 Input unit 350 …Communication department, BL…Bus line, FA…Factory, NW…Network, PS…Semi-finished product, W…Worker

Claims (6)

position information acquisition means for acquiring position information indicating the position of the worker within a predetermined monitoring area;
a captured image acquiring means for acquiring a captured image of the worker;
Process area information that indicates the range of each process area that is predetermined as an area to be used in each process, and work master information that defines the work included in each process and the posture when the work is performed. and a storage means for storing
Posture determination means for determining a posture of the worker based on the captured image;
a process determination means for determining a process in which the worker is involved based on the position information and the process area information;
work determination means for determining the work being performed by the worker based on the process in which the worker is involved , the posture of the worker , and the work master information ;
Work monitoring device. further comprising work adequacy determination means for determining the adequacy of the work performed by the worker,
The storage means stores product-specific work information in which work to be performed in each process in manufacturing each product is defined in advance,
The position information acquiring means acquires position information indicating the position of the semi-finished product in the middle of manufacturing within the monitoring area,
The process determination means determines the process to which the semi-finished product belongs based on the position information indicating the position of the semi-finished product and the process area information,
The work appropriateness determination means determines that the work performed by the worker determined by the work determination means is the work to be performed in the process to which the semi-finished product determined by the process determination means belongs to the product-specific work information. Determining the suitability of the work performed by the worker based on whether it is defined in
The work monitoring device according to claim 1. The position of the worker is obtained by a predetermined positioning method based on the measurement result of measuring the reception mode when the receiving device receives the radio signal periodically transmitted from the transmitting device possessed by the worker. is the position
The work monitoring device according to claim 1 or 2. A position specifying device that specifies the position of a worker within a predetermined monitoring area, an imaging control device that acquires a captured image of the worker, and a work monitoring device that determines the work performed by the worker. including
The work monitoring device
Posture determination means for determining a posture of the worker based on the captured image acquired from the imaging control device;
Process determination means for determining a process in which the worker is involved based on position information obtained from the position specifying device and process area information indicating the range of each process area predetermined as an area to be used in each process. and,
Based on work master information that defines the process in which the worker is involved, the posture of the worker, the work included in each process, and the posture during the work, the worker performs and a work determination means for determining the work being performed,
Work monitoring system. the computer
Acquiring position information indicating the position of the worker within a predetermined monitoring area,
Acquiring a captured image that captures the worker,
Determining the posture of the worker based on the captured image,
Based on the position information and process area information indicating the range of each process area predetermined as an area to be used in each process, determine the process in which the worker is engaged,
Based on work master information that defines the process in which the worker is involved, the posture of the worker, the work included in each process, and the posture during the work, the worker performs determine the work being done,
Work monitoring method. the computer,
position information acquisition means for acquiring position information indicating the position of the worker within a predetermined monitoring area;
Captured image acquisition means for acquiring a captured image of the worker;
Process area information indicating the range of each process area predetermined as an area to be used in each process, and work master information defining the work included in each process and the posture when the work is performed. and storage means for storing
Posture determination means for determining the posture of the worker based on the captured image;
Process determination means for determining a process in which the worker is involved based on the position information and the process area information;
Functioning as work determination means for determining the work being performed by the worker based on the process in which the worker is involved , the posture of the worker , and the work master information ;
program.

Images