JP7442066B2 - Work display method and work display device - Google Patents

Description

The present invention relates to a work display method and a work display device.

2. Description of the Related Art In the past, studies have been conducted to detect assembly errors made by workers performing assembly work in factories and the like. Patent Document 1 discloses that by detecting the position of the worker's hand based on an image taken with a camera, it is possible to determine whether the worker has picked up a component from the correct component placement section among multiple component placement sections. A production system (work display system) for determining whether

JP 2018-45669 Publication

By the way, in such a production system, it is desired that false detections be suppressed.

Therefore, the present invention provides a work display method and a work display device that can suppress false detections.

A work display method according to one aspect of the present invention includes: a first work in which a part of the worker's body passes through a first area and does not pass through a second area different from the first area; To display work details to a worker who performs a plurality of tasks including a second task in which a part of the worker's body passes through the second area and does not pass through the first area. The work display method includes a first display step for displaying a first work content in the first work, and a second display step for displaying a second work content in the second work, The first display step enables detection of whether or not a part of the worker's body passes through the first area, and a part of the worker's body passes through the second area. The first work has been performed normally when a part of the body of the worker is detected in the first region based on the sensing result obtained from the sensor unit, with the detection of whether or not the work is disabled. outputting information indicating as the first work content to a display device, and the second displaying step enables detection of whether or not a part of the worker's body passes through the second area, and The detection of whether or not a part of the worker's body passes through the first area is disabled, and the part of the worker's body passes in the second area based on the sensing result obtained from the sensor unit. If detected, information indicating that the second work has been performed normally is output to the display device as the second work content.

Further, the work display device according to one aspect of the present invention is configured to perform a first work in which a part of the worker's body passes through a first area and does not pass through a second area different from the first area. , Displaying work details to a worker who performs a plurality of tasks including a second task in which a part of the worker's body passes through the second region and does not pass through the first region. The work display device is configured to enable detection of whether a part of the worker's body passes through the first region when the first work is performed, and to detect whether or not a part of the worker's body passes through the first region; invalidating the detection of whether or not a part of the worker's body passes through the area, and when the second work is performed, the part of the worker's body passing through the second area; a control unit that enables detection of whether or not a part of the worker's body passes through the first region and disables detection of whether or not a part of the worker's body passes through the first region; , when a part of the body of the worker is detected in the first area based on the sensing result obtained from the sensor section, information indicating that the first work has been performed normally is provided as the first work content. and when a part of the body of the worker is detected in the second region based on the sensing result obtained from the sensor section when the second work is performed, and an output unit that outputs information indicating that the second work has been performed normally to the display device as second work content.

Note that these comprehensive or specific aspects may be realized in a system, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, and the system, integrated circuit, computer program, and recording It may be implemented with any combination of media.

According to the work display method and the like according to one aspect of the present invention, false detection can be suppressed.

FIG. 1 is a block diagram showing the functional configuration of a work instruction system according to an embodiment. FIG. 2A is a diagram showing an example of a work table. FIG. 2B is a diagram showing an example of a detection table. FIG. 3 is a schematic diagram showing detection points according to the embodiment. FIG. 4A is a first diagram for explaining the basic operation of the work instruction device according to the embodiment. FIG. 4B is a second diagram for explaining the basic operation of the work instruction device according to the embodiment. FIG. 4C is a third diagram for explaining the basic operation of the work instruction device according to the embodiment. FIG. 4D is a fourth diagram for explaining the basic operation of the work instruction device according to the embodiment. FIG. 5 is a sequence diagram showing the operation of the work instruction system according to the embodiment. FIG. 6 is a flowchart showing the operation of the work instruction device according to the embodiment. FIG. 7 is a flowchart showing the operation of the work instruction device according to the first modification of the embodiment. FIG. 8 is a flowchart showing the operation of the work instruction device according to the second modification of the embodiment. FIG. 9 is a flowchart showing the operation of the work instruction device according to the third modification of the embodiment. FIG. 10 is a flowchart showing the operation of the work instruction device according to the fourth modification of the embodiment.

Embodiments will be described below with reference to the drawings. The embodiments described below are all inclusive or specific examples. The numerical values, shapes, materials, components, arrangement positions and connection forms of the components, steps, order of steps, etc. shown in the following embodiments are merely examples, and do not limit the present invention. Further, among the constituent elements in the following embodiments, constituent elements that are not described in the independent claims will be described as arbitrary constituent elements.

Furthermore, each figure is a schematic diagram and is not necessarily strictly illustrated. Furthermore, in each figure, substantially the same configurations are denoted by the same reference numerals, and overlapping explanations may be omitted or simplified.

(Embodiment)
[1. Work instruction system configuration]
First, the configuration of a work instruction system according to an embodiment will be explained using FIGS. 1 to 3. FIG. 1 is a block diagram showing the functional configuration of a work instruction system 1 according to an embodiment.

As shown in FIG. 1, the work instruction system 1 includes a work instruction device 10, a first driver 20, a second driver 30, a sensor device 40, and a display device 70. Although an example in which the work instruction system 1 includes two tools (the first driver 20 and the second driver 30) will be described below, the work instruction system 1 is not limited thereto. Note that hereinafter, when the first driver 20 and the second driver 30 are not distinguished, they will also be simply referred to as drivers. Note that the work instruction system 1 is an example of a work display system.

The work instruction device 10 is a server device that enables prevention of work mistakes, support for learning, observance of work time, work improvement, notification of work mistakes, and the like. The basic operation of the work instruction device 10 will be described later. The work instruction device 10 according to the present embodiment provides work instructions, detects work errors, etc. to a worker who performs a one-person assembly work in which one person is in charge of multiple tasks, for example, in an assembly work or the like. Note that the work performed by the worker includes, for example, work that uses a tool (eg, a screwdriver) and work that does not use a tool. A work without tools is a work that does not use any of the tools used in any of the plurality of works. Operations without tools include manual operations, such as inserting washers, tightening clips, and inspection operations. Note that the work instruction device 10 is an example of a work display device for displaying on the display device 70 the contents of the work performed by the worker.

The work instruction device 10 includes a communication section 11, a control section 12, and a storage section 13.

The communication unit 11 is a communication interface that is communicably connected to various devices included in the work instruction system 1 via wireless communication or wired communication. The communication unit 11 outputs, to the sensor device 40, sensor control information for controlling the sensor device 40, which is generated by the control unit 12, for example. The communication unit 11 also acquires information based on the sensing results of the sensor unit 60 via the sensor device 40. In this way, the communication unit 11 functions as an output unit that outputs sensor control information and an acquisition unit that acquires sensing results from the sensor unit 60.

Further, the communication unit 11 may acquire a start signal indicating the start and an end signal indicating the end of each of the plurality of tasks. For example, when the work is a work using a driver, the communication unit 11 may acquire at least one of a start signal and an end signal from the first driver 20 or the second driver 30. Further, the communication unit 11 may acquire at least one of the start signal and the end signal, for example, through an operator's operation (for example, an operation on a button or a foot switch (not shown)).

The control unit 12 generates and outputs information related to processing executed by the device to various devices connected to the work instruction device 10, and information acquired by the device from the various devices (for example, acquired by measurement). This is a processing unit that acquires information and performs predetermined processing based on the information.

Specifically, the control unit 12 sets the driver control information for controlling the first driver 20 and the second driver 30 based on the work table T1 (see FIG. 2A) stored in the storage unit 13, for example. The signal is output to the first driver 20 and the second driver 30. Further, the control unit 12 outputs sensor control information for controlling various sensors included in the sensor device 40 to the sensor device 40 based on the detection table T2 (see FIG. 2B) stored in the storage unit 13. .

Further, the control unit 12 determines whether the work has been performed normally based on the sensing results of various sensors obtained from the sensor device 40. Then, the control unit 12 outputs information for displaying the determination result to the display device 70 via the communication unit 11.

The storage unit 13 is a storage device that stores a control program that is executed by the control unit included in the work instruction device 10 and the control unit 12 . The storage unit 13 also stores a work table T1 and a detection table T2. Further, the storage unit 13 may store information (for example, sensing results, etc.) acquired via the communication unit 11. The storage unit 13 is realized by, for example, a semiconductor memory.

Here, the working table T1 and the detection table T2 stored in the storage unit 13 will be explained with reference to FIGS. 2A and 2B. FIG. 2A is a diagram showing an example of the work table T1. Note that FIG. 2A shows a case where a screw is tightened as an example of a screw. Note that hereinafter, a screw will also be simply referred to as a screw.

As shown in FIG. 2A, the storage unit 13 stores a work table T1 in which work procedures, work names, driver names, numbers of screws, and upper and lower limit pulses are associated with each other. The work in work procedures 1, 2, and 4 is an example of work that uses a driver, and the work in work procedure 2 is an example of work that does not use a driver. In other words, the work table T1 is a table for performing a plurality of tasks including tasks that use a driver and tasks that do not use a driver. Note that the number and order of tasks using a driver and tasks not using a driver included in the work table T1 are not particularly limited.

The work procedure indicates the order of multiple tasks performed by a worker. The work procedure is predetermined. The example in FIG. 2A shows that work steps 1 to 4 are performed in that order.

The work name indicates the content of the work, and is set for each of a plurality of works. The worker can know the content of the work just by looking at the work name.

The driver name indicates a name for the operator to identify the driver, and is set for each driver. The driver name may be the driver's model number, etc., as long as the operator can identify the driver.

The number of screws indicates the number of screws to be tightened in the relevant work.

The upper limit pulse and the lower limit pulse are threshold values (number of pulses) used by the control unit 12 to determine whether the work using the screwdriver is completed based on the screw tightening information. The upper limit pulse and the lower limit pulse are determined, for example, based on the number of rotations (or number of pulses) when the screw tightening work (screw tightening work) is properly completed by each of the plurality of workers. The upper limit pulse and the lower limit pulse are, for example, based on the rotation speed of each of the plurality of workers, the rotation speed above a predetermined number (for example, the maximum rotation speed) and the rotation speed below a predetermined value (for example, the minimum rotation speed). may be determined. This allows the upper limit pulse and the lower limit pulse to be appropriately set even if the number of rotations when the screw tightening operation is appropriately completed by a plurality of workers is different.

Note that the work table T1 only needs to include at least one of the upper limit pulse and the lower limit pulse. Furthermore, when the screw tightening information includes torque information, the work table T1 may include at least one of an upper limit and a lower limit of the torque. In addition, the work table T1 does not need to include information on the upper limit panel and lower limit pulse when determining whether the driver has completed the work.

Work in work procedure 1 (hereinafter also referred to as work 1) indicates that the work involves tightening two screws A using driver X. Driver X is, for example, the first driver 20. In addition, the upper limit pulse and the lower limit pulse are standards for determining whether screw tightening of screw A is completed when screw A is tightened using driver X, and corresponds to the number of rotations of screw A. This is the numerical value.

The work of work procedure 2 (hereinafter also referred to as work 2) indicates that the work involves tightening three screws B using a driver Y. In work 2, a different driver is used than in work 1. Driver Y is, for example, the second driver 30.

The work in work procedure 3 (hereinafter also referred to as work 3) is an example of work for attaching one clip.

The work in work procedure 4 (hereinafter also referred to as work 4) shows an example of a work in which four screws C are tightened using the same driver as in work procedure 1.

As described above, the work instruction device 10 provides information for a worker to perform a plurality of tasks, including tasks using a driver (for example, screw tightening) and tasks not using a driver, according to predetermined work procedures. (For example, a work table T1) is held.

Next, the detection table T2 stored in the storage unit 13 will be explained. FIG. 2B is a diagram showing an example of the detection table T2.

As shown in FIG. 2B, the storage unit 13 stores a detection table T2 in which work procedures, work names, and information regarding the sensor device 40 are associated with each other. The information regarding the sensor device 40 includes a detection point sensor, a prohibited point sensor, a stop sensor, a detection site, a detection color, and the shape of the detection point. Note that the information regarding the sensor device 40 only needs to include at least information regarding the detection point sensor.

The detection point sensor indicates a sensor that is operated to determine whether the current work has been performed normally. For example, in work 1, an example is shown in which sensor a among sensors a to sensor d is operated as a detection point sensor.

The prohibited point sensor indicates a sensor that is operated to determine whether or not a part of the worker's body has passed through a prohibited point that the worker's body is not allowed to pass during the current work. . For example, in work 1, an example is shown in which sensor c among sensors a to sensor d is operated as a prohibition point sensor. Further, for example, in work 2, an example is shown in which none of the sensors is operated as the prohibition point sensor.

The stop sensor indicates a sensor that stops operating in the current work. In other words, the sensors listed as stop sensors do not perform sensing during the work. For example, in work 1, an example is shown in which the operations of sensor c and sensor d among sensors a to d are stopped. Note that if the sensor device 40 does not control the start and stop of the operations of the sensors a to d of the sensor unit 60, the detection table T2 may not include information about the stopped sensors. Note that at least one sensor is set as the stop sensor.

The detection site indicates a target site of the worker passing through a predetermined area (detection point) for determining whether the work has been performed normally. For example, this indicates that in order for Work 1 to be performed normally, the worker's right hand (an example of a part of the worker's body) needs to pass through a predetermined area.

Note that if the sensor control unit 50 does not have a function of identifying the body part of the worker from the sensing results of the sensor unit 60, the item of the detected body part may not be included in the detection table T2.

The detection color indicates the color of the detection target for determining whether the work has been performed normally. For example, this indicates that in order for Work 2 to be performed normally, the color of the detection target needs to be blue. The detection target may be a part of the worker's body or a part used in the work. That is, the color to be detected may be the color of a part of the worker's body or the color of a part. Note that the color of the part of the worker's body here, using the hand as an example, is the color of the skin if the work is done with bare hands, and the color of the part of the worker's body if the work is done with gloves etc. It's the color of the gloves. Furthermore, if the sensing result from the sensor unit 60 does not include color information, the detection table T2 may not include items related to detected colors.

The shape of the detection point indicates the shape of the target area sensed by the sensor unit 60. The shape of the detection point includes a dot shape, a line shape, and a planar shape. For example, in work 1, an example is shown in which the detection point of sensor a (sensor for detection point) is dot-like. Note that when the detection point is planar, information regarding the exclusive area of a part of the worker's body in the planar region may be included. In FIG. 2B, the information regarding the exclusive area is the ratio of the exclusive area (for example, in FIG. 80% or more).

Referring again to FIG. 1, the first driver 20 and the second driver 30 are examples of tools that can be operated by power used by an operator in work using the tools. Note that the tool here means, for example, a power tool. In addition, the motive power is electricity, air, or the like. The first driver 20 is, for example, a fastening tool used for tightening screws A and C, and is an example of a first tool. The second driver 30 is a fastening tool different from the first driver 20. The second driver 30 is, for example, a fastening tool used for tightening the screw B, and is an example of a second tool. Note that the number and types of drivers connected to the work instruction device 10 are not particularly limited.

Although not shown, each of the first driver 20 and the second driver 30 includes a communication section for communicating with the work instruction device 10, a pulse measurement section for measuring the number of rotations of the driver, and a torque-up, rotation start, and and a detection section that detects the end of rotation. The pulse measuring section has a circuit that is built into a motor (not shown) of the driver and can measure a pulse signal generated by an encoder (not shown), for example, and detects the rotation speed from the measurement result of the pulse signal. When the motor rotates, the encoder emits a pulse signal as a corresponding rotation signal. The detection unit detects torque increase, start of rotation, and end of rotation, for example, by measuring current consumption of the driver. The communication unit processes at least one of the measurement results measured by the pulse measurement unit and the detection results detected by the detection unit (for example, rotation start and rotation end detection results, which are examples of start signals and end signals). Output to the instruction device 10.

Note that each of the first driver 20 and the second driver 30 may have a processing unit that determines whether screw tightening is completed based on the number of rotations measured by the pulse measurement unit.

The sensor device 40 performs sensing of detection points based on sensor control information from the work instruction device 10 and outputs the sensing result to the work instruction device 10. The sensor device 40 includes a sensor control section 50 and a sensor section 60.

The sensor control unit 50 is a processing unit that controls the sensor unit 60 based on sensor control information from the work instruction device 10. Further, the sensor control unit 50 acquires sensing results from the sensor unit 60 and outputs information based on the acquired sensing results to the work instruction device 10.

The information based on the sensing results may include the sensing results themselves, or may include analysis results obtained by analyzing the sensing results (for example, when the sensing results are images, image analysis results). When the sensing result is an image, the sensor control unit 50 determines the body parts of the worker (for example, head, hands (right hand, left hand, etc.), arms (right arm, left arm, etc.), legs, etc.) based on the image. It may also have a function to detect. That is, the sensor device 40 may be a so-called motion sensor. Furthermore, when the detection point is planar, the sensor control unit 50 may have a function of calculating the above-mentioned exclusive area based on an image that is a sensing result. The worker's body parts and exclusive area are examples of analysis results.

The sensor control unit 50 is realized by, for example, a microcomputer. The sensor control unit 50 reads a control program from a built-in storage unit and executes the read program.

The sensor unit 60 includes one or more sensors for detecting whether a part of the worker's body has passed through a detection point. In this embodiment, the sensor section 60 is composed of sensors a to d. Each of the sensors a to d performs sensing at a detection point set for each sensor, and outputs the sensing results to the sensor control unit 50.

Sensors a to d may be sensors that can obtain sensing results for determining whether or not a part of the worker's body has passed through a detection point, and may be an imaging device, or may be an imaging device. It may be an optical sensor or an area sensor that detects the presence or absence of light by blocking light, or a combination thereof. Furthermore, each of the sensors a to d may be of the same type, or may be of different types. Sensors a to d may be appropriately determined depending on, for example, the work content, detection accuracy, and the shape of the detection point. Note that the number of sensors included in the sensor section 60 is not particularly limited.

Note that the sensor device 40 does not need to include the sensor control section 50. In this case, the work instruction device 10 may have the functions that the sensor control unit 50 has, for example. The work instruction device 10 may output sensor control information to each sensor of the sensor unit 60 via the communication unit 11, and may acquire sensing results from each sensor of the sensor unit 60.

As shown in FIG. 2B, in this embodiment, sensor a is a sensor for determining whether a part of the worker's body has passed through a detection point (an example of the first region) in work 1. Sensor b is a sensor for determining whether a part of the worker's body has passed through a detection point (an example of the second region) in work 2. Sensor c is a sensor for determining whether a part of the worker's body has passed through a detection point (an example of the third region) in work 3. Sensor d is a sensor for determining whether a part of the worker's body has passed through a detection point (an example of the fourth region) in work 4. The first to fourth regions are, for example, regions that do not overlap with each other.

Work 1 is a work in which a part of the worker's body passes through a first region and does not pass through a second region different from the first region (an example of the first work). Work 2 is a work in which a part of the worker's body passes through the second region and does not pass through the first region (an example of the second work). Furthermore, in the first task, a part of the worker's body is prohibited from passing through the third area, and in task 3, a part of the worker's body is prohibited from passing through the fourth area. prohibited. Therefore, in the first work, sensor c is set as the prohibited point sensor, and in the third work, sensor d is set as the prohibited point sensor.

Note that in cases where the sensor is an imaging device and the angle of view of the imaging device is capable of photographing each of a plurality of detection points and the worker, the sensor section 60 may be configured only with the imaging device. Good too.

Here, the detection points of the sensor section 60 will be explained with reference to FIG. 3. FIG. 3 is a schematic diagram showing detection points according to the embodiment. FIG. 3 shows a state in which detection points d1 to d7 are set and the left arm A of the worker H is passing through the detection point d2.

As shown in FIG. 3, the detection point d1 is a point-like detection point. The detection point d1 is, for example, a detection point corresponding to work 1, and is sensed by the sensor a. The detection points d2 and d3 are linear detection points. The detection point d2 is, for example, a detection point corresponding to work 2, and is sensed by the sensor b. The detection point d3 is, for example, a detection point corresponding to work 3, and is sensed by the sensor c. The detection point d4 is a detection point having a planar shape. The detection point d4 is, for example, a detection point corresponding to work 4, and is sensed by the sensor d. The detection points d5 to d13 are detection points corresponding to tasks other than tasks 1 to 4.

The detection point may be, for example, an area through which a predetermined part (not shown) is passed during work. As shown in FIG. 3, a plurality of cases in which parts are housed are arranged around the worker H. The detection point is, for example, an area through which a part of the worker H's body passes in order to take the part used in the work from a case containing the part, and where the part of the worker H's body passes during other work. It is preferable that this is an area where a part of the area does not pass through. Further, the detection point is, for example, an area where a part of the body of the worker H passes in order to pick up the tool when a tool (for example, a screwdriver) is used in the work, and where the detection point is an area where a part of the body of the worker H passes through in order to take the tool, and where the work is performed using another tool. It may be an area through which a part of the body of the worker H does not pass. In addition, for example, when the work includes operating a predetermined operating section (for example, pressing a button), the detection point is an area through which a part of the body of the worker H passes in order to operate the operating section. It may also be an area through which a part of the body of the worker H does not pass during the work of operating other operating units.

Further, the detection point d3 is, for example, a prohibited point corresponding to work 1, and is sensed by the sensor c. The detection point d4 is, for example, a prohibited point corresponding to work 3, and is sensed by the sensor d.

The prohibited point may be, for example, an area that the user is not allowed to pass through in order to pick up a predetermined part during work. The prohibited point is, for example, an area through which a part of the body of the worker H passes in order to take a similar part from a case containing a part similar in appearance to a part used in the work, and It may be a region other than the region through which a part of the body of the worker H passes in order to pick up the parts used in the work. In this way, the prohibition point may be a point for detecting that the worker H takes the wrong part during work. Further, the prohibition point may be a point for detecting that the worker H takes the wrong tool or operates the wrong operation part during work.

Note that when the sensor is an imaging device that captures images at the angle of view shown in FIG. may be composed only of the sensor.

Referring again to FIG. 1, the display device 70 displays the information acquired from the work instruction device 10 as an image. Images include photographs, videos, illustrations, characters, etc. The display device 70 is realized by a liquid crystal display or the like. The image output by the display device 70 is visually recognized by the worker and used for checking the work content and determination results. The display device 70 displays information indicating that the current work was performed normally, information indicating that the work was not performed normally, and information indicating that the work was not performed as the determination results. Display information, etc.

Furthermore, the display device 70 displays information regarding the work currently being performed. The display device 70 displays, for example, at least one of the work procedure, information identifying the driver to be used (for example, driver name), the number of screws to be tightened, the determination result of screw tightening, and the elapsed time of the work. The display device 70 is placed in a position where it does not get in the way of the worker's work.

The display device 70 is an example of an output device that outputs information acquired from the work instruction device 10. Note that the work instruction system 1 includes, as an output device, a device that displays information on an object (for example, a screen) such as a sound output device (for example, a speaker), a projector, etc., in place of or in addition to the display device 70; It may also include a device that outputs information using light (for example, the color of light) such as a light emitting device.

[2. Basic operation of work instruction system]
Next, basic operations in the work instruction system 1 as described above will be explained with reference to FIGS. 4A to 4C. Specifically, the operation of the work instruction device 10 instructing a worker to perform a work will be described. This is realized by each processing unit of the work instruction device 10 executing a predetermined application program (hereinafter also referred to as a dedicated application).

First, basic operations performed using the work instruction image etc. stored in the storage unit 13 will be explained. FIG. 4A is a first diagram for explaining the basic operation of the work instruction device 10 according to the embodiment.

As shown in FIG. 4A, the worker first starts the dedicated application and inputs predetermined information into the items displayed on the menu. The predetermined information includes, for example, information for specifying a worker and the work performed by the worker. Items displayed on the menu include, for example, "Worker input" for entering information to identify the worker, "Terminal number input" for identifying the work terminal to be used, and "Input for the product number of the product to be worked on". "Product number input". Furthermore, the items displayed on the menu further include handling of performance data obtained during past work, adjustment of screen layout, etc.

When predetermined information is input, an image corresponding to the work is displayed on the display device 70. FIG. 4B is a second diagram for explaining the basic operation of the work instruction device 10 according to the embodiment. Specifically, a work instruction image P displayed on the display device 70 by the work instruction device 10 is shown.

As shown in FIG. 4B, when the product type is set (in FIG. 4B, "DEMO-2017" is set), a work instruction image P is displayed on the display device 70. When the work instruction device 10 obtains an operation from the worker, the work instruction device 10 causes the display device 70 to display a work instruction image P corresponding to the operation. The work instruction image P includes the product type, work name p1 (in FIG. 4B, "take part A"), precautions during work p2 (in FIG. 4B, "take it securely"), and an explanation explaining the work. An image p3, a part name p4 ("part A" in FIG. 4B), etc. are displayed. Further, although not shown, the work instruction system 1 includes a sound output device, and the work instruction corresponding to the explanation image p3 is output as a sound from the sound output device. Note that the explanatory image p3 is, for example, a moving image. Further, a work name p1 (work content), a precaution p2, an explanatory image p3, a part name p4, etc. are created for each of the plurality of works.

Thereby, the worker receives a work instruction using the work instruction image P and voice. The work instruction device 10 can support the prevention of work errors by the worker by providing work instructions using the explanatory image p3 and voice, text work instructions, and displaying the precautions p2. Furthermore, for example, if the worker is an expert, he or she can perform the work using voice instructions from the sound output device without looking at the explanatory image p3 on the display device 70. Further, for example, if the worker is not accustomed to the work concerned, the work can proceed smoothly by viewing the explanatory image p3 on the display device 70 only when necessary. Therefore, according to the work instruction device 10, it is possible to prevent work errors and support learning.

For example, if the work is a work using a screwdriver, the work name p1 includes the driver used, the type of screw, and the number of screws, and is displayed as, for example, "tighten screw 1 in two places with screwdriver X". Ru.

Further, the work instruction image P may further display a selection image for selecting a worker classification according to the skill level of the worker. FIG. 4C is a third diagram for explaining the basic operation of the work instruction device 10 according to the embodiment.

As shown in FIG. 4C, when the worker clicks on a drop-down menu or the like before starting work or during work, a selection image p5 for selecting the worker classification of the worker is displayed. The example in FIG. 4C shows an example in which three categories are displayed: "Newcomer," "Normal," and "Expert." However, the number of worker categories is not particularly limited, and may be 2 or more. . The output content on the display device 70 may be changed by the worker selecting his/her own worker classification. For example, when "new employee" is selected, the work instruction device 10 outputs all the work instructions stored in the storage unit 13. Furthermore, when "normal" or "skilled" is selected, for example, the work instruction device 10 does not need to output a work instruction for a preset work among the plurality of works. Thereby, the work instruction system 1 can output a work instruction image P suitable for the skill level of the worker.

Referring again to FIG. 4B, the work instruction image P displays an elapsed time display bar p6. The elapsed time display bar p6 displays bars indicating progress rates of a plurality of tasks and progress times. The progress rate bar shows the elapsed time of the current task ("work unit progress" shown in the upper part of the elapsed time display bar p6), and the cumulative total of standard working time for each of multiple tasks (the elapsed time display bar p6 shows This includes the "cumulative work base" shown in the middle row) and the elapsed time during one cycle of operation (the "total work progress" shown in the lower row of the elapsed time display bar p6). Standard working hours are set in advance. Note that multiple tasks performed by a worker are also referred to as elemental tasks. 1 cycle operation in progress means that the worker is in the process of performing multiple tasks in accordance with the work procedure, where one cycle is defined as the worker performing multiple tasks in accordance with the work procedure. means.

Thereby, the worker can confirm whether or not the standard time is being kept by checking the elapsed time display bar p6, which is useful for maintaining the work pace. Therefore, according to the work instruction device 10, it is possible to support the worker in observing the work time. Note that the work instruction device 10 may alert the worker when the elapsed time during the work exceeds a predetermined percentage of the standard time for the work. The work instruction device 10 may, for example, call attention by changing the color of the work unit progress bar and the progress time, or may call attention by causing a sound output device to output a sound. For example, the work instruction device 10 changes the color of the work unit progress bar and progress time to orange when the elapsed time during the work exceeds 70% of the standard time of the work, and the elapsed time during the work changes to the standard time of the work. When the time period has elapsed, the color of the work unit progress bar and progress time may be changed to red to draw further attention.

In addition, as shown in explanatory image p3, if there are multiple types of washers and each of the multiple types of washers is housed in a different case, in explanatory image p3, the case containing the washer that the worker takes during the work is highlighted. It may be displayed as

The work instruction device 10 displays a work instruction image P corresponding to the next task on the display device 70 every time the current task is performed normally.

The work instruction device 10 may display the work result on the display device 70 when one cycle of work (a plurality of tasks assigned to a worker) is completed. FIG. 4D is a fourth diagram for explaining the basic operation of the work instruction device 10 according to the embodiment.

As shown in FIG. 4D, the work instruction device 10 may cause the display device 70 to display the working time upon completion of one cycle. Further, the work instruction device 10 may further display the standard time of one cycle on the display device 70.

Referring again to FIG. 4B, performance information p7 indicating the performance of the work is displayed on the work instruction image P. FIG. 4B shows an example in which the work is a work using a driver, and the work instruction image P displays performance information p7 indicating the performance of the work using the driver. That is, the work instruction image P including the performance information p7 shown in FIG. 4B is an image during driver cooperation that is displayed when performing work using a driver. As the performance information p7, for example, the work result ("OK" shown in FIG. 4B), the name of the driver used for the work ("Driver X" shown in FIG. 4B), the pulse, the count, and the number of NGs are displayed.

The work result indicates the determination result as to whether or not the screw tightening was successful. In the work result, for example, each time the control unit 12 determines that the screw is properly tightened or not, the determination result regarding the screw tightening is displayed. The work results are displayed for each screw, for example.

The driver name indicates information that identifies the driver used in the work using the driver. Only the drivers displayed in the driver name are operational.

The pulse is the actual number of pulses displayed for each screw tightening operation.

The count indicates the number of times the control unit 12 has determined that the screw has been tightened (for example, has been determined to be OK). Specifically, the count includes the actual number ("0" shown in Figure 4B), which is the number of screws that were determined to be "OK", and the planned number ("0", shown in Figure 4B), which is the total number of screws to be installed in the relevant work. 3") is displayed.

The number of NGs is the number of times screw tightening has failed. The number of NGs is counted up when the control unit 12 determines that screw tightening has failed.

By displaying the track record information p7 in this way, the worker can confirm the track record in work using the driver. Furthermore, since the work results, driver name, etc. are displayed on the display device 70, the worker can easily know the work results and information on the driver to be used.

Note that the performance information p7 for work that does not use a driver includes information indicating that the current work was performed normally, information indicating that the work was not performed normally, and information indicating that the work was not performed normally. Contains information indicating that there was no such thing.

Further, in the work instruction image P, an operation image p8 for performing operations such as switching the explanation image p3 is displayed. For example, when a predetermined button of the operation image p8 is selected with a mouse or the like, the explanation image p3 etc. are switched according to the button. The buttons of the operation image p8 include, for example, a button to stop the currently displayed explanation image p3 or restart the stopped explanation image p3, a button to proceed to the next task, a button to return to the previous task, and a button to read out voice instructions. It includes buttons to start or stop, etc.

Note that instead of the above buttons, shortcut keys may be assigned to the keyboard for easy operation. Further, the work instruction system 1 includes a sound collection device (not shown, for example, a microphone), and the work instruction device 10 displays the work instruction image P based on the worker's voice acquired by the sound collection device. You may change the contents.

Thereby, the worker can change the display contents of the work instruction image P according to the progress of the work and the like. For example, by redisplaying the explanation image p3 of the part that was difficult to understand, work errors can be prevented. Further, for example, if the work is completed before the explanation of the explanation image p3 is finished, the work can be smoothly proceeded by proceeding to the next work.

Further, the work instruction image P may display information such as a work list p9 showing a list of elemental works of one cycle.

This allows the worker to know information about the work performed before the current work and the work to be performed after the current work.

For example, when the work instruction device 10 detects that the current work is completed (e.g., detected based on the sensing result from the sensor device 40), the work instruction device 10 outputs information to the display device 70 as the next work to be performed. automatically switch to the information. For example, the work instruction device 10 automatically switches the work instruction image P displayed on the display device 70 to the work instruction image P of the next task to be performed. Note that the work instruction device 10 is not limited to automatically switching the work instruction images P, etc., and may switch the work instruction images P etc. by an operation from the worker (for example, operation of a foot switch).

[3. Operation of work instruction system]
Next, the operation of the work instruction system 1 as described above will be explained with reference to FIG. 5. FIG. 5 is a sequence diagram showing the operation of the work instruction system 1 according to the embodiment. Note that an example in which no prohibited points are set will be described below. Further, it is assumed that the work procedure includes work 1 to work n. The Nth work is also written as work N.

As shown in FIG. 5, the work instruction device 10 reads work procedures (1 to n) by activating a dedicated application and inputting predetermined information by an operation of a worker (S11). The work instruction device 10 can determine whether the worker is the worker who performs the work with the production number by inputting the "worker" and the "product number." The work instruction device 10 extracts a work instruction image P, a work table T1, and a detection table T2 according to predetermined information from among the plurality of work instruction images and information tables stored in the storage unit 13. Note that reading includes reading the work instruction image P, the work table T1, and the detection table T2 from a recording medium (CD-ROM, USB memory, etc.) external to the work instruction device 10. Further, reading the work procedure also includes the communication unit 11 acquiring the work instruction image P, the work table T1, and the detection table T2 through communication from an external device.

Next, the work instruction device 10 reads the information on the work N and outputs it to the display device 70 (S12). Work N is the work to be performed from now on. In step S12, the control unit 12 acquires the work instruction image P corresponding to the work N and information regarding the sensor to be operated in the work 1 (for example, the sensor for detection point) from the detection table T2. Then, the control unit 12 outputs the work instruction image P corresponding to the work N to the display device 70.

The display device 70 acquires information on work N from the work instruction device 10 and displays the information (S13). Thereby, the worker can work after or while checking the display device 70. Note that, for example, when the work instruction system 1 includes a sound output device as an output device, a sound based on the acquired information may be output in step S14.

Next, the work instruction device 10 outputs sensor control information for work N to the sensor control unit 50 (S14). Specifically, the work instruction device 10 generates sensor control information including information for specifying the sensor that acquires the sensing result in the work N based on the detection table T2, and outputs it to the sensor control unit 50. .

In the present embodiment, the work instruction device 10 operates the sensor a to sense the detection point (an example of the first region) in the work 1, and in other work Generate sensor control information indicating that the operation of the sensor (for example, sensor b) is to be stopped in order to stop sensing the detection point (for example, the detection point in work 2, which is an example of the second area), and It is output to the control section 50. This enables detection of whether or not a part of the worker's body passes through the first region, and disables detection of whether or not a part of the worker's body passes through the second region. This is an example of what to do.

The sensor control unit 50 acquires sensor control information and controls the sensor unit 60 based on the acquired sensor control information (S15). In this embodiment, sensor control unit 50 controls sensor unit 60 to operate only the sensor corresponding to work N based on the sensor control information. Note that the control of the sensor section 60 by the sensor control section 50 is not limited to this. The sensor control unit 50 may operate sensors other than the sensor corresponding to work N.

The sensor unit 60 operates only the sensor corresponding to the work N (S16), and outputs the sensing result obtained by sensing the detection point (area) corresponding to the work N to the sensor control unit 50 (S17). If the sensor corresponding to work N is an optical sensor or an area sensor, the sensing result includes, for example, at least one of whether the detection point is shielded from light and the number of times the detection point is shielded from light. Further, the sensing result includes an image when the sensor corresponding to work N is an imaging device. Note that the sensing results may be outputted sequentially or at predetermined intervals.

The sensor control unit 50 acquires sensing results from the sensor unit 60 (S18), and analyzes the acquired sensing results (S19). When the sensing result is an image, the sensor control unit 50 detects the body part of the worker by analyzing the image. A body part is an example of an analysis result. Then, the sensor control unit 50 outputs the sensing result and the analysis result to the work instruction device 10 (S20). The sensing results and the analysis results may be outputted sequentially or at predetermined intervals.

Note that the sensor control unit 50 does not need to analyze the sensing results. The sensor control unit 50 may function as a relay device that acquires sensing results from the sensor unit 60 and outputs the acquired sensing results to the work instruction device 10, for example.

Further, in step S15 shown in FIG. 5, when sensors other than the sensor corresponding to the work N are also operating (for example, when all sensors are operating), the sensor control unit 50 controls the work N in step S20. Only the sensing results of the sensor corresponding to work N may be output to the work instruction device 10 from the sensing results of the sensor corresponding to the work N and the sensors other than the sensor. In this manner, the sensor control unit 50 may extract the sensing result of the sensor corresponding to the work N from among the sensing results of the plurality of sensors acquired from the sensor unit 60 and output it to the work instruction device 10. The fact that the sensor control unit 50 outputs only the sensing result of the sensor corresponding to the work N (for example, work 1) to the work instruction device 10 means that whether a part of the worker's body passes through the first area or not This is an example of enabling detection and disabling detection of whether a part of the worker's body passes through the second area.

In addition, when the sensor unit 60 has an imaging device, the sensor control unit 50 uses an image acquired from the imaging device (for example, an image with the angle of view shown in FIG. 3) to control the area corresponding to the work N (the first It is also possible to detect whether a part of the worker's body has passed through the area (an example of the region) and output the detection result to the work instruction device 10. In other words, in the work N, a detection result as to whether or not a part of the worker's body has passed through a region (an example of a second region) different from the region corresponding to the work N is not output to the work instruction device 10. The fact that the sensor control unit 50 outputs only the detection result of the area corresponding to the work N from the image to the work instruction device 10 makes it effective to detect whether or not a part of the worker's body passes through the first area. , and is an example of disabling the detection of whether or not a part of the worker's body passes through the second region.

Next, the work instruction device 10 acquires the sensing results and analysis results corresponding to the work N from the sensor device 40 (S21). The work instruction device 10 determines whether work N was performed normally based on the acquired sensing results and analysis results (S22). The determination will be described later. Then, the work instruction device 10 outputs the determined result to the display device 70 (S23). The determination result (for example, information indicating that work N was performed normally) is included in the work content. The work content according to this embodiment includes at least a determination result.

The display device 70 acquires the determination result and displays the acquired determination result (S24). Thereby, it is possible to inform the operator whether or not work N has been performed normally.

The processes of steps S12 to S24 are repeatedly executed until all of the work procedures (for example, work 1 to work n) included in the work table T1 are completed. Note that when the work instruction device 10 determines in step S22 that the work N is not being performed normally, it outputs a determination result indicating that the work N is not being performed normally to the display device 70. Then, the work instruction device 10 does not execute the processing after step S12 in the next work. In other words, no further work will be performed.

In addition, although the example in which the work instruction device 10 directly outputs the determination result to the display device 70 has been described above, the work instruction device 10 outputs the determination result directly to the display device 70. You can also output it. The work instruction device 10 outputting the determination result to the relay device is included in outputting the determination result to the display device 70.

Note that the work instruction device 10 may cause the display device 70 to display the determination result superimposed on the work instruction image P for the task.

Next, the operation of the work instruction device 10 will be explained with reference to FIG. 6. FIG. 6 is a flowchart showing the operation of the work instruction device 10 according to the embodiment. Note that each step shown in FIG. 6 is an example of a display step for displaying the work details to the worker.

As shown in FIG. 6, the control unit 12 reads the work procedure (S31). Step S31 corresponds to step S11 shown in FIG. Then, the control unit 12 sets work N to be performed from now on to work 1 in the read work procedure. That is, the control unit 12 sets N=1 (S32). From step S34 onwards, the case where N=1 will be mainly explained.

Next, the control unit 12 reads the information on the work 1 and outputs the read information on the work 1 to the display device 70 (S33). Specifically, the control unit 12 outputs the work instruction image P corresponding to work 1 to the display device 70.

Next, the control unit 12 sets the detection point of work 1 to be valid (S34). Enabling the detection point of work 1 means that the work instruction device 10 makes the determination in step S36 using the sensing result of the sensor that senses the detection point of work 1 as the sensing result. In other words, it means that the determination in step S36, which will be described later, is performed without using the sensing results of the sensor that senses detection points other than the detection point of work 1. Step S34 enables detection of whether or not a part of the worker's body passes through the detection point of work 1 (an example of the first area), and also enables the detection of whether or not a part of the worker's body passes through the detection point of work 1 (an example of the second area). ) is an example of disabling the detection of whether or not a part of the worker's body passes through.

Specifically, the control unit 12 generates sensor control information based on the detection table T2 and outputs it to the sensor device 40. The sensor control information here may include information for specifying sensor a, which is the sensor that acquires the sensing results in work 1. The sensor control information may include, for example, an instruction to operate only sensor a among sensors a to d. Step S34 corresponds to step S13 shown in FIG.

Next, the control unit 12 acquires the detection result for work 1 from the sensor device 40 (S35). The control unit 12 obtains, for example, a sensing result and an analysis result as the detection result. Specifically, the control unit 12 acquires the sensing result of sensor a and the analysis result of the sensing result. Note that the control unit 12 only needs to acquire at least the sensing results. Hereinafter, an example will be described in which the control unit 12 acquires only the sensing results in step S35. Step S35 corresponds to step S21 shown in FIG. Note that step S35 may be performed multiple times for each task, for example.

Next, the control unit 12 determines whether a part of the worker's body has passed the detection point based on the sensing result (S36). The detection point corresponding to work 1 is an example of the first area. Step S36 corresponds to step S22 shown in FIG.

When the sensing result indicates that a part of the worker's body was detected at the detection point corresponding to work 1, the control unit 12 determines that the part of the worker's body has passed through the detection point. If the control unit 12 determines that the detection point has been passed (S36: Yes), it outputs information indicating that work 1 has been successfully performed (S37). The control unit 12 outputs the information to the display device 70, for example. Step S37 corresponds to step S23 shown in FIG. Further, the information indicating that work 1 was performed normally is an example of the first work content.

Then, the control unit 12 determines whether all the work included in the read work procedure has been completed. Specifically, the control unit 12 determines whether N=n (S38). If N=n (Yes in S38), the control unit 12 ends the process. Further, if N=n is not true (No in S38), the control unit 12 proceeds to the next operation (S39). Specifically, the control unit 12 sets N=n+1 and continues the processing from step S33 onwards. For example, after work 1, work 2 is performed. For example, the information indicating that work 2 in step S37 was performed normally is an example of the second work content.

As a result, when it is detected that a part of the worker's body has passed through the detection point in work N (for example, an example of the first work), the next work (for example, an example of the second work) is performed. Information for this purpose is output to the display device 70. In other words, if it is not detected that a part of the worker's body has passed through a detection point in work N, information for performing the next work is not output to the display device 70.

Further, when the control unit 12 determines that the detection point has not been passed (No in S36), the control unit 12 further determines whether a predetermined time has elapsed (S40). The predetermined period is the elapsed time since the start of the work 1, and may be, for example, the elapsed time since the detection point of the work 1 was enabled in step S34.

If the predetermined time has elapsed (Yes in S40), the control unit 12 outputs information indicating that work 1 has not been performed (S41). The control unit 12 outputs the information to the display device 70, for example. Then, the control unit 12 ends the process. Step S41 corresponds to step S23 shown in FIG. Further, if the predetermined time has not elapsed (No in S40), the control unit 12 returns to step S35 and continues the process. Note that the information indicating that work 1 was not performed is an example of the first work content.

As described above, the work instruction device 10 effectively sets a detection point according to the work, and determines whether the work has been performed normally based on the sensing result of the sensing sensor at the detection point. Further, the work instruction device 10 sets detection points other than the detection points corresponding to the work to be invalid. That is, the work instruction device 10 makes the above determination without using the sensing results of detection points other than the detection points corresponding to the work.

[4. Effects, etc.]
As explained above, in the work instruction method (an example of a work display method) according to the present embodiment, a part of the worker's body passes through a first area, and a second area different from the first area is For workers who perform multiple tasks, including a first task in which the worker does not pass through the area, and a second task in which a part of the worker's body passes through the second area and does not pass through the first area. This is a work display method for displaying work contents on a computer. The work display method includes a first display step for displaying a first work content in a first work, and a second display step for displaying a second work content in a second work. The first display step enables detection of whether or not a part of the worker's body passes through the first region, and also detects whether or not a part of the worker's body passes through the second region. (S34), and if a part of the worker's body is detected in the first area based on the sensing result obtained from the sensor unit 60, information indicating that the first work was performed normally is displayed. It is output to the display device 70 as the first work content (S37). Further, the second display step enables detection of whether or not a part of the worker's body passes through the second region, and detects whether or not a part of the worker's body passes through the first region. (S34), and when a part of the worker's body is detected in the second area based on the sensing result obtained from the sensor unit 60, it is indicated that the second work has been performed normally. The information is output to the display device 70 as the second work content (S37).

Note that the first area is, for example, detection point 1, and the second area is, for example, detection point 2. Further, the first work is, for example, work 1, and the second work is, for example, work 2. Further, the first display step is, for example, each step shown in FIG. 6 that is executed for work 1, and the second display step is each step shown in FIG. 6 that is executed for work 2.

For example, when performing the first work, if it is effective to detect whether a part of the worker's body passes through the second region, based on the sensing results of the first region and the second region, , it is determined whether the first task was performed normally. In this case, even if the first work is performed normally, if it is detected that a part of the worker's body has passed through the second area, it is determined that the first work was not performed normally. There are cases. In other words, false detection may occur.

On the other hand, the work instruction method (an example of the work display method) according to the present embodiment disables detection of whether or not a part of the worker's body passes through the second area when performing the first work. Therefore, it can be determined whether the first work has been performed normally based on the sensing result obtained by sensing only the first region of the first region and the second region. That is, in the work display method, when performing the first work, the above determination can be made without being influenced by the sensing results in the second area that is not passed during the first work. Therefore, according to the work display method according to the present embodiment, false detection can be suppressed.

The sensor unit 60 also includes an imaging device that captures an image including the first region and the second region as a sensing result.

Thereby, it is possible to determine whether the work has been performed normally based on the image (sensing result) taken by the imaging device. For example, when using image analysis results of images (for example, the body part of the worker, color, etc.), it is possible to more accurately determine whether the work has been performed normally. In other words, according to the work display method, false detection can be further suppressed.

Further, each of the first region and the second region is set to have at least one of a dot shape, a line shape, and a planar shape.

As a result, the first area and the second area are set to have a shape depending on the work or the worker, for example, thereby making it possible to further suppress erroneous detection.

Further, the second work is a work to be performed continuously after the first work, the first display step further displays an image for performing the first work on the display device 70, and the second display step further includes: Furthermore, in the first display step, if it is detected that a part of the worker's body has passed through the first region, an image for performing the second task is displayed on the display device 70.

As a result, when the first task is successfully performed, an image for performing the next task is automatically displayed, improving work efficiency.

Further, as described above, the work instruction device 10 (an example of a work display device) according to the present embodiment is configured such that a part of the worker's body passes through the first region, and the work instruction device 10 (an example of a work display device) according to the present embodiment Perform multiple tasks including a first task that does not pass through two areas, and a second task that involves a part of the worker's body passing through the second area and not passing through the first area. This is a work display device for displaying work details to a worker. The work instruction device 10 enables detection of whether or not a part of the worker's body passes in the first area when the first work is performed, and detects whether or not a part of the worker's body passes in the second area. disabling the detection of whether a part of the worker's body passes through the second region, and enabling the detection of whether a part of the worker's body passes in the second region when the second work is performed; A control unit 12 that disables detection of whether or not a part of the worker's body passes through the first area; When a part of the worker's body is detected in the area, information indicating that the first work has been performed normally is output to the display device 70 as the first work content, and the second work is performed. In this case, when a part of the worker's body is detected in the second area based on the sensing result obtained from the sensor unit 60, information indicating that the second work has been performed normally is displayed as the second work content. and a communication unit 11 (an example of an output unit) that outputs the output to the display device 70 as an output unit.

This produces the same effect as the work instruction method described above.

(Modification 1 of the embodiment)
Next, a work instruction method according to modification 1 of the embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart showing the operation of the work instruction device 10 according to the first modification of the embodiment. Note that each step shown in FIG. 7 is an example of a display step for displaying work details to the worker.

Note that the configuration of the work instruction device 10 is similar to the work instruction device 10 according to the embodiment, and a description thereof will be omitted. Further, in the flowchart in FIG. 7 as well, the same processes as in the flowchart in FIG. 6 are denoted by the same reference numerals, and the description thereof will be omitted or simplified. The same applies to modifications 2 to 4 of the embodiment described later.

As shown in FIG. 7, after reading work N in step S33, the control unit 12 sets the detection point and prohibition point of work 1 to be valid (S134). Enabling the detection points and prohibition points of work 1 means that the work instruction device 10 uses the sensing results of the sensor that senses the detection points and prohibition points of work 1 as sensing results to make the determinations in steps S136 and S142, which will be described later. means to do. Step S134 enables the detection of whether or not a part of the worker's body passes through the detection point of work 1 (an example of the first area), and also enables the detection of whether a part of the worker's body passes through the detection point of work 2 (an example of the second area). ), and furthermore, the detection of whether or not a part of the worker's body passes through the prohibition point of work 1 (an example of the third area) is disabled. This is an example of enabling detection.

Specifically, the control unit 12 generates sensor control information based on the detection table T2 and outputs it to the sensor device 40. The sensor control information here may include an instruction to output the sensing results of the sensors a and c, which are the sensors corresponding to the work 1, to the work instruction device 10. The sensor control information may include, for example, an instruction to operate only sensor a and sensor c among sensors a to sensor d. Step S134 corresponds to step S13 shown in FIG.

Next, the control unit 12 acquires the detection result for work 1 from the sensor device 40 (S135). The control unit 12 obtains, for example, sensing results and analysis results. Specifically, the control unit 12 acquires the sensing results of the sensor a and the sensor c, and the analysis results of the sensing results. Note that the control unit 12 only needs to acquire at least the sensing results. Hereinafter, an example will be described in which the control unit 12 acquires only the sensing results in step S135. Step S135 corresponds to step S21 shown in FIG. Note that step S135 may be performed multiple times for each task, for example.

Next, the control unit 12 determines whether a part of the worker's body has passed the detection point based on the sensing result (S36). Specifically, the control unit 12 determines whether a part of the worker's body has passed the detection point based on the sensing result of the sensor a. The detection point corresponding to work 1 is an example of the first area.

When the sensing result of sensor a indicates that a part of the worker's body has been detected at the detection point corresponding to work 1, the control unit 12 determines that the part of the worker's body has passed through the detection point. . If the control unit 12 determines that the worker has passed the detection point (Yes in S36), the control unit 12 further determines whether a part of the worker's body has passed the prohibition point based on the sensing result ( S142).

Specifically, the control unit 12 determines whether a part of the worker's body has passed the prohibition point based on the sensing result of the sensor c. The prohibition point corresponding to work 1 is an example of the third area. Note that the part of the body in step S36 and the part of the body in step S142 may be the same part or may be different parts. Steps S36 and S142 correspond to step S22 shown in FIG. 5.

When the sensing result of sensor c indicates that no part of the worker's body is detected at the prohibition point corresponding to work 1, the control unit 12 determines that the prohibition point has not been passed. If the control unit 12 determines that the prohibited point has not been passed (No in S142), it outputs information indicating that work 1 has been performed normally (S37). The control unit 12 outputs the information to the display device 70, for example.

Further, when the control unit 12 determines that the prohibition point has been passed (S142: Yes), it outputs information indicating that work 1 was not performed normally (S143). Then, the control unit 12 ends the process. Note that steps S37, S41, and S143 correspond to step S23 shown in FIG. 5. Further, the information indicating that work 1 was not performed normally is an example of the first work content.

As described above, the work instruction device 10 effectively sets detection points and prohibition points according to the work, and based on the sensing results of only the sensor that senses the detection point and the sensor that senses the prohibition point. , determine whether the work was performed normally. Further, the work instruction device 10 sets detection points other than the detection points corresponding to the work and the prohibited points to be invalid.

Note that, as shown in FIG. 2B, in a task in which a prohibited point sensor is not set (eg, task 2, etc.), the process of step S142 may not be performed. In this case, if the answer is Yes in step S36, the process advances to step S37. For example, if the result in step S36 is Yes, the control unit 12 performs the determination process in step S142 based on the detection table T2 (e.g., based on whether or not the prohibition point sensor is set in the work concerned). It may be determined whether or not to execute.

As explained above, the work instruction method (an example of the work display method) according to the present modification includes a third area that is different from the first area and the second area, and a part of the body of the worker in the first work. The first display step further enables detection of whether or not a part of the worker's body passes through the third region (S134), and the sensor unit 60 If a part of the worker's body is not detected in the third area based on the sensing results obtained from the first work content (No in S142), information indicating that the first work was performed normally is sent to the first work content. is output to the display device 70 as (S37).

Thereby, it is possible to determine whether the work has been performed normally or not based on whether or not a part of the worker's body has passed through the prohibition point. For example, if a part of the worker's body is detected in both the first region and the third region, there is a possibility that the worker is performing the wrong work (for example, picking up the wrong part). There is. According to the work display method according to this modification, when a part of the worker's body does not pass through the third area, that is, when there is no possibility that the worker is performing the work incorrectly, the work is performed correctly. It is determined that the Therefore, it is possible to more accurately determine whether the work has been performed normally.

Further, in the first display step, if a part of the body of the worker is detected in the third area (Yes in S142), information indicating that the first work was not performed normally is displayed in the first display step. The work content is output to the display device 70 (S143).

This allows the operator to be informed that the work has not been performed properly. Additionally, if the information indicating that the work was not performed normally includes information indicating that the prohibition point has been passed, the worker may be unable to perform the work normally because a part of his or her body has passed the prohibition point. It is possible to know that it has been determined that the For example, if the prohibited point is a point that the worker passes through to pick up a part similar to the part used in the work, the worker can check whether he or she has picked up the wrong part.

(Modification 2 of embodiment)
Next, a work instruction method according to a second modification of the embodiment will be described with reference to FIG. 8. FIG. 8 is a flowchart showing the operation of the work instruction device 10 according to the second modification of the embodiment. The flowchart shown in FIG. 8 is performed, for example, when the sensor section 60 has an imaging device. Note that each step shown in FIG. 8 is an example of a display step for displaying the work details to the worker.

As shown in FIG. 8, after validating the detection point for work N in step S34, the control unit 12 acquires the detection result for work 1 from the sensor device 40 (S235). The control unit 12 obtains, for example, sensing results and analysis results. The analysis results here are, for example, the results of detecting body parts of the worker. That is, in step S235, the control unit 12 acquires information regarding the body part of the worker as the analysis result. The information may include information about a part of the worker's body that has passed through the detection point of sensor a. Step S235 corresponds to step S21 shown in FIG. Note that step S235 may be performed multiple times for each task, for example. Moreover, the acquisition of sensing results and the acquisition of analysis results may be performed at the same timing, or may be performed at mutually different timings.

Note that in step S235, the control unit 12 may further acquire the sensing result of the sensor c and the analysis result of the sensing result.

Next, the control unit 12 determines whether a predetermined part of the worker's body has passed the detection point based on the sensing result and the analysis result (S236). Specifically, the control unit 12 determines whether a predetermined part of the worker's body has passed the detection point corresponding to the work N, based on the sensing results and analysis results of the sensor a, and the detection table T2. Determine. As shown in FIG. 2B, the predetermined part corresponding to work 1 is the right hand, which is an example of a part associated with the first work.

When the sensing result and analysis result of sensor a indicate that a predetermined part of the worker's body has been detected at the detection point corresponding to work 1, the control unit 12 determines that the predetermined part has passed the detection point. . Then, when the control unit 12 determines that the predetermined part has passed the detection point (Yes in S236), the process proceeds to S37 and executes the subsequent processing. Further, when the control unit 12 determines that the predetermined region has not passed the detection point (No in S236), the control unit 12 proceeds to step S40 and executes the subsequent processing.

As described above, the work instruction device 10 effectively sets detection points according to the work, and performs the work based on the detection result indicating whether a predetermined part corresponding to the work has passed at the detection point. Performs control to determine whether or not it has been performed normally.

Note that the method by which the sensor control unit 50 detects (recognizes) the body parts of the worker is not particularly limited, but may be performed by estimating the worker's posture from sensing results (for example, images), for example. . For example, the sensor control unit 50 recognizes multiple parts of the worker from the image.

Note that, as shown in FIG. 2B, in a task in which a detection region is not set (for example, task 2), only whether the detection point has been passed may be determined in step S236. In this case, if a part of the worker's body passes through the detection point (Yes in S236), the process advances to step S37. For example, the control unit 12 determines whether or not it is a predetermined region in step S236 based on the detection table T2 (for example, based on whether a detection region is set in the work concerned). It may be determined whether or not to do so.

As explained above, the first display step of the work instruction method (an example of the work display method) according to the present modification further includes detecting a plurality of body parts of the worker from the image taken in the first display step. Based on the detection result, if the part of the worker's body detected in the first area is a part associated with the first work (Yes in S236), it is determined that the first work was performed normally. The information shown is output as the first work content to the display device 70 (S37). Further, the second display step further includes detecting the parts of the worker's body detected in the second area based on the detection result of detecting a plurality of parts of the worker's body from the image photographed in the second display step. If it is a part associated with the second work (Yes in S236), information indicating that the second work was performed normally is output to the display device 70 as the second work content (S37).

As a result, when the first task is a task performed using a predetermined part (for example, the right hand), it is determined that the task has been performed normally when the predetermined part is detected in the first area. be able to. Therefore, it is possible to more accurately determine whether the work has been performed normally. Also, for example, if a prohibited point and a part that passes through the prohibited point are set in the first operation, the work will continue normally even if the relevant part does not pass at the prohibited point (other parts pass). Since it is determined that the detection has been performed, false detection can be further suppressed.

(Variation 3 of the embodiment)
Next, a work instruction method according to a third modification of the embodiment will be described with reference to FIG. 9. FIG. 9 is a flowchart showing the operation of the work instruction device 10 according to the third modification of the embodiment. Note that each step shown in FIG. 9 is an example of a display step for displaying the work details to the worker.

As shown in FIG. 9, after validating the detection point for work N in step S34, the control unit 12 acquires the detection result for work 1 from the sensor device 40 (S335). The control unit 12 obtains, for example, sensing results and analysis results. Specifically, the control unit 12 acquires the sensing result of sensor a and the analysis result of the sensing result. The analysis result here is, for example, information regarding the color of a part of the worker's body that passed through the detection point, or the color of a part used by the worker in the work. That is, in step S335, the control unit 12 acquires information regarding the color of a part or parts of the worker's body as an analysis result. Step S335 corresponds to step S21 shown in FIG.

Note that in step S335, the control unit 12 may further acquire the sensing result of the sensor c and the analysis result of the sensing result, or may acquire information regarding the body part of the worker.

Next, the control unit 12 determines whether a part of the worker's body has passed the detection point based on the sensing result (S36). When the control unit 12 determines that the detection point has been passed (S36: Yes), the control unit 12 further determines whether a predetermined color has been detected based on the analysis result (S342). Specifically, the control unit 12 determines whether a predetermined color is detected based on the analysis result of the sensing result of the sensor a and the detection table T2.

Taking Work 2 as an example, when the detected color is the color of a part of the worker's body, the control unit 12 detects the color of the worker's body that has passed through the detection point (an example of the first area) corresponding to Work 2. If some of the colors are the same as the detected colors shown in the detection table T2, it is determined that a predetermined color has been detected. Further, when the detected color is the color of the component used in work 2, and when the color of the screw B placed at the predetermined position is the same as the detected color shown on the detection table T2, the control unit 12 detects the predetermined color. It is determined that a color has been detected. Steps S36 and S342 correspond to step S22 shown in FIG.

When the control unit 12 detects the predetermined color (Yes in S342), the control unit 12 proceeds to step S37 and executes subsequent processing. Further, if the control unit 12 does not detect the predetermined color (No in S342), it outputs information indicating that work 1 was not performed normally (S343). Then, the control unit 12 ends the process. Note that steps S37, S41, and S343 correspond to step S23 shown in FIG. 5.

As described above, the work instruction device 10 determines whether the work has been performed normally based on whether the work has passed a detection point corresponding to the work and whether a predetermined color has been detected. control.

Note that, as shown in FIG. 2B, in a task for which a detection color is not set (for example, task 1), it may be determined in step S36 only whether or not the detection point has been passed. In this case, if the detection point has been passed (Yes in S36), the process advances to step S37. The control unit 12 determines whether or not to execute the determination process in step S342, for example, based on the detection table T2 (for example, based on whether a detection color is set in the task). Good too.

As described above, the work instruction device 10 enables the detection points corresponding to the work, and determines whether the work is normally performed based on whether a predetermined color corresponding to the work is detected at the detection point. Control is performed to determine whether or not the

As explained above, the image in the work instruction method (an example of the work display method) according to this modification includes information regarding the colors in the first area and the second area.

Thereby, it is possible to determine whether the work has been performed normally using the color information, so that the above-mentioned determination can be made more accurately. Further, for example, when a prohibited point is set, it is determined that the work has been performed normally if a predetermined color is not detected at the prohibited point, thereby further suppressing false detection.

Further, the information regarding color includes the color of a part of the worker's body.

Thereby, for example, when a part of the body of the worker other than the part corresponding to the work passes through the detection point, it can be detected based on the color of the part. For example, the above detection can be performed when the worker wears clothing of different colors on his hands and arms. Therefore, it is possible to more accurately determine whether the work has been performed normally.

Further, the information regarding color includes the color of a part used in at least one of the first work and the second work.

With this, for example, if a worker picks up the wrong part during work, it can be detected based on the color of the part. Therefore, it is possible to more accurately determine whether the work has been performed normally.

(Modification 4 of embodiment)
Next, a work instruction method according to a fourth modification of the embodiment will be described with reference to FIG. 10. FIG. 10 is a flowchart showing the operation of the work instruction device 10 according to the fourth modification of the embodiment. The flowchart shown in FIG. 10 is performed, for example, when the sensor section 60 has an imaging device. Note that each step shown in FIG. 10 is an example of a display step for displaying work details to the worker.

As shown in FIG. 10, after validating the detection point for work N in step S34, the control unit 12 acquires the detection result for work N from the sensor device 40 (S435). The control unit 12 obtains, for example, sensing results and analysis results. Specifically, the control unit 12 acquires the sensing result of sensor a and the analysis result of the sensing result. For example, when the detection point is planar, the analysis result here may include information regarding the area occupied by a part of the worker's body in the planar region. Note that the shape of the detection point is, for example, when the sensor unit 60 includes an imaging device, the shape when viewed from the imaging direction of the imaging device.

The information regarding the occupied area may include, for example, an occupied ratio that is the ratio of the area through which a part of the worker's body passes to the area of the planar region. That is, the control unit 12 obtains the exclusive use ratio as the analysis result in step S435. Step S435 corresponds to step S21 shown in FIG.

Next, the control unit 12 determines whether a part of the worker's body has passed the detection point based on the sensing result (S36). When the control unit 12 determines that the detection point has been passed (S36: Yes), the control unit 12 further determines whether the detection point has a planar shape (S442). For example, the control unit 12 may determine whether or not the shape of the detection point of the work is a planar shape based on the detection table T2.

If the control unit 12 determines that the detection point in the work is not planar (No in S442), the process proceeds to step S37 and executes the subsequent processing. Further, when the control unit 12 determines that the detection point in the work is planar (Yes in S442), the control unit 12 further determines whether the exclusive area is equal to or larger than the threshold (S443). The control unit 12 executes the determination process in step S443, for example, based on the exclusive use ratio and the detection table T2.

Taking Work 4 as an example, if the exclusive use ratio included in the analysis result obtained in step S435 is equal to or greater than the threshold included in the detection table T2 (80% or greater in the example of FIG. 2B) (Yes in S443). , the process advances to step S37 and the subsequent processing is executed. Further, if the exclusive use ratio included in the analysis result obtained in step S435 is smaller than the threshold value included in the detection table T2 (in the example of FIG. 2B, smaller than 80%) (No in S443), task 4 is successfully completed. Information indicating that the process has not been performed is output (S444). Then, the control unit 12 ends the process. Note that steps S37, S41, and S444 correspond to step S23 shown in FIG. 5.

As described above, the work instruction device 10 effectively sets detection points according to the work, and when the shape of the detection point is planar, the work instruction device 10 further sets the exclusive area of a part of the worker's body at the detection point. Based on this, control is performed to determine whether or not the work has been performed normally.

With this, for example, even if there is variation in the movement of a part of the body among multiple workers, the control unit 12 can suppress the influence of the variation by making the detection point planar. , it is possible to determine whether a part of the worker's body has passed through the detection point.

(Other embodiments)
Although the embodiment and each modified example (hereinafter also referred to as embodiment, etc.) have been described above, the present invention is not limited to such embodiment, etc.

For example, in the above embodiments, an example is described in which there is one detection point for one task, but there may be a plurality of detection points. The same applies to prohibition points, and one task may have a plurality of prohibition points.

Further, in the above embodiments, an example has been described in which a detection point other than the current work among detection points is set as a prohibition point, but the invention is not limited to this. The prohibited point may be set separately from the detection point. In other words, the prohibited point and the detection point may be in different areas.

Furthermore, the operations of the work instruction device 10 in the above embodiments (the operations shown in FIGS. 6 to 10) may be determined for each task based on the information included in the detection table T2. For example, in work 1, information on the prohibited point sensor is included, so the determination process shown in FIG. 7 (processing after S36) is executed, and in work 2, information on the detected color is included, so The determination process (processing after S36) shown in FIG. 9 may be executed.

Further, in the above embodiments, an example has been described in which the sensor control unit 50 performs analysis processing on the sensing results, but the control unit 12 of the work instruction device 10 may perform the analysis processing.

Further, in the above embodiments, an example has been described in which the work instruction device 10 outputs the read information on the work N to the display device 70 (for example, see S33 shown in FIG. 6), but the present invention is not limited to this. The work instruction device 10 does not have to output the work instruction image P corresponding to the work N to the display device 70.

Further, in the embodiments described above, an example has been described in which the number of display devices 70 connected to the work instruction device 10 is one, but the present invention is not limited to this. For example, when a worker performs each of tasks 1 to 4 on different workbenches, the display device 70 may be placed on each of the workbenches.

Further, in the above embodiments, the work performed by the worker includes work using a tool (for example, a screwdriver) and work without using a tool, but the work is not limited thereto. The work performed by the worker may be, for example, only work without using tools.

Further, in the above embodiments and the like, an example in which the tool is a screwdriver has been described, but the present invention is not limited to this. The tool may be any tool as long as it is communicably connected to the work instruction device 10 and can be controlled by control information from the work instruction device 10. The tool may be, for example, a tool other than a screwdriver (for example, an electric tool) or a jig (for example, an inspection jig).

Furthermore, the division of functional blocks in the block diagram shown in Figure 1 is just an example; multiple functional blocks may be realized as one functional block, one functional block may be divided into multiple functional blocks, or some functions may be implemented as other functional blocks. It may be moved to a functional block. Further, functions of a plurality of functional blocks having similar functions may be processed in parallel or in a time-sharing manner by a single piece of hardware or software.

Further, in the above embodiments, the work instruction device and the sensor device are realized by a single device, but they may be realized by a plurality of devices connected to each other.

Further, there is no particular limitation on the communication method between the devices included in the work instruction system in the above embodiments and the like. Wireless communication or wired communication may be performed between the devices.

Further, some or all of the components included in the work instruction device in the above embodiments may be configured from one system LSI (Large Scale Integration). For example, the work instruction device may be configured from a system LSI having a processing section of a control section.

A system LSI is a super-multifunctional LSI manufactured by integrating multiple components on a single chip, and specifically includes a microprocessor, ROM (Read Only Memory), RAM (Random Access Memory), etc. A computer system that includes: A computer program is stored in the ROM. The system LSI achieves its functions by the microprocessor operating according to a computer program.

Note that although it is referred to as a system LSI here, it may also be called an IC, LSI, super LSI, or ultra LSI depending on the degree of integration. Further, the method of circuit integration is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. An FPGA (Field Programmable Gate Array) that can be programmed after the LSI is manufactured, or a reconfigurable processor that can reconfigure the connections and settings of circuit cells inside the LSI may be used.

Furthermore, if an integrated circuit technology that replaces LSI emerges due to advancements in semiconductor technology or other derived technology, then of course the functional blocks may be integrated using that technology. Possibilities include the application of biotechnology.

Further, one aspect of the present invention may be a computer program that causes a computer to execute each characteristic step included in the work instruction method. Further, one aspect of the present invention may be a computer-readable non-transitory recording medium in which such a computer program is recorded.

Note that in the above embodiments and the like, each component may be configured with dedicated hardware, or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

Other embodiments may be obtained by making various modifications to the embodiments that those skilled in the art may think of, or may be realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of the present invention. The form is also included in the present invention.

1 Work instruction system (work display system)
10 Work instruction device (work display device)
11 Communication section (acquisition section, output section)
12 Control unit 13 Storage unit 20 First driver 30 Second driver 40 Sensor device 50 Sensor control unit 60 Sensor unit 70 Display device d1-d13 Detection point H Operator P Work instruction image p1 Work content p2 Notes p3 Explanation image p4 Parts Name p5 Selection image p6 Elapsed time display bar p7 Achievement information p8 Operation image p9 Work list T1 Work table T2 Detection table

Claims (13)

A first task in which a part of the worker's body passes through a first region and does not pass through a second region different from the first region; and a first task in which a part of the worker's body passes through the second region. A work display method performed by a work display device that displays work details to a worker who performs a plurality of tasks including a second work that is a work that passes through the first area and does not pass through the first area, the work display method comprising:
a first display step for displaying a first work content in the first work, and a second display step for displaying a second work content in the second work,
The first display step includes:
Enable detection of whether or not a part of the worker's body passes through the first region, and disable detection of whether or not a part of the worker's body passes through the second region. year,
When a part of the worker's body is detected in the first area based on the sensing result obtained from the sensor unit, information indicating that the first work has been performed normally is transmitted to the first work content. output to the display device as
The second display step includes:
Enables detection of whether a part of the worker's body passes through the second region, and disables detection of whether a part of the worker's body passes through the first region. year,
When a part of the body of the worker is detected in the second area based on the sensing result obtained from the sensor unit, information indicating that the second work has been performed normally is transmitted to the second work. Output to the display device as content,
The second area is an area associated with the first work among the plurality of areas,
The first area is an area associated with the second work among the plurality of areas,
How to display your work. a third area different from the first area and the second area, including a third area through which a part of the body of the worker is prohibited during the first work;
The first display step further includes:
Detecting whether a part of the worker's body passes through the third region is effective;
If a part of the body of the worker is not detected in the third area based on the sensing result obtained from the sensor unit, information indicating that the first work has been performed normally is sent to the first outputting the work content to the display device;
The work display method according to claim 1. The first displaying step further includes displaying information indicating that the first work was not performed normally when a part of the body of the worker is detected in the third area. output to the display device as
The work display method according to claim 2. The sensor unit includes an imaging device that captures an image including the first area and the second area as the sensing result.
The work display method according to any one of claims 1 to 3. The first display step further includes:
Based on the detection result of detecting a plurality of body parts of the worker from the image taken in the first display step, the body parts of the worker detected in the first area are selected for the first work. outputting information indicating that the first work was performed normally to the display device as the first work content when the part is associated with the part;
The second display step further includes:
Based on the detection result of detecting a plurality of body parts of the worker from the image taken in the second display step, the body parts of the worker detected in the second area are selected for the second work. outputting information indicating that the second work has been performed normally to the display device as the second work content if the part is associated with the second work;
The work display method according to claim 4. The image includes information regarding colors in the first area and the second area,
The work display method according to claim 4 or 5. The information regarding the color includes the color of a part of the worker's body.
The work display method according to claim 6. The information regarding the color includes the color of a part used in at least one of the first work and the second work.
The work display method according to claim 6. Each of the first region and the second region is set in at least one of a dot shape, a line shape, and a planar shape.
The work display method according to any one of claims 1 to 8. The second work is a work that is performed continuously after the first work,
The first display step further includes displaying an image for performing the first task on the display device,
The second displaying step further includes, when it is detected in the first displaying step that a part of the worker's body has passed through the first region, causing the display device to perform the second task. display the image of,
The work display method according to any one of claims 1 to 9. a third area different from the first area and the second area, including a third area through which a part of the body of the worker is prohibited during the first work;
In the first display step, it is enabled to detect whether or not a part of the worker's body passes through the third area.
The work display method according to any one of claims 1 to 10. A third area different from the first area and the second area, in which a part of the worker's body is used to take a part from a case containing a part similar in appearance to a part used in the first work. a third area through which the part passes;
In the first display step, it is enabled to detect whether or not a part of the worker's body passes through the third area.
The work display method according to claim 1. A first task in which a part of the worker's body passes through a first region and does not pass through a second region different from the first region; and a first task in which a part of the worker's body passes through the second region. A work display device for displaying work details to a worker who performs a plurality of works including a second work that is a work that passes through the first area and does not pass through the first area,
When the first work is performed, it is effective to detect whether or not a part of the worker's body passes through the first region, and the part of the worker's body in the second region is enabled. disabling detection of whether or not a part of the worker's body passes through in the second area when the second work is performed; and a control unit that disables detection of whether or not a part of the worker's body passes through the first region;
When the first work is performed, when a part of the worker's body is detected in the first area based on the sensing result obtained from the sensor unit, the first work is determined to have been performed normally. outputting information indicating that the worker's body in the second area based on the sensing result obtained from the sensor unit when the second work is performed. an output unit that outputs information indicating that the second work has been performed normally to the display device as a second work content when a portion of the work is detected ;
The second area is an area associated with the first work among the plurality of areas,
The first area is an area associated with the second work among the plurality of areas,
Work display device.

Images