JP7718261B2 - Information processing device, lighting device, and lighting system - Google Patents

Description

Embodiments of the present invention relate to an information processing device, a lighting device, and a lighting system.

Conventionally, a technology has been proposed in which an image captured by an imaging unit is acquired by an information processing device, the position of a specific body part of the worker is detected, and if the specific body part is located within the work area, it is determined that the worker is performing useful work, and the working time of the useful work is recorded, as well as the working time when the worker completes one unit of work.

Japanese Patent Application Laid-Open No. 2019-120577

However, with conventional technology, valid work is determined solely based on the intrusion of a specific part. For example, if a worker must pass through another work area to enter another work area, valid work may be determined in the other work area even though no work is being performed there, resulting in the recording of incorrect work information.

The problem that this invention aims to solve is to provide an information processing device, lighting device, and lighting system that can improve the accuracy of recorded work information.

An information processing device according to an embodiment includes a detection unit, an identification unit, a determination unit, and a work recording unit. The detection unit detects the position of a specific part of the worker's body from an image captured by an imaging unit. The identification unit identifies the work performed by the worker based on the detected position of the specific part. The determination unit determines whether the identified work deviates from a pre-registered work procedure. The work recording unit records work information for the work determined to deviate from the work procedure as invalid work.

FIG. 1 is a perspective view showing an example of the appearance of a lighting device included in a lighting system according to an embodiment. FIG. 2 is a diagram illustrating an overview of a lighting system according to an embodiment. FIG. 3 is a block diagram showing the configuration of the information processing apparatus according to the embodiment. FIG. 4 is a diagram illustrating an example of information processing according to the embodiment. FIG. 5 is a diagram illustrating an example of information processing according to the embodiment. FIG. 6 is a flowchart showing the processing procedure of the processing executed in the information processing apparatus according to the embodiment.

The information processing device 20 described below comprises a detection unit 232, an identification unit 233, a determination unit 234, and a work recording unit 235. The detection unit 232 detects the position of a specific body part of the worker 50 from an image captured by the imaging unit (camera 16). The identification unit 233 identifies the work performed by the worker 50 based on the detected position of the specific body part. The determination unit 234 determines whether the identified work deviates from a pre-registered work procedure. The work recording unit 235 records work information for work determined to deviate from the work procedure as invalid work.

The determination unit 234, which will be described below, determines that a deviation has occurred if the work procedure for the identified task falls into a preset exceptional work procedure.

The work recording unit 235, described below, records work information when work that deviates from a pre-registered work procedure is subsequently performed in accordance with the work procedure, labeling the deviating work as invalid work.

The lighting device 10 described below includes an imaging unit and an illumination unit 11. The imaging unit captures an image of the worker 50 and transmits the captured image to the information processing device 20. The illumination unit 11 illuminates the worker 50.

The lighting system 1 described below comprises a lighting device 10 and an information processing device 20. The lighting device 10 has an imaging unit that captures an image of the worker 50, and an illumination unit 11 that illuminates the worker 50. The information processing device 20 has a detection unit 232 that detects the position of a specific body part of the worker 50 from the image captured by the imaging unit, an identification unit 233 that identifies the work performed by the worker 50 based on the detected position of the specific body part, a determination unit 234 that determines whether the identified work deviates from a pre-registered work procedure, and a work recording unit 235 that records work information for work determined to deviate from the work procedure as invalid work.

The following describes an information processing device, lighting device, and lighting system according to an embodiment, with reference to the drawings. Identical components throughout the embodiments are designated by the same reference numerals, and redundant descriptions will be omitted.

[Lighting equipment]
First, the configuration of a lighting device 10 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a perspective view showing an example of the appearance of the lighting device 10 included in a lighting system 1 according to an embodiment.

As shown in FIG. 1, the lighting device 10 comprises an illumination unit 11, an imaging unit 12, and a main body unit 13. The lighting device 10 is a ceiling-mounted lighting device in which the main body unit 13 is installed on a ceiling surface or the like, and light output from the illumination unit 11 is irradiated onto the floor. The lighting device 10 is primarily used indoors, for example, for monitoring production lines in factories or employee status in offices.

For ease of understanding, Figure 1 illustrates a three-dimensional Cartesian coordinate system including a Z axis, with the positive direction being vertically downward and the negative direction being vertically upward. The X axis is illustrated as running along the length of the lighting device 10, and the Y axis is illustrated as running along the width of the lighting device 10.

The lighting unit 11 is a lighting bar that has multiple light-emitting elements (not shown) arranged at predetermined intervals on a long chassis or substrate (not shown) that is arranged along the Y-axis direction, and a diffusion cover 14 is provided on the floor side, i.e., on the positive Z-axis side, so that the light-emitting elements are housed between the chassis and the lighting bar.

The diffusion cover 14 is made of a translucent material such as acrylic or polycarbonate. The diffusion cover 14 is frosted to diffuse the light emitted from the multiple light-emitting elements. The diffusion cover 14 may also contain diffusing materials or colorants as appropriate.

The imaging unit 12 has a light-shielding cover 15 and a camera 16. The camera 16 is an example of an imaging section. The imaging unit 12 is arranged adjacent to the illumination section 11 on the negative side of the X axis.

The main body 13 holds the lighting unit 11 and the imaging unit 12. The main body 13 also serves as a mounting member for attaching the lighting device 10 to a predetermined location, such as a ceiling.

The light-shielding cover 15 is disposed on the positive Z-axis side of the main body 13 so as to cover the camera 16 between the main body 13 and the light-shielding cover 15. The light-shielding cover 15 also has a through-hole provided in a position facing the lens of the camera 16. By disposing such a light-shielding cover 15, it is possible to make it difficult for light emitted from the diffusion cover 14 of the lighting unit 11 to enter the lens of the camera 16.

[Lighting System]
Next, the configuration of the lighting system 1 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an overview of the lighting system 1 according to the embodiment. Note that the following description will be given taking as an example a case where the lighting system 1 is installed in a factory.

As shown in FIG. 2, the lighting system 1 according to the embodiment includes multiple lighting devices 10 and an information processing device 20. The example shown in FIG. 2 illustrates a case in which each lighting device 10 is installed at a factory work site (e.g., a production line).

For example, multiple lighting devices 10 are installed above the work spaces 40 (see Figure 4) of each worker 50 on a production line, and the camera 16 captures images of each work space 40 from above.

The information processing device 20 is a device that manages each lighting device 10 installed at the work site. For example, the information processing device 20 remotely controls the lighting mode of the lighting unit 11 of each lighting device 10 and the imaging processing of the camera 16 via the network N.

The information processing device 20 also collects and stores images captured by the camera 16 of each lighting device 10. For example, the images collected by the information processing device 20 are used for monitoring a work site. In the present disclosure, the information processing device 20 may acquire images as still images or as videos.

[Information processing device]
Next, the configuration of the information processing device 20 according to the embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the configuration of the information processing device 20 according to the embodiment. As shown in Fig. 3, the information processing device 20 includes a communication unit 21, a storage unit 22, and a control unit 23. The information processing device 20 is, for example, a cloud server.

The communication unit 21 is realized, for example, by a network interface card (NIC). The communication unit 21 transmits and receives information to and from multiple lighting devices 10 and the administrator terminal 30 via the network N, for example.

The storage unit 22 functions as a storage unit in the cloud server. The storage unit 22 is realized, for example, by a semiconductor memory element such as RAM (Random Access Memory) or flash memory, or a storage device such as a hard disk or optical disk.

As shown in FIG. 3, the memory unit 22 includes a captured image memory unit 221, a work time memory unit 222, a work process memory unit 223, a work information memory unit 224, and an exception setting memory unit 225. The captured image memory unit 221 stores captured images captured by each lighting device 10.

The work time memory unit 222 stores the time during which the worker 50 (see Figure 4) performed valid work (hereinafter also referred to as valid work time) and the time during which the worker performed invalid work (hereinafter also referred to as invalid work time) in one unit task or one work process described below.

In this disclosure, useful work refers to work that adds value to the object of the work, such as attaching parts to the object.

In addition, in this disclosure, invalid work refers to work that does not add value to the object of the work, such as work involving the extraction of parts or work tools. Furthermore, in this disclosure, one unit work refers to work performed on one object, for example.

The work process memory unit 223 stores pre-registered work processes that each worker 50 must perform on the production line. In this disclosure, a work process refers to a unit task that a worker 50 must perform in the work space 40. Specifically, a work process includes the type of unit task to be performed and the order in which the unit tasks are performed (work sequence). Note that the work sequence does not necessarily have to be included in the work process.

The work information storage unit 224 stores the work performed by each worker 50. For example, the work information storage unit 224 stores the type of unit work performed by the worker 50, and the start and end times of each unit work (or just one of the times). In other words, the work information storage unit 224 stores the history of work performed by each worker 50.

The exception setting storage unit 225 stores exceptional work procedures for treating work as invalid. These exceptional work procedures are used in the determination process of the determination unit 234, which will be described later.

The control unit 23 functions as a control unit in the cloud server. The control unit 23 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or MPU (Micro Processing Unit) executing various programs stored in the storage device inside the information processing device 20 using RAM as a working area. The control unit 23 is also, for example, a controller, and is realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array).

As shown in FIG. 3, the control unit 23 includes an acquisition unit 231, a detection unit 232, an identification unit 233, a determination unit 234, and an operation recording unit 235, and realizes or executes the functions and actions of the control processing described below. Note that the internal configuration of the control unit 23 is not limited to the configuration shown in FIG. 3, and may be other configurations that perform the control processing described below.

The acquisition unit 231 acquires captured images captured by the camera 16 of the lighting device 10. For example, the acquisition unit 231 acquires captured images from the camera 16 of each lighting device 10 in real time and stores the acquired captured images in the captured image storage unit 221 for each workspace 40 (or for each worker 50).

The detection unit 232 performs various detections. For example, the detection unit 232 detects the positions of both hands 51 (see FIG. 4) of the worker 50 from the captured images acquired by the acquisition unit 231 and stored in the captured image storage unit 221. Both hands 51 of the worker 50 are an example of a specific body part of the worker 50. Note that the detection unit 232 may detect only one hand as the specific body part of the worker 50, or may detect parts other than the hands, such as the head or feet.

In addition, the detection unit 232 detects the position of the object (target) to be worked on within the work space 40 from the captured image acquired by the acquisition unit 231.

The identification unit 233 identifies the work (unit task) performed by the worker 50 based on the positions of both hands 51 of the worker 50 and the position of the object detected by the detection unit 232. For example, the identification unit 233 identifies that the unit task was performed in the work area where the worker's 50's hands are located.

The determination unit 234 determines whether the worker 50 is performing valid or invalid work based on the positions of the worker's 50 hands 51 and the position of the object detected by the detection unit 232. Specifically, the determination unit 234 determines whether the work is valid or invalid based on the state in which the worker's 50 hands 51 are holding the object and whether the worker's hands 51 are present within the work area.

The determination unit 234 also determines whether any of the tasks (unit tasks) identified by the identification unit 233 that have been determined to be valid tasks deviate from the pre-registered work procedure. Details of this determination process will be described later, starting with Figure 4.

The determination unit 234 also measures the time during which the worker 50 performs valid work (valid work time) and the time during which the worker performs invalid work (invalid work time) in one unit task. The determination unit 234 also stores the valid work time and invalid work time in one unit task performed by the worker 50 in the work time memory unit 222 of the memory unit 22.

The work recording unit 235 records work information for work (valid work) that the determination unit 234 determines to have deviated from the work procedure as invalid work. This recording process will be described later with reference to Figure 5.

Next, details of the information processing performed by the information processing device 20 will be explained using Figures 4 and 5. Figures 4 and 5 are diagrams showing an example of information processing according to an embodiment. Figure 4 shows an image captured by the camera 16 of the lighting device 10 placed above the workspace 40.

The example shown in Figure 4 also illustrates a work process in which worker 50 works in work areas A1 to A5 on workbench 41 and places the finished product in finished product area A6. Each of work areas A1 to A5 includes an area where worker 50 works on the product and an area where each part is placed. Alternatively, each of work areas A1 to A5 may include only an area where each part is placed. In such a case, worker 50 picks up parts from each of work areas A1 to A5 and works on the product in an area on workbench 41 other than areas A1 to A6.

Note that while Figure 4 shows an example in which one unit task is performed in each of the work areas A1 to A5, multiple unit tasks may be performed in each of the work areas A1 to A5.

When worker 50 works in work area A2, his/her hands pass through work area A3 to access work area A2, as shown by the arrow in Figure 4. Also, when he/she picks up a part in work area A2 and returns, he/she passes through work area A3.

In this case, even though work should have been performed only in work area A2, conventional technology would incorrectly record work information indicating that work was performed in work area A3, work area A2, and work area A3.

Therefore, when work is performed that deviates from the pre-registered work procedure, the information processing device 20 records the work information as invalid work.

Specifically, as shown in FIG. 5, in a work procedure from work area A1 to work area A3, if work area A1 is followed by work area A3, work area A2, work area A3, and work area A3, the determination unit 234 modifies the work information by deeming the valid work in the second work area A3 and the fourth work area A4 as invalid work.

As a result, the work information actually recorded will show that work was performed in the order of work area A1, work area A2, and work area A3. This means that the accuracy of the recorded work information can be improved.

Specifically, if the work procedure of a task determined to be valid is the same as an exceptional work procedure stored in the exception setting storage unit 225, the determination unit 234 determines that the task has deviated from the pre-registered work procedure.

In other words, if the work procedures for work area A1, work area A3, work area A2, work area A3, and work area A3 are stored as exceptional work procedures, the determination unit 234 will determine that a deviation from the work procedures has occurred if such exceptional work procedures actually occur.

By setting such exceptional work procedures, invalid work that deviates from the work procedure can be identified with high accuracy.

More specifically, if work that deviates from a pre-registered work procedure is performed after work that follows the work procedure is performed, the work recording unit 235 records the deviating work as invalid work in the work information. That is, if work area A1 is followed by work area A3, which deviates from the pre-registered work procedure, and then work area A2, which is in accordance with the original work procedure, the work in work area A3 is recorded in the work information as invalid work.

This improves the accuracy of the work information recorded in situations where, for example, a worker must pass through another work area A3 in order to perform the original work procedure in work area A2.

Next, the processing procedure executed by the information processing device 20 according to the embodiment will be described using FIG. 6. FIG. 6 is a flowchart showing the processing procedure executed by the information processing device 20 according to the embodiment.

As shown in FIG. 6, first, the information processing device 20 starts work analysis (step S101). The start of work analysis may be triggered by an instruction from a manager or the like, or by the start of production on the production line.

Next, the information processing device 20 reads the work process information stored in the work process memory unit 223 (step S102). Next, the information processing device 20 starts acquiring captured images from the lighting device 10 (step S103).

Next, the information processing device 20 starts measuring the work time (step S104). Next, the information processing device 20 determines whether the worker's 50 hand has been detected (step S105).

If the information processing device 20 detects the worker's 50 hand (step S105: Yes), it determines whether the hand is present within the work area (step S106). Next, if the hand is present within the work area (step S106: Yes), the information processing device 20 determines whether the work procedure for the identified work is an exceptional work procedure (step S107).

If the work procedure is not an exceptional work procedure (step S107: No), the information processing device 20 determines that the work procedure is a valid work procedure (step S108), records it as work information (step S109), and returns to step S105.

On the other hand, if the work procedure is an exceptional work procedure in step S107 (step S107: Yes), the information processing device 20 determines that the work procedure is an invalid work procedure (step S110), records this as work information (step S111), and returns to step S105.

Furthermore, in step S105, if the information processing device 20 does not detect the hands of the worker 50 (step S105: No), it determines whether to end the work analysis (step S112). Note that the end of the work analysis may be triggered, for example, by an instruction from a manager or by the end of production on the production line.

If the information processing device 20 determines to end the task analysis (step S112: Yes), it ends the measurement of task time (step S113), ends the task analysis (step S114), and ends processing.

Also, in step S112, if the information processing device 20 does not end the task analysis (step S115: No), it returns to step S105.

Also, in step S106, if the hand is not within the work area (step S106: No), the information processing device 20 returns to step S105.

As described above, the information processing device 20 according to the embodiment includes a detection unit 232, an identification unit 233, a determination unit 234, and a work recording unit 235. The detection unit 232 detects the position of a specific body part of the worker 50 from an image captured by the imaging unit (camera 16). The identification unit 233 identifies the work performed by the worker 50 based on the detected position of the specific body part. The determination unit 234 determines whether the identified work deviates from a pre-registered work procedure. The work recording unit 235 records work information for work determined to deviate from the work procedure as invalid work. This increases the accuracy of the recorded work information.

Although an embodiment of the present invention has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. This embodiment can be embodied in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its variations are within the scope and spirit of the invention, as well as the invention and its equivalents as set forth in the claims.

REFERENCE SIGNS LIST 1 Lighting system 10 Lighting device 11 Lighting section 12 Imaging unit 13 Main body section 14 Diffusion cover 15 Light-shielding cover 16 Camera 20 Information processing device 21 Communication section 22 Memory section 23 Control section 30 Manager terminal 40 Work space 41 Work table 50 Worker 51 Both hands 221 Captured image memory section 222 Work time memory section 223 Work process memory section 224 Work information memory section 225 Exception setting memory section 231 Acquisition section 232 Detection section 233 Identification section 234 Determination section 235 Work recording section N Network

Claims (4)

a detection unit that detects the position of a specific part of the worker's body from the captured image taken by the imaging unit;
an identification unit that identifies the work performed by the worker based on the detected position of the specific part;
a determination unit that determines whether the identified work deviates from a pre-registered work procedure;
a work recording unit that records work information of the work determined to have deviated from the work procedure as an invalid work;
Equipped with
The determination unit
The information processing device determines that a deviation has occurred when the identified work procedure of the work falls into a preset exceptional work procedure. a detection unit that detects the position of a specific part of the worker's body from the captured image taken by the imaging unit;
an identification unit that identifies the work performed by the worker based on the detected position of the specific part;
a determination unit that determines whether the identified work deviates from a pre-registered work procedure;
a work recording unit that records work information of the work determined to have deviated from the work procedure as an invalid work;
Equipped with
The work recording unit
An information processing device that, when work deviating from a pre-registered work procedure is performed after the work is performed in accordance with the pre-registered work procedure, records work information regarding the deviating work as an invalid work. a lighting device;
an information processing device;
Equipped with
The lighting device includes:
an imaging unit that images the worker;
a lighting unit that illuminates the worker;
and
The information processing device includes:
a detection unit that detects the position of a specific part of the worker's body from the captured image taken by the imaging unit;
an identification unit that identifies the work performed by the worker based on the detected position of the specific part;
a determination unit that determines whether the identified work deviates from a pre-registered work procedure;
a work recording unit that records work information of the work determined to have deviated from the work procedure as an invalid work;
and
The determination unit
A lighting system that determines that a deviation has occurred when the identified work procedure for the work falls into a preset exceptional work procedure. a lighting device;
an information processing device;
Equipped with
The lighting device includes:
an imaging unit that images the worker;
a lighting unit that illuminates the worker;
and
The information processing device includes:
a detection unit that detects the position of a specific part of the worker's body from the captured image taken by the imaging unit;
an identification unit that identifies the work performed by the worker based on the detected position of the specific part;
a determination unit that determines whether the identified work deviates from a pre-registered work procedure;
a work recording unit that records work information of the work determined to have deviated from the work procedure as an invalid work;
and
The work recording unit
A lighting system that records work information when work that deviates from a pre-registered work procedure is performed after the work is performed according to the pre-registered work procedure, as invalid work.