JP7682664B2 - System, method, and program - Google Patents

Description

One embodiment of the present invention relates to a system, a control device, a mobile terminal, a method, and a program for preventing infectious diseases.

In recent years, not only influenza viruses but also the novel coronavirus have been wreaking havoc around the world. Such viruses are known to enter the human body mainly through the mucous membranes of the face. Traditionally, it has been recommended to prevent viruses from entering the human body by washing hands or gargling, and covering the nose and mouth with a mask.

However, even if you wash your hands frequently, if you unconsciously touch your face after touching a surface that has the virus on it, you may become infected with the virus. Patent Document 1 discloses a hand recognition device that uses image recognition to determine whether a hand is present near a recognized face area.

JP 2011-86052 A

When using image recognition to determine whether there are hands near a face area, the distance between the face and the hands cannot be determined, which may result in a false positive. In this case, even if the face and hands are far apart, the hands may be determined to be near the face area, which may reduce the accuracy of the determination.

In view of the above problems, one of the objectives of one embodiment of the present invention is to further improve the accuracy of determining whether a user's hand is approaching the user's face.

A system according to one embodiment of the present invention includes a control device having an image capture unit that acquires facial image data of a user and a control unit that analyzes the facial image data, a mobile terminal having a first detection unit worn near the user's wrist, and a second detection unit worn near the user's head, the first detection unit acquires distance data from the second detection unit, the control unit acquires distance data by analyzing the facial image data when it is determined that the face and the hand overlap, and outputs an alarm to the mobile terminal when the distance data is smaller than a predetermined distance set in advance.

In the above configuration, if the control unit determines that the face and the hand do not overlap, it analyzes the newly acquired face image data.

In the above configuration, if the distance between the acquired first detection unit and the second detection unit is equal to or greater than a predetermined distance, the newly acquired face image data is analyzed.

In the above configuration, the specified distance is the distance between the first detection unit and the second detection unit when the user brings their hand close to the user's eye.

A method according to one embodiment of the present invention acquires facial image data of a user, and by analyzing the facial image data, determines whether the face and hand overlap. If it is determined that the face and hand overlap, a first detection unit of a mobile device worn near the user's wrist acquires distance data between the first detection unit and a second detection unit worn near the user's head, and outputs an alarm if the acquired distance between the first detection unit and the second detection unit is smaller than a predetermined distance.

In the above method, if the acquired distance between the first detection unit and the second detection unit is equal to or greater than a predetermined distance, new face image data is acquired.

In the above method, if the distance between the first and second detection units is equal to or greater than a predetermined distance, the newly acquired face image data is analyzed.

In the above method, the specified distance is the distance between the first detection unit and the second detection unit when the user brings his/her hand close to his/her eye.

A program according to one embodiment of the present invention causes a computer to acquire facial image data, analyze the facial image data, and determine whether or not a part of the face overlaps with a hand based on the analysis result; if it is determined that a part of the face overlaps with a hand, acquire the distance between a first detection unit of a mobile device worn on the user's wrist and a second detection unit provided near the user's head; and if the acquired distance between the first detection unit and the second detection unit is smaller than a predetermined distance, output an alert to the mobile device.

According to one embodiment of the present invention, it is possible to further improve the accuracy of determining whether a user's hand is approaching the user's face.

FIG. 1 is a diagram illustrating an overview of a system according to an embodiment of the present invention. FIG. 2 is a block diagram of hardware according to an embodiment of the present invention. 13 is an example of a database in which predetermined distances are stored. FIG. 4 is a functional block diagram illustrating a determination function in one embodiment of the present invention. FIG. 2 is a functional block diagram of an image analysis unit. 10 is a flowchart illustrating a determination process in one embodiment of the present invention. FIG. 2 is a block diagram of hardware according to an embodiment of the present invention. 10 is a flowchart illustrating a determination process in one embodiment of the present invention.

One embodiment of the present invention will be described in detail below with reference to the drawings. The present invention is not limited to the following embodiment, and can be modified in various ways within the scope of the invention.

(1. Overview)
System 1 according to one embodiment of the present invention outputs an alarm to prevent a user from unconsciously touching their face when working in a fixed position, such as working at a supermarket cash register or on a factory line.

FIG. 1 is a diagram illustrating an overview of a system 1 according to an embodiment of the present invention. The system 1 includes a control device 10, a mobile terminal 20, and a detection unit 30. The control device 10 is connected to the mobile terminal 20 via a wireless or wired network 40. The mobile terminal 20 may be connected to the detection unit 30 via short-range wireless communication, or may be connected via the network 40. Short-range wireless communication is, for example, communication using Bluetooth (registered trademark), infrared communication, LAN (Local Area Network), etc.

The control device 10 outputs an alarm to the mobile terminal 20 to prevent the user 1000 from touching his/her face. The control device 10 is, for example, a personal computer, a smartphone, or a tablet. The image capturing unit 103 is provided in a position where it can constantly capture the face of the user 1000. The image capturing unit 103 captures facial image data of the user 1000 at predetermined intervals. The control device 10 analyzes the captured facial image data of the user 1000 and determines whether the user's 1000 face, particularly the mucous membranes such as the eyes, nose, and mouth, are overlapping with the user's 1000 hands. The image capturing unit 103 may be a device separate from the control device 10 as shown in FIG. 1, or may be included in the control device 10.

Even if the face and hands of the user 1000 are overlapping, the distance between the face and hands of the user 1000 cannot be determined from the facial image data of the user 1000 acquired by the image capturing unit 103. Therefore, it is necessary to detect the distance between the face and hands of the user 1000.

The user 1000 wears the mobile terminal 20 near the hand and the detection unit 30 near the head. The mobile terminal 20 is provided with a detection unit 207. The mobile terminal 20 is, for example, a wearable device such as a wristwatch type or a finger ring type. The detection unit 30 is installed on an item 31. The item on which the detection unit 30 is installed may be any item that can be worn near the head, such as a helmet, earrings, a necklace, glasses, a hair accessory, a mask, or a neck-hanging wearable device. When the hand of the user 1000 approaches the vicinity of the user's 1000 face, the detection unit 207 of the mobile terminal 20 detects the distance to the detection unit 30.

In FIG. 1, it is assumed that a user 1000 wears a mobile device 20 on his/her wrist, and a necklace 31 with a detection unit 30 attached around his/her neck. At this time, the detection unit 207 of the mobile device 20 worn on the wrist acquires distance data between the detection unit 30 attached to the necklace 31 at predetermined intervals and transmits it to the control device 10. If the control device 10 determines that the distance between the mobile device 20 and the detection unit 30 is shorter than a predetermined distance, the control device 10 outputs an alarm. Here, the predetermined distance is the distance for determining that the face and hand of the user 1000 are close to each other.

According to the system 1, an alarm can be output when the user 1000 unconsciously tries to touch his/her face. Whether the user 1000's face and hand are overlapping is determined by image recognition, and is also determined based on the distance between the mobile terminal 20 and the detection unit 30. This can further improve the accuracy of determining whether the user 1000's hand is approaching the user's 1000 face. This can prevent unnecessary alarms from being output. Since the user can be prevented from unconsciously touching their face, it can encourage the prevention of infectious diseases.

2. First embodiment
In this embodiment, a case will be described in which the control device 10 determines whether or not the user's hand is approaching the face, and outputs a warning to the user not to touch the face.

Figure 2 is a block diagram of hardware in one embodiment of the present invention. As shown in Figure 2, the control device 10 has a control unit 101, a memory unit 102, an image capture unit 103, a communication unit 104, an operation unit 106, and a display unit 105.

The control unit 101 includes an arithmetic processing circuit such as a CPU. The control unit 101 executes a program stored in the storage unit 102 by the CPU to realize each function in the control device 10. The functions realized in the control device 10 include, for example, a judgment function for executing a judgment process. The storage unit 102 is a storage device such as a non-volatile memory. The storage unit 102 stores a program 300 for realizing the above-mentioned judgment function. The judgment function will be described later. The storage unit 102 also stores face image data and distance data used in the judgment process. Here, the face image data is a face image of the user, and the distance data is the distance between the mobile terminal 20 and the detection unit 30 acquired from the mobile terminal 20. The storage unit 102 may also store a database in which distance data (also called a predetermined distance) between the mobile terminal 20 and the detection unit 30 set in advance by the user is stored. The predetermined distance is a distance for determining that the user's hand has approached the user's eyes, nose, or mouth. Since the predetermined distance differs for each user wearing the mobile terminal 20, the predetermined distance is set for each mobile terminal 20. Furthermore, the distance data stored in the database differs depending on the part of the body where the user wears the mobile terminal 20 and the part of the body where the detection unit 30 is worn. For example, distance data when the mobile terminal 20 (device 0001) is worn on the wrist and the detection unit 30 is worn around the neck may be stored, or distance data when the mobile terminal 20 (device 0003) is worn on a finger and the detection unit 30 is worn on a helmet may be stored.

The image capturing unit 103 is, for example, a photographing device such as a CCD camera. The image capturing unit 103 captures an image of the user's face. The facial image data of the user's facial image captured by the image capturing unit 103 is stored in the storage unit 102. The image capturing unit 103 captures the user's facial image at predetermined intervals (for example, every few milliseconds to one second).

The communication unit 104 connects to the mobile terminal 20 by wireless communication based on the control of the control unit 101. The communication unit 104 transmits and receives information to and from the mobile terminal 20 by communication using, for example, Bluetooth (registered trademark), infrared communication, LAN (Local Area Network), or the like. The communication unit 104 may, for example, obtain distance data from the mobile terminal 20 or transmit an alert to the mobile terminal 20.

The operation unit 106 is a device such as a keyboard, a mouse, and a touch sensor, and outputs a signal according to an input operation to the control unit 101. The display unit 105 is a display device such as a liquid crystal display or an organic EL display, and displays a screen based on the control by the control unit 101 and an image captured by the image capturing unit 103. The operation unit 106 and the display unit 105 may be integrated to form a touch panel.

Here, an example of the database stored in the storage unit 102 will be described with reference to FIG. 3. FIG. 3 is an example of the database 313. The device ID stored in the database 313 is an ID for identifying the mobile terminal 20. A distance [mm] set by the user is associated with each device ID. FIG. 3 shows an example in which the distance when the hand approaches the eye, the distance when the hand approaches the nose, and the distance when the hand approaches the mouth are set. The distance when the hand approaches the eye means the distance between the mobile terminal 20 (detection unit 207) and the detection unit 30 when the hand approaches the eye. Similarly, the distance when the hand approaches the nose means the distance between the mobile terminal 20 (detection unit 207) and the detection unit 30 when the hand approaches the nose, and the distance when the hand approaches the mouth means the distance between the mobile terminal 20 (detection unit 207) and the detection unit 30 when the hand approaches the mouth. The predetermined distance may be set by the user touching the eyes, nose, and mouth with the hand, and the detection unit 207 may acquire distance data for each of the actions and store the data in the database 313. The user may also input the predetermined distance from the operation unit 106. In FIG. 3, the distance when the hand approaches the eyes, nose, and mouth is set, but the largest value among these distances may be used in the determination process. For example, when the device ID of the mobile terminal 20 is 0001, the distance from the eyes is set to 10 cm. In the determination process, the control device 10 may output an alarm when it is determined that the distance between the mobile terminal 20 and the detection unit 30 is less than 10 cm. In addition, although not shown in FIG. 3, the number of times an alarm has been output may be recorded for each device ID. By displaying the number of times an alarm has been output on the display unit 105 of the control device 10 or the display unit of the mobile terminal 20, the user can be alerted not to touch his or her face.

2, the control device 10 is illustrated as including a control unit 101, a storage unit 102, an image capturing unit 103, a communication unit 104, an operation unit 106, and a display unit 105, but an embodiment of the present invention is not limited to this. For example, the image capturing unit 103 may be an image capturing device (e.g., a camera) provided separately from the control device 10, and the image capturing device may be connected to the control device 10. In addition, the program stored in the storage unit 102 or the database 313 in which the predetermined distance is stored may be stored in a storage device separate from the storage unit 102, and the separate storage device may be connected to the control device 10.

The mobile terminal 20 has a control unit 201, a memory unit 202, a communication unit 204, a detection unit 207, and an alarm output unit 208.

The control unit 201 includes an arithmetic processing circuit such as a CPU. The control unit 201 executes a program stored in the memory unit 202 using the CPU, and realizes each function in the control device 10. The memory unit 202 is a storage device such as a non-volatile memory. The memory unit 202 also stores distance data acquired by the detection unit 207.

The detection unit 207 is a sensor capable of measuring distance, such as a distance sensor. For example, an infrared distance sensor, an optical sensor, an ultrasonic sensor, etc. can be used as the distance sensor. The detection unit 207 may include an acceleration sensor, a gyro sensor, etc. The detection unit 207 is paired with the detection unit 30, and measures the distance between the detection unit 207 and the detection unit 30. The detection unit 207 acquires distance data between the detection unit 207 and the detection unit 30 at predetermined intervals (for example, every few milliseconds to one second). The distance data is stored in the memory unit 202. The distance data may be transmitted to the control device 10 and stored in the memory unit 102 of the control device 10.

The communication unit 204 connects to the control device 10 via wireless communication based on the control of the control unit 201. The communication unit 204 transmits and receives information to and from the control device 10 via communication using, for example, Bluetooth (registered trademark), infrared communication, LAN (Local Area Network), or the like. The communication unit 204 transmits distance data to the control device 10 and receives alarms from the control device 10, for example. The communication unit 204 transmits distance data to the control device 10 at timings ranging from every few milliseconds to every second.

The alarm output unit 208 includes, for example, at least one of the sound output unit 281, the light-emitting unit 282, and the vibration unit 283. The alarm output unit 208 outputs an alarm received from the control device 10 by at least one of the sound output unit 281, the light-emitting unit 282, and the vibration unit 283. Here, the alarm may be, for example, outputting a voice or a warning sound by the sound output unit 281, or vibrating by the vibration unit 283. In addition, the alarm may be causing the LED of the light-emitting unit 282 to emit light and turn on, or may be causing it to blink. Although not shown, if the mobile terminal 20 has a display unit, a warning message may be displayed on the display unit as an alarm. When the alarm output unit 208 receives a signal to output an alarm, it outputs an alarm by using one of the sound output unit 281, the light-emitting unit 282, and the vibration unit 283, or a combination of these. The period for outputting the alarm may be a predetermined period (for example, several milliseconds to one second), or a signal to stop the alarm may be sent from the operation unit 107 to the control unit 101 in response to an operation by the user. The period for outputting the alarm may also be until the control unit 101 acquires the next face image data.

Although not shown in FIG. 2, the mobile terminal 20 may have a display unit and an operation unit, similar to the control device 10.

Figure 4 is a block diagram showing the determination function in one embodiment of the present invention. Note that some or all of the configuration for realizing each function described below may be realized by hardware.

The judgment function (program 300) for outputting an alarm includes an acquisition unit 301, an image analysis unit 302, a judgment unit 303, and an output unit 304.

The acquisition unit 301 acquires face image data 311 acquired by the image capturing unit 103 and distance data 312 acquired by the detection unit 207 of the mobile terminal 20. The acquisition unit 301 acquires the face image data 311 and distance data 312 at predetermined intervals (for example, every few milliseconds to one second).

The image analysis unit 302 analyzes the facial image data 311. FIG. 5 is a functional block diagram of the image analysis unit 302. The image analysis unit 302 has teacher data 322, a learning unit 323, a machine learning model 324, and an estimation unit 325.

The image analysis unit 302 has a function of analyzing the user's face image data acquired by the acquisition unit 301. The teacher data 322 stores two types of images: an image in which the face and hands overlap, and an image in which the face and hands do not overlap. The image in which the face and hands overlap includes, for example, an image in which the eyes and hands overlap, an image in which the nose and hands overlap, and an image in which the mouth and hands overlap. The image in which the face and hands overlap may be an image in which the cheek and hands overlap, an image in which the forehead and hands overlap, or an image in which the chin and hands overlap. The entire eye does not have to overlap with the hand, and may be an image in which a part of the eye and a part of the hand (fingers) overlap. The image may also be an image in which the user is facing sideways and the eyes and hands overlap. The image in which the face and hands do not overlap may be an image of only the face, an image in which the hands are near the face, or an image in which the hands are away from the face. The learning unit 323 constructs a machine learning model 324 by performing machine learning in advance on two types of training data 322: images in which the face and hands overlap, and images in which the face and hands do not overlap. The constructed machine learning model 324 is stored in the storage unit 202.

The user's facial image data acquired by the image capturing unit 103 is sent to the acquisition unit 301. The facial image data acquired by the acquisition unit 301 is estimated by the estimation unit 325 using the machine learning model 324 as to whether it is facial image data in which the face and hands overlap, or facial image data in which the face and hands do not overlap.

The determination unit 303 determines whether the user's face and the user's hand overlap based on the result of the analysis by the image analysis unit 302. Specifically, the determination unit 303 determines whether the user's eyes, nose, and mouth overlap with the user's hand. When the user is wearing a mask, the determination unit 303 determines whether at least the user's eyes and the user's hand overlap. In addition, the determination unit 303 determines whether the distance data 312 is smaller than a predetermined distance set in advance.

The acquisition unit 301 also acquires distance data 312. When the determination unit 303 acquires the distance data 312, it refers to a database in which a predetermined distance is stored and determines whether the acquired distance data 312 is smaller than the predetermined distance.

When the determination unit 303 determines that the user's face and the user's hand are overlapping based on the analysis result of the facial image data and determines that the distance data is smaller than a predetermined distance, the output unit 304 outputs an alarm. The control unit 101 transmits the alarm output from the output unit 304 to the mobile terminal 20. When the mobile terminal 20 receives the alarm from the control device 10, it outputs the alarm from the alarm output unit 208.

Next, the determination process according to one embodiment of the present invention will be described with reference to FIG. 6. The determination process outputs an alarm to the mobile terminal 20 based on the facial image data of the user's face acquired by the image capturing unit 103 and the distance data acquired from the mobile terminal 20.

Figure 6 is a flowchart explaining the determination process in one embodiment of the present invention.

For example, when the mobile terminal 20 outputs a signal instructing the start of the determination process, the control unit 101 of the control device 10 starts the process of determining whether the user's hand is approaching the face. First, the control unit 101 acquires the user's face image data captured by the image capturing unit 103 (step S401). The control unit 101 acquires the user's face image data captured by the image capturing unit 103 every few milliseconds to one second. Next, the control unit 101 analyzes the face image data (step S402). Next, the control unit 101 determines whether the user's face and the user's hand (or finger) are overlapping based on the analyzed face image data (step S403). If the control unit 101 determines that the user's face and the user's hand are not overlapping in the analyzed face image data (step S403; No), the control unit 101 proceeds to the process of step S401.

When the control unit 101 determines that the user's face and the user's hand overlap in the analyzed face image data (step S403; Yes), it acquires distance data (step S404). The control unit 101 determines whether the distance data is smaller than a predetermined distance set in advance (step S404). As the predetermined distance used in the determination of step S405, one of the distances when the hand approaches the eye, the distance when the hand approaches the nose, and the distance when the hand approaches the mouth in the database shown in FIG. 3 is used. Which of the three distances is used as the predetermined distance may be different for each device. Here, the distance when the hand approaches the eye is used as the predetermined distance. When the control unit 101 determines that the distance data is equal to or greater than the predetermined distance (step S405; No), it proceeds to the processing of step S401.

When the control unit 101 determines that the distance data is smaller than the predetermined distance (step S405; Yes), the control unit 101 outputs an alarm to the mobile device 20 (step S406). When the mobile device 20 receives the alarm, the alarm output unit 208 outputs an alarm. The period for outputting the alarm is a predetermined period (e.g., several seconds). Next, the control unit 101 determines whether or not the end condition is satisfied (step S407). Here, examples of the end condition include a case where a predetermined period has elapsed since the start of the judgment process, and a case where a signal to stop the judgment process is received from the operation unit 106. When the control unit 101 determines that the end condition is satisfied (step S407; Yes), the control unit 101 ends the judgment process. When the control unit 101 determines that the end condition is not satisfied (step S407; No), the process proceeds to step S401.

According to the determination process shown in FIG. 6, when the control unit 101 determines that a hand is approaching the user's face, an alarm is output. If the timing at which the control unit 101 proceeds from acquiring face image data in step S401 to step S407 and proceeds to the next step S401 is short, such as a few milliseconds to one second, the alarm continues to be output continuously while the hand is approaching the user's face. In this case, the output of the alarm stops while the hand is away from the user's face.

According to the control device 10 of one embodiment of the present invention, it is determined from the user's facial image data whether the user's hand and face are overlapping, and if it is determined that the user's hand and face are overlapping, it is determined whether the distance between the mobile terminal 20 and the detection unit 30 is smaller than a predetermined distance. This makes it possible to improve the accuracy of the timing of outputting an alarm compared to determining whether the user's hand is approaching the face based on facial image data alone.

3. Second embodiment
In this embodiment, a case will be described in which the mobile terminal 20 determines whether or not the user's hand is approaching the face and outputs a warning to the user not to touch the face. Note that only the parts that differ from the first embodiment will be described, and the explanation of the overlapping parts will be omitted.

Figure 7 is a diagram illustrating an overview of a system 1A according to one embodiment of the present invention. In this embodiment, a program 300 is executed in a mobile terminal 20. In this embodiment, the mobile terminal 20 is a wearable device, such as a wristwatch or finger ring.

In FIG. 7, the control device 10 transmits face image data acquired by the image capturing unit 103 from the communication unit 104 to the mobile terminal 20.

In the mobile terminal 20, the control unit 201 executes the program 300 stored in the storage unit 202 by the CPU, and realizes each function shown in FIG. 4 in the mobile terminal 20. The storage unit 202 stores face image data 311 received from the control device 10. The storage unit 202 also stores a predetermined distance (the distance between the mobile terminal 20 and the detection unit 30) previously set by the user. In this embodiment, it is sufficient that the predetermined distance of the user who uses the mobile terminal 20 is stored in the storage unit 202. The storage unit 202 also stores distance data 312 between the mobile terminal 20 and the detection unit 30 acquired by the detection unit 207 at every predetermined period. The storage unit 202 may accumulate and store the acquired distance data 312 for long-term storage. Alternatively, the storage unit 202 may temporarily store the acquired distance data 312. When the distance data 312 is temporarily stored, the past distance data may be updated with new distance data.

Next, the determination process in this embodiment will be described with reference to FIG.

When the mobile terminal 20 outputs a signal instructing the start of the determination process, the control unit 201 starts the process of determining whether the user's hand is approaching the face. First, the control unit 201 acquires the user's face image data 311 captured by the image capturing unit 103 (step S401). Next, the control unit 201 analyzes the face image data 311 (step S402). Next, the control unit 201 determines whether the user's face and the user's hand (or fingers) are overlapping based on the analyzed face image data 311 (step S403). If the control unit 201 determines that the user's face and the user's hand are not overlapping in the analyzed face image data 311 (step S403; No), it proceeds to the process of step S401.

When the control unit 201 determines that the user's face and the user's hand overlap in the analyzed facial image data (step S403; Yes), it acquires distance data 312 (step S404). The control unit 201 determines whether the distance data 312 is smaller than a predetermined distance that has been set in advance (step S404). When the control unit 201 determines that the distance data 312 is equal to or greater than the predetermined distance (step S404; No), it proceeds to the processing of step S401.

If the control unit 201 determines that the distance data 312 is smaller than the predetermined distance (step S404; Yes), the control unit 201 outputs an alarm to the alarm output unit 208 (step S406), and the control unit 101 ends the determination process.

According to the mobile terminal 20 of one embodiment of the present invention, it is determined from the user's facial image data whether the user's hand and face are overlapping, and if it is determined that the user's hand and face are overlapping, it is determined whether the distance between the detection unit 207 of the mobile terminal 20 and the detection unit 30 is smaller than a predetermined distance. This makes it possible to improve the accuracy of the timing of outputting an alarm compared to determining whether the user's hand is approaching the face from facial image data alone.

(4. Modifications)
Although one embodiment of the present invention has been described above, this embodiment can be modified in various ways as described below. Furthermore, the above-described embodiment and the modifications described below can be applied in combination with each other.

(1) In the first and second embodiments, a case has been described in which it is determined whether or not the face and the hand overlap based on the analysis results of the facial image data, and then the distance between the mobile terminal 20 and the detection unit 30 is determined, but one embodiment of the present invention is not limited to this. After determining the distance between the mobile terminal 20 and the detection unit 30, it may be determined whether or not the face and the hand overlap based on the analysis results of the facial image data.

Figure 8 is a flowchart explaining the determination process in one embodiment of the present invention. Here, a case is explained in which the determination process is executed in the control unit 101 of the control device 10, but the determination process may also be executed in the control unit 201 of the mobile terminal 20.

For example, when a signal instructing the start of the determination process is output in the mobile terminal 20, the control unit 101 of the control device 10 starts the process of determining whether the user's hand is approaching the face. First, the control unit 101 acquires distance data from the mobile terminal 20 (step S411). The control unit 101 determines whether the distance data is smaller than a predetermined distance that has been set in advance (step S412). When the control unit 101 determines that the distance data is equal to or greater than the predetermined distance (step S412; No), it proceeds to the process of step S411.

When the control unit 101 determines that the distance data is smaller than a predetermined value (step S412; Yes), the control unit 101 acquires the user's facial image data captured by the image capturing unit 103 (step S413). Next, the control unit 101 analyzes the facial image data (step S414). Next, the control unit 101 determines whether the user's face and the user's hand (or finger) overlap based on the analyzed facial image data (step S415). When the control unit 101 determines that the user's face and the user's hand do not overlap in the analyzed facial image data (step S415; No), the control unit 101 proceeds to the processing of step S411.

When the control unit 101 determines that the user's face and the user's hand overlap in the analyzed facial image data (step S415; Yes), the control unit 101 outputs an alarm to the mobile terminal 20 (step S406), and the control unit 101 ends the determination process. When the mobile terminal 20 receives the alarm, it outputs the alarm from the alarm output unit 208.

(2) In the first and second embodiments, an example has been described in which the mobile terminal 20 measures the distance to the detection unit 30, but one embodiment of the present invention is not limited to this. Whether a hand is approaching the user's face or not may be measured by only the detection unit 207 of the mobile terminal 20, and the distance may be measured.

(3) In the first and second embodiments, the mobile terminal 20 is described as a wearable device, but one embodiment of the present invention is not limited to this. The mobile terminal 20 may be, for example, a mobile terminal carried by a user, such as a smartphone or a tablet.

(4) Systems 1 and 1A are useful when a user works in a fixed position. For example, they can be applied to desk work in an office, driving a car, etc.

(5) In the first and second embodiments, a case has been described in which an alarm is output from the mobile terminal 20, but one embodiment of the present invention is not limited to this. A communication unit and an alarm output unit may be provided in the item in which the detection unit 30 is installed. When an alarm is output from the control device 10 or the mobile terminal 20, an alarm may be output from an alarm output unit possessed by the item. For example, when an alarm is output from the control device 10 or the mobile terminal 20, a voice or warning sound may be output by a sound output unit possessed by the item in which the detection unit 30 is installed.

1, 1A: System, 10: Control device, 20: Mobile terminal, 30: Detection unit, 40: Network, 101: Control unit, 102: Storage unit, 103: Image capture unit, 104: Communication unit, 105: Display unit, 106: Operation unit, 201: Control unit, 202: Storage unit, 204: Communication unit, 207: Detection unit, 208: Alarm output unit, 300: Program, 301: Acquisition unit, 302: Image analysis unit, 303: Determination unit, 304: Output unit, 311: Face image data, 312: Distance data

Claims (9)

A control device having an image capturing unit that captures face image data of a user and a control unit that analyzes the face image data;
A portable terminal having a first detection unit attached to the user's wrist;
A second detection unit is attached near the head of the user,
The first detection unit acquires distance data from the second detection unit,
The control unit analyzes the facial image data and, when it determines that the face and the hand overlap, acquires the distance data, and when the distance data is smaller than a predetermined distance set in advance, outputs an alert to the mobile terminal. The system of claim 1, wherein the control unit analyzes newly acquired face image data if it determines that the face and the hand do not overlap. The system according to claim 1 or 2, wherein if the acquired distance between the first detection unit and the second detection unit is equal to or greater than a preset distance, newly acquired face image data is analyzed. The system according to any one of claims 1 to 3, wherein the predetermined distance is the distance between the first detection unit and the second detection unit when the user brings his/her hand close to the user's eye. acquiring face image data of the user and analyzing the face image data to determine whether the face and the hand overlap;
When it is determined that the face and the hand overlap, a first detection unit of the portable terminal worn near the wrist of the user acquires distance data between the first detection unit and a second detection unit worn near the head of the user;
A method for outputting an alarm when the acquired distance between the first detection unit and the second detection unit is smaller than a predetermined distance set in advance. The method according to claim 5, further comprising: analyzing newly acquired face image data if it is determined that the face and the hand do not overlap. The method according to claim 5 or 6, further comprising: analyzing newly acquired face image data if the acquired distance between the first detection unit and the second detection unit is equal to or greater than a preset predetermined distance. The method according to any one of claims 5 to 7, wherein the predetermined distance is the distance between the first detection unit and the second detection unit when the user brings the hand close to the eye. Acquire facial image data of the user ;
Analyzing the face image data and determining whether or not a part of the face overlaps with the hand based on the analysis result;
When it is determined that the part of the face and the hand overlap, a distance between a first detection unit of a portable terminal worn on the wrist of the user and a second detection unit provided near a head of the user is acquired;
A program for causing a computer to execute the following: when the acquired distance between the first detection unit and the second detection unit is smaller than a predetermined distance, outputting an alarm to the mobile terminal.

Images