JP5293589B2 - Biological monitoring device - Google Patents

Description

  The present invention relates to a biological monitoring apparatus that monitors a biological state of a user.

  Conventionally, an apparatus for discriminating the state of a user's eyes is known. For example, Patent Document 1 below discloses an eye state determination device that determines the state of the eye area of a person to be detected. The eye state determination device sets a predetermined area including an eye position from a face image of a detection target person photographed by a camera as an eye search area, obtains a luminance distribution of the area, and based on the luminance distribution, the eye area Determine the state of.

  Here, when the luminance dispersion value is less than or equal to the set value, it is determined that sunglasses are present as the state of the eye region. Otherwise, the open / closed state of the eyelid of the detection target is detected as the state of the eye region.

JP 2008-224565 A

  The eye state determination device described in Patent Literature 1 either determines that there is sunglasses as the state of the eye region, or detects the open / closed state of the eyelid of the person to be detected as the state of the eye region. Even in a situation where the open / closed state of the eyelid can be detected by the displacement of the eye, it is only determined that there is sunglasses. As a result, there is room for improving convenience because no consideration is given to the monitoring of the biological state in a situation where the biological state such as the open / closed state of the eyelid can be monitored by the displacement of spectacles such as sunglasses and glasses.

  Accordingly, the present invention has been made to solve the above-described problem, and provides a biological monitoring apparatus capable of enhancing convenience by monitoring a biological state as well as a shift of glasses of a person to be monitored. The purpose is to do.

  In order to achieve the above object, a living body monitoring apparatus according to the present invention is a living body monitoring apparatus that monitors a user's biological state, and includes eyeglasses acquisition means for acquiring eyeglasses information about eyeglasses on the user's face. A face acquisition means for acquiring facial information related to the face, spectacle information acquired by the spectacle acquisition means, and a specifying means for specifying an arrangement state of the spectacles based on the face information acquired by the face acquisition means; Monitoring means for monitoring the biological state of the user based on the arrangement state of the spectacles specified by the specifying means.

  In the biological monitoring apparatus according to the present invention, first, spectacles information related to spectacles on the user's face and facial information related to the face are acquired. Next, the arrangement state of the glasses is specified based on the acquired glasses information and face information. And a user's biological condition is monitored based on the arrangement | positioning condition of specified spectacles. For this reason, for example, in a situation where it is possible to monitor the biological state such as the open / close state of the eyelids due to the displacement of the eyeglasses, it is possible to improve the convenience by monitoring the biological state after specifying the arrangement state of the eyeglasses. .

  Moreover, it is also preferable that the eyeglasses obtaining means obtains eyeglasses information relating to an inclination angle of the eyeglasses with respect to the horizontal plane. Thereby, since the arrangement | positioning condition of the spectacles in which the inclination angle with respect to the horizontal surface of spectacles was considered is specified, it becomes possible to monitor a biological state more correctly.

  Moreover, it is preferable that the face acquisition means acquires face information relating to an inclination angle of the face with respect to a horizontal plane. Thereby, since the arrangement | positioning condition of the spectacles in consideration of the inclination angle with respect to the horizontal surface of a face is specified, it becomes possible to monitor a biological state more correctly.

  Further, when the arrangement state of the spectacles specified by the specifying unit indicates a situation where the spectacles are removed from the user's eyes, the monitoring unit preferably masks the region of the spectacles and monitors the biological state of the user. . Thereby, when the arrangement | positioning condition of spectacles shows the condition removed from a user's eyes, since the area | region of the said spectacles is masked, it becomes possible to monitor a biological state more correctly.

  The monitoring means preferably monitors the state of the user's eyes. Accordingly, for example, in a situation in which the eye state can be monitored due to the displacement of the eyeglasses, it is possible to improve the convenience by monitoring the eye state after specifying the arrangement state of the eyeglasses.

  ADVANTAGE OF THE INVENTION According to this invention, the biological monitoring apparatus which can monitor not only the shift | offset | difference of spectacles of a monitoring subject but a biological state, and can improve the convenience can be provided.

It is explanatory drawing for demonstrating the function outline | summary of an eye area | region detection apparatus. 1 is a schematic configuration diagram for explaining a schematic configuration of an eye region detection device. It is explanatory drawing for demonstrating the calculation method of an eyeglass temple angle. It is a flowchart which shows the flow of the eye area detection process in an eye area detection apparatus.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

(1) Functional Overview of Eye Region Detection Device First, a functional overview of an eye region detection device as a living body monitoring device according to the present embodiment will be described with reference to FIG. FIG. 1 is an explanatory diagram for explaining the functional outline of the eye region detection device. The eye region detection device is a monitoring device that is mounted on a mobile vehicle such as an automobile and monitors a biological state such as the state of the eye E by detecting the position of the eye E region of the driver D as a user. The driver D is wearing spectacles G as spectacles having a lens L and a temple T. The glasses are not particularly limited as long as they have the lens L and the temple T, and may be sunglasses, for example.

  First, as shown in FIG. 1 (a), when the eyeglasses G are slung and removed so that the lens L is positioned near the forehead and the top of the eye E, The detecting device acquires the inclination angle of the temple T with respect to the horizontal plane H (that is, the horizontal plane including the straight line connecting the positions of the lower eyelids of the left eye and the right eye) and the inclination angle of the face G with respect to the horizontal plane H and specifies the inclination state of the glasses G. Then, by masking the region of the glasses G and excluding it from the monitoring target, the detection rate of the facial feature points is improved, and the state of the eye E of the driver D is monitored more accurately.

Similarly, as shown in FIG. 1 (b), when the eyeglasses G are worn with the eyeglasses G being lowered and removed so that the lens L is located in the vicinity of the cheek on the lower side of the eyes E, The detection apparatus acquires the inclination angle of the temple T with respect to the horizontal plane H and the inclination angle of the face with respect to the horizontal plane H, specifies the inclination state of the glasses G, masks the region of the glasses G, and removes it from the monitoring target. By improving the detection rate of feature points,
The state of the eye E of the driver D is monitored more accurately.

(2) Configuration of Eye Region Detection Device Next, the configuration of the eye region detection device will be described with reference to FIG. FIG. 2 is a schematic configuration diagram for explaining a schematic configuration of the eye region detection device 10. The eye region detection device 10 includes a glasses information detection unit 1 (glasses acquisition unit), a face orientation angle calculation unit 2 (face acquisition unit), a glasses temple angle calculation unit 3 (specification unit), and an eye region detection unit 4 (monitoring). Means) as a component.

  Note that the function of the eye region detection device 10 is realized by an ECU (not shown) that is an electronic control device mounted inside the host vehicle, for example. The ECU is a unit whose main component is a microcomputer including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory) and the like.

  The eyeglass information detection unit 1 receives the reflected light by irradiating the face of the driver D with the infrared light from the LED, and determines whether the spectacle G is detected according to whether the reflected light having a luminance of a predetermined value or more other than the pupil is detected. This is a spectacle presence / absence determination portion for determining the presence / absence of eyeglasses. For the details of irradiation with infrared light and reception of reflected light, for example, a technique described in JP-A-8-185503 is used. Further, when the presence of the glasses G is detected, the glasses information detection unit 1 detects the glasses L such as the positions of the ends of the lens L and the frame, the position of the temple T on the face, and the inclination angle of the temple T with respect to the horizontal plane H. To get.

  The face angle calculation unit 2 receives the reflected light by irradiating the face of the driver D with infrared light from the LED, the size of the pupil (the area of the pupil defined by the upper eyelid and the lower eyelid), the driver It is the information acquisition part which acquires face information, such as the pitch angle (face direction angle) inclined with respect to the horizontal surface H of the gaze direction of D. For the details of irradiation with infrared light and reception of reflected light, for example, a technique described in JP-A-8-185503 is used.

  The spectacle temple angle calculation unit 3 is based on the spectacles information acquired by the spectacle information detection unit 1 and the facial information acquired by the face direction angle calculation unit 2, and the relative angle of the temple T with respect to the line-of-sight direction (glasses temple). It is an arrangement specifying part for specifying the arrangement state of the glasses G such as (angle). Details of the calculation method of the eyeglass temple angle by the eyeglass temple angle calculation unit 3 will be described later.

  The eye region detection unit 4 is a monitoring unit that monitors a biological state such as the state of the eye E based on the arrangement state of the glasses G specified by the glasses temple angle calculation unit 3 using a camera. More specifically, the eye region detection unit 4 masks the region of the eyeglasses G when the arrangement state of the eyeglasses G specified by the eyeglass temple angle calculation unit 3 indicates a state in which the eyeglasses G are removed from the eye E. (I.e., set as a non-monitoring area that is not a monitoring target of the biological state), and monitors the biological state such as the open / closed state of the bag.

(3) Calculation Method of Eyeglass Temple Angle Next, a calculation method of the eyeglass temple angle will be described with reference to FIG. FIG. 3 is an explanatory diagram for explaining a method for calculating a spectacle temple angle. FIG. 3 (a) corresponds to the state shown in FIG. 1 (a), and FIG. This corresponds to the state shown in b).

  First, as shown in FIG. 3 (a), a description will be given of a situation in which the eyeglasses G are hung in a state where the eyeglasses G are lifted and removed so that the lens L is positioned near the forehead and the top of the eye E. . The situation in which the eyeglasses G are lifted is recognized based on the eyeglasses information acquired by the eyeglass information detection unit 1 and the face information acquired by the face orientation angle calculation unit 2. Then, the eyeglass temple angle calculation unit 3 obtains the inclination angle A with respect to the horizontal plane H of the temple T acquired by the eyeglass information detection unit 1 (here, the normal direction when the clockwise direction is positive with the vine of the eyeglass G being the rotation center). ) Is subtracted from the face orientation angle C (a positive value in this case) with respect to the horizontal plane H in the line-of-sight direction V obtained by the face orientation angle calculator 2 to obtain the eyeglass temple angle (AC).

  Then, the eye region detection unit 4 has a first predetermined condition that the eyeglass temple angle (AC) obtained by the eyeglass temple angle calculation unit 3 is equal to or larger than a first predetermined angle Θ1 (here, a positive value). Is determined to be satisfied. When the first predetermined condition is satisfied, the eye region detection unit 4 recognizes that the glasses G are not only shifted up but also out of the cover region of the eye E. The Then, the eye region detection unit 4 masks the region of the glasses G (that is, sets it as a non-monitoring region that is not a monitoring target of the biological state), and monitors the biological state such as the open / closed state of the eyelid using a camera. .

  In addition, as shown in FIG. 3B, a description will be given of a situation where the eyeglasses G are worn with the lens G being lowered and removed so that the lens L is positioned in the vicinity of the lower cheek of the eye E. The situation in which the eyeglasses G are lowered is recognized based on the eyeglasses information acquired by the eyeglass information detection unit 1 and the face information acquired by the face orientation angle calculation unit 2. Then, the eyeglass temple angle calculation unit 3 tilts the angle T of the temple T acquired by the eyeglass information detection unit 1 with respect to the horizontal plane H (here, the negative when the clockwise direction is positive with the vine of the eyeglass G being the rotation center). ) Is subtracted from the face orientation angle C (negative value here) with respect to the horizontal plane H in the line-of-sight direction V obtained by the face orientation angle calculation unit 2 to obtain the eyeglass temple angle (BC).

  Then, the eye region detection unit 4 has a second predetermined condition that the eyeglass temple angle (BC) obtained by the eyeglass temple angle calculation unit 3 is equal to or smaller than a second predetermined angle Θ2 (here, a negative value). Is determined to be satisfied. When the second predetermined condition is satisfied, the eye region detecting unit 4 recognizes that the glasses G are not only shifted down but also out of the cover region of the eye E. The Then, the eye region detection unit 4 masks the region of the glasses G (that is, sets it as a non-monitoring region that is not a monitoring target of the biological state), and monitors the biological state such as the open / closed state of the eyelid using a camera. .

  Here, a description will be given of a situation where the eyeglasses G are worn without being displaced from the cover area of the eye E. In this situation, the eyeglass temple angle calculation unit 3 determines the face direction with respect to the horizontal plane H in the line-of-sight direction V acquired by the face direction angle calculation unit 2 from the inclination angle of the temple T acquired with the eyeglass information detection unit 1 with respect to the horizontal plane H. The glasses temple angle is obtained by subtracting the angle.

  Then, the eye region detection unit 4 has the eyeglass temple angle obtained by the eyeglass temple angle calculation unit 3 less than the first predetermined angle Θ1 (positive value here) and the second predetermined angle Θ2 (here negative). It is determined whether or not a third predetermined condition that is greater than the value of (3) is satisfied. When the third predetermined condition is satisfied, the eye region detection unit 4 recognizes that the glasses G are not displaced from the cover region of the eye E and are not removed. At this time, the eye region detection unit 4 ends the series of processes without monitoring the biological state.

(4) Flow of Eye Region Detection Processing in Eye Region Detection Device Subsequently, the flow of eye region detection processing in the eye region detection device 10 will be described with reference to FIG. FIG. 4 is a flowchart showing a flow of eye region detection processing in the eye region detection apparatus 10.

  First, the eyeglass information detection unit 1 receives reflected light by irradiating the face of the driver D with infrared light from the LED, and whether or not the reflected light having a luminance of a predetermined value or more other than the pupil is detected. The presence or absence of glasses G is determined (step S01). When it is determined that the glasses G are not present, the series of processing ends. On the other hand, when the presence of the glasses G is detected, steps S02 and S03 described later are performed.

  In step S02, the spectacle information detection unit 1 detects and acquires spectacle information such as the position of the end of the lens L, the position of the temple T on the face, and the inclination angle of the temple T with respect to the horizontal plane H. When step S03 described later is completed, the process proceeds to step S04 described later.

  In step S03, the face direction angle calculation unit 2 receives the reflected light by irradiating the face of the driver D with infrared light from the LED, and the size (area) of the pupil or the horizontal plane H in the line of sight of the driver D. Face information such as inclination angles A and B (face orientation angles) is obtained by calculation. And if step S02 is completed, it will transfer to below-mentioned step S04.

  In step S04, the spectacle temple angle calculation unit 3 calculates and acquires the spectacle temple angle as the spectacle mask frame angle based on the spectacles information acquired in step S02 and the face information acquired in step S03. By doing so, the arrangement situation including the inclination situation of the glasses G is specified. And it transfers to below-mentioned step S05.

  In step S05, the eye region detection unit 4 determines that the eyeglass temple angle acquired by the eyeglass temple angle calculation unit 3 is equal to the first predetermined condition (A−C ≧ Θ1) and the second predetermined condition (B−C ≦ It is determined whether or not any of Θ2) is satisfied. When neither the first predetermined condition nor the second predetermined condition is satisfied (that is, when the third predetermined condition (A-C <Θ1 and BC> Θ2) is satisfied), the series of processes is finish. On the other hand, when either the first predetermined condition or the second predetermined condition is satisfied (that is, when the third predetermined condition is not satisfied), the process proceeds to step S06 described later.

  In step S06, the eye region detection unit 4 masks the region of the eyeglasses G (that is, sets it as a non-monitoring region that is not a monitoring target of the biological state), detects the eye E region, The living body state such as the open / closed state is monitored. Then, a series of processing ends.

(5) Actions and Effects of Eye Region Detection Device In the eye region detection device 10 as a living body monitoring device according to the present invention, first, spectacles information about the glasses G on the face of the driver D and face information about the face are acquired. . Next, an arrangement state including the inclination state of the glasses G is specified based on the acquired spectacles information and face information, and the spectacle temple angle is acquired. Then, the deviation of the eyeglasses G from the cover area of the eye E is determined based on the specified eyeglass temple angle, and when the deviation of the eye E from the cover area is detected, it is considered that the eyeglasses G have been removed. The biological state of the driver D is monitored after masking the region of the glasses G.

  For this reason, for example, in a situation where it is possible to monitor the biological state such as the open / closed state of the eyelid due to the displacement of the glasses G, the biological state is monitored after detecting the displacement of the eye E from the cover region of the glasses G. It becomes possible to increase.

  In addition, since the arrangement state including the inclination state of the glasses G taking into account the inclination angles A and B with respect to the horizontal plane H of the glasses G is specified, it becomes possible to monitor the biological state more accurately.

  In addition, since the arrangement state including the inclination state of the glasses G taking into account the face orientation angle C with respect to the horizontal plane H of the face is specified, it becomes possible to monitor the biological state more accurately.

  Further, when the arrangement state of the glasses G indicates a situation where the glasses G are removed from the eye E, the region of the glasses G is masked, so that the detection rate of the face feature points is improved and the biological state is more accurately detected. Monitoring can be performed.

  Further, for example, in a situation where the state of the eye E can be monitored by the deviation of the glasses G, the state of the eyeglasses G including the tilted state is specified, and the state of the eye E is detected and monitored to detect the drowsiness of the driver D. Since the presence / absence can be estimated, the convenience can be improved.

(6) Modification In the above embodiment, the spectacle information detection unit 1 receives the reflected light by irradiating the face of the driver D with infrared light from the LED, and the reflection other than the pupil has a luminance equal to or higher than a predetermined value. It has been described that the configuration is such that the presence or absence of the glasses G is determined based on whether or not the light is detected. However, if it is possible to determine the presence or absence of the glasses G and obtain the glasses information, the infrared light may not be used. Good.

  Further, the eye region detection device 10 has been described as a monitoring device that detects the position of the eye E region of the driver D as a user, but the detection target person who is the detection target of the position of the eye E region is not particularly limited. For example, another passenger may be used.

  ADVANTAGE OF THE INVENTION According to this invention, the biological monitoring apparatus which can monitor not only the shift | offset | difference of spectacles of a monitoring subject but a biological state, and can improve the convenience can be provided.

  DESCRIPTION OF SYMBOLS 1 ... Glasses information detection part, 2 ... Face direction angle calculation part, 3 ... Eyeglass temple angle calculation part, 4 ... Eye area detection part, 10 ... Eye area detection apparatus, A, B ... Inclination angle, C ... Face direction angle, D: Driver, E ... Eye, G ... Glasses, H ... Horizontal plane, L ... Lens, T ... Temple, V ... Gaze direction.

Claims (4)

A biological monitoring device for monitoring a user's biological state,
Spectacles acquisition means for acquiring spectacles information about spectacles on the user's face;
Facial acquisition means for acquiring facial information relating to the face;
Specifying means for specifying an arrangement state of the glasses based on the glasses information acquired by the glasses acquisition means and the face information acquired by the face acquisition means;
Monitoring means for masking a region of the eyeglasses and monitoring the biological state of the user when the arrangement state of the eyeglasses specified by the specifying means indicates a situation removed from the user's eyes ;
A living body monitoring apparatus comprising:   The biological monitoring apparatus according to claim 1, wherein the spectacles acquisition unit acquires the spectacles information related to an inclination angle of the spectacles with respect to a horizontal plane.   The living body monitoring apparatus according to claim 1, wherein the face acquisition unit acquires the face information related to an inclination angle of the face with respect to a horizontal plane. It said monitoring means, biological monitoring device according to any one of claims 1 to 3, characterized in that monitoring the state of the eye of the user.

Images