JP4186567B2 - Eye determination apparatus and method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an eye determination apparatus and method for determining whether or not a photographed image has eyes and capturing the image when eyes are present.
[0002]
[Prior art]
Conventionally, as an eye determination device for determining whether or not a photographed image has eyes, it is determined whether or not a photographed image has a specular reflection image (high brightness portion) by an eye pupil generated by a light source at the time of photographing. If a search is performed, the size, the circularity, the edge strength, and the like are determined, and the presence of an eye is determined based on the determination result (see, for example, Patent Document 1).
[0003]
[Patent Document 1]
JP-A-10-269356 (page 1-2, FIG. 1)
[0004]
[Problems to be solved by the invention]
However, what is known in the art is only to search for a specular reflection image, that is, a high-luminance part in the captured image, and to determine the presence of the eye based on the result. In the end, although it is said that the determination is made taking into consideration the size, circularity, edge strength, etc. of the high-luminance part, there are other light sources around the subject, and the subject is wearing glasses. In this case, in addition to the specular reflection image from the pupil, a high-luminance part with the same size and circularity may occur, and in such a case, the determination itself is greatly mistaken. was there.
[0005]
The present invention has been made in view of the above-described conventional problems, and provides an eye determination apparatus and method that can determine the presence of eyes with higher accuracy.
[0006]
[Means for Solving the Problems]
An eye determination device according to the present invention includes a simple eye position detection unit that simply detects an eye position from an image captured by an imaging device, and a search window based on the eye position detected by the simple eye position detection unit. Search window creation means to be created, high brightness portion detection means for detecting a high brightness portion from video in the search window, and an area within a predetermined range within the high brightness portion detected by the high brightness portion detection means Determining means for determining whether or not there is a high-intensity part having an image, and when the determination means determines that there is a high-intensity part having an area within a predetermined range determined in advance, It is configured to capture the video shot by the imaging device when it is determined that the eyes are present.
[0007]
With this configuration, the position of the eyes is easily detected, a search window is created based on the position, and whether there is a high-luminance part having an area within a predetermined range within the search window is detected. Therefore, even if there are other light sources or glasses, there is an effect that the presence of eyes can be accurately determined without being influenced by them.
[0008]
Further, in the eye determination device of the present invention, the simple eye position detection unit includes a binarization unit that binarizes an image captured by the image capturing device, an X-axis from the image binarized by the binarization unit, A configuration comprising projection processing means for obtaining a projection output for each Y-axis, and detection means for detecting the position of the eye by calculating the center of gravity of the image binarized by the binarization means based on the projection output. Have.
[0009]
With this configuration, the eye position can be easily calculated quickly, and as a whole, the operation can be performed quickly and smoothly.
[0010]
In the eye determination device of the present invention, the high-intensity part detected by the high-intensity part detection means includes a specular reflection image by the light source at the time of shooting, and the specified range includes the area of the high-intensity part by the specular reflection image. The configuration is set as follows.
[0011]
With this configuration, it is possible to accurately detect the specular reflection image from the pupil of the eye by the illumination light source at the time of photographing, and it is possible to accurately determine the presence of the eye.
[0012]
In addition, the eye determination device of the present invention includes an integration unit that measures and integrates the luminance outside the high luminance part having an area within the specified range when there is a high luminance part having an area within the specified range; A second determination means for comparing the luminance value integrated by the means with a predetermined threshold value and determining where the reflected light from the high-luminance portion having an area within the specified range is provided; The configuration is such that the eye position is determined by the second determining means.
[0013]
With this configuration, the position of the eyes can be detected more accurately, and the presence of the eyes can be determined more accurately.
[0014]
In the eye determination device of the present invention, the integrating means measures and integrates the luminance on the circumference of a predetermined radius r centered on the gravity center position of the high luminance portion having an area within the specified range.
[0015]
With this configuration, the outer position of the high luminance part can be easily set, and the outer luminance can be easily measured and integrated.
[0016]
Further, the eye determination device of the present invention has a configuration in which the radius r is larger than the radius of the high-luminance portion having an area within the specified range and smaller than the radius of the pupil.
[0017]
With this configuration, the position of the eyes can be determined by accurately distinguishing pupils, irises, white eyes, and the like, and the position of the eyes can be determined more accurately.
[0018]
The eye determination method of the present invention includes a step of inputting a captured image, a step of simply detecting an eye position from the input image, and a search window based on the detected eye position. A step of creating, a step of detecting a high-intensity part from the video in the search window, and a step of determining whether or not the detected high-intensity part has a high-intensity part having an area within a predetermined specified range. And determining that there is an eye in the input video when it is determined in the determining step that there is a high-luminance part having an area within a specified range, and capturing the input video.
[0019]
By this method, even when there is another light source or wearing glasses, it is possible to accurately detect the eye position with little influence from them.
[0020]
The eye determination method of the present invention includes a step of measuring and integrating the outer luminance of the high luminance part having an area within the specified range when it is determined that there is a high luminance part having an area within the specified range. Comparing the integrated luminance value with a predetermined threshold, and determining where the high-luminance portion having an area within the specified range is due to reflected light from, and calculating the area within the specified range. The position of the eyes is determined by determining where the high-intensity part is due to the reflected light from, and the input video is captured.
[0021]
By this method, the position of the eyes can be detected more accurately, and the presence of the eyes can be determined more accurately.
[0022]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.
[0023]
FIG. 1 is a schematic configuration diagram of an eye determination device according to an embodiment of the present invention.
[0024]
As shown in FIG. 1, an eye determination device according to an embodiment of the present invention includes a photographing device 1 for photographing a subject, a light source 2 such as a light emitting diode that gives illumination light to the subject at the time of photographing, and these photographing devices. 1. An eye determination device main body 3 that drives each of the light sources 2 and inputs an image captured by the image capturing device 1 and determines the presence of eyes based on the image.
[0025]
In addition to the input unit and the output unit, the eye determination device main body 3 includes a memory that temporarily stores video input from the input unit, a central processing unit (CPU) such as a microcomputer that controls these, and the like. Yes.
[0026]
Next, the operation of the eye determination device in one embodiment of the present invention will be described.
[0027]
FIG. 2 is a flowchart showing the operation of the eye determination apparatus according to the embodiment of the present invention, and FIGS. 3 and 4 are operation explanatory diagrams in respective operation states.
[0028]
First, when photographing a subject, the subject is illuminated with the light source 2 and the subject is photographed with the photographing device 1. Here, when measuring an iris or the like, it is desirable to use a light source that emits infrared rays.
[0029]
When the subject is photographed by the photographing device 1 and the photographed video is input to the eye determination device main body 3 (S201), the eye determination device main body 3 first binarizes the input video (S202). Then, the binarized image is projected in the X-axis and Y-axis directions (S203), and the barycentric position of the image is calculated (S204). As described below, when the eye is present in the video, the calculated position of the center of gravity substantially coincides with the eye position, so this position is simply determined as the eye position.
[0030]
That is, if the video imaged by the imaging device 1 is an image including eyes as shown in FIG. 3A, when this is binarized, as shown in FIG. The pupil part appears more clearly. Therefore, when the binarized video is projected in the X-axis and Y-axis directions, the outputs are as shown in 11 and 12, respectively. Based on the outputs 11 and 12, the center of gravity position 13 is obtained. When calculated, the position 13 is slightly different from the position of the pupil 15 due to the influence of the eyelashes 14 and the like, but almost represents the position of the pupil 15. Therefore, the position 13 is simply determined as the eye position first.
[0031]
If the eye position is simply detected in this way, the search window 16 is created based on the position (S205). When the search window 16 is created, as shown in FIG. 4 (A), the eye position 15 obtained simply is coincident with the center of the search window 16 or simply by the influence of eyelashes. Considering that the obtained eye position 15 may be shifted upward, the search window 16 is positioned so as to be long and the size of the iris portion 17 including the pupil 15 is sufficiently large. Create it so that it is large enough to be selected.
[0032]
Once the search window 16 is created in this way, the video within the range surrounded by the search window 16 is taken out and a high-luminance portion in the video is detected (S206). If there is no high-luminance part, it is determined that the position is not the eye position, and the next captured video is input again to the eye determination device body 3 (S201). Are divided into groups (S207), and the area of each group is calculated (S208).
[0033]
Now, as shown in FIG. 4B, if there are three high luminance portions in the search window, these high luminance portions are the high luminance portions 18 of the first, second, and third groups, respectively. , 19 and 20, and the areas are calculated in the high luminance portions 18, 19 and 20 of the respective groups.
[0034]
Then, based on the calculation result, it is sequentially determined whether or not the areas of the high brightness portions 18, 19, and 20 of each group are within a predetermined range (S209). If it is outside (N in S210), the process proceeds to Step 201, and if there is even one within the specified range (Y in S210), it is determined that there is an eye in the video input in Step S201, and that A video is captured (S211).
[0035]
Here, the predetermined specified range is set to a range of areas M1 to M2 (where M1 <M2), for example, as shown in FIG. In the case where the reflected light is reflected by a portion other than the area M2 and is larger than the area M2, it is determined that the reflected light is reflected by glasses, and only the specular reflection image from the pupil 15 by the light source 1 is excluded. The range (M1 to M2) is set so that can be determined as accurately as possible.
[0036]
Therefore, as shown in FIG. 4B, the high luminance portion 18 of the first group has a predetermined range (M1 to M2), and the high luminance portion 19 of the second and third groups. , 20 is outside the predetermined range (M1 to M2), it is determined that only the high-intensity portion 18 of the first group is reflected light within the predetermined range (M1 to M2). Then, the high-luminance portions 19 and 20 of the second and third groups are determined to be reflected light that is smaller than the prescribed range (M1 to M2) reflected by portions other than the pupil. In this case, it is determined that there is a high-luminance portion whose area is within a predetermined range (M1 to M2) determined in advance (Y in S210), and it is determined that eyes are present in the video input in step S201. The video is captured (S211).
[0037]
As described above, according to the present embodiment, the position of the eyes is easily obtained, a search window is formed based on the position, and the high brightness portion is searched based on the video existing in the search window. If the searched high-luminance part has an area within a predetermined range (M1 to M2) determined in advance, it is determined that the video has eyes, and the video is captured. Even if there are other light sources in the surrounding area, there are high-luminance parts reflected by parts other than the eyes, or there is reflected light from eyeglasses, they are not present in the search window. Even if it is, the size is not within the specified range (M1 to M2), so the presence of eyes can always be accurately determined without being influenced by them, and the necessary video can be captured correctly. .
[0038]
In the present embodiment, only one light source 1 is provided, but two or more light sources may be provided. When two or more light sources are provided, specular reflection light from the pupil of the light source 1 appears for the number of the light sources 1 respectively, so that the areas of the reflected light are all defined in a predetermined range (M1 to M2). It is desirable to make a configuration so as to determine whether or not the positional relationship between the reflected lights is in a predetermined positional relationship. That is, in the case of such a configuration, the presence of the eyes can be determined with higher accuracy, and the necessary video can be captured with higher accuracy.
[0039]
Further, in the present embodiment, a high luminance part is searched based on an image existing in the search window, and the searched high luminance part may have a predetermined area (M1 to M2). For example, it is determined that the image has eyes, but in order to more accurately determine the position of the eyes, the area is based on a high luminance part within a predetermined range (M1 to M2). The following determination may be performed.
[0040]
FIG. 6 shows a flow newly added to the flow shown in FIG. 2 in order to more accurately determine the eye position. The operation will be described below with reference to this flowchart.
[0041]
The high luminance part is searched based on the video existing in the search window 16, and it is determined whether or not the searched high luminance part has an area within a predetermined range (M1 to M2) determined in advance (S210). ), If there is (Y in S210), as shown in FIG. 7A, the center of gravity position 21 is calculated (S601) for the high-luminance portion 18 within the prescribed range (M1 to M2). The luminance on the circumference of the radius r centered on the center of gravity position 21 is measured (S602) and integrated (S603). Then, it is determined whether or not the integrated luminance value K is equal to or smaller than a predetermined first threshold value K1 (S604). If not, the luminance value K is equal to or larger than a second threshold value K2 (K2> K1). Determination is made (S605).
[0042]
Then, based on these determination results, it is determined whether the high-intensity part 18 is due to reflected light from the pupil, reflected light from the iris, or reflected light from the white eye. It is finally determined whether it is reflected light.
[0043]
For example, if the radius r from the gravity center position 21 of the high brightness portion 18 is set to be larger than the radius of a predetermined range (M1 to M2) and smaller than the radius of the pupil, the high brightness portion 18 reflects light from the pupil. The integrated luminance value K is the smallest, when it is due to the reflected light from the iris, is the next smallest, and is the largest when it is due to the reflected light from the white eye. As shown in FIG. 7B, the first and second threshold values K1 and K2 are set to be reflected from the pupil if the integrated luminance value K is smaller than the first threshold value K1, and the first threshold value K1. If the value is between the second threshold value K2 and the reflected light from the iris, and if the value is larger than the second threshold value K2, then the reflected light from the white eye is set, these threshold values K1 and K2 are used. Which threshold K1, K2 is the integrated luminance value K? Small or, in greater, whether the reflected light from where it can be determined accurately.
[0044]
In the embodiment shown in FIG. 6, when the integrated luminance value K exceeds the first threshold value K1 (N in S604), the image is abandoned and only when it is equal to or lower than the first threshold value (Y in S604). The image is captured (S606). As a result, the eye position is detected only by the reflected light from the pupil, and the eye position can be determined more accurately.
[0045]
In the embodiment shown in FIG. 6, even when the integrated luminance value K is less than or equal to the second threshold value (N in S605), if the image is captured, the reflected light from the iris can be It goes without saying that the position can be determined.
[0046]
【The invention's effect】
As described above, according to the present invention, even if there are other light sources or glasses, it is possible to determine the presence of eyes without being affected by them, and it is necessary to have higher accuracy. Can capture video.
[Brief description of the drawings]
FIG. 1 is a schematic configuration diagram of an eye determination device according to an embodiment of the present invention. FIG. 2 is a flowchart showing an operation of the eye determination device according to an embodiment of the present invention. Schematic explanatory diagram when the position of the eye is simply detected in the eye determination device in the embodiment (A) A diagram showing an example of an eye image captured by the image capturing device (B) A binarized image and each axis FIG. 4 is a schematic diagram for explaining the presence of an eye in the eye determination apparatus according to an embodiment of the present invention. FIG. 4B is a conceptual diagram showing a search window. FIG. 5 is a schematic explanatory diagram for explaining a predetermined prescribed range used when the presence of an eye is determined in the eye determination device according to an embodiment of the present invention. In the eye determination device in another embodiment, FIG. 7 is a flowchart for explaining the operation of the newly added portion. FIG. 7 is an explanatory diagram for more accurately determining the eye position in the eye determination device according to another embodiment of the present invention. A diagram showing the circumference of radius r centered on the position of the center of gravity (B) A diagram showing integrated luminance K and two threshold values K1 and K2
DESCRIPTION OF SYMBOLS 1 Image pick-up device 2 Light source 3 Eye determination apparatus main body 11,12 Output 13 Center of gravity position 14 Eyelash 15 Pupil 16 Search window 17 Iris 18, 19, 20 High brightness part

Claims (6)

A simple eye position detecting means for simply detecting the position of the eye from the video imaged by the photographing apparatus; and a search window creating means for creating a search window based on the eye position detected by the simple eye position detecting means; , A high-luminance portion detecting means for detecting a high-luminance portion from the video in the search window, and a high-luminance portion having an area within a predetermined range among the high-luminance portions detected by the high-luminance portion detecting means A first determination unit that determines whether or not there is a high-luminance part having an area within a predetermined range determined in advance by the first determination unit. An eye determination device that captures the image that is determined to have eyes and is determined to have eyes,
When there is a high luminance part having an area within the specified range, an integrating means for measuring and integrating the luminance outside the high luminance part having an area within the specified range, and a luminance value integrated by the integrating means And a second determination means for determining where the high-luminance portion having an area within the specified range is due to reflected light from the second determination means, An eye determination device characterized by determining the position of the eye by means of:   A simple eye position detecting means for simply detecting the position of the eye from the video imaged by the photographing apparatus; and a search window creating means for creating a search window based on the eye position detected by the simple eye position detecting means; , A high-luminance portion detecting means for detecting a high-luminance portion from the video in the search window, and a high-luminance portion having an area within a predetermined range among the high-luminance portions detected by the high-luminance portion detecting means A first determination unit that determines whether or not there is a high-luminance part having an area within a predetermined range determined in advance by the first determination unit. An eye determination device that captures the image determined to have eyes and is determined to have eyes,
When there is a high luminance part having an area within the specified range, an integrated value obtained by measuring the luminance on the circumference of a predetermined radius r centered on the center of gravity of the high luminance part having the area within the specified range And the integration means for calculating the integrated value and the first threshold value and the second threshold value determined in advance, and where the high-luminance portion having an area within the specified range is due to reflected light And a second determining means for determining the eye.   The simple eye position detection means binarizes the image captured by the imaging device, and outputs the projection output for each of the X axis and the Y axis from the image binarized by the binarization means. And a detection means for detecting a position of an eye by calculating a centroid position of an image binarized by the binarization means based on the projection output. Item 1. The eye determination device according to Item 1. The high-intensity part detected by the high-intensity part detection means includes a specular reflection image by a light source at the time of photographing, and the specified range is set to include the area of the high-intensity part by the specular reflection image. The eye determination device according to any one of claims 1 to 3, wherein the eye determination device is characterized in that: 3. The eye determination device according to claim 2, wherein the radius r is larger than a radius of a high-luminance portion having an area within the specified range and smaller than a radius of the pupil. A step of inputting a photographed image; a step of simply detecting an eye position from the input image; a step of creating a search window based on the detected eye position; detecting a high-luminance portion from the image, a first determination step of determining whether there is a high luminance portion with an area in the predetermined specified range in the high luminance portion is detected, the first when it is determined in the determination step the there is a high brightness having an area within a specified range, a eye judging method comprising the steps of capturing an image input is determined that the eye has input video exists ,
When it is determined that there is a high-intensity part having an area within the specified range, the luminance on the circumference of a predetermined radius r centered on the center of gravity of the high-intensity part having the area within the specified range is measured. The step of calculating the integrated value is compared with the predetermined first threshold value and the second threshold value, and the high luminance part having an area within the specified range is caused by reflected light from where eye determination method being characterized in that either further comprising a second determination step of determining certain.

Images