JP6528469B2 - Pupil diameter measuring device, pupil diameter measuring method and program thereof - Google Patents

Description

  The present invention relates to a pupil diameter measurement device, a pupil diameter measurement method, and a program thereof.

  There are known portable pupil position measuring devices and pupil diameter measuring devices that measure the position of the subject's pupil, pupil diameter and the like using infrared images or visible images of the subject. (For example, refer patent documents 1-3).

  Non-contact line-of-sight measurement that measures the subject's gaze direction, head movement, pupil diameter, etc. by capturing the subject's face using multiple imaging devices and infrared illumination and analyzing the captured image A system is known (see, for example, Non-Patent Document 1).

JP 2001-340300 A JP, 2014-79374, A Japanese Patent Application Laid-Open No. 2002-238853

"Non-contact eye gaze measurement system", [online], Toyo Technica Co., Ltd. [searched February 7, 2015], Internet <URL: http://www.toyo.co.jp/car/smarteye/pro. html〉

  However, since the above-described portable pupil position measuring device and pupil diameter measuring device are dedicated devices for measuring the pupil position and pupil diameter, the subject prepares a dedicated device for measuring the pupil position and pupil diameter It will be done. Also, as with the above-mentioned non-contact line-of-sight measurement system, a camera such as a smartphone can simply think of shooting from a distance, but the accuracy of the measured pupil diameter is about ± 0.5 mm, There is a problem that the accuracy is low.

  In one embodiment, it is an object of the present invention to provide a pupil diameter measurement device capable of highly accurate pupil diameter measurement with a simple configuration without using a dedicated device for measuring the pupil diameter.

  In one aspect, the pupil diameter measurement device includes a display unit capable of emitting monochromatic light, a barrier, a lenticular lens, and a pupil diameter determination unit. When the barrier is disposed such that one surface faces the surface of the display unit, a plurality of light transmission regions transmitting monochromatic light emitted by the display unit to the other surface opposite to the one surface transmit light. It is formed in parallel via the light impermeable area which does not transmit. The lenticular lens is disposed on the other surface of the barrier and emits the light transmitted through the plurality of transmission areas so as to be concentrated. The pupil diameter determination unit determines and determines the pupil diameter of the subject based on the width and distance of the light transmission area of the barrier, the thickness and refractive index of the lenticular lens, and the suitable distance using the appropriate visual distance. The pupil diameter signal indicating the pupil diameter is output. The appropriate viewing distance is the distance between the center of curvature of the lenticular lens and the pupil when the subject determines that the image displayed on the display unit has a uniform color when light from the lenticular lens enters the pupil of the subject. Distance between

  In one embodiment, it has become possible to provide a pupil diameter measuring device capable of highly accurate pupil diameter measurement with a simple configuration without using a dedicated device for measuring the pupil diameter.

It is a figure for demonstrating the pinhole effect. (A) is a figure which shows the pupil of the user who visually recognizes the image displayed on a related display apparatus and a display apparatus, (b) is the elements on larger scale enclosed with the broken line in (a), (c) Is a figure which shows a user's pupil. It is a perspective view of the pupil diameter measurement device concerning a 1st embodiment. It is a block diagram of the pupil diameter measurement apparatus shown in FIG. It is a disassembled perspective view of the optical apparatus shown in FIG. (A) is a figure which shows the state before mounting the optical apparatus shown in FIG. 3 in a display part, (b) is a figure which shows the state in which the optical apparatus shown in FIG. 3 was mounted in a display part. 5 is a flowchart showing pupil diameter measurement processing of the pupil diameter measurement device 1; (A) is a figure which shows the test subject's eyeball which visually recognizes the image displayed on the display part of the pupil diameter measuring device shown in FIG. 3, and a pupil diameter measuring device, (b) was enclosed with the broken line in (a) It is a partial enlarged view, and (c) is a figure which shows the relationship between the pitch of a barrier, and aperture diameter. (A) And (b) is a figure which shows distribution of the light which injects into the pupil in being 1st visual recognition distance, (c) is a display part visually recognized by a test subject when it is 1st visual recognition distance (D) and (e) show the distribution of light incident on the pupil at the second viewing distance, and (f) shows the second viewing distance. FIG. 6 is a view showing an image of a display section visually recognized by a subject. (A) and (b) is a figure which shows distribution of the light which injects into the pupil in case it is 3rd visual recognition distance and it is 1st pupil diameter, (c) is 3rd visual recognition distance, and It is a figure which shows the image of the display part visually recognized by a test subject when it is 1st pupil diameter, (d) and (e) are 3rd visual recognition distance and a pupil when it is 2nd pupil diameter. It is a figure which shows distribution of the light which injects into, and is a figure which shows the image of the display part visually recognized by a test subject, when it is 3rd visual recognition distance and it is 2nd pupil diameter. (A) is a figure which shows distribution of the light in a 1st incident state, (b) is a figure which shows distribution of the light in a 2nd incident state. (A) is a block diagram of the pupil diameter measurement apparatus which concerns on 2nd Embodiment, (b) is a figure which shows the pupil diameter calculation table shown to (a). It is a figure which shows roughly the simulation which shows the relationship between visual recognition distance and a visual recognition image. It is a figure which shows a 1st simulation result. It is a figure which shows a 2nd simulation result.

  The pupil diameter measuring device, the pupil diameter measuring method, and the program thereof will be described below with reference to the drawings. However, it should be noted that the technical scope of the present invention is not limited to those embodiments, but extends to equivalents to the invention described in the claims.

(Overview of Pupil Diameter Measurement Device According to Embodiment)
In the pupil diameter measuring device according to the embodiment, the distance between the lens and the pupil and the pupil diameter of the image visually recognized when the monochromatic light emitted from the display unit is incident on the pupil through the barrier and the lenticular lens The pupil diameter is measured using the change according to. This makes it possible to easily and easily measure the pupil diameter without using a dedicated device by using a portable terminal having a display unit and an inexpensive optical device formed of a barrier and a lenticular lens.

(Display Device Related to Pupil Diameter Measurement Device According to Embodiment)
Before describing the pupil diameter measurement device according to the embodiment, a display device related to the pupil diameter measurement device according to the embodiment will be briefly described. The related display device is to apply the pinhole effect shown in FIG. 1 to obtain a clear image. As shown in FIG. 1A, when the diameter of the pupil 901 is increased to allow the user to view the image 900 in a dark place, the figure of the captured light spreads on the retina 902 and the image 900 The visual recognition accuracy may deteriorate. In this case, the user hardly sees the image 900 as compared to a bright environment, and visually recognizes an image in a blurred state in which it is difficult to focus on the image 900 and the outline of the subject or the body portion is not clear. Therefore, as shown in FIG. 1B, by arranging a barrier 903 whose width is smaller than the pupil diameter of the pupil 901 between the image 900 and the pupil 901, it is possible to apply the pinhole effect to the image 900. A display device has been found which improves the viewing accuracy.

  FIG. 2 (a) is a diagram showing the associated display device and the pupil of the user viewing the image displayed on the display device, and FIG. 2 (b) is a partially enlarged view surrounded by a broken line in FIG. 2 (a) FIG. 2 (c) is a diagram showing the pupil of the user.

  As shown in FIG. 2A, the display device 910 includes a barrier unit 911, a lenticular lens 912, and a display unit 914. The display device 910 displays the aperture diameter K of the light LG of the image incident on the eye 920 of the user viewing the image displayed on the display unit 914 smaller than the diameter W of the pupil 921 in a predetermined direction. ing. The display device 910 realizes a pinhole effect that enhances the visibility of an image by making the irradiation width of light smaller than the diameter W of the pupil 921.

  As shown in FIG. 2B, the barrier means 911 changes the aperture of the window portion 913 in the vertical direction with respect to the display surface, and the aperture diameter K with respect to the light irradiation destination according to the user's visual ability. While adjusting the incident amount of light LG. In the barrier means 911, the window portion 913 A in which the pitch is narrowed and the window portion 913 B in which the pitch is widened are switched according to the illumination condition. The window portion 913 may be provided with a mechanism capable of adjusting the pitch in detail in accordance with the illuminance or the visual recognition ability, or may be a mechanism for switching the pitch stepwise for each fixed width.

  The lenticular lens 912 refracts the light LG having passed through the window 913 on the convex surface side to concentrate the light LG in a predetermined direction. The light LG passing through the curvature center RO of the convex surface portion is irradiated to the pupil 921 of the user on the display surface side of the lenticular lens 912, and the user is incident on the pupil 921 through the barrier means 911 and the lenticular lens 912. View the image according to the

  In the display device 910, the barrier means 911 has a window portion 913 formed in the lateral direction with respect to the display surface of the display portion 914, and the opening amount is adjusted in the vertical direction. For a user who visually recognizes the display surface, as shown in FIG. 2C, the light LG emitted from each lenticular lens 912 has an aperture diameter K narrower than the longitudinal direction of the pupil 921. At this time, in the case where the aperture amount which allows light to pass through the pupil 921 is wide according to the illuminance of the display environment, the aperture diameter KB according to the window 913 B or the aperture is narrow. The light is irradiated with an aperture diameter KA corresponding to the window portion 913A.

  When a white screen is displayed on the display unit 914, when the distance between the user using the display device 910 and the curvature center RO of the lenticular lens 912 is a suitable viewing distance, the color is uniform and there is no unevenness. The image is viewed by the user. On the other hand, when the distance between the user using the display device 910 and the curvature center RO of the lenticular lens 912 deviates from the appropriate viewing distance, an image having shading in the color to be viewed, that is, an image having unevenness is viewed by the user. That is, when a white screen is displayed on the display unit 914 of the display device 910, an image visually recognized by the user according to the distance between the user using the display device 910 and the curvature center RO of the lenticular lens 912 and the pupil diameter. Was found to change. The pupil diameter measurement device according to the embodiment measures the pupil diameter of the user based on this finding.

(Configuration of Pupil Diameter Measurement Device According to First Embodiment)
FIG. 3 is a perspective view of the pupil diameter measuring device according to the first embodiment, and FIG. 4 is a block diagram of the pupil diameter measuring device according to the first embodiment.

  The pupil diameter measurement device 1 has a portable terminal 10 and an optical device 20. The portable terminal includes a communication unit 11, an operation unit 12, an imaging unit 13, a display unit 14, a storage unit 15, and a processing unit 16. The optical device 20 includes a diffusion plate 21, a barrier 22, and a lenticular lens 23. The optical device 20 is detachably mounted on the surface of the display unit 14 of the mobile terminal 10.

  The communication unit 11 mainly includes a communication interface circuit including an antenna whose detection band is in the 2.1 GHz band, and connects the portable terminal 10 to a communication network (not shown). The communication unit 11 establishes a wireless signal channel by code division multiple access (CDMA) with the base station via a channel allocated by a base station (not shown), and performs wireless communication with the base station. Do. Then, the communication unit 11 supplies the data received from the base station to the processing unit 16. The communication unit 11 also transmits the data supplied from the processing unit 16 to the base station. The communication unit 11 performs data communication in accordance with the HTTP (Hypertext Transfer Protocol) protocol. Further, the communication unit 11 mainly has a communication interface circuit including an antenna whose sensitivity band is in the 2.4 GHz band, and does not go through a base station but via a base station of a wireless LAN such as Wi-Fi (registered trademark). Wireless communication.

  The operation unit 12 may be any device as long as it can operate the mobile terminal 10, and is, for example, a push switch. The operation unit 12 receives a user's instruction, generates a signal corresponding to the received instruction, and outputs the signal to the processing unit 16.

  The imaging unit 13 includes an imaging element arranged in an array and an element driving unit that drives the imaging element. The imaging device includes a charge coupled device (CCD) type sensor or an active pixel sensor (APS) type sensor, and a color filter, and accumulates a charge according to incident light. The element driving unit converts the charge accumulated in each of the imaging elements into an electric signal and outputs the electric signal to the processing unit 16.

  The display unit 14 may be any device as long as it can output moving images, still images, and the like, and is, for example, a touch panel display device. The display unit 14 displays a moving image according to moving image data supplied from the processing unit 16, a still image according to still image data, and the like. The display unit 14 receives an instruction of the user by contact such as tap, drag, or flick, generates a signal corresponding to the received instruction, and outputs the signal to the processing unit 16. The display unit 14 can emit monochromatic light such as white and gray.

  The storage unit 15 includes, for example, a semiconductor memory. The storage unit 15 stores a driver program, an operating system program, an application program, data, and the like used for processing in the processing unit 16. For example, the storage unit 15 stores, as a driver program, a mobile phone communication device driver program for controlling the communication unit 11, an input device driver program for controlling the operation unit 12, an output device driver program for controlling the display unit 14, and the like. In addition, the storage unit 15 stores, as an operating system program, a connection control program that executes a short distance wireless communication method such as Bluetooth (registered trademark) standard, a connection control program of a mobile phone and a wireless LAN, and the like. In addition, the storage unit 15 stores various programs including a pupil diameter measurement program for executing pupil diameter measurement processing as an application program. The computer program may be installed in the storage unit 15 from a computer-readable portable recording medium such as a semiconductor memory including a flash memory, using a known setup program or the like.

  In addition, the storage unit 15 stores, as data, data used in pupil diameter measurement processing such as the thickness of the lenticular lens 23, the refractive index of the lenticular lens 23, and the width of the light transmission region of the barrier 22. Furthermore, the terminal storage unit 305 may temporarily store data temporarily used in predetermined processing such as pupil diameter measurement processing.

  The processing unit 16 includes one or more processors and their peripheral circuits. The processing unit 16 centrally controls the overall operation of the mobile terminal 10, and is, for example, a CPU (Central Processing Unit). The processing unit 16 communicates with the communication unit 11 so that the various processes of the portable terminal 10 can be performed in an appropriate procedure according to the program stored in the storage unit 15, the operation of the operation unit 12 and the display unit 14, and the like. It controls the operation of the unit 13 and the like. The processing unit 16 executes processing based on a program (a driver program, an operating system program, an application program, etc.) stored in the storage unit 15. Further, the processing unit 16 can execute a plurality of programs (application programs and the like) in parallel.

  The processing unit 16 includes an instruction acquisition unit 161, a display instruction unit 162, a distance determination unit 163, and a pupil diameter determination unit 164. The pupil diameter determination unit 164 includes an aperture diameter calculation unit 165 and a pupil diameter calculation unit 166. These units included in the processing unit 16 are functional modules implemented by a program executed on a processor included in the processing unit 16. Also, these units included in the processing unit 16 may be mounted on the portable terminal 10 as an independent integrated circuit, a microprocessor, or firmware.

  FIG. 5 is an exploded perspective view of the optical device 20. FIG. 6 (a) is a view showing a state before the optical device 20 is mounted on the display unit 14. FIG. 6 (b) is a diagram showing the optical device 20. It is a figure which shows the state with which the part 14 was mounted | worn.

  The diffusion plate 21 is a textured transparent film that forms a diffusion surface for diffusing the light incident from the display unit 14, one surface of which is detachably mounted on the display unit 14, and is detachably mounted on the display unit 14. The other side opposite to the side to be mounted is adhered to the barrier 22. Alternatively, the diffusion plate 21 may be formed by printing on the barrier 22 using a transparent ink.

  The barrier 22 has a transparent light transmission area that transmits the light diffused by the diffusion plate 21 and a light non-transmission area that does not transmit the light, and emits the light transmitted through the light transmission area to the lenticular lens 23. The light transmission areas and the light non-transmission areas are alternately formed in parallel so as to extend in the Y direction with a predetermined width, and the light transmitted through the light transmission areas is arranged on the lenticular lens 23 at an interval where the light transmission areas are disposed. Emit at the corresponding intervals. The barrier 22 is formed by printing a black ink on the diffusion plate 21 as a light opaque area. In one example, an interval at which the light transmission area is disposed via the light non-transmission area is substantially the same length as the width of the pixel of the display unit 14.

  The lenticular lens 23 is disposed on the display surface of the display unit 14 via the diffusion plate 21 and the barrier 22, and is emitted from the display unit 14, diffused by the diffusion plate 21, and transmitted through the light transmission region of the diffusion plate 21. Consolidate in the X direction and emit in the Z direction. In the lenticular lens 23, the shape of the back surface facing the display unit 14 is flat, and the surface on the opposite side to the surface facing the display unit 14 is a convex portion having a cross section of Cylindrical continuous at a constant cycle Are formed lenses. That is, on the surface of the lenticular lens 23 which is located in the Z direction to be viewed by the subject and extends in the Y direction, a convex portion having a hollow shape is continuously formed in the X direction. The convex surface portion of the lenticular lens 23 has a formation area set based on a predetermined number of pixels, for example, for the display unit 14 or an image to be displayed.

  As a result, the lenticular lens 23 is irradiated with the light narrowed down to the area where the convex portion is formed on the user side, so that the aggregated light is irradiated more than when the flat display portion 14 is viewed. Further, in the lenticular lens 23, the irradiation angle of the light irradiated to the eyeball side changes due to the difference in the viewing angle and the distance to the display unit 14.

(Pupillary diameter measurement processing by the pupil diameter measurement device according to the first embodiment)
FIG. 7 is a flowchart showing pupil diameter measurement processing of the pupil diameter measurement device 1. Before starting the process shown in FIG. 7, the optical device 20 is disposed on the surface of the display unit 14 of the portable terminal 10.

The display instruction unit 162 displays a white screen on the display unit 14 in response to an instruction to start the process of measuring the pupil diameter via the operation unit 12 or the display unit 14 which is a touch panel (S101). In response to the subject who visually recognizes the image displayed on the display unit 14 visually recognizing that the image displayed on the display unit 14 is an image without unevenness and having a uniform color, the user operates the operation unit 12, The instruction acquisition unit 161 acquires a distance measurement start instruction (S102). Next, the distance determination unit 163 causes the imaging unit 13 to image the face of the subject (S103). The distance determination unit 163 is a distance between the center of curvature of the lenticular lens 23 and the pupil when the subject determines that the image displayed on the display unit 14 is uniform using the captured image of the face An appropriate viewing distance is calculated (S104). Then, the aperture diameter calculation unit 165 calculates the aperture diameter H ₁ at the pupil of the subject, and a viewpoint distance H ₂ (S105). Aperture diameter H ₁ is the diameter of the entrance surface of the optical pupil 82 to be incident from a single lenticular lens 23 passes through the light transmission region of the barrier 22 to the pupil 81. Viewpoint distance H ₂ is the spacing between the pupil 82 of the light incident from the two adjacent lenticular lenses 23 to the pupil 81.

  FIG. 8 (a) is a view showing the pupil diameter of the pupil diameter measuring device 1 and the subject's eye viewing the image displayed on the display unit 14 of the pupil diameter measuring device 1, and FIG. 8 (b) is a view shown in FIG. It is the elements on larger scale enclosed with a dashed line, and Drawing 8 (c) is a figure showing the relation between the pitch of a barrier, and the diameter of an iris diaphragm.

Aperture diameter H ₁ is visible distance L, the thickness t of the lenticular lens 23, the light transmission region of the refractive index n and the barrier 22 of the lenticular lens 23 is the distance between the center of curvature R0 and the subject of the pupil 81 of the lenticular lens 23 Use the similarity of triangles by the width ΔP of
H ₁ = ΔP × L × (n / t) (Equation 1)
It is indicated by. On the other hand, the viewpoint distance H ₂ similarly utilizes the similarity of a triangle by the distance L, the thickness t, the refractive index n and the distance P of the light transmission region of the barrier 22,
H ₂ = P × L × (n / t) (Equation 2)
It is indicated by. Here, assuming that the distance P between the light transmission regions of the barrier 22 is m times the width ΔP of the light transmission region of the barrier 22, the viewpoint distance H ₂ is
H ₂ = m × ΔP × L × (n / t) (Equation 3)
It is indicated by.

The aperture diameter calculation unit 165 calculates the thickness t of the lenticular lens 23 stored in the storage unit 15, the refractive index n of the lenticular lens 23, the width ΔP of the light transmission region of the barrier 22, and the distance L calculated by the distance determination unit 163. The aperture diameter H ₁ is calculated by Equation 1 using this equation. In addition, the aperture diameter calculation unit 165 further calculates the viewpoint distance H _{2 according} to Expression 3 using the multiple m of the distance P of the light transmission region of the barrier 22 to the width ΔP of the light transmission region.

Then, the pupil diameter calculation unit 166 uses the aperture diameter H ₁ and viewpoint interval H ₂ aperture diameter calculation unit 165 calculates, for calculating the pupil diameter (S106). Pupil diameter calculation unit 166 uses the aperture diameter H ₁ and viewpoint interval H _2, and the amount of light incident on the pupil 81 at the first incident state, the region of the pupil 81 where the light is incident at the first incident state The light amount is calculated in a second incident state different from the area of the pupil 81 where the light is incident. The first incident state is a state in which light from any one lens of the lenticular lens 23 in which the center of the pupil of the subject and the center of light incident on the pupil 81 coincide with each other is incident on the entire pupil 81 . Further, in the second incident state, light in which the center of the subject's pupil 81 and the center between the two lights incident on the pupil 81 from the two adjacent lenses of the lenticular lens 23 coincide with each other throughout the pupil 81 Light is incident. The pupil diameter calculation unit 166 determines the pupil diameter when the light amount in the first incident state matches the light amount in the second incident state as the pupil diameter of the subject.

FIG. 9 (a) and. 9 (b) shows the distribution of light incident on the pupil 81 when a visible distance L _1, visible to a subject when FIG. 9 (c) is a visible distance L ₁ It is a figure which shows the image of the display part 14 being carried out. Figure 9 (d) and 9 (e) is a diagram showing the distribution of the light incident on the pupil 81 of the case is L ₂ different from the visible distance L _1, FIG. 9 (f) is the visible distance L ₂ It is a figure which shows the image of the display part 14 visually recognized by a test subject. 9 (a) and 9 (d) show the first incident state, and FIGS. 9 (b) and 9 (e) show the second incident state. In FIGS. 9 (a), 9 (b), 9 (d) and 9 (e), white indicates a portion where light is incident, and black indicates a portion where light is not incident.

As shown in FIG. 9C, when the visual recognition distance L ₁ , light of uniform light quantity is incident over the entire retina of the subject, so the subject has an image with uniform color and no unevenness. It visually recognizes that it is displayed on the display unit 14. That is, in the case of FIGS. 9 (a) and 9 (b) in which the area of the pupil 81 to which light is incident is different, light of the same light quantity is incident on the retina.

On the other hand, as shown in FIG. 9F, when the visible distance L ₂ , light of different light amounts is incident on the retina of the subject, so the subject has an image with unevenness and shades of color on the display unit 14. Visualize that it is displayed. That is, in the case of FIG. 9 (d) and the case of FIG. 9 (e), light having different light amounts is incident on the retina.

FIG. 10 (a) and. 10 (b) shows the distribution of the light incident on the pupil 81 when the pupil diameter of the viewing distance is L ₃ and the subject is a D _1, subject if FIG. 10 (c) The The image of the display part 14 visually recognized by FIG. Figure 10 (d) and 10 (e) shows the distribution of light pupil diameter of the viewing distance L is ₃ and the subject is incident on the pupil 81 when a D ₂ different from the D _1, FIG. 10 (f) Indicates an image of the display unit 14 that is visually recognized by the subject in this case. 10 (a) and 10 (d) show the distribution of light in the first incident state, and FIGS. 10 (b) and 10 (e) show the distribution of light in the second incident state. In FIGS. 10 (a), 10 (b), 10 (d) and 10 (e), white indicates a portion where light is incident, and black indicates a portion where light is not incident.

As shown in FIG. 10 (c), when and pupil diameter of the subject is visible distance L ₃ is D _1, because throughout the subject's retina uniform quantity of light incident, subjects, uneven If the image is displayed on the display unit 14, the image is visually recognized. That is, in the case of FIGS. 10 (a) and 10 (b), light having the same light quantity is incident on the retina.

On the other hand, as shown in FIG. 10 (f), when and pupil diameter of the subject is visible distance L ₃ is D _2, the amount of light to the retina of the subject is different light incident, subjects, there is uneven color The image is visually recognized as being displayed on the display unit 14. That is, even when the visual recognition distance is the same, when the pupil diameter of the subject changes, the image visually recognized by the subject is different.

FIG. 11 (a) is a view showing the distribution of light in the first incident state, and FIG. 11 (b) is a view showing the distribution of light in the second incident state. In FIGS. 11 (a) and 11 (b), pupil diameter was D, the aperture diameter is H _1, the viewpoint distance is H _2.

The pupil diameter calculation unit 166
-sqrt (D ² /4-x ² ) y y <sqrt (D ² /4-x ² ) (Equation 4)
By changing the pupil diameter D in a range of, 11 case when the first light quantity is the amount of light incident on the pupil 81 E ₁ and FIG. 11 (b) of light incident on the pupil 81 of (a) comparing the second and the light amount E ₂ is the amount of light. Since it is assumed that the pupil 81 is circular, the range of the pupil diameter D is changed in the range shown by (Expression 4).

The first light quantity E ₁ is
E ₁ = ΣI (x, y) × J ₁ (x, y) (Equation 5)
It is indicated by. Where I (x, y) is
I (x, y) = 10 ^{- p (x2 + y2 )} (equation 6)
It is indicated by. Here, the constant p is 0.066. I (x, y) is a function indicating the Tiles-Crawford Effect in which the light efficiency decreases as the distance from the center of the pupil 81 concentrically increases. Further, J ₁ (x, y) corresponds to the distribution of light incident on the pupil 81 in the case of FIG.
_{J 1 (x, y) =} 1 ( when _{-H 1/2 ≦ y <H} 1/2) ( Equation 7)
_{0 (-H 1/2 ≦ y} <H 1/2 not equal)
It is indicated by.

The second light amount E ₂ is
E ₂ = ΣI (x, y) × J ₂ (x, y) (Equation 8)
It is indicated by. Here, I (x, y) is expressed by (Expression 6). J ₂ (x, y) corresponds to the distribution of light incident on the pupil 81 in the case of FIG.
_{J 2 (x, y) =} 1 ( when _{-D / 2 ≦ y <-H 3} /2 and _{H 3/2 ≦ y <D} / 2)
0 (-D / 2 ≦ y < -H 3/2 or H _3/2 ≦ y <not equal D / 2) (Equation 9)
It is indicated by. Here H ₃ is the width of the opaque regions is a value obtained by subtracting the viewpoint distance H ₂ from the stop diameter _{H 1 (H 3 = H 1} -H 2).

Pupil diameter calculation unit 166 determines the pupil diameter D when the first light amount E ₁ and the second light quantity E ₂ are identical as the pupil diameter of the subject (S106). Then, the display instruction unit 162 outputs a pupil diameter signal indicating the pupil diameter D determined by the pupil diameter calculation unit 166 to the display unit 14, and the display unit 14 displays the pupil diameter D corresponding to the pupil diameter signal S107).

(Configuration of Pupil Diameter Measurement Device According to Second Embodiment)
Fig.12 (a) is a block diagram of the pupil diameter measurement apparatus based on 2nd Embodiment, FIG.12 (b) is a figure which shows the pupil diameter calculation table shown to Fig.12 (a).

  The pupil diameter measurement device 2 is different from the pupil diameter measurement device 1 according to the first embodiment in that the portable terminal 30 is disposed instead of the portable terminal 10. The portable terminal 30 differs from the portable terminal 10 in that a processing unit 17 having a pupil diameter determination unit 174 instead of the pupil diameter determination unit 164 is disposed instead of the processing unit 16. The configuration other than the pupil diameter determination unit 174 of the pupil diameter measurement device 2 has the same configuration and function as the configuration of the pupil diameter measurement device 1 according to the first embodiment to which the corresponding reference numerals are attached. The description is omitted.

  The pupil diameter determination unit 174 has a pupil diameter calculation table 175. The pupil diameter calculation table 175 is a pupil diameter calculated using the expressions 1 to 9 from the visual recognition distance L and the visual recognition distance L when the subject is visually recognized as an image having no unevenness and a uniform color. Show the relationship with D. The pupil diameter determination unit 174 determines the pupil diameter D from the distance between the subject's pupil and the curvature center of the lenticular lens 23 calculated by the distance determination unit 163 and the pupil diameter calculation table 175.

(Relationship between visual distance and visual image)
The relationship between the visible distance and the visible image was examined by simulation. The simulation conditions are as follows.
Image horizontal size: 11520 (pixels)
The width of one pixel: 0.004775 (mm) (actual screen size = 55.008000 (mm), 12 pixels (0.0573 mm), which corresponds to one pixel of the actual screen)
Position of curvature center (distance to pixel): 1.85923 (mm) (Lentric lens thickness is 2.72 mm, refractive index is 1.46297, position of curvature center = calculated from thickness / refractive index)
Distance between curvature centers: 0.057030 (mm) (When distance D in FIG. 2A is set to 389 mm, distance between curvature centers = distance D × width of one pixel of screen / (distance D + position of curvature center) Calculated)
Number of curvature centers: 964 (real size of lenticular lens: 55.005435 (mm))
Width of light transmission area of barrier: 0.004775 (mm)
Distance between light transmission areas of barrier: 0.014325 (mm)
As shown in FIG. 13, in the simulation, the pupil is sampled at 100 points, and the line connecting the pupil with the center of curvature R0 of the lenticular lens is stretched, depending on whether or not there is a pixel as a light source. Calculate the illuminance K at the top. That is, the illuminance K on the retina is
K = I I (x, y) × M (x, y) / I I (x, y) (Equation 10)
x ² + y ² ≦ (square of pupil radius)
It is indicated by. Here, I (x, y) is expressed by (Expression 6). M (x, y) is “1” when there is a pixel after extending the line connecting the center of curvature R0 of the lenticular lens to the pupil, and extends the line connecting the center of curvature R0 of the lenticular lens to the pupil When there is no pixel ahead, it is "0". In the simulation, the pupil diameter was changed from 2.5 mm to 3.5 mm to generate an image. The viewing distance of the first simulation is 31 cm, and the viewing distance of the second simulation is 33 cm.

  FIG. 14 is a diagram showing a first simulation result, and FIG. 15 is a diagram showing a second simulation result. An image with a pupil diameter of 2.5 mm indicated by an arrow in FIG. 14 is an image having a uniform color without unevenness, and the other 10 images are images having unevenness and a shade of color. An image having a pupil diameter of 2.7 mm indicated by an arrow in FIG. 15 is an image having no unevenness and having a uniform color, and the other 10 images are images having an unevenness and having a uniform color.

  In the first simulation, the pupil diameter is 2.5 mm with respect to 31 cm in the visual recognition distance, and in the second simulation, the pupil diameter is 2.7 mm with respect to 33 cm. In response to a change of 2 cm in the visual recognition distance between the first simulation and the second simulation, the diameter of the pupil recognized as an image having unevenness and a uniform color changes by 0.2 mm. That is, since the change of the pupil diameter with respect to the change of 1 cm in the visible distance is about 0.1 mm, and the accuracy of the visible distance calculated by the image captured by the imaging unit 13 is sufficiently smaller than ± 1 cm, the pupil according to the embodiment The measurement error of the diameter measuring device is about 0.1 to 0.2 mm.

(Operation effect of pupil diameter measurement device concerning an embodiment)
The pupil diameter measuring device according to the embodiment can measure the diameter of the pupil by arranging the optical device including the lenticular lens in the display unit, so that the simple and high-accuracy measurement can be performed on the display unit of the portable terminal inexpensively. It can be realized by arranging the optical device. That is, the pupil diameter measuring device according to the embodiment can form a highly accurate portable pupil diameter measuring device with a simple configuration using a portable terminal without using a dedicated device for measuring the pupil diameter. is there.

  In addition, the pupil diameter measuring device according to the embodiment is disposed between the display unit and the barrier, and includes a diffusion plate that diffuses the monochromatic light incident from the display unit and emits the light to the barrier. It becomes possible to provide uniform light diffused from the emitted light. Since the pupil diameter measuring device according to the embodiment includes the diffusion plate, the optical device is disposed on the display unit without adjusting the positional relationship between the black matrix of the display unit and the light opaque region of the barrier of the optical device. It will be possible to

  In the pupil diameter measuring device according to the embodiment, the light amount of light incident on the pupil in the first incident state and the region of the pupil on which light is incident are incident on the pupil in the second incident state different from the first incident state. The pupil diameter is determined so as to coincide with the amount of light. Thus, the pupil diameter can be measured simply and easily by utilizing the fact that the image visually recognized through the barrier and the lenticular lens changes in accordance with the visual recognition distance and the pupil diameter. In one example, the first incident state is a state in which light from any one lens of the lenticular lens in which the center of the pupil and the center of light incident on the pupil coincide is incident on the entire pupil. The second incident state is a state in which light in which the center of the pupil and the center between two light incident on the pupil from two adjacent lenses of the lenticular lens coincide is incident over the entire pupil. . In the pupil diameter measurement device according to the second embodiment, a pupil diameter calculation table showing a relationship between a visual recognition distance when the subject is visually recognized as an image having no unevenness and a uniform color and a pupil diameter is used. Thus, the pupil diameter can be measured more quickly.

(Modification of pupil diameter measuring device according to the embodiment)
In the pupil diameter measurement device described above, the display unit 14 emits white light when measuring the pupil diameter, but if the display unit emits monochromatic light of another color such as gray light, the pupil diameter Can be measured. Further, in the pupil diameter measuring device described above, the optical device 20 is disposed over substantially the entire surface of the display unit 14, but if the optical device is disposed in at least a part of the display unit, the pupil diameter is measured can do. Also, in the pupil diameter measuring device described, the optical device 20 has the diffusion plate 21, but the pupil diameter may be measured using an optical device in which the diffusion plate is omitted. When using an optical device in which the diffusion plate is omitted, after adjusting the positional relationship between the black matrix of the display unit and the light opaque region of the barrier of the optical device in a state where the display unit emits monochromatic light , Start pupil diameter measurement.

1, 2 pupil diameter measuring device 10 portable terminal 11 communication unit 12 operation unit 13 imaging unit 14 display unit 15 storage unit 16 processing unit 20 optical device 21 diffusion plate 22 barrier 23 lenticular lens

Claims (6)

A display portion capable of emitting monochromatic light;
When one surface is disposed to face the surface of the display unit, a plurality of light transmission regions transmitting the monochromatic light emitted by the display unit to the other surface opposite to the one surface are light Barriers formed in parallel through light opaque regions that do not transmit light,
A lenticular lens disposed on the other surface of the barrier and emitting the light transmitted through the plurality of light transmission areas so as to concentrate them;
The center of curvature of the lenticular lens and the pupil when the subject determines that the image displayed on the display unit has a uniform color when light from the lenticular lens enters the pupil of the subject The subject's pupil diameter is determined based on the width and distance of the light transmission area of the barrier, the thickness and refractive index of the lenticular lens, and the suitable viewing distance using the appropriate viewing distance which is the distance between A pupil diameter determining unit that outputs a pupil diameter signal indicating the determined pupil diameter;
Pupil diameter measuring device having.   The pupil diameter measuring device according to claim 1, further comprising: a diffusion plate disposed between the display unit and the barrier, for diffusing the monochromatic light incident from the display unit and emitting the light to the barrier.   The pupil diameter determination unit uses the appropriate viewing distance, the light amount of light incident on the pupil in the first incident state, and the pupil in which light is incident on the area of the pupil on which the light is incident. The pupil diameter measurement device according to claim 1 or 2, wherein the diameter of the pupil is determined such that the amount of light incident on the pupil in the second incident state different from the region of (4) matches. The first incident state is a state in which light from any one lens of the lenticular lens in which the center of the pupil and the center of light incident on the pupil coincide is incident over the entire pupil.
In the second incident state, light of which the center of the pupil and the center of two light incident on the pupil from two adjacent lenses of the lenticular lens coincide is incident on the entire pupil. The pupil diameter measuring device according to claim 3 which is a state. A plurality of light transmission regions transmitting light incident on one surface to the other surface opposite to the one surface are formed in parallel on the surface via light non-transmission regions which do not transmit light; Emitting monochromatic light to a display unit disposed on the other surface of the barrier and having a lenticular lens disposed to diverge the light transmitted through the plurality of light transmission regions;
The center of curvature of the lenticular lens and the pupil when the subject determines that the image displayed on the display unit has a uniform color when light from the lenticular lens enters the pupil of the subject Get the appropriate viewing distance which is the distance between
The pupil diameter of the subject is determined using the width and spacing of the light transmission area of the barrier, the thickness and refractive index of the lenticular lens, and the suitable viewing distance,
Outputting a pupil diameter signal indicating the determined pupil diameter,
The way it involves. A plurality of light transmission regions transmitting light incident on one surface to the other surface opposite to the one surface are formed in parallel on the surface via light non-transmission regions which do not transmit light; Emitting monochromatic light to a display unit disposed on the other surface of the barrier and having a lenticular lens disposed to diverge the light transmitted through the plurality of light transmission regions;
The center of curvature of the lenticular lens and the pupil when the subject determines that the image displayed on the display unit has a uniform color when light from the lenticular lens enters the pupil of the subject Get the appropriate viewing distance which is the distance between
The pupil diameter of the subject is determined using the width and spacing of the light transmission area of the barrier, the thickness and refractive index of the lenticular lens, and the suitable viewing distance,
Outputting a pupil diameter signal indicating the determined pupil diameter,
Computer program to make the controller execute