JP6495149B2 - Electronic device, control method, and control program - Google Patents

Description

  The present application relates to an electronic device, a control method, and a control program.

  Conventionally, there is a state detection device that detects a human state. For example, as an eyeball observation information obtained from reflected light from the eye, an apparatus that obtains information on the pupil diameter and determines a human state based on the acquired information, thereby issuing a warning to a person about the degree of fatigue. It is known (see Patent Document 1).

Japanese Patent Laid-Open No. 7-255669

  By the way, there is a technique for automatically adjusting the brightness of a display included in an electronic device. For example, when pupil diameter information is used in the technique, there remains room for improvement such as consideration of processing speed and individual differences.

  An electronic device according to one aspect includes a display unit having a screen, an image acquisition unit that acquires an image of a user who owns the device, and a measurement that measures the intensity L of light emitted to the display unit And a control unit that calculates the intensity P of light reflected from the user's eyeball based on the image acquired by the image acquisition unit. The control unit adjusts the luminance of the screen based on the light intensity L and the light intensity P.

  A control method according to one aspect includes a display unit having a screen, an image acquisition unit that acquires an image of a user who owns the device, and a measurement that measures the intensity L of light emitted to the display unit. A control method to be executed by an electronic device including a unit. The control method is based on the step of calculating the intensity P of the light reflected from the user's eyeball based on the image acquired by the image acquisition unit, the intensity L of the recording light, and the intensity P of the light. Adjusting the brightness of the screen.

  A control program according to one aspect includes a display unit having a screen, an image acquisition unit that acquires an image of a user who owns the device, and a measurement that measures the intensity L of light emitted to the display unit A step of calculating an intensity P of light reflected from the eyeball of the user based on the image acquired by the image acquisition unit, and an intensity L of the light and an intensity P of the light. And adjusting the luminance of the screen.

FIG. 1 is a block diagram illustrating a functional configuration of the smartphone according to the embodiment. FIG. 2 is a diagram illustrating an example of the configuration of the screen brightness adjustment table. FIG. 3 is a flowchart illustrating an example of processing by the smartphone according to one embodiment. FIG. 4 is a block diagram illustrating a functional configuration of a smartphone according to another embodiment. FIG. 5 is a diagram illustrating an example of the configuration of the screen brightness adjustment table. FIG. 6 is a diagram illustrating an example of an image of a user's eye when the light intensity L and the light intensity P are different. FIG. 7 is a diagram illustrating an example of an image of a user's eye when the light intensity L and the light intensity P are different. FIG. 8 is a diagram illustrating an example of an image of a user's eye when the light intensity L and the light intensity P are different. FIG. 9 is a diagram illustrating an example of an image of a user's eye when the light intensity L and the light intensity P are different. FIG. 10 is a flowchart illustrating an example of processing by a smartphone according to another embodiment.

  A plurality of embodiments for carrying out an electronic device, a control method, and a control program according to the present application will be described in detail with reference to the drawings.

  Hereinafter, a smartphone will be described as an example of the electronic apparatus according to the present application, but the portable electronic apparatus is not limited to the smartphone. The portable electronic device may be a device other than a smartphone as long as it is an electronic device that can be carried by the user and performs determination of the moving means, for example, a mobile phone, a tablet, a portable computer, a digital camera, It may be a device such as a media player, an electronic book reader, a navigator, or a game machine.

  FIG. 1 is a block diagram illustrating a functional configuration of the smartphone 1. In the following description, the same code | symbol may be attached | subjected about the same component. Furthermore, duplicate descriptions may be omitted. In the following description, the smartphone 1 may be referred to as “own device”.

  As shown in FIG. 1, the smartphone 1 includes a touch screen display 2, a button 3, an illuminance sensor 4, a proximity sensor 5, a communication unit 6, a receiver 7, a microphone 8, a storage 9, and a controller 10. A speaker 11, a camera 12, a camera 13, a connector 14, an acceleration sensor 15, a direction sensor 16, and an infrared irradiation unit 17.

  The touch screen display 2 includes a display 2A and a touch screen 2B. The display 2 </ b> A and the touch screen 2 </ b> B may be arranged, for example, may be arranged side by side, or may be arranged apart from each other. When the display 2A and the touch screen 2B are arranged so as to overlap each other, for example, one or more sides of the display 2A may not be along any side of the touch screen 2B.

  The display 2A includes a liquid crystal display (LCD: Liquid Crystal Display), an organic EL display (OELD: Organic Electro-Luminescence Display), or an inorganic EL display (IELD: Inorganic Electro-Luminescence Display). The display 2A displays characters, images, symbols, graphics, and the like. The screen including characters, images, symbols, graphics, and the like displayed on the display 2A includes a screen called a lock screen, a screen called a home screen, and an application screen displayed during execution of the application. The home screen may be called a desktop, a standby screen, an idle screen, a standard screen, an application list screen, or a launcher screen. The display 2A is an example of a display unit.

  The touch screen 2B detects contact of a finger, a pen, a stylus pen, or the like with respect to the touch screen 2B. The touch screen 2B is a position (hereinafter referred to as a contact position) on the touch screen 2B when a plurality of fingers, a pen, a stylus pen or the like (hereinafter simply referred to as “finger”) contacts the touch screen 2B (touch screen display 2). Can be detected. The touch screen 2B notifies the controller 10 of the contact of the finger with the touch screen 2B together with the contact position. The touch screen 2B is an example of a contact position detection unit.

  The detection method of the touch screen 2B may be any method such as a capacitance method, a resistive film method, a surface acoustic wave method (or an ultrasonic method), an infrared method, an electromagnetic induction method, and a load detection method. In the following description, in order to simplify the description, it is assumed that the user uses the finger to touch the touch screen 2B in order to operate the smartphone 1.

  The controller 10 (smart phone 1) has at least one of the contact detected by the touch screen 2B, the position at which the contact is detected, the change in the position at which the contact is detected, the interval at which the contact is detected, and the number of times the contact is detected. The type of gesture is determined based on the one. The gesture is an operation performed on the touch screen 2B (touch screen display 2) using a finger. The gestures that the controller 10 (smart phone 1) determines via the touch screen 2B include, for example, touch, long touch, release, swipe, tap, double tap, long tap, drag, flick, pinch in, and pinch out. However, it is not limited to these.

  The button 3 receives an operation input from the user. The number of buttons 3 may be singular or plural.

  The illuminance sensor 4 detects illuminance. The illuminance is the value of the light beam incident on the unit area of the measurement surface of the illuminance sensor 4. The illuminance sensor 4 is used for adjusting the luminance of the display 2A, for example. In the following description, the illuminance measured by the illuminance sensor 4 is expressed as “light intensity L” irradiated to the display 2A. The illuminance sensor 4 is an example of a measurement unit.

  The proximity sensor 5 detects the presence of a nearby object without contact. The proximity sensor 5 detects the presence of an object based on a change in a magnetic field or a change in a feedback time of an ultrasonic reflected wave. For example, the proximity sensor 5 detects that the display 2A is brought close to the face. The illuminance sensor 4 and the proximity sensor 5 may be configured as one sensor. The illuminance sensor 4 may be used as a proximity sensor.

  The communication unit 6 communicates wirelessly. The wireless communication standards supported by the communication unit 6 include, for example, cellular phone communication standards such as 2G, 3G, and 4G, and short-range wireless communication standards. Cellular phone communication standards include, for example, LTE (Long Term Evolution), W-CDMA (Wideband Code Division Multiple Access), WiMAX (Worldwide PDA), WiMAX (Worldwide Interoperability Pc). ) (Global System for Mobile Communications), PHS (Personal Handy-phone System), and the like. Examples of short-range wireless communication standards include IEEE 802.11, Bluetooth (registered trademark), IrDA (Infrared Data Association), NFC (Near Field Communication), and WPAN (Wireless Personal Area Network). As a communication standard of WPAN, for example, there is ZigBee (registered trademark). The communication unit 6 may support one or more of the communication standards described above.

  The receiver 7 is a sound output unit. The receiver 7 outputs the sound signal transmitted from the controller 10 as sound. The receiver 7 is used, for example, to output the other party's voice during a call. The microphone 8 is a sound input unit. The microphone 8 converts a user's voice or the like into a sound signal and transmits the sound signal to the controller 10.

  The storage 9 stores programs and data. The storage 9 is also used as a work area for temporarily storing the processing result of the controller 10. The storage 9 may include any non-transitory storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage 9 may include a plurality of types of storage media. The storage 9 may include a combination of a storage medium such as a memory card, an optical disk, or a magneto-optical disk and a storage medium reader. The storage 9 may include a storage device used as a temporary storage area such as a RAM (Random Access Memory).

  The programs stored in the storage 9 include an application executed in the foreground or the background, and a control program (not shown) that supports the operation of the application. An application executed in the foreground displays a screen on the display 2A, for example. The control program includes an OS, for example. The application and the basic program may be installed in the storage 9 via wireless communication by the communication unit 6 or a non-transitory storage medium.

  The storage 9 stores a control program 9A, a mail application 9B, a telephone application 9C, a line-of-sight detection program 9D, a screen brightness adjustment table 9E, setting data 9Z, and the like.

  When the user's line of sight is detected on the display 2A as a result of the line-of-sight detection process by the line-of-sight detection program 9D, the control program 9A determines the light reflected from the user's eyeball based on the image acquired by the camera 12. A function for calculating the intensity P can be provided. The control program 9A can provide a function of acquiring the light intensity L from the illuminance sensor 4 and adjusting the luminance of the display 2A based on the light intensity L and the light intensity P. For example, when both the light intensity L and the light intensity P tend to increase, the control program 9A increases the luminance according to the screen luminance adjustment table 9E, and both the light intensity L and the light intensity P tend to decrease. In this case, the luminance is decreased according to the screen luminance adjustment table 9E. Alternatively, the control program 9A increases the luminance according to the screen luminance adjustment table 9E when the light intensity L is constant and the light intensity P tends to increase, and the light intensity L is constant. In the state and when the light intensity P tends to decrease, the luminance is decreased according to the screen luminance adjustment table 9E. Alternatively, the control program 9A increases the luminance according to the screen luminance adjustment table 9E when the light intensity P is in a constant state and the light intensity L tends to increase, and the light intensity P is constant. In the state and when the light intensity L tends to decrease, the luminance is decreased according to the screen luminance adjustment table 9E. Alternatively, the control program 9A maintains the current brightness according to the screen brightness adjustment table 9E when the light intensity L is increasing and the light intensity P is decreasing. Alternatively, when the light intensity L and the light intensity P are in a constant state, the control program 9A maintains the current brightness according to the screen brightness adjustment table 9E. Alternatively, the control program 9A maintains the current brightness according to the screen brightness adjustment table 9E when the light intensity L is decreasing and the light intensity P is increasing.

  The mail application 9B provides an electronic mail function for creating, transmitting, receiving, and displaying an electronic mail. The telephone application 9C provides a telephone call function for a telephone call by wireless communication.

  The line-of-sight detection program 9D can provide a function of detecting the user's line-of-sight position. That is, the line-of-sight detection program 9D detects the line-of-sight position by applying an algorithm based on the corneal reflection method to the user's image. Specifically, the line-of-sight detection program 9 </ b> D irradiates infrared rays from the infrared irradiation unit 17 when acquiring an image of a user photographed by the camera 12. The line-of-sight detection program 9D identifies the position of the pupil and the position of infrared corneal reflection from the acquired user image. The line-of-sight detection program 9D specifies the direction of the user's line of sight based on the positional relationship between the position of the pupil and the position of infrared corneal reflection. The line-of-sight detection program 9D determines that the direction of the line of sight is the eye corner side if the position of the pupil is closer to the corner of the eye than the position of the corneal reflection, and if the position of the pupil is closer to the eye than the position of the corneal reflection, It is determined that the direction of the line of sight is the eye side. The line-of-sight detection program 9D calculates the distance between the user's eyeball and the touch screen display 2 based on the size of the iris, for example. The line-of-sight detection program 9D is based on the direction of the user's line of sight and the distance between the user's eyeball and the touch screen display 2, and the line of sight starting from the pupil is located at the center position of the pupil in the user's eyeball. For example, it is determined whether the user's line of sight is on the display 2A.

  The screen brightness adjustment table 9E is used for the process of adjusting the brightness of the display 2A by the control program 9A. FIG. 2 is a diagram illustrating an example of the configuration of the screen brightness adjustment table 9E. As shown in FIG. 2, the screen brightness adjustment table 9 </ b> E displays the increase / decrease tendency of the light intensity L applied to the display 2 </ b> A and the increase / decrease tendency of the light intensity P reflected from the user's eyeball. 2A brightness adjustment methods are associated with each other. For example, in the screen brightness adjustment table 9E, when both the light intensity L and the light intensity P tend to increase, “increase adjustment” for increasing the brightness is set as the brightness adjustment method of the display 2A. Alternatively, in the screen brightness adjustment table 9E, when both the light intensity L and the light intensity P tend to decrease, “decrease adjustment” for decreasing the brightness is set as the brightness adjusting method of the display 2A.

  The setting data 9Z includes information on various settings related to the operation of the smartphone 1. The various setting information is used for various data used for processing executed based on functions provided by the control program 9A and the like, and for processing executed based on functions provided by various applications such as the mail application 9B. Including various data.

  The controller 10 is an arithmetic processing device. The arithmetic processing unit includes, for example, a CPU (Central Processing Unit), an SoC (System-on-a-Chip), an MCU (Micro Control Unit), an FPGA (Field-Programmable Gate Array), and a coprocessor. It is not limited. The controller 10 controls various operations of the smartphone 1 to realize various functions. The controller 10 is an example of a control unit.

  Specifically, the controller 10 executes instructions included in the program stored in the storage 9 while referring to the data stored in the storage 9 as necessary. And the controller 10 controls a function part according to data and a command, and implement | achieves various functions by it. The functional unit includes, for example, the display 2A, the communication unit 6, the microphone 8, the speaker 11, and the infrared irradiation unit 17, but is not limited thereto. The controller 10 may change the control according to the detection result of the detection unit. Examples of the detection unit include, but are not limited to, the touch screen 2B, the button 3, the illuminance sensor 4, the proximity sensor 5, the microphone 8, the camera 12, the camera 13, the acceleration sensor 15, and the azimuth sensor 16.

  The following processing is executed by executing the control program 9A and the line-of-sight detection program 9D. That is, when the user's line of sight is detected on the display 2A as a result of the line-of-sight detection process by the line-of-sight detection program 9D, the controller 10 reflects light reflected from the user's eyeball based on the image acquired by the camera 12. The intensity P is calculated. Subsequently, the controller 10 acquires the light intensity L from the illuminance sensor 4, and adjusts the luminance of the display 2 </ b> A based on the light intensity L and the light intensity P. For example, when both the light intensity L and the light intensity P tend to increase, the controller 10 increases the luminance according to the screen luminance adjustment table 9E, while the light intensity L and the light intensity P tend to decrease. If there is, the luminance is decreased according to the screen luminance adjustment table 9E. Alternatively, when the light intensity L is constant and the light intensity P tends to increase, the controller 10 increases the luminance according to the screen luminance adjustment table 9E, while the light intensity L is constant. If the light intensity P tends to decrease, the luminance is decreased according to the screen luminance adjustment table 9E. Alternatively, the controller 10 increases the luminance according to the screen luminance adjustment table 9E when the light intensity P is constant and the light intensity L tends to increase, and the light intensity P is constant. If the light intensity L tends to decrease, the luminance is decreased according to the screen luminance adjustment table 9E. Alternatively, when the light intensity L is increasing and the light intensity P is decreasing, the controller 10 maintains the current brightness according to the screen brightness adjustment table 9E. Alternatively, when the light intensity L and the light intensity P are constant, the controller 10 maintains the current brightness according to the screen brightness adjustment table 9E. Alternatively, when the light intensity L is decreasing and the light intensity P is increasing, the controller 10 maintains the current brightness according to the screen brightness adjustment table 9E.

  For example, the controller 10 calculates the increasing / decreasing tendency of the light intensity L and the light intensity P by the following method. That is, when the light intensity L and the light intensity P are measured and plotted every second by the measurement unit, the controller 10 determines that the increase is monotonically continuous for 3 points, and determines that the controller 10 is increasing. If the points continuously decrease monotonously, the controller 10 determines that the trend is decreasing. When the controller 10 increases the luminance of the display 2 </ b> A, the controller 10 continuously acquires an image of the user's eye, analyzes the acquired image, and the area of the pupil of the user's eyeball captured by the camera 12. The brightness of the display 2A is increased until the shift from the enlargement tendency to the reduction tendency occurs. On the other hand, when decreasing the brightness of the display 2A, the controller 10 continuously acquires an image of the user's eye photographed by the camera 12, analyzes the acquired image, and calculates the area of the pupil of the user's eyeball. The brightness of the display 2A is decreased until the shift from the reduction trend to the expansion trend. The controller 10 divides the image into pixels to form pixels, and binarizes the light intensity on the image based on a predetermined threshold. For example, in each pixel, the value of the bright portion corresponding to the iris and corneal portion is set to “0” and the dark portion corresponding to the pupil portion is set to “1” in each pixel. As a result, if the number of pixels whose value is “0” decreases and the number of pixels whose value is “1” increases, the controller 10 tends to increase the pupil area of the user's eyeball. Judge that there is. Further, if the number of pixels whose value is “0” increases and the number of pixels whose value is “1” decreases, the controller 10 tends to reduce the pupil area of the user's eyeball. Judge as.

  The speaker 11 outputs the sound signal transmitted from the controller 10 as sound. The speaker 11 is used for outputting a ring tone and music, for example. One of the receiver 7 and the speaker 11 may also function as the other.

  The camera 12 and the camera 13 convert the captured image into an electrical signal. The camera 12 is an in camera that captures an object facing the display 2A. The camera 13 is an out camera that captures an object facing the opposite surface of the display 2A. The camera 12 and the camera 13 may be mounted on the smartphone 1 in a functionally and physically integrated state as a camera unit that can be used by switching between the in-camera and the out-camera. In one embodiment, the camera 12 captures an image of the user's eyes. For example, the camera 12 is an example of an image acquisition unit.

  The connector 14 is a terminal to which another device is connected. The connector 14 may be a general-purpose terminal such as a universal serial bus (USB), a high-definition multimedia interface (HDMI) (registered trademark), a light peak (thunderbolt (registered trademark)), or an earphone microphone connector. . The connector 14 may be a dedicated terminal such as a dock connector. Devices connected to the connector 14 include, but are not limited to, external storage, speakers, and communication devices, for example.

  The acceleration sensor 15 detects the direction and magnitude of acceleration acting on the smartphone 1. The direction sensor 16 detects, for example, the direction of geomagnetism, and detects the direction (azimuth) of the smartphone 1 based on the direction of geomagnetism.

  The smartphone 1 may include a GPS receiver and a vibrator in addition to the above functional units. The GPS receiver receives a radio signal in a predetermined frequency band from a GPS satellite, demodulates the received radio signal, and sends the processed signal to the controller 10. The vibrator vibrates a part or the whole of the smartphone 1. The vibrator includes, for example, a piezoelectric element or an eccentric motor in order to generate vibration. Although not shown in FIG. 1, the smartphone 1 is mounted with a functional unit that is naturally used to maintain the function of the smartphone 1, such as a battery.

  With reference to FIG. 3, the flow of processing by the smartphone 1 according to one embodiment will be described. FIG. 3 is a flowchart illustrating an example of processing by the smartphone 1 according to one embodiment. The processing shown in FIG. 3 is realized by the controller 10 executing the control program 9A and the line-of-sight detection program 9D stored in the storage 9. The process shown in FIG. 3 is repeatedly executed during the operation of the smartphone 1.

  As shown in FIG. 3, the controller 10 determines whether the user's line of sight has been detected on the display 2A (step S101).

  When the controller 10 detects the line of sight as a result of the determination (step S101, Yes), the controller 10 analyzes the increasing / decreasing tendency of the light intensity L and the light intensity P (step S102).

  Subsequently, the controller 10 adjusts the luminance of the display 2A based on the increasing / decreasing tendency of the light intensity L and the light intensity P (step S103).

  In step S101, when the controller 10 does not detect the line of sight as a result of the determination (No in step S101), the controller 10 repeats the determination.

  In the above embodiment, the smartphone 1 adjusts the luminance of the display 2A based on the increasing / decreasing tendency of the light intensity L and the light intensity P. Therefore, according to the above embodiment, the luminance of the display 2A can be adjusted in consideration of the intensity P of light reflected from the user's eyeball. Compared with the case where the luminance of the display 2A is adjusted based only on the intensity L, more appropriate luminance adjustment can be realized.

  FIG. 4 is a block diagram illustrating a functional configuration of the smartphone 1 according to another embodiment. The smartphone 1 according to another embodiment basically has the same configuration as the above embodiment, but differs in the points described below.

  When the light intensity P exceeds the first threshold value and the light intensity L exceeds the second threshold value, the control program 9A sets the luminance to the first value, and the light intensity P becomes the first value. When the threshold value of 1 is exceeded and the light intensity L does not exceed the second threshold value, the function of setting the luminance to a second value smaller than the first value is provided. Alternatively, the control program 9A sets the luminance to the third value when the light intensity P does not exceed the first threshold value and the light intensity L exceeds the second threshold value, A function of setting the luminance to a fourth value smaller than the third value when the intensity P of the light does not exceed the first threshold value and the light intensity L does not exceed the second threshold value. provide.

  The storage 9 stores a screen brightness adjustment table 9F. FIG. 5 is a diagram showing an example of the configuration of the screen brightness adjustment table 9F. As shown in FIG. 5, the screen brightness adjustment table 9F includes a relationship between the intensity L of light irradiated to the display and the threshold value Lt, and a relationship between the intensity P of light reflected from the user's eyeball and the threshold value Pt. The brightness setting value of the display 2A is associated with the display value. For example, in the screen brightness adjustment table 9F, when the light intensity P exceeds the threshold value Pt and the light intensity L exceeds the threshold value Lt, the brightness value B1 is set as the brightness value, and the light intensity P is set to the threshold value. When Pt is exceeded and the light intensity L does not exceed the threshold Lt, the brightness B2 smaller than the brightness B1 is set as the brightness value. Alternatively, in the screen brightness adjustment table 9F, when the light intensity P does not exceed the threshold value Pt and the light intensity L exceeds the threshold value Lt, the brightness value B2 is set as the brightness value. When P does not exceed the threshold value Pt and the light intensity L does not exceed the threshold value Lt, the luminance B3 smaller than the luminance B2 is set as the luminance value. The brightness B1 is an example of the first value, the brightness B2 is an example of the second value and the third value, and the brightness B3 is an example of the fourth value.

  The controller 10 adjusts the brightness of the display 2A based on the light intensity L and the light intensity P by executing the control program 9A. Specifically, when the light intensity P exceeds the threshold value Pt and the light intensity L exceeds the threshold value Lt, the controller 10 changes the luminance value to the luminance B1 based on the screen luminance adjustment table 9F. If the light intensity P exceeds the threshold value Pt and the light intensity L does not exceed the threshold value Lt, the luminance value is changed to a luminance B2 smaller than the luminance B1 based on the screen luminance adjustment table 9F. To do. Alternatively, when the light intensity P does not exceed the threshold value Pt and the light intensity L exceeds the threshold value Lt, the controller 10 changes the luminance value to the luminance B2 based on the screen luminance adjustment table 9F. If the light intensity P does not exceed the threshold value Pt and the light intensity L does not exceed the threshold value Lt, the luminance value is set to a luminance smaller than the luminance B2 based on the screen luminance adjustment table 9F. Change to B3.

  6 to 9 are diagrams illustrating examples of images of the eyes of the user when the light intensity L and the light intensity P are different. FIG. 6 shows an example of an eye image when both the light intensity P and the light intensity L exceed the threshold, and FIG. 7 shows an example of an eye image when only the light intensity L exceeds the threshold. 8 shows an example of an eye image when only the light intensity P exceeds the threshold, and FIG. 9 shows an example of an eye image when both the light intensity P and the light intensity L are less than or equal to the threshold. The eye image 50 shown in FIGS. 6 to 9 includes an infrared spot 51 for line-of-sight detection, a conjunctival portion 52, an iris and cornea portion 53, a pupil portion 54, and a reflected light spot from the display 2A. 55 is included.

  The calculation of the light intensity P will be described with reference to FIG. The controller 10 enlarges the eye image 50 captured by the camera 12. Subsequently, the controller 10 draws the center line 56 to the reflected light spot 55 included in the enlarged eye image 50, and calculates the light intensity P from the brightness on the center line 56. The light intensity P can be measured in the same manner as the laser power density measurement. Specifically, the controller 10 can measure and calculate the distribution of the light intensity P on the center line 56 in the controller 10. Well, it is not always necessary to display on the screen the image 50 of the eye being photographed.

  FIG. 10 is a flowchart illustrating an example of processing performed by the smartphone 1 according to another embodiment. The processing shown in FIG. 10 is realized by the controller 10 executing the control program 9A and the line-of-sight detection program 9D stored in the storage 9. The process illustrated in FIG. 10 is repeatedly executed during the operation of the smartphone 1.

  As shown in FIG. 10, the controller 10 determines whether the user's line of sight has been detected on the display 2A (step S201).

  If the controller 10 detects the line of sight as a result of the determination (step S201, Yes), the controller 10 calculates the light intensity L and the light intensity P (step S202).

  Subsequently, the controller 10 determines whether or not the conditions of light intensity P> threshold value Pt and light intensity L> threshold value Lt are satisfied (step S203).

  If the controller 10 satisfies the condition that the light intensity P> the threshold value Pt and the light intensity L> the threshold value Lt (step S203, Yes), the controller 10 changes the luminance of the display 2A to B1 (step S204). Return to the determination in step S201.

  On the other hand, if the controller 10 does not satisfy the conditions of the light intensity P> the threshold value Pt and the light intensity L> the threshold value Lt (No in step S203), the controller 10 determines that the light intensity P> the threshold value Pt and the light intensity It is determined whether or not the condition of intensity L ≦ threshold value Lt is satisfied (step S205).

  When the controller 10 satisfies the condition that the light intensity P> the threshold value Pt and the light intensity L ≦ the threshold value Lt (Yes in step S205), the controller 10 changes the luminance of the display 2A to B2 (step S206). Return to the determination in step S201.

  On the other hand, if the controller 10 does not satisfy the conditions of the light intensity P> the threshold value Pt and the light intensity L ≦ the threshold value Lt (No in step S205), the controller 10 determines that the light intensity P ≦ the threshold value Pt and the light intensity It is determined whether the condition of intensity L> threshold value Lt is satisfied (step S207).

  As a result of the determination, when the condition of light intensity P ≦ threshold value Pt and light intensity L> threshold value Lt is satisfied (Yes in step S207), the controller 10 sets the brightness of the display 2A to B2 as in step S206. And return to the determination in step S201.

  On the other hand, if the controller 10 does not satisfy the conditions of the light intensity P ≦ the threshold value Pt and the light intensity L> the threshold value Lt (step S207, No), the controller 10 changes the luminance of the display 2A to B3 (step S207). S208), the process returns to the determination in step S201.

  In step S201, if the controller 10 does not detect the line of sight as a result of the determination (No in step S201), the controller 10 repeats the determination.

  In the above embodiment, the smartphone 1 compares the light intensity L and the light intensity P with threshold values, and adjusts the brightness of the display 2A based on the magnitude relationship, thereby realizing simpler and more appropriate brightness adjustment. it can.

  The characterizing embodiments have been described in order to fully and clearly disclose the technology according to the appended claims. However, the appended claims should not be limited to the above-described embodiments, but all modifications and alternatives that can be created by those skilled in the art within the scope of the basic matters shown in this specification. Should be embodied by a possible configuration.

DESCRIPTION OF SYMBOLS 1 Smart phone 2 Touch screen display 2A Display 2B Touch screen 3 Button 4 Illuminance sensor 5 Proximity sensor 6 Communication unit 7 Receiver 8 Microphone 9 Storage 9A Control program 9B Mail application 9C Telephone application 9D Gaze detection program 9E, 9F Screen brightness adjustment table 9Z setting Data 10 Controller 11 Speaker 12 Camera 13 Camera 14 Connector 15 Acceleration sensor 16 Direction sensor 17 Infrared irradiation unit

Claims (7)

A display unit having a screen;
An image acquisition unit that acquires an image of a user who owns the device;
A measuring unit for measuring the intensity L of light irradiated to the display unit;
A control unit that calculates an intensity P of light reflected from the eyeball of the user based on the image acquired by the image acquisition unit;
With
The control unit is an electronic device that adjusts the luminance of the screen based on the light intensity L and the light intensity P. The controller is
When both the light intensity L and the light intensity P tend to increase, increase the brightness,
The electronic device according to claim 1, wherein the luminance is decreased when both the light intensity L and the light intensity P tend to decrease. The controller is
When the light intensity L is in a constant state and the light intensity P tends to increase, the brightness is increased,
2. The electronic device according to claim 1, wherein the luminance is decreased when the light intensity L is constant and the light intensity P tends to decrease. The controller is
If the light intensity P exceeds a first threshold and the light intensity L exceeds a second threshold, the brightness is set to a first value;
The light intensity P is set to a second value smaller than the first value when the light intensity P exceeds a first threshold value and the light intensity L does not exceed a second threshold value. Item 2. The electronic device according to Item 1. The controller is
If the light intensity P does not exceed the first threshold and the light intensity L exceeds the second threshold, the luminance is set to a third value;
When the light intensity P does not exceed the first threshold value and the light intensity L does not exceed the second threshold value, the luminance is set to a fourth value smaller than the third value. The electronic device according to claim 1 to be set. A display unit having a screen;
An image acquisition unit that acquires an image of a user who owns the device;
A control method that is executed by an electronic device comprising: a measurement unit that measures the intensity L of light emitted to the display unit;
Calculating an intensity P of light reflected from the user's eyeball based on the image acquired by the image acquisition unit;
Adjusting the luminance of the screen based on the light intensity L and the light intensity P. A display unit having a screen;
An image acquisition unit that acquires an image of a user who owns the device;
An electronic device comprising: a measuring unit that measures the intensity L of light irradiated to the display unit;
Calculating an intensity P of light reflected from the user's eyeball based on the image acquired by the image acquisition unit;
A control program for executing the step of adjusting the brightness of the screen based on the light intensity L and the light intensity P.

Images