JP6565702B2 - Electronic device and operation control program - Google Patents

Description

  The present invention relates to an electronic device and an operation control program.

  In recent years, a touch panel or the like is mounted on a mobile terminal device such as a smart phone or a PDA (Personal Digital Assistant). For example, in a mobile terminal device, there is a technique for turning off the screen backlight of the touch panel when there is no touch operation on the touch panel for a certain time. For example, in a mobile terminal device, there is a technique for enabling an operation on the touch panel when the screen backlight is on, and invalidating an operation on the touch panel when the screen backlight is off.

  As a prior art, for example, there is a technique for determining a content browsing degree in accordance with a contact time of a person with a display medium such as electronic paper or a portable terminal device (for example, refer to Patent Document 1 below). In addition, for example, when it is determined that the object is in the proximity state with respect to the display unit, the physical quantity corresponding to the detected distance between the display unit and the object is centered on the position of the specified object. There is a technique for enlarging or reducing an image according to the display (for example, refer to Patent Document 2 below).

JP 2009-176197 A JP 2012-238177 A

  However, conventionally, for example, when a user performs a presentation or the like using a mobile terminal device, if a touch operation is performed so as not to turn off the backlight of the touch panel, there is a problem that an erroneous operation such as a screen switching occurs. . On the other hand, for example, if the user does not operate the touch panel so that the touch panel is not recognized as an erroneous operation, the backlight of the touch panel is turned off.

  In one aspect, the present invention enables a user to efficiently perform work while showing the display surface of the touch panel of the mobile terminal device to another person.

  According to an aspect of the present invention, the measurement unit capable of measuring the distance from the own device to an object existing in the same direction as the display direction of the touch panel display of the own device, and the measurement at the time of a touch operation on the display A storage unit for storing the distance measured by the unit, and referring to the storage unit to determine a threshold range based on the distance measured at the time of a touch operation on the display, and screen display by the display is effective In addition, the first operation mode in which the processing according to the touch operation on the display is effective, the screen display by the display is effective, and the screen display by the display according to the touch operation on the display is effective. Second operation in which processing according to the touch operation other than processing for extending the period is invalid And a control unit that sets the second operation mode when the distance measured by the measurement unit is not within the determined threshold range in any one of the operation modes. A featured electronic device and an operation control program are proposed.

  According to one embodiment of the present invention, a user can efficiently perform work while showing the display surface of the touch panel of the mobile terminal device to another person.

FIG. 1 is an explanatory diagram illustrating an example of mode switching by an electronic device. FIG. 2 is a block diagram illustrating a hardware configuration example of the electronic device. FIG. 3 is a block diagram illustrating a functional configuration example of the electronic device. FIG. 4 is an explanatory diagram showing an example of a list of operation modes. FIG. 5 is an explanatory diagram showing an example of transition of the operation mode. FIG. 6 is an explanatory diagram illustrating an example of switching from the presentation mode to the low power consumption mode. FIG. 7 is an explanatory diagram illustrating an example of switching from the low power consumption mode to the normal mode. FIG. 8 is an explanatory diagram illustrating an example of switching from the low power consumption mode to the presentation mode. FIG. 9 is an explanatory diagram illustrating an example of storage of measurement and measurement results. FIG. 10 is an explanatory diagram illustrating an example of determining the distance distribution and the threshold range. FIG. 11 is a flowchart illustrating an example of a processing procedure performed by the electronic device in the low power consumption mode. FIG. 12 is a flowchart illustrating an example of a non-operation period measurement processing procedure performed by the electronic device in the presentation mode. FIG. 13 is a flowchart illustrating an example of a user detection processing procedure performed by the electronic device in the presentation mode. FIG. 14 is a flowchart illustrating an example of a non-operation period measurement processing procedure performed by the electronic device in the normal mode. FIG. 15 is a flowchart illustrating an example of a user detection processing procedure performed by the electronic device in the normal mode. FIG. 16 is a flowchart illustrating an exemplary determination processing procedure performed by the electronic device.

  Exemplary embodiments of an electronic device and an operation control program according to the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is an explanatory diagram illustrating an example of mode switching by an electronic device. The electronic device 100 is a computer having a touch panel display. A touch panel display is simply referred to as a “touch panel”. The electronic device 100 is, for example, a tablet terminal device such as a smartphone or a PDA.

  2. Description of the Related Art Conventionally, an electronic device 100 is used for, for example, a task of explaining contents displayed on a touch panel 101 to a person receiving the explanation while a touch panel 101 is shown to the person receiving the explanation by a user us who operates the electronic device 100. It is done. Since the person who receives the explanation is the user us and another person cu, it is also referred to as another person cu. For example, the work of explaining includes a presentation such as a demonstration using the electronic device 100, for example.

  However, conventionally, for example, when a user us is giving a presentation using a mobile terminal device, if a touch operation is performed so that the backlight of the touch panel 101 is not turned off, an operation error such as a screen switching occurs. There is. On the other hand, for example, if the user us does not operate the touch panel 101 so that the touch panel 101 is not recognized as an erroneous operation, the backlight of the touch panel 101 is turned off.

  Therefore, in the present embodiment, when the electronic device 100 determines that the user us is not in the display direction d1 based on the distance from the electronic device 100 measured during screen display to the user, the electronic device 100 displays the screen, and the no-operation period. Disable processing according to touch operations other than timer reset processing. Thereby, for example, an erroneous operation on the touch panel 101 when the display surface of the touch panel 101 of the mobile terminal device is shown to another person cu can be suppressed. Further, when the user us is showing the display surface of the touch panel 101 of the mobile terminal device to another person cu, it is possible to suppress the display stop due to the elapse of the no-operation period. Therefore, the user us can efficiently perform work while showing the display surface of the touch panel 101 of the mobile terminal device to another person cu. The work while showing the display surface of the touch panel 101 includes, for example, a presentation.

  The electronic device 100 includes, for example, a touch panel 101, a measurement unit 301, a storage unit 302, and a control unit 303. Details of a functional block diagram of the electronic device 100 will be described later with reference to FIG.

  The measurement unit 301 measures the distance from the device itself to an object existing in the same direction as the display direction d1 of the touch panel 101. The object here is, for example, the user us of the electronic device 100. The user us of the electronic device 100 is described using the electronic device 100 by operating the electronic device 100 as described above. The storage unit 302 stores the distance measured by the measurement unit 301 during a touch operation on the touch panel 101.

  The control unit 303 refers to the storage unit 302 and determines a threshold range based on the distance measured during the touch operation on the touch panel 101. The range of the threshold value may be, for example, a width of 20 [cm] to 22 [cm], or may be the threshold value itself such as 20 [cm].

  The control unit 303 switches to the second operation mode when the distance measured by the measurement unit 301 is not within the determined threshold range in any one of the first operation mode and the second operation mode. To do. In the first operation mode, for example, as shown in the upper side of FIG. 1, screen display by the touch panel 101 is effective, and processing according to a touch operation on the touch panel 101 is effective. In the second operation mode, the screen display by the touch panel 101 is valid, and the process according to the touch operation other than the process of extending the period during which the screen display by the touch panel 101 is valid according to the touch operation on the touch panel 101 is performed. It is invalid.

  Here, for example, when the distance measured by the measurement unit 301 in any one of the operation modes is not within the determined threshold range, the control unit 303 causes the user us to touch the touch panel as shown in the lower side of FIG. It can be determined that the display direction d1 is not 101. On the other hand, for example, when the distance measured by the measurement unit 301 in any one of the operation modes is within the determined threshold range, the control unit 303 indicates that the user us is in the display direction d1 as shown on the upper side of FIG. It can be determined that the user is operating while viewing the display screen of the touch panel 101.

  For this reason, the control unit 303 enters the second operation mode when the distance is not within the determined threshold range. Thus, as shown in the lower side of FIG. 1, the case where the user us is not in the display direction d1 or the case where the user us is away from the electronic device 100 can be detected. Then, when the user us is explaining to another person cu using the electronic device 100, processing other than the timer reset processing for measuring the no-operation period according to the touch operation becomes invalid. For this reason, it is possible to suppress erroneous operations during the presentation. In addition, since the screen display is enabled at the time of presentation and the reset of the timer that measures the non-operation period is effective, the screen display is performed by the touch operation, and thus the display stop due to the elapse of the non-operation period can be suppressed. Therefore, work such as presentation can be performed efficiently. Efficiently performing means, for example, giving a presentation without being interrupted by the electronic device 100 or the like.

  In addition, the control unit 303 sets the first operation mode when the distance is within the threshold range determined in the first operation mode or the second operation mode. Accordingly, when the user us is in the display direction d1 of the touch panel 101, for example, when the user us wants to change the operation of the application being executed in response to the touch operation on the touch panel 101, the touch operation is performed. All are valid.

  In this way, the mode can be switched according to the usage state of the user, and the user's convenience is improved. In addition, the user can switch modes by simple handling of whether or not the display surface of the touch panel 101 is directed toward the user.

(Example of hardware configuration of electronic device 100)
FIG. 2 is a block diagram illustrating a hardware configuration example of the electronic device. In FIG. 2, an electronic device 100 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a nonvolatile memory 204, a touch panel 101, an in-camera 205, Have In addition, the electronic device 100 includes an infrared communication circuit 206, a fingerprint authentication device 207, an audio I / F 208, a wireless communication circuit 209, a WiFi module 211, a battery control module 213, and a battery 214. Each unit is connected by a bus 200.

  Here, the CPU 201 governs overall control of the electronic device 100. The CPU 201 includes, for example, an application processor 221 and a baseband processor 222. For example, the application processor 221 controls each unit from the ROM 202 to the audio I / F 208 and the battery control module 213. The baseband processor 222 controls the wireless communication circuit 209, the WiFi module 211, and the like.

  The ROM 202 stores a program such as a boot program. The RAM 203 is used as a work area for the CPU 201. The nonvolatile memory 204 is a writable memory and holds predetermined data. For example, the writable nonvolatile memory 204 includes a flash memory. The non-volatile memory 204 may be a removable external storage such as a USB (Universal Serial Bus) flash memory, for example.

  The touch panel 101 is a touch panel 101 type display having two functions of a display function and a function of accepting an operation input. The touch panel 101 displays image information received from the outside such as a computer on a display or the like. As the display, for example, a TFT (Thin Film Transistor) liquid crystal display can be employed.

  The touch panel 101 senses information on the touched screen position when the user us touches a point or area such as a picture or a pictogram displayed on a screen such as a display with a hand or a finger, and sends it to the CPU 201 as an information signal. Output. Specifically, the touch panel 101 detects contact for each area obtained by dividing the screen of the touch panel 101 into a plurality of areas, and outputs contact information as a detection result. Here, the touch panel 101 senses a weak current generated when the touch panel 101 is touched with a finger, that is, a change in capacitance (charge), by a sensor and grasps the touched position. For example, a region with a larger positive number indicates a region with a larger amount of weak current.

  The in-camera 205 can capture images and moving images and can detect illuminance. The in-camera 205 is provided, for example, on the upper side of the touch panel 101, that is, on the surface of the housing. For this reason, if the face of the user us is in the display direction of the screen of the touch panel 101, the in-camera 205 can capture the face of the user us.

  The distance between the user us and the electronic device 100 used in this embodiment can be measured using the in-camera 205. For example, the in-camera 205 photographs the face of the user us. Then, the CPU 201 measures the distance between the user us and the electronic device 100 based on the size of the face in the captured image. For example, when the face is brought closer to the electronic device 100, the face size appears larger, and when the face is moved away, the face size appears smaller. For this reason, for example, the face size at the reference distance is registered in advance, and the CPU 201 determines the user us based on the reference face size and the face size in the image captured by the in-camera 205. The distance between the electronic device 100 and the electronic device 100 is measured.

  Further, the in-camera 205 detects the positions of both eyes of the user us, for example. Then, the CPU 201 measures the distance between the user us and the electronic device 100 based on the distance between the eyes obtained from the detected eye position. For example, when the face is brought closer to the electronic device 100, the distance between the right eye and the left eye is increased, and when the face is moved away, the distance between the right eye and the left eye is decreased. For this reason, for example, the face size at the reference distance is registered in advance. Then, the distance between the user us and the electronic device 100 is measured based on the distance between the eyes serving as a reference and the distance between the eyes based on the positions of both eyes measured by the in-camera 205. To do.

  The infrared communication circuit 206 is an infrared transmission / reception unit. The infrared communication circuit 206 is provided on the upper side of the touch panel 101, that is, on the surface of the housing. For example, the infrared communication circuit 206 can be used in combination with the in-camera 205 for biometric authentication using an iris.

  The fingerprint authentication device 207 performs biometric authentication using fingerprint information. Specifically, the fingerprint authentication device 207 performs biometric authentication, for example, by collecting a fingerprint image and comparing the collected fingerprint image with a previously registered fingerprint image.

  Examples of the audio I / F 208 include a microphone and a speaker. The microphone has a function of converting sound into an electrical signal. The speaker has a function of generating electric sounds such as music and voice by changing electrical signals into physical vibrations. For example, the CPU 201 implements a call function using a microphone and a speaker.

  The distance between the user us and the electronic device 100 used in this embodiment can be measured using the infrared communication circuit 206. For example, the infrared communication circuit 206 irradiates infrared rays toward the user us, and receives infrared rays that are reflected and returned, so that a difference between the user us and the electronic device 100 can be obtained from the time difference between the start of irradiation and reception. Measure the distance.

  The antenna 210 transmits and receives radio waves for wireless communication with other devices. In response to an instruction from the baseband processor 222, the wireless communication circuit 209 outputs a radio wave received via the antenna 210 as a reception signal and transmits a transmission signal via the antenna 210 as a radio wave.

  The antenna 212 transmits and receives radio waves for wireless communication with other devices. The WiFi module 211 performs wireless communication via the antenna 212 according to the WiFi standard in response to an instruction from the baseband processor 222.

  The battery 214 is, for example, a rechargeable battery. Examples of the battery 214 include a lithium ion battery. The battery control module 213 performs control to supply the electric power stored in the battery 214 to each unit of the electronic device 100 as a driving power source. Further, the battery control module 213 controls whether or not to supply power to each unit of the electronic device 100 according to each mode described later.

(Functional configuration example of electronic device 100)
FIG. 3 is a block diagram illustrating a functional configuration example of the electronic device. The electronic device 100 includes a touch panel 101, a measurement unit 301, a control unit 303, and a storage unit 302.

  The storage unit 302 is realized by, for example, the RAM 203, the nonvolatile memory 204, and the like. The storage unit 302 stores, for example, a distance DB (DataBase) described later with reference to FIG.

  The touch panel 101 includes, for example, a display unit 311 and a reception unit 312. The display unit 311 outputs various information, for example. The accepting unit 312 accepts a touch operation. Then, the reception unit 312 notifies the control unit 303 and the like that the touch operation has been received.

  For example, the measurement unit 301 has a function capable of measuring a distance from the touch panel 101 of its own device to an object existing in the same direction as the display direction of the touch panel 101. The object is, for example, a user us who operates the electronic device 100. The measurement unit 301 measures the distance using, for example, the infrared communication circuit 206 or the in-camera 205.

  When the infrared communication circuit 206 is used as the measurement unit 301, the measurement unit 301 measures the distance between the own device and the object using a time difference from the irradiation of infrared rays to the reception of the reflected wave. Specifically, as described above, the measurement unit 301 irradiates infrared rays toward the user us and receives infrared rays that are reflected and returned, for example. The distance between us and the electronic device 100 is measured. The distance between the user's device and the target is converted into the distance between the user's device and the target based on the correspondence information that associates the distance between the eyes that is the reference for the user us and the distance from the user us to the target. The correspondence information is stored in advance in, for example, the ROM 202, the RAM 203, the nonvolatile memory 204, and the like. Alternatively, for example, the ratio between the distance between the left eye and the right eye and the distance from the user us to the object is prepared in advance and stored in the ROM 202, the RAM 203, the nonvolatile memory 204, and the like. And the measurement part 301 may measure the distance from the present user us to a target object based on the distance between the left eye and right eye measured this time, and the said ratio.

  When the in-camera 205 is used as the measuring unit 301, the measuring unit 301 captures the face of the user us and measures the size of the face. The size of the face is represented by, for example, the length in the X-axis direction and the length in the Y-axis direction in the image. Then, the measurement unit 301 converts the measured face size into the distance between the own device and the target object. Specifically, as described above, for example, the measurement unit 301 automatically determines, based on the correspondence information in which the size of the face that is the reference for the user us and the distance from the user us to the object are associated with each other. Convert the distance between the device and the object. The correspondence information is stored in advance in, for example, the ROM 202, the RAM 203, the nonvolatile memory 204, and the like. Alternatively, for example, the ratio between the face size and the distance from the user us to the object is prepared in advance and stored in the ROM 202, the RAM 203, the nonvolatile memory 204, or the like. Then, the measurement unit 301 may measure the distance from the current user us to the target object based on the currently measured face size and the ratio.

  Further, the measurement unit 301 uses the in-camera 205 to detect the positions of both eyes of the user us. The CPU 201 measures the distance between the user us and the electronic device 100 based on the distance between the eyes obtained from the detected eye position. For example, when the face is brought closer to the electronic device 100, the distance between the right eye and the left eye is increased, and when the face is moved away, the distance between the right eye and the left eye is decreased. For this reason, for example, the size of the face at the reference distance is registered in advance, and the distance between the eyes based on the distance between the reference eyes and the position of both eyes measured by the in-camera 205 is stored. The distance between the user us and the electronic device 100 may be measured based on the distance.

  The processing of the control unit 303 is coded in a program stored in a storage device such as a ROM 202, a RAM 203, and a nonvolatile memory 204 that can be accessed by the CPU 201 shown in FIG. Then, the CPU 201 reads the program from the storage device and executes the process coded in the program. Thereby, the CPU 201 operates as the control unit 303. The processing result of the control unit 303 is stored in a storage device such as the ROM 202, the RAM 203, and the nonvolatile memory 204, for example.

  The control unit 303 determines the range of the threshold when determining whether or not the user us is detected, and controls the operation mode according to the determination result. For example, the control unit 303 includes an operation mode control unit 322 and a determination unit 321. The operation mode control unit 322 switches between the first operation mode, the second operation mode, and the third operation mode. The determination unit 321 determines the range of the threshold when determining whether or not the user us is detected. Here, first, processing by the operation mode control unit 322 will be described, and processing by the determination unit 321 will be described.

<Operation mode control>
For example, the operation mode control unit 322 switches between the first operation mode, the second operation mode, and the third operation mode with reference to the storage unit 302.

  FIG. 4 is an explanatory diagram showing an example of a list of operation modes. The table 400 in FIG. 4 shows whether the touch operation on the touch panel 101 is valid / invalid and the backlight of the touch panel 101 is turned on / off for each operation mode.

  The first operation mode is also referred to as a normal mode. In the normal mode, for example, screen display by the touch panel 101 is effective, and processing according to a touch operation on the touch panel 101 is effective. The normal mode is an operation mode in a state where it is determined that the user us is operating the electronic device 100 with the intention to operate. In the normal mode, the operation of the touch panel 101 is effective. Further, in the normal mode, the backlight of the touch panel 101 is turned on, and lighting is continued by a touch operation.

  The second operation mode is also referred to as a presentation mode. The presentation mode is omitted and is also referred to as a presentation mode. In the presentation mode, for example, the screen display by the touch panel 101 is valid, and the process according to the touch operation other than the process of extending the period during which the screen display by the touch panel 101 is valid according to the touch operation on the touch panel 101 is invalid. It is. The presentation mode is, for example, an operation mode in a state where the user us is not within the operation range. In the presentation mode, for example, a touch operation on the touch panel 101 is accepted by the accepting unit 312, but processes other than the process of extending the period during which the screen display by the touch panel 101 according to the touch operation is valid are invalidated. In the presentation mode, for example, the backlight of the touch panel 101 is turned on, and the lighting is continued by a touch operation.

  Specifically, when the control unit 303 receives a touch operation in the presentation mode, the control unit 303 performs a process of resetting the elapsed measurement of the specified time by the mode switching timer executed by the application processor 221 and responds to the touch operation other than the process. Do not process. Since the control unit 303 does not perform any process according to the touch operation other than the process, the control unit 303 performs a process according to the touch operation to a process such as an application executed by the OS (Operation System) or a screen slide according to the slide operation. I will not hand it over. As a result, the operation information such as the touch operation is not reflected in the application being executed, and it seems to the user us that the process corresponding to the touch operation is invalid.

  The third operation mode is also referred to as a low power consumption mode, for example. The low power consumption mode is, for example, an operation mode in a state where it is determined that the user us is not using the electronic device 100. In the low power consumption mode, for example, a touch operation on the touch panel 101 is invalid. That is, in the low power consumption mode, unlike the presentation mode, the control unit 303 does not perform all the processes corresponding to the touch operation, or the reception unit 312 does not receive the touch operation itself. In the low power consumption mode, for example, the backlight of the touch panel 101 is turned off.

  Here, power supply control in the low power consumption mode is not particularly limited. For example, when entering the low power consumption mode, the control unit 303 may instruct the battery control module 213 to control the power supply to each unit according to the low power consumption mode. The battery control module 213 changes the power control to each unit by, for example, the low power consumption mode, the normal mode, and the presentation mode. For example, the battery control module 213 may perform control so as not to supply power to the backlight of the touch panel 101 in the low power consumption mode.

  FIG. 5 is an explanatory diagram showing an example of transition of the operation mode. Here, the transition of the operation mode by the operation mode control unit 322 will be described.

  For example, the operation mode control unit 322 switches to the presentation mode s2 when the distance measured by the measurement unit 301 is not within the determined threshold range in any one of the normal mode s1 and the presentation mode s2. To do. Here, for example, the distance of the measuring unit 301 is measured every predetermined time. For example, the predetermined time may be about 1 [second]. Here, the case where the distance measured by the measurement unit 301 is not within the determined threshold range includes, for example, the case where the distance could not be measured by the measurement unit 301.

  For example, the operation mode control unit 322 sets the presentation mode s2 when the distance measured by the measurement unit 301 in the normal mode s1 is not within the determined threshold range. Thereby, as shown in FIG. 5, when the user us is not detected, the operation mode is changed to the presentation mode s2.

  Further, for example, when the distance measured by the measurement unit 301 in the normal mode s1 is within the determined threshold range, the operation mode control unit 322 remains in the normal mode s1.

  In addition, the operation mode control unit 322 sets the low power consumption mode s3 when the non-operation period of the touch panel 101 has passed a specified time in the normal mode s1. In addition, the operation mode control unit 322 shifts to the low power consumption mode s3 by a predetermined operation of the user us with respect to the electronic device 100 in the normal mode s1. The predetermined operation here is, for example, an operation of pressing the power button of the electronic device 100.

  Further, for example, when the distance measured by the measurement unit 301 is not within the determined threshold range in the presentation mode s2, the operation mode control unit 322 remains in the presentation mode s2. As a result, when the user us is not detected, it can be determined that the user us will give a presentation, and processing other than the timer reset processing corresponding to the touch operation is invalidated.

  For example, the operation mode control unit 322 sets the normal mode s1 when the distance measured by the measurement unit 301 in the presentation mode s2 is within the determined threshold range. Accordingly, when the user us is detected, it can be determined that the user us performs a normal touch operation, and when the user us wants to perform an operation, the operation can be performed immediately.

  FIG. 6 is an explanatory diagram illustrating an example of switching from the presentation mode to the low power consumption mode. For example, the operation mode control unit 322 sets the low power consumption mode s3 when the non-operation period of the touch panel 101 elapses during the presentation mode s2. As shown in FIG. 6, when the specified time elapses from the last touch operation in the presentation mode s2, a state where the electronic device 100 is not used is considered. For this reason, by shifting from the presentation mode s2 to the low power consumption mode s3, the power of the backlight can be turned off, and the power consumption can be reduced.

  Returning to the description of FIG. 5, the operation mode control unit 322 shifts to the low power consumption mode s <b> 3 by a predetermined operation of the user us with respect to the electronic device 100 in the presentation mode s <b> 2. The predetermined operation here is, for example, an operation of pressing the power button of the electronic device 100.

  For example, the operation mode control unit 322 causes the measurement unit 301 to measure the distance to the object when the electronic device 100 is resumed by a predetermined operation by the user us in the low power consumption mode s3. For example, when the operation mode control unit 322 accepts that the measurement unit 301 has resumed by a predetermined operation of the user us with respect to the electronic device 100 in the low power consumption mode s3, the distance between the object and the electronic device 100 is determined. Measure. Resume is to restart the operation of the electronic device 100 by turning on the power of the electronic device 100 in the suspended state and returning it to the original state. Turning on the power here simply indicates that the power button is pressed. For example, the electronic device 100 resumes when receiving a pressing operation of the power button in the low power consumption mode s3. The suspended state is a state in which the working state of the electronic device 100 is stored in the RAM 203 or the nonvolatile memory 204 when the low power consumption mode s3 is entered.

  FIG. 7 is an explanatory diagram illustrating an example of switching from the low power consumption mode to the normal mode. When the user us changes the orientation of the touch panel 101 so that the display direction of the touch panel 101 and the orientation of the user us face each other in order to perform a touch operation at the time of resuming, the measuring unit 301 causes the user us and the electronic device to The distance to 100 can be measured. For this reason, the user us is detected. Then, for example, when the resume is performed, the operation mode control unit 322 sets the normal mode s1 when the distance measured by the measurement unit 301 is within the determined threshold range.

  FIG. 8 is an explanatory diagram illustrating an example of switching from the low power consumption mode to the presentation mode. In order for the user us to continue the presentation using the electronic device 100 at the time of resuming, for example, if the display direction of the touch panel 101 and the direction of the user us are the same, the measuring unit 301 may determine that the user us and the electronic device 100 are the same. Cannot be detected. For this reason, the user us is not detected. For example, when the resume is performed, the operation mode control unit 322 sets the presentation mode s2 when the distance measured by the measurement unit 301 is not within the determined threshold range.

  In this way, by adding the presentation mode s2 in addition to the normal mode s1 and the low power consumption mode s3, erroneous operations during presentation can be suppressed.

<Determination of threshold range>
Next, an example of determining the threshold range by the determination unit 321 will be described. For example, when receiving a touch operation on the touch panel 101, the measurement unit 301 measures the distance from the own device to an object existing in the same direction as the display direction of the touch panel 101. Then, the measurement unit 301 stores the measured distance in the storage unit 302.

  FIG. 9 is an explanatory diagram illustrating an example of storage of measurement and measurement results. As illustrated in FIG. 9, for example, when the measurement unit 301 receives a touch operation by the reception unit 312, the measurement unit 301 measures the distance from the own device to an object existing in the same direction as the display direction of the touch panel 101. Here, the measurement unit 301 such as the in-camera 205 or the infrared communication circuit 206 is provided in the same direction as the display direction of the touch panel 101 on the upper part of the touch panel 101 or the like.

  When the in-camera 205 is used as the measurement unit 301, the measurement unit 301 measures the distance between the eyes of the user us as shown in FIG. And the measurement part 301 converts the measured distance between eyes into the distance of an own apparatus and a target object.

  When the in-camera 205 is used as the measurement unit 301, as shown in FIG. 9B, the measurement unit 301 shoots the face of the user us and measures the size of the face obtained from the image pic obtained by the shooting. To do. In the example of FIG. 9B, the measurement unit 301 measures the size in the X direction and the size in the Y direction. Then, the measurement unit 301 converts the measured face size into the distance between the own device and the target object.

  In the example of FIG. 9, the distance between the user us and the electronic device 100 is 18 [cm]. Then, the measurement unit 301 stores the measured distance in the distance DB 900 stored in the storage unit 302.

  In the example of FIG. 9, only the distance is stored, but the present invention is not limited to this. For example, the measurement unit 301 may store the distance and the measurement time in association with each other, or may store the distance and the number in the storage order in association with each other. The measuring unit 301 may store only the distance in the order of measurement. In this way, by storing the measurement time, the number in the storage order, etc., or by storing in the measurement order, the past such as several days ago, one month ago, several months ago, etc. Old data may be periodically deleted. As a result, the threshold range can be determined from the latest data.

  Next, the determination unit 321 determines a threshold range based on the distance stored in the distance DB 900. Specifically, the determination unit 321 calculates a statistic of the distribution of distances stored in the distance DB 900, for example. Here, the statistic of the distance distribution is, for example, a basic statistic representing the center of the distance distribution. For example, center values such as the average value, median value, and mode value of the distribution of distances can be mentioned.

  FIG. 10 is an explanatory diagram illustrating an example of determining the distance distribution and the threshold range. As described above, the determination unit 321 obtains the distance distribution by counting the frequency for each distance stored in the distance DB 900. The table 1000 is an example in which the usage frequency is obtained for each distance of 0.5 [cm], for example. The frequency of use is the number of times measured. A graph 1001 is an example in which the obtained distribution is graphed for easy understanding. The horizontal axis direction of the graph 1001 represents the distance from the electronic device 100, and the vertical axis direction of the graph 1001 represents the usage frequency. In the graph 1001, since the central value that is the basic statistic is 20 [cm], the determination unit 321 sets the reference value of the threshold range to 20 [cm].

  Then, the determination unit 321 may obtain the variance as a statistic of the distribution of distances in order to set the error from the reference value as the threshold range. The determination unit 321 may determine the threshold range based on the variance and the average value.

  Further, in order to include an error, the determination unit 321 may set a range between the minimum value of the center value−predetermined value and the maximum value of the center value + 1 [cm] as the threshold range. The predetermined value is determined by the developer or the user us of the electronic device 100 and stored in advance in the ROM 202, RAM 203, nonvolatile memory 204, and the like. In the example of FIG. 10, the determination unit 321 sets the predetermined value to 1 [cm], from 19 [cm] of 20 [cm] −1 [cm] to 21 [cm] of 20 [cm] +1 [cm]. Is determined as the threshold range.

  Here, the center value of the distribution is exemplified as the distribution statistic. However, the present invention is not limited to this, and the maximum value or the minimum value of the distribution may be used.

  Then, as described above, the operation mode control unit 322 controls the operation mode based on the threshold range determined by the determination unit 321. Accordingly, it is possible to avoid turning off the screen against the intention of the user us, and to avoid invalidating the touch panel 101 against the intention of the user us.

(Example of processing procedure performed by electronic device 100)
FIG. 11 is a flowchart illustrating an example of a processing procedure performed by the electronic device in the low power consumption mode. For example, the electronic device 100 determines whether or not it has been resumed in the low power consumption mode s3 (step S1101). When it is determined that the device has not been resumed (step S1101: No), the electronic device 100 returns to step S1101, for example.

  When it is determined that the resume has been made (step S1101: Yes), the electronic device 100 measures, for example, the distance between the user us and the own device (step S1102). In step S1102, the distance from the own device to the user us in the display direction of the touch panel 101 is measured.

  For example, the electronic device 100 determines whether or not the measured distance is within a threshold range (step S1103). When it is determined that the measured distance is within the threshold range (step S1103: Yes), the electronic device 100 switches from the low power consumption mode s3 to the normal mode s1 (step S1104), for example, and ends the series of processes. To do. If it is determined that the measured distance is not within the threshold range (step S1103: No), for example, the electronic device 100 switches from the low power consumption mode s3 to the presentation mode s2 (step S1105), and the series of processing ends. .

  FIG. 12 is a flowchart illustrating an example of a non-operation period measurement processing procedure performed by the electronic device in the presentation mode. For example, the electronic device 100 starts measurement of a specified time by a mode switching timer (step S1201). For example, the electronic device 100 determines whether a specified time has elapsed (step S1202). When it is determined that the specified time has not elapsed (step S1202: No), the electronic device 100 determines, for example, whether a touch operation on the touch panel 101 has been detected (step S1203).

  If it is determined that a touch operation has been detected (step S1203: Yes), for example, the electronic device 100 restarts measurement of a specified time by a mode switching timer (step S1204), and returns to step S1202. Accordingly, it is possible to extend the period during which the screen display is enabled by the touch operation in the presentation mode s2. Here, when the electronic device 100 detects a touch operation on the touch panel 101, the electronic device 100 does not notify the OS or the like that controls processing such as an application and screen control to the information related to the touch operation.

  On the other hand, when it is determined that the touch operation has not been detected (step S1203: No), the electronic device 100 returns to step S1202.

  Next, for example, when it is determined that a specified time has elapsed (step S1202: Yes), the electronic device 100 switches from the presentation mode s2 to the low power consumption mode s3 (step S1205), and ends a series of processes.

  FIG. 13 is a flowchart illustrating an example of a user detection processing procedure performed by the electronic device in the presentation mode. For example, the electronic device 100 determines whether or not a predetermined time has elapsed (step S1301). The predetermined time here is a short time of about 0.1 to 1 [second], and is a time interval for measuring the distance between the user us and the user's own device. For example, when it is determined that the predetermined time has not elapsed (step S1301: No), the electronic device 100 returns to step S1301, for example.

  Next, for example, when it is determined that a predetermined time has elapsed (step S1301: Yes), the electronic device 100 measures, for example, the distance between the user us and the own device (step S1302). For example, the electronic device 100 determines whether or not the distance is within a threshold range (step S1303). When it is determined that the distance is not within the threshold range (step S1303: No), the electronic device 100 returns to step S1301. As a result, the presentation mode s2 remains.

  When it is determined that the distance is within the threshold range (step S1303: Yes), the electronic device 100 switches from the presentation mode s2 to the normal mode s1 (step S1304), and the series of processing ends.

  FIG. 14 is a flowchart illustrating an example of a non-operation period measurement processing procedure performed by the electronic device in the normal mode. First, the electronic device 100 starts measuring the specified time by the mode switching timer (step S1401). For example, the electronic device 100 determines whether a specified time has elapsed (step S1402). When it is determined that the specified time has not elapsed (step S1402: No), the electronic device 100 determines, for example, whether a touch operation on the touch panel 101 has been detected (step S1403). When it is determined that the touch operation is not detected (step S1403: No), the electronic device 100 returns to step S1402. When it is determined that the touch operation has been detected (step S1403: Yes), the electronic device 100 restarts the measurement of the specified time by the mode switching timer (step S1404) and returns to step S1402.

  When it is determined that the specified time has elapsed (step S1402: Yes), for example, the electronic device 100 switches from the normal mode s1 to the low power consumption mode s3 (step S1405), and ends the series of processes.

  FIG. 15 is a flowchart illustrating an example of a user detection processing procedure performed by the electronic device in the normal mode. For example, the electronic device 100 determines whether or not a predetermined time has elapsed (step S1501). For example, when it is determined that the predetermined time has not elapsed (step S1501: No), the electronic device 100 returns to step S1501, for example.

  Next, for example, when it is determined that a predetermined time has elapsed (step S1501: Yes), the electronic device 100 measures, for example, the distance between the user us and the own device (step S1502). For example, the electronic device 100 determines whether or not the distance is within a threshold range (step S1503). If it is determined that the distance is within the threshold range (step S1503: Yes), the electronic device 100 returns to step S1501. As a result, the operation mode remains in the normal mode s1.

  If it is determined that the distance is not within the threshold range (step S1503: No), the electronic device 100 switches from the normal mode s1 to the presentation mode s2 (step S1504), and the series of processing ends.

  FIG. 16 is a flowchart illustrating an exemplary determination processing procedure performed by the electronic device. For example, the electronic device 100 determines whether or not a touch operation on the touch panel 101 has been detected (step S1601). For example, when it is determined that a touch operation on the touch panel 101 is not detected (step S1601: No), the electronic device 100 returns to, for example, step S1601.

  For example, when it is determined that a touch operation on the touch panel 101 has been detected (step S1601: Yes), the electronic device 100 measures, for example, the distance between the user us and the own device (step S1602). For example, the electronic device 100 stores the measured distance in the distance DB 900 (step S1603). For example, the electronic device 100 counts the usage frequency for each distance stored in the distance DB 900 (step S1604).

  Then, the electronic device determines a threshold range based on the central value of the usage frequency distribution for each distance (step S1605), and ends the series of processes.

  As described above, when the electronic device 100 determines that there is no user in the display direction of the touch panel 101 based on the distance between the user and the device measured during the screen display, Disable processing according to touch operations other than extending the operation period. Specifically, the electronic device 100 switches to the presentation mode s2 when the distance measured in the normal mode s1 is not within the range. Also, the electronic device 100 switches to the presentation mode s2 when the distance measured in the presentation mode s2 is not within the range. Thereby, the display stop by progress of a no-operation period can be suppressed, suppressing erroneous operation.

  The electronic device 100 switches to the normal mode s1 when the distance measured in the operation mode of any one of the normal mode s1 and the presentation mode s2 is within the determined threshold range. Thus, when the user wants to operate the screen, the operation mode can be switched immediately so that the user can operate without being aware of it. In addition, since the user can switch the operation mode by simply handling whether or not the display surface of the touch panel 101 is directed toward the user, the usability is improved.

  In the electronic device 100, the screen display is invalid and the processing corresponding to the touch operation is invalid when a certain period of time has passed without any touch operation in either the normal mode s1 or the presentation mode s2. A certain low power consumption mode s3 is set. As a result, when the user does not use the electronic device for a long time at the time of presentation or operation, the low power consumption mode s3 can be set, and the power consumption can be reduced.

  The electronic device 100 switches to the normal mode s1 when the distance measured when resumed from the low power consumption mode s3 is within the determined range. On the other hand, the electronic device 100 switches to the presentation mode s2 when the distance measured when resumed from the low power consumption mode s3 is not within the determined threshold range. Since the operation mode can be switched by simply handling whether or not the user faces the display surface of the touch panel 101 toward himself / herself at the time of resume, the usability is improved.

  The electronic device 100 calculates a statistic of the distance distribution measured at the time of the touch operation, and determines the threshold range based on the calculated statistic. The distance distribution statistic is a basic statistic that represents the center of the distance distribution measured during the touch operation. Thereby, the distance between the user and the electronic device 100 when the user is performing the touch operation can be learned, and the accuracy of the determination as to whether the user wants to operate the screen can be improved. .

  The operation control method described in the present embodiment can be realized by executing an operation control program prepared in advance on a computer such as a personal computer or a workstation. The operation control program is recorded on a computer-readable recording medium such as a magnetic disk, an optical disk, or a USB flash memory, and is executed by being read from the recording medium by the computer. The operation control program may be distributed via a network such as the Internet.

  In addition, the electronic device 100 described in this embodiment includes an application-specific IC (hereinafter simply referred to as “ASIC”) such as a standard cell or a structured ASIC (Application Specific Integrated Circuit), or an FPGA (Field Programmable Gate Array). It can also be realized by PLD (Programmable Logic Device). Specifically, for example, the functions of the control unit 303 and the storage unit 302 of the electronic device described above are defined by HDL (Hardware Description Language) description, and the HDL description is logically synthesized and given to the ASIC or PLD. The electronic device 100 can be manufactured.

  The following additional notes are disclosed with respect to the embodiment described above.

(Appendix 1) A measuring unit capable of measuring the distance from the own device to an object existing in the same direction as the display direction of the touch panel display of the own device;
A storage unit for storing a distance measured by the measurement unit during a touch operation on the display;
The threshold value range is determined based on the distance measured during the touch operation on the display with reference to the storage unit, the screen display by the display is effective, and the processing according to the touch operation on the display is effective In accordance with the touch operation other than the first operation mode and the process of extending the period during which the screen display by the display is valid and the screen display by the display is valid according to the touch operation on the display. The second operation mode is set when the distance measured by the measurement unit is not within the determined threshold range in any one of the second operation modes in which the processing is invalid. A control unit;
An electronic device comprising:

(Appendix 2) The control unit
When the distance measured by the measurement unit during the first operation mode is not within the determined threshold range, the second operation mode is set.
The electronic device as set forth in Appendix 1, wherein

(Appendix 3) The control unit
When the distance measured by the measurement unit during the second operation mode is not within the determined threshold range, the second operation mode is set.
The electronic device according to appendix 1 or 2, characterized by the above.

(Appendix 4) The control unit
The first operation when the distance measured by the measurement unit in the operation mode of any of the first operation mode and the second operation mode is within the determined threshold range. Mode
The electronic device according to any one of appendices 1 to 3, wherein:

(Supplementary Note 5) The control unit
When the distance measured by the measurement unit in the first operation mode is within the determined threshold range, the first operation mode is set;
The electronic device as set forth in Appendix 4, wherein

(Appendix 6) The control unit
When the distance measured by the measurement unit during the second operation mode is within the determined threshold range, the first operation mode is set;
The electronic device according to appendix 4 or 5, characterized by the above.

(Appendix 7) The control unit
When a certain amount of time has passed without any touch operation on the display during the first operation mode or the second operation mode, the screen display by the display is invalid, A third operation mode in which processing according to a touch operation on the display is invalid;
The electronic device according to any one of appendices 1 to 6, characterized in that:

(Appendix 8) The control unit
When the distance measured by the measurement unit when resumed from the third operation mode is within the determined threshold range, the first operation mode is set.
When the distance measured by the measurement unit when resumed from the third operation mode is not within the determined threshold range, the second operation mode is set.
The electronic device as set forth in Appendix 7, wherein

(Appendix 9) The control unit
Referring to the storage unit, calculate a statistic of the distribution of the distance measured during the touch operation on the display,
Determining the range of the threshold based on the calculated statistics;
The electronic device according to any one of appendices 1 to 8, characterized in that:

(Supplementary note 10) The supplementary note 9 is characterized in that the distance distribution statistic is a basic statistic representing the center of the distance distribution measured during a touch operation on the display with reference to the storage unit. The electronic device as described in.

(Supplementary note 11)
Refers to a storage unit that stores a distance measured during a touch operation on the display by a measuring unit capable of measuring a distance from the own device to an object existing in the same direction as the display direction of the touch panel display of the own device. Determining a threshold range based on the distance measured during the touch operation on the display;
The first operation mode in which the screen display by the display is effective and the processing according to the touch operation on the display is effective, the screen display by the display is effective, and the touch operation on the display is in accordance Measured by the measurement unit in any one of the second operation modes in which the process according to the touch operation other than the process of extending the period during which the screen display by the display is valid is invalid. When the measured distance is not within the determined threshold range, the second operation mode is set.
An operation control program for executing a process.

100 Electronic Device 101 Touch Panel 201 CPU
202 ROM
203 RAM
204 Non-volatile memory 205 In-camera 206 Infrared communication circuit 301 Measuring unit 302 Storage unit 303 Control unit 311 Display unit 312 Reception unit 321 Determination unit 322 Operation mode control unit 900 Distance DB
1000 Table 1001 Graph d1 Display direction s1 Normal mode s2 Presentation mode s3 Low power consumption mode

Claims (6)

A measuring unit capable of measuring a distance from the own device to an object existing in the same direction as the display direction of the touch panel type display of the own device;
A storage unit for storing a distance measured by the measurement unit during a touch operation on the display;
The threshold value range is determined based on the distance measured during the touch operation on the display with reference to the storage unit, the screen display by the display is effective, and the processing according to the touch operation on the display is effective In accordance with the touch operation other than the first operation mode and the process of extending the period during which the screen display by the display is valid and the screen display by the display is valid according to the touch operation on the display. The second operation mode is set when the distance measured by the measurement unit is not within the determined threshold range in any one of the second operation modes in which the processing is invalid. A control unit;
An electronic device comprising: The controller is
The first operation when the distance measured by the measurement unit in the operation mode of any of the first operation mode and the second operation mode is within the determined threshold range. Mode
The electronic device according to claim 1. The controller is
When a certain amount of time has passed without any touch operation on the display during the first operation mode or the second operation mode, the screen display by the display is invalid, A third operation mode in which processing according to a touch operation on the display is invalid;
The electronic device according to claim 1, wherein the electronic device is an electronic device. The controller is
When the distance measured by the measurement unit when resumed from the third operation mode is within the determined threshold range, the first operation mode is set.
When the distance measured by the measurement unit when resumed from the third operation mode is not within the determined threshold range, the second operation mode is set.
The electronic device according to claim 3. The controller is
Referring to the storage unit, calculate a statistic of the distribution of the distance measured during the touch operation on the display,
Determining the range of the threshold based on the calculated statistics;
The electronic device according to claim 1, wherein the electronic device is an electronic device. On the computer,
Refers to a storage unit that stores a distance measured during a touch operation on the display by a measuring unit capable of measuring a distance from the own device to an object existing in the same direction as the display direction of the touch panel display of the own device. Determining a threshold range based on the distance measured during the touch operation on the display;
The first operation mode in which the screen display by the display is effective and the processing according to the touch operation on the display is effective, the screen display by the display is effective, and the touch operation on the display is in accordance Measured by the measurement unit in any one of the second operation modes in which the process according to the touch operation other than the process of extending the period during which the screen display by the display is valid is invalid. When the measured distance is not within the determined threshold range, the second operation mode is set.
An operation control program for executing a process.

Images