JP4864607B2 - Portable electronic device and control method thereof - Google Patents

Description

The present invention relates to a portable electronic device and a control method thereof, and more particularly to a portable electronic device provided with a plurality of sensor elements that detect contact as an operation input unit and a control method thereof .

  Portable electronic devices are equipped with various functions such as an FM / AM radio and a music player in addition to a call function because of their small size and portable nature. In recent years, IC cards and dedicated antennas have been installed to enable non-contact wireless data communication at short distances, and electronic money and portable electronic devices with functions as non-contact commuter pass and fare settlement prepaid cards Equipment has been developed. In this way, when using a portable electronic device other than the call function, the user operates the operation input unit to select a music list to be played back and to set / cancel a security password when using electronic money. If the operation input section is “mechanical”, it means that the operation is being performed, that is, that the operation / input is accepted when the button is pressed or the dial is rotated. Can be easily recognized.

  On the other hand, in a portable electronic device equipped with a touch sensor as an operation input unit, unlike a mechanical sensor, it is difficult for a user to recognize whether it is an operational feeling or an input enabled state. Therefore, it is convenient if the operation state can be notified to the user by turning on the display unit (display) during detection of the touch sensor so that the user can confirm the operation state of the touch sensor. At this time, as the display unit, an EL display using a self-luminous element having excellent visibility even outdoors is suitable.

  A portable electronic device is generally small, and a power supply (battery) mounted on the portable electronic device is inevitably small, and generally has a small battery capacity. However, a portable electronic device that is always carried and used by a user, such as a mobile phone terminal, can reduce the power consumption of the entire device and extend the operation time even for such a low-capacity battery. It is desirable to improve convenience. However, the above-described EL display has high power consumption, and power is consumed by both the touch sensor and the display unit, and there is a problem that power consumption increases as the detection time of the touch sensor increases.

In order to solve this problem, the present invention provides a portable electronic device capable of preventing excessive power consumption during operation of the touch sensor while notifying the user of the operation state of the touch sensor on the display unit, and a control method thereof. For the purpose.

In order to solve the above-described problems, the portable electronic device according to the first invention detects a contact with the touch sensor and a movement of the contact position as a contact operation (for example, a clockwise turn and a finger trace upward). (For example, a contact sensor whose detection surface is provided on the outer surface of the device casing and detects contact / proximity of an object such as a finger) and a display operation within a predetermined time. A display unit provided on the outer surface of the device casing that displays predetermined information) and a time during which the display unit performs a display operation (that is, a display time of an icon, a character, an image, etc.) (display elapsed time) ) A timing unit, a determination unit that determines whether or not the detection unit has completed detection of a predetermined contact operation within a predetermined time after the timing unit starts timing, and the determination The predetermined time as a result of the determination by the section If the predetermined contact operation is not completed (predetermined based on the operation target application and power consumption when displaying predetermined information for the application), the predetermined time has elapsed. Later, control is performed to stop the display operation of the display unit and detection of the detection unit, and when the predetermined contact operation is completed within the predetermined time, the predetermined time is extended. continued display operation of the display portion Te, and a controlling unit for controlling the so that to stop detection of the detection unit and stops extended a predetermined time has elapsed the display operation of the display unit To do.

Further, in the portable electronic device according to the second invention , when the predetermined contact operation is not completed within the predetermined time as a result of the determination by the determination unit, the control unit detects before that The contact operation is regarded as not detected.
In the portable electronic device according to the third invention, the predetermined contact operation includes at least a first contact operation and a second contact operation, and the control unit performs the predetermined contact operation within the predetermined time. If the first contact operation is completed among the predetermined contact operations within the predetermined time, the display operation of the display unit is continued by extending the predetermined time. It is characterized by controlling as follows.
In the portable electronic device according to a fourth aspect of the invention, the predetermined contact operation is an operation for releasing the lock, and when the control unit is unlocked, the predetermined contact operation is performed within the predetermined time. Even when the contact operation is not completed, after the lapse of the predetermined time, control for stopping the display operation of the display unit and stopping the detection of the detection unit is not performed .

As described above, the solving means of the present invention has been described as a device (apparatus). However, the present invention can also be realized as a method, a program, and a storage medium recording the program. It should be understood that these ranges are also included.
For example, a method for controlling a portable electronic device according to a fifth aspect of the present invention realized as a method includes a detection unit that detects contact with a touch sensor and movement of the contact position as a contact operation, and a display unit. A method for controlling an electronic device, the step of determining whether or not the detection unit has completed detection of a predetermined contact operation within a predetermined time after the display unit starts a display operation. If the predetermined contact operation is not completed within the predetermined time as a result of the determination, the display unit stops the display operation and the detection unit detects after the predetermined time elapses. When the predetermined contact operation is completed within the predetermined time, the display operation of the display unit is continued by extending the predetermined time, and when the extended predetermined time elapses. The display A step to stop the display operation is controlled in so that to stop detection of the detection portion, characterized in that it comprises a.

ADVANTAGE OF THE INVENTION According to this invention, the portable electronic device which can prevent the excessive power consumption at the time of touch sensor operation, and its control method can be provided, notifying a user of the operation state of a touch sensor by a display part.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The present invention is applied to a mobile phone terminal as a typical example of a portable electronic device.

  FIG. 1 is a block diagram showing an outline of the mobile phone terminal of this embodiment. The cellular phone terminal 100 shown in the figure includes a control unit 110, a sensor unit 120, a display unit 130, a storage unit (flash memory, etc.) 140, an OS timer CLK, an information processing function unit 150, a telephone function unit 160, and a key operation unit KEY. And a speaker SP, and a communication unit COM that communicates by connecting to a CDMA communication network (not shown). Further, the control unit 110 includes a timer unit 112 and a determination unit 114. Further, the sensor unit 120 uses a sensor element group including a plurality of sensor elements (for example, a contact sensor whose detection unit is provided on the outer surface of the device housing and detects contact / proximity of an object such as a finger) Corresponding to n, that is, the first sensor element group G1, the second sensor element group G2, and the nth sensor element group G3. The storage unit 140 includes a storage area 142 and an external data storage area 144. Yes. The control unit 110 and the information processing function unit 150 are preferably configured by a calculation unit such as a CPU and a software module. Note that a serial interface unit SI, which will be described later, an RFID module RFID connected to the control unit 110 via the serial interface unit SI, an infrared communication unit IR, a camera 180 and a light 190, a microphone, a radio module, a power source, and a power source A controller or the like is connected to the control unit 110, but is omitted here for simplification.

  The function of each block in the block diagram of FIG. 1 will be briefly described. The control unit 110 detects contact of an object such as a user's finger by the sensor unit 120, stores the detected information in the storage area 142 of the storage unit 140, and controls processing of the information stored by the information processing function unit 150. . Then, information corresponding to the processing result is displayed on the display unit 130. Although the effect will be described later in detail, the timer 112 measures the time since the display of the display unit 130 is started. The determination unit 114 determines whether the contact operation detected by the sensor unit 120 is a predetermined contact operation, and further determines whether the predetermined contact is completed within a predetermined time. Further, the control unit 110 controls the telephone function unit 160 for the normal call function, the key operation unit KEY, and the speaker SP. The display unit 130 includes a sub display unit ELD and a main display unit (not shown) (a display unit provided at a position where the mobile phone terminal 100 is hidden in the closed state and exposed in the open state).

  FIG. 2 is a perspective view of the mobile phone terminal 100 of the present embodiment in which the sensor element is mounted on the housing. In addition to the closed state as shown in FIG. 2, the mobile phone terminal 100 can form an open state by rotating and sliding the hinge portion, and the touch sensor unit 170 can be operated even in the closed state. Is provided. FIG. 2A is a perspective view showing the appearance of the mobile phone terminal 100. The cellular phone terminal 100 includes a touch sensor unit 170 (in terms of appearance, a panel PNL described later with reference to FIG. 3 covering the sensor unit 120, that is, the sensor elements G1 and G2), a camera 180, and a light 190. FIG. 2B illustrates the mobile phone terminal 100 according to the present embodiment in which the panel PNL is omitted and only the arrangement around the sensor element and the sub display unit ELD is displayed for explaining the operation of the touch sensor according to the present embodiment. It is a perspective view. As illustrated, the sensor elements L1 to L4 and R1 to R4 are arranged side by side along the periphery of the sub display unit ELD. The sensor elements R1 to R4 and L1 to L4 constitute a first sensor element group and a second sensor element group, respectively. The first sensor element group and the second sensor element group are arranged with the separation portions SP1 and SP2 therebetween. In contrast to the layout of the first sensor element group G1, the second sensor element group G2 has a line-symmetric layout with the display unit interposed therebetween and the direction in which the selection candidate items are arranged as a center line. In this embodiment, an organic EL display is used for the sub display unit ELD. However, for example, a liquid crystal display or the like can be used. In this embodiment, a capacitive contact sensor is used as the sensor element, but a thin film resistance contact sensor or the like can also be used.

  In the mobile phone terminal 100 of FIG. 2, the sub display unit ELD displays information according to the use of the mobile phone terminal 100. For example, when the mobile phone terminal 100 is used as a music player, the sub-display unit ELD displays a song that can be played. A combination of a song name and an artist name is one item, that is, a “selection candidate item”. The user operates the touch sensor unit 170 as an operation input unit to change the capacitances of the sensor elements R1 to R4 and L1 to L4, and moves items and operation target areas displayed on the sub display unit ELD. Select the song. At this time, if the touch sensor has a configuration in which sensor elements are arranged around the sub display unit ELD as shown in FIG. 2, it is not necessary to occupy a large mounting portion in the external housing of a small portable electronic device, and The user can operate the sensor element while viewing the display on the sub display unit ELD.

  FIG. 3 is an exploded perspective view showing a configuration around the display unit on which the cellular phone terminal 100 of the present embodiment shown in FIG. 2 is mounted. For ease of understanding, the members are shown separately in the order of construction. As shown in the figure, a donut-shaped panel PNL is arranged along the periphery of the display unit ELD made of organic EL elements. The panel PNL is preferably thin enough so as not to affect the sensitivity of the sensor element provided in the lower part. Under the panel PNL, eight capacitive elements L1-L4 and R1-R4 that can detect the contact of a human finger are arranged in a substantially ring shape. The left four sensor elements L1-L4 constitute a first sensor element group, and the right four sensor elements R1-R4 constitute a second sensor element group. A clearance (gap) is provided between adjacent sensor elements in each sensor element group so that adjacent sensor elements do not interfere with the contact detection function. Note that this clearance is not necessary when using a sensor element that does not interfere. Between the sensor element L4 located at one end of the first sensor element group and the sensor element R1 located at one end of the second sensor element group, a clearance larger than the clearance (for example, a length of twice or more). ) Is provided. Similarly to the separation portion SP1, the separation portion SP2 is provided between the sensor element L1 located at the other end of the first sensor element group G1 and the sensor element R4 located at the other end of the second sensor element group G2. Provide. Such separation portions SP1 and SP2 can prevent fingers from interfering with each other when the first sensor element group G1 and the second sensor element group G2 function separately.

  Each sensor element of the first sensor element group G1 is arranged in an arc shape, and the center of the tact switch SW1 is arranged in the center of the arc, that is, in the lower part between the sensor elements L2 and L3. Similarly, the tact switch SW2 is arranged at the center of the arc formed by the sensor elements of the second sensor element group G2, that is, at the lower part between the sensor elements R2 and R3. In this way, by arranging the tact switch substantially in the center in the arrangement direction of the sensor element group that is not associated with the directionality, the direction instruction by the movement instruction operation with the direction of the finger by the user on the sensor element is possible. The user can easily grasp that the switch is an operation that is not directly related. If the tact switch is arranged at the end (for example, L1 or L4) instead of the center of the arrangement direction of the sensor element group, the movement direction by the touch sensor is continued to remind the directionality toward the end side. It is easy to give the user a misunderstanding that it is a “switch” that is held down for a long time. On the other hand, if the tact switch is arranged in the center of the arrangement direction of the sensor element group as in the configuration of the present invention, such misunderstanding can be prevented and a more comfortable user interface can be provided. It is. In addition, since the tact switch is placed under the sensor element and is not exposed to the outside of the device, the number of operation parts that are exposed on the external appearance of the device can be reduced, and a smart impression that does not require complicated operation and Become. In addition, when providing in places other than switch panel PNL lower part, it is necessary to provide a through-hole separately in an apparatus housing | casing, However, A housing | casing intensity | strength fall may arise depending on the position which provides a through-hole. In this configuration, by disposing the tact switch below the panel PNL and the sensor element, it is not necessary to provide a new through-hole, and the housing strength can be prevented from being lowered.

  For example, when the user sequentially traces the sensor elements L1, L2, L3, and L4 upward in a circular arc shape with a finger, for example, selection candidate items displayed on the display unit ELD (for example, sound, display, data, camera, etc.) ), The items displayed as the selection target area (inverted display, highlighting in another color, etc.) are sequentially changed to the upper one, or the selection candidate items are scrolled upward. When a desired selection candidate item is displayed as the selection target area, the user presses the tact switch SW1 through the panel PNL and the sensor elements L2 and L3 to make a selection decision, or presses the tact switch SW2. The display situation can be changed to another screen. That is, the panel PNL is reversible enough to depress the tact switches SW1 and SW2, or is attached to the device housing so as to be slightly tiltable, and also has a pusher role for the tact switches SW1 and SW2. .

  FIG. 4 is a block diagram showing a more detailed configuration of the touch sensor function of the mobile phone terminal 100 of this embodiment described above. The mobile phone terminal 100 shown in the figure includes a touch sensor driver block TDB, a touch sensor base application block TSBA, a device layer DL, an interrupt handler IH, a queue QUE, an OS timer CLK, and various applications AP1 to AP3. Here, the touch sensor base application block TSBA includes a base application BA and a touch sensor driver upper application program interface API, and the touch sensor driver block TDB includes a touch sensor driver TSD and a result notification unit NTF. The device layer DL includes a switching control unit SWCON, a switching unit SW, a serial interface unit SI, an infrared communication unit IR, an RFID module RFID, and a touch sensor module TSM, and an interrupt handler IH includes a serial interrupt monitoring unit SIMON and a confirmation Part CNF.

  Next, the function of each block will be described with reference to the drawings. In the touch sensor base application block TSBA, whether or not to activate the touch sensor is exchanged between the base application BA and the touch sensor driver upper application program interface API. The base application BA is an application that is a base of the sub display unit display application AP1 that is an application for the sub display unit, the lock security application AP2 that is an application that locks the mobile phone terminal 100 for security protection, and other applications AP3. Yes, when activation of the touch sensor is requested from the respective applications to the base application BA, activation of the touch sensor is requested to the application program interface API higher than the touch sensor driver. The sub-display unit is a sub-display unit ELD shown in each drawing, and refers to a display unit surrounded by sensor elements in the mobile phone terminal 100 in this embodiment.

  The RFID module RFID is a non-contact type recognition device (tag) that uses proximity wireless communication, and generally includes a communication control circuit, an IC chip with a built-in memory, and an antenna. By performing wireless communication with a target host device (reader / writer) at a close distance, information in the memory can be read out or written in the memory. In recent years, the above-described circuit elements can be realized with a small one-chip IC, which is also called an IC tag. Electronic money can be handled by the mobile phone terminal of this embodiment equipped with this IC tag.

  In order to use such an electronic money function using the RFID module RFID safely, it is necessary to provide a security lock mechanism that prevents unauthorized use and impersonation of others by a password or the like and an application for that purpose (ie, lock security application AP2). . The mobile phone terminal according to the present invention has a touch sensor disposed on the outer surface of the housing, and the touch sensor can be operated in a state in which the housing is folded, and this is used as an operation unit for the security lock mechanism ( Details will be described later).

  Here, the detection operation by the touch sensor will be described. In response to the activation request, the touch sensor upper application program interface API confirms whether or not the touch sensor can be activated in a block (not shown) that manages the activation of the application in the base application BA. That is, it is set in advance that the touch sensor cannot be activated, such as lighting of the sub display unit ELD indicating that application selection is being performed, key locking, or FM radio or other applications attached to the mobile phone terminal 100. The presence or absence of a flag indicating the activation of the registered application is confirmed. As a result, when it is determined that the touch sensor module can be activated, the touch sensor upper application program interface API requests the touch sensor driver TSD to activate the touch sensor. That is, power supply from the power source PS to the touch sensor module TSM via the power source controller PSCON is substantially started.

  When the activation is requested, the touch sensor driver TSD requests the serial interface unit SI in the device layer DL to control to open a port with the touch sensor driver TSD in the serial interface unit SI.

  Thereafter, the touch sensor driver TSD outputs a signal having information on the sensing result of the touch sensor (hereinafter referred to as a contact signal) to the serial interface unit SI at a cycle of 20 ms by the internal clock of the touch sensor module TSM. To control.

  The contact signal is output as an 8-bit signal corresponding to each of the eight sensor elements R1 to R4 and L1 to L4. That is, when each sensor element detects a contact, a signal corresponding to the sensor element that has detected the contact is set with “flag: 1” indicating contact detection, and the contact signal is formed by these bit strings. Is done. That is, the contact signal includes information indicating “which sensor element” is “one of contact / non-contact”.

  The serial interrupt monitoring unit SIMON in the interrupt handler IH takes out the contact signal output to the serial interface unit SI. Here, the confirmation unit CNF confirms the True / False of the extracted contact signal in accordance with the condition set in advance in the serial interface unit SI, and puts only True signal data into the queue QUE (signal True). The type of / False will be described later.) The serial interrupt monitoring unit SIMON also monitors other interrupt events of the serial interface unit SI during activation of the touch sensor, such as occurrence of pressing of the tact switch.

  When the detected contact is the first contact, the monitoring unit SIMON puts a signal indicating “press” into the queue QUE (queuing) before the contact signal. Thereafter, the contact signal is updated at a cycle of 45 ms by the OS timer CLK of the operation system, and if no contact is detected a predetermined number of times, a signal indicating “release” is put in the queue QUE. This makes it possible to monitor the movement of contact detection between sensor elements from the start of contact to release. Note that “first contact” refers to an event in which a signal having “flag: 1” is generated when there is no data in the queue QUE or when the latest input data is “release”. Through these processes, the touch sensor driver TSD can know the detection state of the sensor element in the section from “press” to “release”.

  At the same time, when the contact signal output from the touch sensor is a signal that satisfies the condition of “False”, the monitoring unit SIMON generates a pseudo-signal indicating “release” and puts it in the queue QUE. Here, the conditions to be False (false) are “when contact is detected by two discontinuous sensor elements”, “when an interrupt occurs during activation of the touch sensor (for example, sub-display by notification such as incoming mail) "When the lighting / extinguishing state of the part ELD is changed)", "When a key press occurs while the touch sensor is activated", or "When contact across a plurality of sensor element groups is detected".

  In addition, for example, when the monitoring unit SIMON detects contact with two adjacent sensor elements such as the sensor elements R2 and R3 at the same time, the monitoring unit SIMON corresponds to the element that detects the contact as in the case of detecting a single element. The contact signal flagged in the bit to be put is put in the queue QUE.

  The touch sensor driver TSD reads a contact signal from the queue QUE at a period of 45 ms, and determines an element that has detected contact based on the read contact signal. The touch sensor driver TSD considers the change in contact determined by the contact signal sequentially read from the queue QUE and the positional relationship with the detected element, and “contact start element”, “contact moving direction (right / Counterclockwise) "and" the number of elements moved from press to release (ie, movement distance) ". The touch sensor driver TSD writes the determined result in the result notification unit NTF and notifies the base application BA to update the result.

  The determination of the moving direction and the moving distance of contact is performed by a combination of detection of adjacent sensor elements and detection of each sensor element, and various methods (determination rules) can be applied to this (details will be described later). ). For example, when a contact transitions from one sensor element (for example, R2) to an adjacent sensor element (in this example, R2 and R3), one element (for one item in the sub display unit) is moved in that direction. Judged to be moving.

  As described above, when the update of the result is notified to the base application BA by the touch sensor driver TSD, the base application BA confirms the result notification unit NTF, and further describes the content of the information notified to the result notification unit NTF. Notification is made to a higher-order application that requires a touch sensor result (such as a display unit display application AP1 for displaying a menu screen on the sub display unit and a lock security application AP2 for lock control).

  FIG. 5 is a schematic block diagram showing data processing of contact detection by each sensor element in the mobile phone terminal 100 of the present embodiment. For simplicity of explanation, only the sensor elements R1 to R4 are shown, but the same applies to the sensor elements L1 to L4. A high frequency is applied to each of the sensor elements R1 to R4, and calibration is performed in consideration of a change in a certain stray capacitance, and the high frequency state at this time is set as a reference. (R1 pre-processing unit 200a, R2 pre-processing unit 200b, R3 pre-processing unit 200c, R4 pre-processing unit 200d) detects a change in a high-frequency state based on a change in capacitance due to finger contact or the like Then, it is transmitted to the A / D converter 210 (A / D converter 210a for R1, A / D converter 210b for R2, A / D converter 210c for R3, A / D converter 210d for R4), It is converted into a digital signal indicating contact detection. The digitized signals are transmitted to the control unit 220, and the information held by the signals is stored in the storage unit 230 as a set of collected signals as a sensor element group. Thereafter, this signal is sent to the serial interface unit and the interrupt handler. The interrupt handler converts the signal into a signal that can be read by the touch sensor driver, and puts the converted signal in a queue. Note that the control unit 220 detects the direction when contact is detected by two or more adjacent sensor elements based on the information stored in the storage unit 230. Although FIG. 5 shows an example in which the control unit 220 and the storage unit 230 dedicated to sensor element detection are provided, these units may be shared with the control unit 110 and the storage unit 140 of FIG.

  FIG. 6 is a schematic diagram illustrating the transition of the display unit when setting the security unlock condition in the mobile phone terminal 100 of the present embodiment. When handling the electronic money in the mobile phone terminal 100 of the present embodiment, it is necessary to set / release the security lock in order to prevent the use of others. The user can determine in advance a “predetermined touch operation” in the touch sensor, which becomes a password for setting / releasing the security lock. Here, the predetermined contact operation is a contact operation such as “trace the touch sensor one turn clockwise” or “trace the touch sensor two turns counterclockwise”. The user can set an arbitrary password by a combination of these predetermined contact operations. That is, it is possible to create a password that can be understood only by the user. Hereinafter, the setting of the security unlock condition will be described as an example with reference to the drawings. First, menu items such as the screen D1 are displayed on the display unit. The user can select an item by using a touch sensor or other suitable key (key operation unit), and in this case, the user selects “No. 4” “security”. Next, the screen D2 is displayed to prompt the user to select a security unlock condition. Here, a case where the first “touch sensor” is selected will be described. Next, a pattern tracing the touch sensor, such as screens D3 and D4, is presented. The screen D3 is an example of “one turn clockwise”, and the screen D4 is an example of “one turn left”. In addition, patterns such as “one turn left” and “two turns clockwise” are presented on the display unit. The user can select a pattern with a touch sensor or other suitable key (key operation unit), and create a combination to be used as a password. After determining the combination, the screen D5 is displayed to prompt the user to press the enter key for password confirmation. When the enter key is pressed, the screen D6 is displayed to notify the user that the setting has been completed.

  7 to 9 are schematic diagrams for explaining the operation of each block with the passage of time and the operation of the display unit associated therewith in the cellular phone terminal 100 of the present embodiment. Hereinafter, the present embodiment will be described with reference to the drawings for the case of releasing the security lock. In the figure, a code starting with the initial letter ST indicates an operation step, and a code starting with the initial letter T indicates time. FIG. 7A illustrates the operation of each block as time elapses when a predetermined contact operation is not completed within a predetermined time, and FIG. 7B illustrates the operation of the display unit associated therewith. FIG. In FIG. 6, the case has been described in which the password for unlocking the security lock is set by operating the key operation unit from the menu items displayed on the display unit (display) that appears when the mobile phone terminal 100 is opened. 7 to 9, the security lock is released by operating the sub display unit ELD and the touch sensor 170 provided on the outer surface of the housing while the mobile phone terminal 100 is in the closed state. As described above, the cellular phone terminal 100 can enter the security unlock mode even when the casing is closed. Although the menu is displayed as shown in FIG. 6 and selection can be repeated on the menu as appropriate to shift to the security unlock mode, the tact switch SW1-4 shown in FIG. Any one of these buttons may be previously assigned to the “jump button for security lock release mode”, for example, by long pressing any one of them, or by simultaneously pressing two of these tact switches. Thereby, the user can shift to the security unlock mode by a simple operation.

  The user operates the touch sensor while viewing the display on the display unit ELD to set the mobile phone terminal 100 to the security unlock mode. That is, in the mobile phone terminal 100, when contact of the touch sensor is detected by the detection unit (step ST11), the control unit determines an application (mode) to be executed from the output data (step ST12), and according to the determination. Instruct the upper layer to update the application. Actually, steps ST11 and ST12 are repeated until the user operates the touch sensor to reach the security unlock mode, but the figure shows a case where a contact immediately before reaching the security unlock mode is detected. . When the security lock release mode is entered, the control unit instructs the display unit to start the display operation and also instructs the time measuring unit to start measuring time (step ST13). Upon receiving the instruction, the display unit displays a message such as “Please enter your password” as shown in the screen D11, for example, and starts counting time (step ST14). This time is T11. Thereafter, the control unit determines a detection operation from the queued data until a predetermined time elapses (step ST15). As a result of the operation determination, if the operation for releasing the lock is not detected even after a predetermined time has elapsed, the control unit instructs the display unit to stop the display operation and stops the timing unit. (Step ST16). Upon receiving the instruction, the display on the display unit disappears as shown in the screen D12, and the time measurement stops (step ST17). At the same time, the control unit instructs the detection unit to stop detection. This time is T12. Here, the “predetermined time” is defined in advance based on the operation target application and the power consumption when displaying information for the application. For example, when the display unit is a display composed of self-luminous elements such as organic EL elements, the average luminance of pixel data to be displayed, the number of frames per second, the scheduled display time, and the consumption of pixel-luminance Power consumption can be calculated based on current correlation data. Specifically, in the case of unlocking according to the present embodiment, [3 seconds] is set in consideration of the time required for the user to complete the operation of the touch sensor. In the example shown in the figure, the “predetermined time” is [T12−T11].

  Here, the determination operation in step ST15 is performed based on whether or not the contact operation by the user has reached a predetermined “predetermined contact operation”. The “predetermined touch operation” can be specified for each application, or can be arbitrarily specified by the user. The user tries the touch operation for the application, and the user has the intention to continue the operation. Set a value that can be considered as something. For example, when the unlocking operation is set to “6 laps” detection of “one round of the touch sensor (right / left rotation)”, the contact detection is performed based on “3 laps” of the “half”. As a result, if it is less than 3 laps, it is considered that the unlocking operation has not been detected. In this case, the reference may be “two-thirds or more”, for example, and it may be determined whether “four rounds” is detected. As a result of the determination, a case where the predetermined contact operation is completed will be described later.

  FIG. 8A is a diagram for explaining the operation of each block as time elapses when a predetermined contact operation is completed within a predetermined time, and FIG. 8B is a diagram for explaining the operation of the display unit associated therewith. As in FIG. 7, when contact of the touch sensor is detected by the detection unit (step ST <b> 21), the control unit determines an application (mode) to be executed from the output data (step ST <b> 22). Instruct the layer to update the application. In the figure, a case is shown in which a contact immediately before reaching the security unlock mode is detected. When entering the security unlock mode, the control unit instructs the display unit to start the display operation, and also instructs the time measuring unit to start measuring time (step ST23). In response to the instruction, the display unit displays a message such as “Please enter your password” as shown on the screen D21, for example, and starts counting time (step ST24). This time is T21. Thereafter, when contact is detected by the detection unit (step ST25), the output data is queued. The control unit determines a detection operation from the queued data before a predetermined time elapses (step ST26). If the detected contact operation matches the password as a result of the determination, for example, a message notifying the user that the password has been recognized such as “released” shown on the screen D22 is displayed on the display unit. After that, the control unit requests the upper layer to update the application after the password is released, and a “menu screen” such as a screen D23 is displayed on the display unit. This time is T22. In this way, when the predetermined contact operation is completed, the control unit resets the previous time after the predetermined time has elapsed, and instructs the time measuring unit to newly start timing, and displays Is instructed to extend the display (step ST27). Thereafter, the time measuring unit starts measuring time for which the display operation of the display unit is extended (step ST28). This time is T23. In the example shown in the figure, the “predetermined time” is [T23-T21].

  FIG. 9 shows a case where a predetermined contact operation is not completed within a predetermined time. Unlike the case described in FIG. 7, a contact is detected, but the contact operation is different from the password release operation. It is a figure explaining operation | movement of each block and a display part. As in the case described above, when the touch sensor detects contact (step ST31), the control unit determines an application (mode) to be executed from the output data (step ST32). Instruct the upper layer to update the application. In the figure, a case is shown in which a contact immediately before reaching the security unlock mode is detected. When entering the security unlock mode, the control unit instructs the display unit to start the display operation, and also instructs the time measuring unit to start measuring time (step ST33). Upon receiving the instruction, the display unit displays a message such as “Please enter your password” as shown in the screen D31, for example, and starts counting time (step ST34). This time is T31. Thereafter, when contact is detected by the detection unit (step ST35), the output data is queued. The control unit determines a detection operation from the queued data until a predetermined time elapses (step ST36). As a result of the operation determination, if the detected contact operation does not match the password, the control unit displays a message such as “Password is wrong, please enter again” on the display unit, for example, screen D32. This time is T32.

  Thereafter, the control unit resets the previous time after a predetermined time has elapsed, and instructs the timing unit to newly start timing, and instructs the display unit to extend the display ( Step ST37). Thereafter, the time measuring unit starts measuring the time for which the display operation of the display unit is extended (step ST38). This time is T33. After that, similarly, it is determined whether or not a predetermined contact operation, that is, a touch sensor contact operation by the user is completed within a predetermined time, and the control unit will explain, for example, in FIG. 8 when the predetermined contact operation is completed. If the control is not completed, the control is performed as described with reference to FIG. In this example, it is assumed that the predetermined contact operation has not been completed as shown in FIG. When the operation for releasing the lock, that is, the touch sensor contact is not detected even after the predetermined time has elapsed, the control unit instructs to stop the display operation of the display unit, and also counts the time to the timing unit. An instruction to stop is given (step ST39). Upon receiving the instruction, the display on the display unit disappears as shown in screen D33, and the time measurement stops (step ST40). At the same time, the control unit instructs the detection unit to stop detection. This time is T34. In the case of this example, the first “predetermined time” after the password release is started is [T33-T31], and the second “predetermined time” after extending the first predetermined time. Is [T34-T33].

  So far, the touch sensor contact detection at the time of password release has been described, but the same control is performed when the mobile phone terminal 100 is used as a music player. That is, when the user selects a music list to be played back, a predetermined contact operation is defined in advance as “half circle” of the touch sensor, and the touch sensor contact is detected within a predetermined time (for example, 5 seconds). If the contact does not reach the half of the touch sensor even if contact is detected, it is assumed that the user has no intention to make a selection, and the display on the display unit is the same as in the above-described embodiment. It is something that stops.

  Here, the contact detection method of the touch sensor according to the present invention will be described. FIG. 10 is a conceptual diagram showing the sensor element detection state divided into 16 so as to determine not only a single element detection state but also a multiple element detection state in which two adjacent elements are further detected. is there. Although it is substantially the same as the structure of FIG. 3, it is the structure which provided the tact switch between the 1st sensor element group G1 and the 2nd sensor element group G2. That is, a tact switch SW3 is newly provided between the sensor element L4 and the sensor element R1, and a tact switch SW4 is newly provided between the sensor element R4 and the sensor element L1. If the detection states of the eight sensor elements are managed one by one, the eight detection states can be managed. However, in the eight detection states, since the number of states, that is, state changes are small, it is not possible to perform very precise control. For example, in the case of the tact switch SW1 arranged across the sensor elements, when the tact switch SW1 is pressed, contact with the sensor elements L2 and L3 is detected first. There is a fear. That is, when the sensor elements L2 and L3 are detected in this order, the upward movement instruction is given regardless of the tact switch SW1 pressing operation for some determination instruction, and the operation target area is set to “1” upward. There is a possibility that the selection operation by depressing the tact switch SW1 is finalized after “displacement”, and an unintended item is instructed to be determined.

  In order to appropriately process the pressing process of the tact switch SW1-4, there is a method of holding the confirmation of the movement instruction until two or three detection state changes (movements) are detected in the 16 detection states. is there. A method of discarding the detection state (result) of the sensor element up to that point when the tact switch has been pressed can be considered, and will be described in detail below with reference to a flowchart.

  FIG. 11 is a flowchart showing an example of the movement confirmation process (that is, the hold process) in the 16 detection states, and this flowchart every time it is detected that any one detection state occurs in the queue QUE. Processing is performed by the touch sensor driver TSP. A position (any one of 16 detection states) first detected from the released state is set as the first reference point. From this reference point, the current detection position (detection state newly entered in the queue QUE), and the previous detection position (previous detection state remaining in the queue QUE), the movement distance (detection state) Transition). As shown in the figure, in step K10, it is determined whether or not the previous position has been released. If it is determined that it has been released (the previous data remaining in the queue QUE is “release”), the process proceeds to step K12, and whether or not the current detection position has been released (ie, newly entered) Whether or not the data is “release”). If it is determined that the current detection position has been released, the process ends. If not, the process proceeds to step K14, where the reference point and the previous detection position are set as the current detection position.

  If it is determined in step K10 that the previous position has not been released (that is, if another detection has occurred and the current detection follows), the process proceeds to step K16, where the current detection position is It is determined whether or not it has been released (that is, whether or not the newly input signal is “release”). If it is determined that the current detection position is released, the reference point and the previous detection position are initialized (cleared), and the process ends (step K18). If it is determined in step K16 that the current detection position has not been released, the distance between the previous detection position and the current detection position is calculated (step K20), and is the calculated distance 1 or 2? It is determined whether or not (step K22). If it is determined that the calculated distance is not 1 or 2 (that is, 3 or more), the sensor element is skipped and it is determined that the detection state is discontinuous (step K24), and the reference point is set to the current detection position. Set (step K26), proceed to step K36. If it is determined that the distance calculated in step K22 is 1 or 2, the distance between the current detection position and the reference point is calculated (step K28). In addition, since the calculation of the distance indicates the detection position for each sensor element by the signal put in the queue QUE, the number of the 16 detection states between the previous detection position and the current detection position. The touch sensor driver TSD determines whether there is a difference in minutes.

  Further, it is determined whether or not the distance calculated in step K28 is 2 or 3 (step K30). If the condition is not satisfied (that is, 4 or more), the process proceeds to step K36 as an error, and the condition is satisfied ( If the distance is 2 or 3, the movement is confirmed (step K32). That is, the first touched position is set as the “reference point”, and then the “previous position” is updated when contact is continuously detected without being “released”, and finally the latest detected position “ Only when it is determined that “current position” is “moved 2 or 3” with respect to the reference point, it is determined that “there is movement”. Further, since the single element detection state and the multiple element detection state are continuously detected, it is determined that the movement is “2”. Therefore, on the sensor element, the sensor element is not used until the above “2 movement”. One finger is moved. The next reference point is set to a position that is moved by two in the movement direction from the previous reference point (step K34), and the process proceeds to step K36. In step K36, the “previous detection position” is set to the “current detection position” for the next process, and the process ends.

  When the tact switches SW1 to SW4 are pressed, the previous detection position and reference point set at the time of pressing detection are initialized (cleared). Next, a process when the tact switch in FIG. 10 is pressed will be described using the movement confirmation process in the flowchart. When the tact switch SW1 is pressed, if the detection state transitions in the order of “L2 detection state” and “L2-L3 detection state”, only one detection state transitions (moves / changes) at this time. Therefore, the movement is not fixed. When the finger is released after the tact switch SW1 is pressed, the detection state may transition in the order of “L2-L3 detection state” and “L3 detection state”. At this time, if the detection state until the tact switch is pressed is held, two detection states transition in the order of “L2 detection state”, “L2-L3 detection state”, and “L3 detection state”. Although the movement may be confirmed, as described above, since the past detection result is discarded when the tact switch SW1 is pressed, the erroneous detection when the finger is released is prevented. Therefore, when the tact switch is released, it is not erroneously recognized as a movement instruction of the sensor element.

  Alternatively, when the tact switch SW1 is released, the detection state may transition in the order of “L2 detection state” and “L2-L3 detection state”. Even if the detection result before the tact switch is pressed is discarded, the sensor element may be touched again when the tact switch is released. However, even in such a case, according to the processing of the flowchart of FIG. 11, only one detection state is changed, so that it is erroneously recognized as a sensor element movement instruction when the tact switch is released. There is no.

  FIG. 12 is a diagram for explaining a determination process when the process of the flowchart of FIG. 11 is applied to the contact from the sensor elements L1 to L4 of FIG. As shown in the figure, the detection state changes are “L1 detection”, “L1-L2 detection”, “L2 detection”, “L2-L3 detection” “L3 detection”, “L3-L4 detection”, “L4 detection”. It becomes. That is, the single element detection state, the multiple element detection state, and L1 to L4 are repeatedly detected. First, the first “L1 detection” is set to the reference point BP1 (K14). Next, when “L1-L2 detection” occurs, since the previous position is not “release” but “L1 detection”, the previous position is compared with the current position detected this time (K20). Here, it is validated because it is the movement of one frame from L1 to “L1-L2”, and this time, the reference point is compared with the current position (K28). Here, since both the reference point and the previous position are set to the same L1, the movement amount is still one frame, and the movement is not confirmed at this stage, and the L1-L2 detection state of the current position is set to the previous position PP1. (K36).

  Further, if “L2 detection” occurs without “release” in the middle, the previous position is “L1-L2 detection”, so the previous position is compared with the current position CP1 detected this time (K20). . Here, the movement is one frame from L1-L2 to L2, which is valid because the determination condition “1 or 2?” Is satisfied. Next, the reference point is compared with the current position (K28). Since the reference point is set to the same L1 as in the L1 detection again this time, the positional relationship with L2 is two frames, so the movement amount is determined to be two frames (K30). The movement is confirmed for the first time here (K32). Then, for the next determination, the reference point BP2 is set to a point where two frames are shifted in the moving direction from “L1 detection”, that is, “L2 detection” is set (K34), and the previous position is set to the current position “L2 detection”. The setting process 1 is completed again.

  In this way, the touch sensor driver determines the movement “1” by detecting the transition of the detection state of two frames. That is, when the movement is confirmed in step K32, the movement direction component (clockwise direction from L1 to L4, ie, the direction from SP2 to SP1) and the movement of “1” and the movement of “1” are stored in the result notification unit NTF. The update of the storage content is notified to the application, and the base application extracts the update content and notifies the sub display unit display application AP1 and the like. If the sub display unit display application AP1 is in use, a movement amount of “1” is given to the “direction from bottom to top” based on the movement direction component. The display of the part ELD is changed. By the way, in the same manner as in the determination process 1, the detection states of the second sensor element group R1-R4 are continuously detected as “R4-R3 detection” and “R3 detection” from the “R4 detection” state. Even when the transition is made, the touch sensor gives the sub-display unit display application AP1 via the base application information on the “direction from the bottom to the top” and the movement amount of “1” based on the movement direction component. On the screen display of the list display, the operation target area changes from the item LS4 to LS3 as in the operation in the first sensor element unit.

  Next, a case where the finger movement continues without “release” subsequent to the confirmation process 1 will be described. As in the case of the confirmation process 1, as shown in the confirmation process 2 in the figure, the detection state from the reference point BP2 is “L2-L3 detection” as the previous position PP2, and “L3 detection” is the current position CP2. Since the distance between the reference point BP2 and the current position CP2 is two frames, the movement “1” is further determined. That is, the movement of the total “2” is confirmed by both the confirmation process 2 subsequent to the confirmation process 1. Then, for further subsequent processing, the reference point is changed with “L3 detection” two frames ahead from the reference point BP2 “L2 detection” as a new reference point BP3.

  Similarly, as shown in the confirmation process 3 in the figure, the detection state advances two frames from the reference point BP3, and “L3-L4 detection” is set to the previous position CP3, and “L4 detection” becomes the current position CP3. At that time, since the distance becomes two frames, “1” movement is further confirmed, and a total of “3” movements are confirmed together with the confirmation processes 1 and 2. In this way, a total of “3” moves are notified to the application.

  As the display on the sub display part ELD, the sub display part display application AP1 is notified of the movement confirmation of “1” twice in the “direction from bottom to top” following the confirmation process 1. The operation target area changes from LS3 to LS1 that has moved "2" upward. Here, not only the detection of a single element detection state but also a detection state of a plurality of elements is detected and the detection state is subdivided, but the movement amount determined by the movement of two state transitions is “ As a result, in the case of a sensor element composed of four sensor elements as in the example, the movement confirmation of a maximum of “3” is finally performed. In other words, in the case where the number of sensor elements is four and the movement is confirmed only by single element detection, the final amount of movement is very approximate, but only the single element is accurately positioned. Even if it is not touched, a movement amount of “3” at the maximum can be ensured, and inaccurate operation by the user can be dealt with in a form that meets the user's wishes without causing any reaction. In this way, when an item is selected by the touch sensor and the tact switch is subsequently pressed, the key detection driver prompts the determination instruction by pressing the donut-shaped panel that is in contact with the touch sensor during operation. Since it can be given to an in-use application such as a sub display unit display application via the user interface, a more comfortable user interface with less finger movement for the user is provided.

  In the case of a sensor element group composed of “4” sensor elements, “3”, which is obtained by subtracting “1” for the sensor element that comes into contact first, is the maximum movement determination amount. Therefore, when displaying the selection items on the sub display unit ELD as a list, it is preferable that the sub display unit display application displays the selection items of “4” rows, which is the same number as the number of sensor elements “4”. By performing display control in this way, contact detection is first performed on the sensor elements L1 and R4 at the bottom (SP1 side), and when contact detection continues to the top (SP2 side), the movement of “3” is confirmed. Is supplied to the sub-display unit display application, the selection target area moves from the lowermost level (LS4) to the uppermost level (LS1). That is, since the maximum movement from the bottom to the top is the maximum movement from the bottom to the top on the display, the movement operation to the touch sensor coincides with the movement display on the sub display unit ELD. It is possible to provide a user interface that is very easy to grasp the operation content.

  Furthermore, since the first sensor element group and the second sensor element group are arranged in a symmetrical form with the sub display unit ELD interposed therebetween, the same operation instruction can be given regardless of which one is operated. In addition, since the end portions are arranged side by side, for example, when the contact detection state is shifted clockwise from the sensor element L1 to the detection state of the sensor element R4, the following is displayed on the sub display unit ELD. Such a display change occurs. That is, when the operation target area moves from the lowermost stage LS4 to the uppermost stage LS1 from the detection of L1 to the time point of L4, and subsequently the detection state transitions from R1 to R4, the operation target area changes from the uppermost stage LS1 to the lowermost stage LS4. Will return. As a result, the user can give an up / down direction when selecting a selection item or return the operation target area to the original position without removing the finger even once, which is highly comfortable for the user. A feeling of operation can be given.

  In addition, when the user carrying the mobile phone performs an operation in a place where vibration is likely to occur, there may be a case where the finger leaves the touch sensor for a moment during movement of the finger due to external vibration. In such a case, if a rough detection method that detects only movement by detecting only the number of sensor elements is used to detect movement, detection omissions are unlikely to occur, but not only single element detection but also multiple element detection In the case of a precise detection method that also detects the state, it is conceivable that even if the instruction is momentarily left, the detection state may be skipped because the finger continues to rotate. However, if the distance between the previous position and the current position is 1 or 2 in step K22, the continuous movement detection state is established even if two movements have been made from the previous position, that is, even if one is skipped from the previous position. Because it can be handled, it can be as close as possible to the user's desired action even under vibration.

  In step K30, not only 2 frames but also 3 frames are valid. Therefore, even when the finger is momentarily detached due to vibration or when a detection state is detected by a quick operation, it moves. Operation can be detected. In addition, when detecting the amount of movement for three frames, not only is the amount of movement “1” fixed as in the case of the next two frames, but the setting of the reference point for the next detection is the same as when moving two frames. Since only two frames are moved relative to the previous reference point, even when movement is confirmed by detecting three frames, an amount of movement confirmation of “n−1” obtained by subtracting 1 from the number n of sensor elements is secured. This makes it possible for the user to obtain a stable operation feeling of the same operation feeling regardless of how the user touches.

  Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and corrections based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, functions included in each member, each means, each step, etc. can be rearranged so as not to be logically contradictory, and a plurality of means, steps, etc. can be combined or divided into one. Is possible. In the embodiment, the description has been made using the capacitive sensor as the touch sensor, but the touch sensor is not limited to this system. For example, there are touch sensors such as a thin film resistance method that detects contact by measuring current fluctuation by detecting contact between a plurality of thin film electrodes, but the present invention is realized even if such a touch sensor is used. Is possible. For example, in the embodiment, the sensor element layout provided in an annular shape has been described. However, sensor element groups arranged in a U-shape may be arranged to face each other with the display unit interposed therebetween. Moreover, although the sensor element group was demonstrated in the Example of arrangement | positioning on either side, you may comprise in upper and lower 2 groups. Furthermore, in the embodiments, the description has been made with reference to a mobile phone terminal, but a mobile wireless terminal other than a telephone, a PDA (Personal Digital Assistance), a portable game machine, a portable audio player, a portable video player, a portable electronic dictionary, a portable electronic The present invention can be widely applied to portable electronic devices such as a book viewer. In the embodiment, the capacitance type contact sensor is used as the sensor element. However, the thin film resistance type described above, the optical method for detecting the contact based on the fluctuation of the amount of received light, and the contact by the attenuation of the surface acoustic wave. You may use the sensor element of the SAW system to detect, and the electromagnetic induction system sensor which detects a contact by generation | occurrence | production of an induced current. Some types of contact sensors use an indicator such as a dedicated pen other than a finger, but the principle of the present invention can also be applied to portable electronic devices equipped with such contact sensors. .

It is a block diagram which shows the outline | summary of the mobile telephone terminal of a present Example. It is a perspective view of the mobile telephone terminal of a present Example. It is a disassembled perspective view which shows the structure of the display part periphery mounted in the mobile telephone terminal of a present Example. It is a block diagram which shows the structure of the touch sensor function of the mobile telephone terminal of a present Example. It is a schematic block diagram of the data processing of the contact detection by each sensor element in the mobile phone terminal of the present embodiment. It is the schematic explaining the transition of the display part at the time of setting the lock release conditions in the mobile telephone terminal of a present Example. FIG. 5 is a schematic diagram for explaining the operation of each block with the passage of time and the operation of the display unit associated therewith when a predetermined contact operation is not completed within a predetermined time in the mobile phone terminal of the present embodiment. . It is the schematic explaining the operation | movement of each block with progress of time when the predetermined | prescribed contact operation is completed within the predetermined time in the mobile telephone terminal of a present Example, and the operation | movement of the display part accompanying it. FIG. 5 is a schematic diagram for explaining the operation of each block with the passage of time and the operation of the display unit associated therewith when a predetermined contact operation is not completed within a predetermined time in the mobile phone terminal of the present embodiment. . It is the conceptual diagram which divided and showed the sensor element detection state to 16. It is a flowchart which shows an example of the movement confirmation process in 16 detection states. It is a figure explaining the determination process at the time of applying the process of the flowchart of FIG. 11 to the contact to the sensor elements L1 to L4 of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Mobile phone terminal 110 Control part 112 Timing part 114 Determination part 120 Sensor part 130 Display part 140 Storage part 142 Storage area 144 External data storage area 150 Information processing function part 160 Telephone function part 170 Touch sensor 180 Camera 190 Light 200 Pre-processing system 210 A / D converter 220 Control unit 230 Storage unit KEY Key operation unit SP Speaker ELD Sub display unit PNL Panels R1 to R4 Sensor elements L1 to L4 Sensor elements G1 to G3 Sensor element groups SP1 and SP2 Separation units SW1 to SW4 Tact switch AP1 to AP3 Application BA Base application SI Serial interface unit SWCON switching control unit COM Communication unit SW switching unit IR Infrared communication unit RFID RFID module TSM Touch sensor module QUE Queue CNF Confirmation unit NT Result notification unit SIMON Serial interrupt monitoring unit IH Interrupt handler DL Device layer CLK OS timer TSD Touch sensor driver TDB Touch sensor driver block TSBA Touch sensor base application block API Application program interfaces D1 to D6 Display units D11 to D33 Display units BP1 to BP3 Reference points PP1 to PP3 Previous position CP1 to CP3 Current position

Claims (5)

A detection unit for detecting contact with the touch sensor and movement of the contact position as a contact operation;
A display unit;
A timekeeping unit for measuring the time during which the display unit performs a display operation;
A determination unit that determines whether or not the detection unit has completed detection of a predetermined contact operation within a predetermined time after the time measurement unit starts counting;
As a result of the determination by the determination unit, when the predetermined contact operation is not completed within the predetermined time, the display unit stops the display operation after the predetermined time elapses and the detection unit When the predetermined contact operation is completed within the predetermined time, the display operation of the display unit is continued by extending the predetermined time, and the extended predetermined time is controlled. a control unit for controlling the so that to stop detection of the detection unit and stops elapsed and the display operation of the display unit,
A portable electronic device comprising: When the predetermined contact operation is not completed within the predetermined time as a result of the determination by the determination unit, the control unit considers that the contact operation detected before is not detected. The portable electronic device according to claim 1, wherein The predetermined contact operation includes at least a first contact operation and a second contact operation,
Even if the predetermined contact operation is not completed within the predetermined time, the control unit, when the first contact operation is completed among the predetermined contact operations within the predetermined time, 3. The portable electronic device according to claim 1, wherein control is performed such that the display operation of the display unit is continued by extending the predetermined time. 4. The predetermined contact operation is an operation for releasing the lock,
When the lock is released, the control unit performs the display operation of the display unit after the predetermined time has elapsed even if the predetermined contact operation is not completed within the predetermined time. The portable electronic device according to any one of claims 1 to 3, wherein the portable electronic device is not controlled so as to stop and stop detection by the detection unit. A method for controlling a portable electronic device comprising: a detection unit that detects contact with a touch sensor and movement of the contact position as a contact operation; and a display unit,
A step of determining whether or not the detection unit has completed detection of a predetermined contact operation within a predetermined time after the display unit starts a display operation;
As a result of the determination, when the predetermined contact operation is not completed within the predetermined time, the display operation of the display unit is stopped and the detection of the detection unit is stopped after the predetermined time has elapsed. When the predetermined contact operation is completed within the predetermined time, the display operation of the display unit is continued by extending the predetermined time, and the display is performed when the extended predetermined time elapses. and controlling the so that to stop detection of the detecting unit stops the display operation parts,
A method for controlling a portable electronic device, comprising:

Images