JP4679342B2 - Virtual key input device and information terminal device - Google Patents

Description

The present invention relates to a virtual key input device and an information terminal equipment, more particularly, a virtual key input device such as a virtual keyboard or a touch panel, and the portable telephone and information such as a portable information terminal having the virtual key input device about the terminal equipment.

  In addition to a key input device that uses a physical input device such as a keyboard or numeric keypad as a device for inputting characters, numbers, etc. to a data terminal device, a touch panel that displays keys on the screen and detects and inputs touches There is an input device (also called a soft keyboard).

  In recent years, there is a virtual keyboard (also referred to as a virtual keyboard) that projects a keyboard onto a plane and uses the projected keyboard as an input device (see, for example, Non-Patent Document 1). As illustrated in FIG. 5, the virtual keyboard described in Non-Patent Document 1 detects a red semiconductor laser module 21 for projecting a keyboard image, a holographic optical element provided in the light emission direction, and key detection. It comprises an infrared (invisible) semiconductor laser projection module 22c and a CMOS camera module 22a.

  First, an infrared laser emitted from the red semiconductor laser module 21 is emitted to the holographic optical element, whereby the laser is dispersed and a keyboard image is projected. This unit simply projects a keyboard image and has nothing to do with key detection. The infrared semiconductor laser projection module 22c emits an infrared laser for position detection that is invisible to humans in a fan shape parallel to a projection surface such as a desk. The CMOS camera module 22a detects the reflected light of the laser emitted from the infrared semiconductor laser projection module (light reflected by the finger) with the CMOS camera and detects the position where the key image is pressed.

  Patent Document 1 discloses a virtual keyboard system that displays a keyboard image on a display device and displays the position of an operator's finger so that an operation corresponding to input can be performed. The system includes a reference sensor that is attached at a predetermined position and has a virtual keyboard reference position set, a fingertip sensor that detects a relative position of the fingertip that performs key input and a fingertip movement, and a key of the virtual keyboard. The first display means for displaying the top image, the second display means for displaying the position of the fingertip detected by the fingertip sensor on the displayed keytop image, and the key input is performed by the detection signal from the fingertip sensor. Input key detecting means for detecting the detected key and identifying the key at the position of the fingertip displayed in the key top image, and an input key code for generating a key code of the detected input key and transmitting it to the computer application device Generating means.

Since these virtual key input devices (also referred to as virtual input devices) do not require a physical key, there is an advantage that the information terminal device can be reduced in size, and in the future, especially when mounting on portable information terminal devices proceeds. Conceivable.
JP 2000-242394 A Tanaka, “Qwerts Clinic Virtual Keyboard”, [online], December 5, 2004, [August 4, 2005 search], Internet <URL: http: // park16. wakwak. com / ˜ex4 / kb / main_vkb. htm>

  However, since portable information terminal devices are usually lightweight, they are easily affected by vibrations from the surroundings. Even if the information terminal device is not portable, the information terminal device is somewhat affected by vibrations from the surroundings. As a result, in an information terminal device provided with a virtual key input device such as a virtual keyboard or a touch panel (soft keyboard), erroneous input is likely to occur due to the influence of vibration.

  As described above, none of the conventional techniques including Non-Patent Document 1 and Patent Document 1 considers the influence of vibration, and erroneous input may occur due to the influence of vibration.

The present invention has been made in view of the above circumstances, a virtual key input device in which erroneous input is unlikely to occur even when subjected to vibration from the surroundings, and a mobile phone or mobile information including the virtual key input device providing an information terminal equipment of the terminal such as its purpose.

In order to solve the above-described problem, the first technical means of the present invention is a key display means for displaying one or more key images, and each of the key images displayed by the key display means is designated by the user. And a designated key detecting means for detecting this, and a virtual key input device using the information corresponding to the key image detected by the designated key detecting means as input information, and detecting the movement of the virtual key input device itself Determining whether the motion detected by the motion detector exceeds a predetermined level, and if it is determined that the motion exceeds the predetermined level, a correction candidate for the input information is determined. A candidate presenting means for presenting, and an input deciding means for allowing the user to selectively input from among the correction candidates presented by the candidate presenting means, and the correction candidates selected and inputted by the input deciding means It is obtained by, characterized in that said input information.

The second technical means is an information terminal device with a charger provided with the virtual key input device in the first technical means, wherein the key display means is provided on the main body side of the information terminal device, and the designated key detection means Is provided on the charger side, and transmitting means for transmitting information detected on the charger side to the main body side is provided.

A third technical means is an information terminal device with a charger provided with the virtual key input device in the first technical means, wherein the key display means is provided on the main body side of the information terminal device, and the designated key detection means Are distributed on the charger side and the main body side.

  According to the present invention, when a virtual key input device is used, erroneous input is less likely to occur even if it receives vibration from the surroundings.

  FIG. 1 is a block diagram illustrating a configuration example of an information terminal device including a virtual key input device according to an embodiment of the present invention. In FIG. 1, 1 is an information terminal device, 10 is a virtual key input device, and 11 is a Key display means, 12 is designated key detection means, 13 is output means, 14 is motion detection means, 15 is motion compensation means, 16 is various processing means, KI is a keyboard image, and kI is an individual key image.

  The virtual key input device according to the present invention can be called a virtual input device or a virtual key input device, and as exemplified by the virtual key input device 10 of FIG. 1, a key display means 11, a designated key detection means 12, and a motion detection means. 14, and preferably motion compensation means 15.

  The key display means 11 is means for displaying a keyboard image KI having a plurality of key images kI. The keyboard image KI is an arrangement of a plurality of key images kI. However, the keyboard image KI is not necessarily arranged in the form of a so-called keyboard. For example, an image of several input buttons may be simply arranged. Good.

  The designation key detection means 12 detects that each key image kI in the keyboard image KI displayed by the key display means 11 is designated by the user. That is, the designated key detecting means 12 detects that a certain key image kI is selected by the user with a finger or the like.

  The virtual key input device 10 uses the information (code or key code) corresponding to the key image kI detected by the key designation detection means 12 as input information, and the output terminal 13 includes, for example, the information terminal device 1 in which the device 10 is incorporated. Output to the main body side. Note that the output unit 13 only needs to be able to control such that it can be transmitted through a predetermined transmission path. Based on the output input information, various processes such as character display and storage are executed by various processing means 16 in the main body of the information terminal device 1.

  The key display means 11 and / or the designated key detection means 12 may be configured to start processing when no movement is detected after the movement detection means 14 detects the movement. In this way, in the information terminal device 1 provided with the projection-type key display means 11 in particular, by starting the key display and key detection for the projection and the like described later after no impact is detected, that is, after the stationary state is reached. , Can prevent erroneous input.

  The motion detector 14 which is the main feature of the present invention detects the motion of the virtual key input device 10 itself. The motion detection means 14 is a movement amount detection means for detecting the movement amount of the virtual key input device 10 itself (actually, for example, the movement direction and the movement amount in that direction), or an impact applied to the virtual key input device 10 itself. What is necessary is just to provide the impact detection means which detects this, and to detect a motion. Here, as the movement amount detection means, a camera and an image taken by the camera are subjected to image analysis to obtain a movement amount by comparison with the background, a capacitance type multi-axis acceleration sensor, or virtual When the key input device is independent of the information terminal device, the amount of movement is measured by a change in distance by a physical connection means equipped with a means for measuring the distance to the information terminal, such as a measure, etc. However, it is not limited to this. Further, the impact detection means can be said to be an impact detection means, and there are cases where the main part is constituted by such a movement amount detection means. As described above, the motion detection unit 14 in the present invention may be any device that can detect physical phenomena such as movement amount, impact, vibration, and tilt.

  The motion compensation unit 15 executes a predetermined process for compensating for the motion based on the motion detected by the motion detection unit 14. Here, although the predetermined process is described later, it also includes a process of finally stopping the process in order to compensate for the motion. In short, it is sufficient that the motion compensation unit 15 can execute a process according to the detection result. The motion compensation means 15 can be implemented as a program for incorporating the virtual key input device 10 as described above and causing the arithmetic processing unit of the virtual key input device 10 to function as the motion compensation means 15. Similarly to the motion compensation unit 15, the units 11 to 14 and 16 can be realized by incorporating a part of them into the apparatus as a program. The present invention can also adopt a form as a computer-readable recording medium in which these programs are recorded.

  Further, instead of the motion compensation means 15 described above and later, motion may be compensated by processing such as control stop on the information terminal device 11 side. That is, the motion compensation means 15 may be provided on the main body side of the information terminal apparatus 1, and the output means 13 in this case does not transmit the control stop code to the main body side of the information terminal apparatus 1. Instead, the motion detection result of the motion detection means 14 is simply transmitted.

  According to the virtual key input device 10 and the information terminal device 1 including the virtual key input device 10 according to the present invention, it is difficult for erroneous input to occur even when receiving vibration from the surroundings. That is, the user interface as the virtual key input device 10 according to the present invention is less affected by vibrations from the surroundings, can prevent and correct erroneous input, and is a conventional user interface that does not consider the effects of vibrations. It can be said that the performance has been greatly improved.

  As another embodiment of the present invention, the motion compensation unit 15 may be configured to include a determination unit that determines whether or not the motion detected by the motion detection unit 14 exceeds a predetermined level (threshold). preferable. And the motion compensation means 15 should just perform a predetermined process, when it determines with the determination means exceeding a predetermined level. When the motion detection means 14 is a motion detection sensor (movement amount detection sensor or impact detection sensor), this determination means is substantially incorporated in the motion detection sensor as a detection threshold and threshold determination means. This threshold value is a threshold value for the purpose of controlling the operation according to the magnitude of the impact, for example. By providing such a determination means, for example, the above-described predetermined processing need not be executed with a small amount of movement such as camera shake.

  FIG. 2 is a block diagram illustrating a configuration example of a portable information terminal device including a virtual key input device according to another embodiment of the present invention, and is a block diagram illustrating an example of the information terminal device of FIG. 3 is a block diagram showing an example of the configuration of a virtual key input device (virtual input operation unit) in the portable information terminal device of FIG. 2, and FIG. 4 is a schematic diagram showing the appearance of the portable information terminal device of FIG. FIG. 5 is a schematic diagram for explaining key display means and designated key detection means applied to the portable information terminal device of FIG.

  Examples of the portable information terminal device 2 in FIG. 2 include a PDA (Personal Digital Assistant), a mobile phone, a mobile PC, and the like. The mobile phone 2 includes a virtual input operation unit 20, a wireless unit 31, a communication control unit 32, an image processing unit 33, an imaging unit 34, a nonvolatile memory 35, a volatile memory 37, and a light emitting unit as an example of the virtual key input device 10. 38, a display driver 39, an operation unit 40, a display unit 41, a microphone (microphone) 42, a speaker 43, and a main control unit 36 for controlling them.

  The mobile phone 2 performs wireless communication by controlling the wireless unit 31 connected to the antenna with the communication control unit 32. The image capturing unit 34 is a camera for taking a photograph, and an image captured by the image capturing unit 34 is subjected to image processing by an image processing unit 33 and stored in a nonvolatile memory 35 or the like. The light emitting unit 38 is formed of a light emitting diode (LED) or the like, and is used for representing an incoming call or during communication, and assisting image capturing in the imaging unit 34. The volatile memory 37 is used as a buffer memory for the image processing unit 33, the main control unit 36, and the display driver 39. The display driver 39 is a driver for displaying an image on the display unit 41 such as a liquid crystal display device. The microphone 42 and the speaker 43 are mainly used at the time of a call, the microphone 42 is also used at the time of inputting other voices, and the speaker 43 emits a voice at the time of content reproduction or an incoming call.

  In addition, the operation unit 40 is a user operation unit including numeric keys and function keys that enable input of 1 to 9 and alphabets, and is used for inputting a telephone number or an email sentence. This is an operation unit different from the virtual input operation unit 20 according to the present invention. Although it is preferable that the virtual input operation unit 20 enables basically the same user input as that of the operation unit 40, it is possible to input in place of the operation unit 40 particularly for inputting mail text that is difficult to operate due to a size problem. It should be possible.

  The virtual input operation unit 20 illustrated in FIGS. 3 to 5 includes a key image projection unit 21, a camera 22a, a key input determination unit 22b, a position detection laser projection unit 22c, an impact detection unit 24, and a control unit that controls them. 23. Therefore, in this example, an image projecting unit that projects the keyboard image KI is used as the key display unit 11 described above. When this form is adopted, the above-described virtual key input device 10 (and the virtual input operation unit 20) corresponds to a so-called virtual keyboard.

  Further, in this example, the above-described designation key detection unit 12 includes a detection light projection unit and a reflected light detection unit. The detection light projection means is a means for projecting detection light (marker) for detecting a position designated by the user, and can be said to be a position detection marker projection means. The reflected light detection means is means for detecting a predetermined level of reflected light from the obstacle as reflected light from the position of the key image kI designated by the user with respect to the detection light projected by the detection light projection means. It can be said that it is an imaging means.

  For example, the virtual keyboard described in Non-Patent Document 1 may be applied. As the detection light projection means, the key image projection unit 21 can be applied as illustrated in FIG. In the example of FIG. 5, the key image projection unit 21 may be a red semiconductor laser module 21 for projecting a keyboard image and a holographic optical element provided in the light emission direction.

  In addition, as illustrated in FIG. 3, a camera 22a, a key input determination unit 22b, and a position detection laser projection unit 22c can be applied as reflected light detection means. For example, the infrared (invisible) semiconductor laser projection module 22c illustrated in FIG. 5 can be applied as the position detection laser projection unit 22c, and the CMOS camera module 22a illustrated in FIG. 5 can be applied as the camera 22a. The key input determination unit 22b detects the reflected light of the laser emitted by the infrared semiconductor laser projection module captured by the CMOS camera module 22a (light reflected by the finger) as a position where the key image is pressed, Determine whether there is key input.

  The mobile phone 2 illustrated in FIG. 4 can be folded between the display unit 41 and the operation unit 40, and the virtual input operation unit 20 operates the mobile phone 2 to display the result on the display unit 41. In the case of making it, the main body with the operation unit 40 is placed on a desk as illustrated, and the display unit 41 side is set up so that the user can visually recognize it. Then, the keyboard image KI is projected from the key image projection unit 21 disposed on the display unit 41 of the mobile phone 2. In this state, the laser is emitted from the position detection laser projection unit 22c disposed on the lowermost side surface of the mobile phone 2 as illustrated in FIG. 5B, and illustrated in FIG. 5C. In this way, it is detected that the user touches a key image kI with the finger F by detecting the reflected light of the laser with the camera 22a disposed on the display unit 41, and the display unit 41 detects the key image. Displays the key characters (1-9, A-Z, etc.) meaning kI. As shown in FIG. 4, the camera 22a may serve as the imaging unit 34 for taking a picture, but may be configured separately.

  In addition, you may employ | adopt the structure regarding the key display and designation | designated key detection which were described in prior arts including the patent document 1. FIG. Further, as an alternative to the above-described detection light projection means and reflected light detection means, it is conceivable to detect the position of a finger on the projected keyboard using an image recognition technique. When the image projecting unit is used, it is preferable that the motion detecting unit 14 is a unit that detects a motion in the vicinity of the projection source of the image projecting unit because a more accurate motion of the key image KI can be predicted.

  The key display means 11 may be an image display means for displaying a keyboard image KI on a display screen (touch panel) (not shown). When this form is adopted, the virtual key input device 10 is a so-called software. It corresponds to the keyboard. The designated key detecting means 12 in this embodiment is a pressed position detecting means for detecting the position pressed by the user on the display screen (on the touch panel) as the position of the key image kI specified by the user. Here, naturally, pressing includes both touching. Further, as the pressed position detection means, a conventional pressure-sensitive type or electrostatic type may be applied, as long as the touch position of the user can be detected and output.

  FIG. 6 is a flowchart for explaining a processing example of the virtual key input device according to another embodiment of the present invention, and is a flowchart showing an input processing example in the virtual input operation unit 20 of FIG. When the user himself / herself or another person hits the virtual input operation unit 20 (the mobile phone 2 equipped with the same) during input using the virtual input operation unit 20, the virtual key input device 10 moves and the input position (that is, the keyboard image KI) Position) changes. However, when the input speed of the user is fast, there is a possibility that the input is performed at the input position before the virtual input operation unit 20 moves, that is, the keyboard image KI projected before the movement by the key image projection unit 21. is there. In such a case, the input processing example illustrated in FIG. 6 is effective.

  First, when the impact detection unit 24 detects an impact (YES in step S1), it is determined by the determination means whether the impact is equal to or greater than a threshold value (step S2). If the result of determination in step S2 is that the impact is greater than or equal to the threshold value, the key input determination unit 22b determines whether or not there is a key input by the user (step S3). (Step S4). The invalidation of the key input in step S4 is executed by stopping the output from the output unit or stopping the laser projection of the position detection laser projection unit 22c.

  After invalidating the key input, it is determined whether or not a certain period has elapsed (step S5). When the certain period has elapsed, the key image projecting unit 21 restarts the projection of the keyboard image KI and the like. It is validated (step S6). In this processing example, in this way, when the mobile phone 2 detects an impact, the key itself is invalidated to prevent erroneous input.

  In order to realize the virtual input operation unit 20 described with reference to FIG. 6, the motion compensation unit 15 may include an input invalidation unit as described with the virtual key input device 10 described with reference to FIG. 1. This input invalidation means invalidates the input in the virtual key input device 10 when the motion detection means 14 detects a motion as the determination result by the determination means.

  FIG. 7 is a flowchart for explaining a processing example of the virtual key input device according to another embodiment of the present invention, and is a flowchart showing an example of input processing in the virtual input operation unit 20 of FIG. As described above, when the input speed of the user is fast, there is a possibility that the input will be performed at the input position before the virtual input operation unit 20 moves. In such a case, the input processing example illustrated in FIG. It becomes effective.

  First, when the impact detection unit 24 detects an impact (YES in step S11), it is determined by the determination means whether the impact is equal to or greater than a threshold value (step S12). If the result of determination in step S12 is that the impact is greater than or equal to the threshold, projection of the keyboard image KI by the key image projection unit 21 is stopped (stopped) (step S13). After stopping the projection of the keyboard image, it is determined whether or not a certain period has elapsed (step S14). When the certain period has elapsed, the projection of the keyboard image KI is resumed (step S15). In this processing example, in this way, when the mobile phone 2 detects an impact, the key display is stopped to prevent erroneous input.

  In order to realize the virtual input operation unit 20 described with reference to FIG. 7, when described with the virtual key input device 10 described with reference to FIG. 1, the motion compensation unit 15 includes an input invalidation unit similar to the mode described with reference to FIG. 6. Good. This input invalidation means invalidates the input in the virtual key input device 10 when the motion detection means 14 detects a motion as the determination result by the determination means.

  Assume that the input invalidation means described in FIG. 7 includes means for canceling the display of the keyboard image KI by the key display means 11. In particular, when the key display unit 11 is a projection type display unit, the display of the virtual key input device 10 (projection or the like) is stopped based on the motion detection, so that the user himself / herself or others may be caused by the projection type glare. You don't have to feel uncomfortable. However, if the display of the keyboard image KI alone is stopped, there is a possibility that the user moves his / her finger immediately after the stop, so that the key detection by the designated key detection means 12 should also be stopped at the same time.

  FIG. 8 is a flowchart for explaining a processing example of the virtual key input device according to another embodiment of the present invention, and is a flowchart showing an example of input processing in the virtual input operation unit 20 of FIG. As described above, when the input speed of the user is fast, there is a possibility that the input will be performed at the input position before the virtual input operation unit 20 moves. In such a case, the input processing example illustrated in FIG. It becomes effective.

  First, when the impact detection unit 24 detects an impact (YES in step S21), a movement amount (basically a movement amount in two directions) due to the impact is calculated (step S22). Next, it is determined by the determining means whether or not the movement amount calculated in step S22 is greater than or equal to a threshold value (step S23). If the amount of movement is greater than or equal to the threshold value as a result of the determination in step S23, the key input determination unit 22b determines whether or not there is a user key input (step S24).

  If it is determined in step S24 that there is an input, the position correction input mode is turned on (step S25). When the position correction input mode is on, it is assumed that another key image kI separated from the key input key image kI by the calculated movement amount (movement vector) is designated, and information on the key corresponding to the image is displayed. Output. Specifically, in the case of a QWERTY keyboard, assuming that the virtual input operation unit 20 receives an impact and moves to the right at the moment when an attempt is made to input “S”, the virtual input operation unit 20 has been pressed. 20 can prevent erroneous input by detecting the amount of movement and inputting “S” which was actually intended by the user.

  After the position correction input mode is turned on, it is determined whether or not a certain period has elapsed (step S26). When the certain period has elapsed, the position correction input mode is turned off (step S27). In this processing example, when the mobile phone 2 detects an impact in this way, the movement amount is calculated, position correction according to the movement amount is performed, and the input at the position before the movement is recognized. This prevents erroneous input. Further, as in other embodiments, the threshold for determination regarding time, a predetermined period, or the like may be changed based on the input speed of the user.

  In order to realize the virtual input operation unit 20 described with reference to FIG. 8, as described with reference to the virtual key input device 10 described with reference to FIG. The motion correction unit converts the key image kI (for example, the key “F”) detected by the designated key detection unit 12 into another key image kI (for example, the adjacent key image kI) according to the motion detected by the motion detection unit 14. It is corrected that the key “S”) is detected. That is, the motion correction unit automatically corrects the result detected by the designated key detection unit 12 from the actually detected key image to another key image corresponding to the motion detected by the motion detection unit 14. The result corrected here is output as input information. When this motion correction unit is used in combination with the above-described determination unit, the motion correction may be performed only when there is a motion exceeding a predetermined level after the determination by the determination unit.

  The automatic correction input in the motion correction means described above is, for example, the calculation of the movement direction and the movement amount according to the movement detected by the movement detection means 14, and the movement direction and movement amount (may be a movement amount in two directions). The other key image kI corresponding to the position that has been returned is automatically input. Here, the movement detection means 14 may detect the movement direction and the movement amount itself, and the result may be used for automatic input.

  In addition, the motion compensation unit 15 described above may not include automatic correction input, and may include a candidate presentation unit and an input determination unit. The candidate presenting means presents correction candidates for other key images kI on the display unit 41 or the like as character input information so as to be understood by the user according to the motion (for example, movement amount) detected by the motion detecting means 14. . For example, if the input phrase does not make sense, the conversion candidate is presented as a conversion candidate with the amount of movement taken into account. Then, the input determining means causes the user to select and input from among the correction candidates presented by the candidate presenting means, and as a result, the correction candidates selected and input by the input determining means are output as input information. When this candidate presentation means and input determination means are used in combination with the above-described determination means, the candidates may be presented only when there is a movement exceeding a predetermined level after the determination by the determination means.

  In another embodiment, the motion compensation unit 15 preferably includes an input correction unit. The input correction means automatically corrects the input information by estimating the input information from, for example, previously input characters when the movement detection means 14 detects the movement. Here, the fact that the movement is detected is regarded as an erroneous key image kI being detected by the designated key detection means 12. As this input correction means, the character conversion function of the dictionary unit may be used. In other words, if the input word or phrase does not make sense, the input is corrected, for example, corrected and presented as something that makes sense. When this input correction unit is used in combination with the above-described determination unit, input correction may be performed only when there is a movement exceeding a predetermined level after determination by the determination unit.

  Further, the motion compensation unit 15 described above may not include the input correction unit, and may include a candidate presentation unit and an input determination unit. The candidate presenting means presents correction candidates for the input information as character input information (information on designated characters on the keyboard, etc.) so that the user can understand the movement detected by the motion detecting means 14. Here too, the fact that the motion is detected is regarded as an erroneous key image kI being detected by the designated key detection means 12. Examples of the correction candidates include input conversion candidates. For example, if the input word / phrase does not make sense, what is considered to be correct may be presented as the conversion candidate. Then, the input determining means causes the user to select and input from among the correction candidates presented by the candidate presenting means, and as a result, the correction candidates selected and input by the input determining means are output as input information. When this candidate presentation means and input determination means are used in combination with the above-described determination means, the candidates may be presented only when there is a movement exceeding a predetermined level after the determination by the determination means.

  As another embodiment, it is preferable that the motion compensation unit 15 includes a warning presenting unit that presents a warning to the user when a motion is detected by the motion detection unit 14 as a determination result by the determination unit. . Furthermore, it is preferable that the warning presenting means includes one or more of the following display changing means, warning sound output means, and display color change instruction means.

  The display change means is means for changing the display of the keyboard image KI by the key display means 11, and includes, for example, changing the color or display content of the keyboard, displaying a warning, or the like. The warning sound output means is a means for emitting a warning sound, and includes a speaker 43 and means for outputting an audio signal thereto.

  The display color change instruction means is a means for outputting information for making the display color of the key image kI different from the normal color as well as information on the designated key image kI as the detection result of the designated key detection means 12. In the form having the display color change instruction means, the display unit 41 as an example of the information display means sequentially displays the input information, and the key image information designated by the designation key detection means 12 and the key. Information that makes the display color of the image different from the normal color is displayed on the display unit 41 as input information. By changing the display color of the input information based on the impact detection by the display color change instruction means, it is possible to suggest the possibility of erroneous input. When changing the display color, the normal input is blue, and after confirmation is black, it may be red when an impact is detected. If so, delete it.

  As another embodiment of the present invention, the motion compensation unit 15 is a return unit that returns to the previous state when the motion detection unit 14 detects a motion as the determination result of the above-described determination unit (also referred to as a return instruction unit). It is preferable to have. This return means is a means for outputting an instruction or the like for returning the display state on the display unit 41 to the display state before the impact is detected. The return means may execute the instruction after a predetermined time has elapsed after detecting the impact, or may execute the instruction after inputting a certain number (a certain number of times) of keys. The return means may be based on an operation of a release button displayed on the display unit 41 or the keyboard image KI.

  Further, the return means may include input position return means. In the form having the input position return means, the display unit 41 as an example of the information display means displays the input information sequentially, and the current input position on the display is indicated by a mark such as a cursor or a color difference. Keep as shown. That is, the input position refers to a position such as a position where a character is currently input on a sentence, as represented by a cursor position. Since the input position return means indicates to the user when the movement is detected by the movement detection means 14, the display position of the display position on the display section 41 of the input information for the key image that has been determined to be input last at the detection time. Immediately after that, the input position of the cursor or the like is restored. However, the term “return” here may be processing such as returning in units of words when returning to the original state.

  The input position return means includes key input number calculation means for calculating the number of key inputs after the movement is detected by the motion detection means 14 and returning the input position of the cursor or the like by the calculated number of key inputs. May be. Further, the input position return means may make the display method for returning the input position such as the cursor different from the normal display method. For example, when the cursor is displayed, the display color is changed or the blinking pattern is changed depending on whether it is normal or restored.

  Specifically, when the user is about to input “Shinjuku top play to 10 o'clock tomorrow”, the user contacts between “Shinjuku” and “top play”, for example, “tomorrow 10 Suppose that "Shinjuku Jona sometimes" is entered, and character input is stopped at that time. In this case, “Shinjuku Jonah at 10:00 tomorrow” is output to the display unit 41 side by the output means. In the form without the input position return means described above, the display cursor after the input stop is behind “NA” even if the movement is detected. However, in the embodiment including the input position return means described above, the input position is detected after “Shinjuku” (before “Jona”) when the movement is detected by the input position correction means. Can be corrected. Therefore, the user can make a correct input from there. “Jona” may be deleted when a new input is made at the cursor position.

  As another embodiment of the present invention, when the motion compensation means 15 detects motion with the motion detection means 14 as a result of determination by the above-mentioned determination means, the motion is generated based on the detection reference by the designation key detection means 12. It is preferable to have means for a later position. In particular, the virtual input operation unit 20 capable of detecting the movement amount may include a means for changing the position after detecting the impact to the reference input position. As a result, it is possible to perform key input based on the input position after movement. If the keyboard image KI is moved to a position where it is difficult for the user to input due to the impact, the keyboard image KI is returned to the original position where the user can easily input again. . As described above, since the user may return the position immediately, the change may be performed after a certain period of time, and the reference setting may be executed from the initial position to the position returned without performing unnecessary reference setting in the middle. preferable. The reference position may be changed after a certain number (a certain number of times) of key inputs, or the reference position may be changed by operating the release button displayed on the display unit 41 or the keyboard image KI. . In the former case, key input up to a certain number may be ignored.

  The information terminal device 1 according to the above embodiment uses the virtual key input device 10 as one of input means, and uses the input result for at least one process (one means of various processing means 16). . However, in the present invention, as an application form of the virtual key input device, the one illustrated in FIG. 9 can be adopted. In addition, as an installation position of the motion detection means 14, it is provided in parts other than the virtual key input device 10 in the information terminal device 1, and detects the motion of the information terminal device 1 itself as a motion of the virtual key input device 10 itself. May be.

  FIG. 9 is a schematic diagram for explaining three examples of a virtual key input system according to another embodiment of the present invention. The virtual key input system illustrated in FIG. 9 uses the charger 3 for the information terminal device (illustrated by the mobile phone 2). The power source related to the key input used in the charger 3 may be obtained from an outlet or, conversely, from the main body of the mobile phone 2. When the virtual key input device 10 includes the projection-type key display means 11, part or all of the virtual key input device 10 can be easily incorporated on the charger 3 side. Moreover, although the example of illustration is an example which rotated the screen part from the closed position to the viewer position, and inserted in the charger 3, the example of illustration is not restricted to this. Further, a means not described such as the motion compensation means 15 may be provided in either the mobile phone 2 or the charger 3.

  The system illustrated in FIG. 9A is a mobile phone 2 with a charger provided with a virtual input operation unit 20. In this system, a charger 3 is provided as a charging means for charging the mobile phone 2, and a transmission means (not shown) for transmitting information input by the virtual input operation unit 20 to the mobile phone 2 is provided. As the transmission means, if communication means such as Bluetooth is provided in the charger 3, input information can be transmitted to the main body of the mobile phone 2.

  In this system, the key display unit 11 (key image projection unit 21) is provided on the main body side of the mobile phone 2, and the designation key detection unit 12 (camera 22a, key input determination unit 22b, and position detection laser projection unit 22c). ) Are distributed on the charger 3 side and the main body 2 side. In particular, as the designated key detection means 12, a camera 22a (an example in which the imaging unit 34 is substituted) is provided on the main body 2 side, and a key input determination unit 22b and a position detection laser projection unit 22c are provided on the charger 3 side. The key input determination unit 22b may be provided on the main body 2 side.

  The system illustrated in FIG. 9B is a mobile phone 2 with a charger provided with a virtual input operation unit 20. In this system, a key display unit 11 (key image projection unit 21) is provided on the main body side of the mobile phone 2, and a designation key detection unit 12 (camera 22a, key input determination unit 22b, and position detection laser projection unit 22c) is provided. Transmitting means (not shown) as described above is provided on the charger 3 side and transmits information detected on the charger 3 side to the main body 2 side. The key input determination unit 22b may be provided on the main body 2 side.

  The system illustrated in FIG. 9C is a charger including the mobile phone 2 and the virtual input operation unit 20. In this system, a key display unit 11 (key image projection unit 21) and a designated key detection unit 12 (camera 22a, key input determination unit 22b, and position detection laser projection unit 22c) are provided on the side of the charger 3, and the charger Transmitting means (not shown) as described above for transmitting information detected on the 3 side to the main body 2 side is provided. The key input determination unit 22b may be provided on the main body 2 side.

  As described above, in the present invention, for example, an information terminal including a virtual key input device is further provided with a means for detecting an impact, and when an impact is detected, the input is invalidated or the projection / display of the key display means is stopped. By doing so, it becomes possible to prevent erroneous input.

It is a block diagram which shows the example of 1 structure of the information terminal device provided with the virtual key input device which concerns on one Embodiment of this invention. It is a block diagram which shows the example of 1 structure of the portable information terminal device provided with the virtual key input device which concerns on other embodiment of this invention. It is a block diagram which shows one structural example of the virtual key input device (virtual input operation part) in the portable information terminal device of FIG. It is the schematic which shows the external appearance of the portable information terminal device of FIG. It is the schematic for demonstrating the key display means and designation | designated key detection means which were applied to the portable information terminal device of FIG. It is a flowchart for demonstrating the process example of the virtual key input apparatus which concerns on other embodiment of this invention. It is a flowchart for demonstrating the process example of the virtual key input apparatus which concerns on other embodiment of this invention. It is a flowchart for demonstrating the process example of the virtual key input apparatus which concerns on other embodiment of this invention. It is the schematic for demonstrating three examples of the virtual key input system which concerns on other embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Information terminal device, 2 ... Portable information terminal device (cellular phone), 3 ... Charger, 10 ... Virtual key input device, 11 ... Key display means, 12 ... Designated key detection means, 13 ... Output means, 14 ... Movement Detection means, 15 ... motion compensation means, 16 ... various processing means, 20 ... virtual input operation section, 21 ... key image projection section, 22a ... camera, 22b ... key input determination section, 22c ... laser projection section for position detection, 23 DESCRIPTION OF SYMBOLS ... Control part, 24 ... Impact detection part, 31 ... Radio | wireless part, 32 ... Communication control part, 33 ... Image processing part, 34 ... Imaging part, 35 ... Non-volatile memory, 36 ... Main control part, 37 ... Volatile memory, 38 ... Light emitting unit, 39 ... Display driver, 40 ... Operation unit, 41 ... Display unit, 42 ... Microphone (microphone), 43 ... Speaker, KI ... Keyboard image, kI ... Key image.

Claims (3)

Key display means for displaying one or more key images, and designation key detection means for detecting that each of the key images displayed by the key display means is designated by the user, and detected by the designation key detection means A virtual key input device using information corresponding to the key image as input information,
The motion detection means for detecting the motion of the virtual key input device itself, and whether or not the motion detected by the motion detection means exceeds a predetermined level, is determined to exceed the predetermined level A candidate presenting means for presenting correction candidates for the input information, and an input deciding means for allowing the user to selectively input correction candidates presented by the candidate presenting means. A virtual key input device, wherein the correction candidate is used as the input information. An information terminal device with a charger comprising the virtual key input device according to claim 1 , wherein the key display means is provided on the main body side of the information terminal device, and the designation key detection means is provided on the charger side. An information terminal device with a charger, comprising a transmission means for transmitting information detected on the charger side to the main body side. An information terminal device with a charger comprising the virtual key input device according to claim 1 , wherein the key display means is provided on a main body side of the information terminal device, and the designation key detection means is connected to the charger side and the charger. An information terminal device with a charger, wherein the information terminal device is provided dispersed on the main body side.

Images