JP7102996B2 - Program, information processing device and handwriting input judgment method - Google Patents

Description

The present invention relates to a program, an information processing device, and a handwriting input determination method.

A technique has been proposed for enabling overwriting input of handwriting on a display screen including display elements such as icons and software keyboards displayed on a touch panel of a smartphone or the like.

Japanese Unexamined Patent Publication No. 09-319502 Japanese Unexamined Patent Publication No. 2005-092583 Japanese Unexamined Patent Publication No. 2005-08542 Japanese Unexamined Patent Publication No. 2010-176190 Japanese Unexamined Patent Publication No. 2011-186792 US Patent Application Publication No. 2011/0066984

However, in the prior art, the input of the handwriting is required, for example, an intentional operation is required to overwrite the handwriting, or one character is required to be input before the overwriting of the handwriting is automatically determined. It is considered that there is room for improvement in operability.

Therefore, on one aspect, it is an object of the present invention to improve the operability of inputting handwriting on the display screen.

In one embodiment, the program determines whether or not the interval between the input time of each of the plurality of inputs to the display screen and the input time of the immediately preceding input is within a predetermined time, and is within the predetermined time. Regarding the shape of the locus of each input before and after the interval, it is determined whether or not the degree of deviation from the straight line is less than the threshold value, and the relative positional relationship of the locus of each input whose degree is less than the threshold value is determined. Based on this, the computer is made to execute a process of determining whether or not each of the inputs is a handwriting input.

As one aspect, it is possible to improve the operability of inputting handwriting on the display screen.

It is a figure which shows the hardware configuration example of the smart terminal 10 in embodiment of this invention. It is a figure for demonstrating the judgment condition of handwriting input. It is a figure which shows the functional structure example of the smart terminal 10 in embodiment of this invention. It is a flowchart for demonstrating an example of the processing procedure executed by smart terminal 10. It is a figure which shows the structural example of the coordinate string information of an input locus. It is a figure which shows the example of the input locus which is determined to be exceptionally linear. It is a flowchart for demonstrating an example of the processing procedure of the handwriting input processing.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing a hardware configuration example of the smart terminal 10 according to the embodiment of the present invention. In FIG. 1, the smart terminal 10 has a CPU 101, a memory 102, an auxiliary storage device 103, a touch panel 104, and the like.

The auxiliary storage device 103 stores programs and the like installed in the smart terminal 10. The memory 102 reads and stores the program from the auxiliary storage device 103 when the program is instructed to start. The CPU 101 realizes the function related to the smart terminal 10 according to the program stored in the memory 102.

The touch panel 104 is an electronic component having both an input function and a display function, and displays information, accepts input from a user, and the like. The touch panel 104 includes a display device 111, an input device 112, and the like.

The display device 111 is a liquid crystal display or the like, and is responsible for the display function of the touch panel 104. The input device 112 is an electronic component that includes a sensor that detects contact of a contact object with the display device 111. The contact detection method of the contact object may be any known method such as an electrostatic method, a resistance film method, or an optical method. The contact object means an object that comes into contact with the contact surface (surface) of the touch panel 104. Examples of such an object include a user's finger, a dedicated or general pen, and the like.

An example of the smart terminal 10 is a smartphone, a tablet terminal, a PC (Personal Computer), or the like. Further, a touch pad may be used instead of the touch panel 104. That is, an input device that is an electronic component that does not include a display device and has a contact surface may be used.

It is considered that the drag scrolling operation for an application that can be dragged up / down / left / right (hereinafter referred to as "application") such as a home application on the smart terminal 10 has the following features a to c.
Features a) The locus is straight and does not bend significantly.
Feature b) Continuous drag scrolling is performed at approximately the same position (horizontal or vertical position).
Feature c) Left and right scrolling and up and down scrolling are rarely mixed frequently.

In the present embodiment, in view of these characteristics related to the drag scroll operation, an input operation that is considered not to normally occur in an operation of an application or the like is referred to as a handwriting overwrite input (hereinafter referred to as "handwriting input") on a display screen. ), It is possible to automatically discriminate the handwriting input with high accuracy and at an early timing after the start of input.

Based on the features a to c, the smart terminal 10 determines that an input satisfying any of the following conditions A to C is a handwriting input. In the following, the input locus means one locus from the start to the end of the input of the locus.

FIG. 2 is a diagram for explaining a determination condition for handwriting input. In FIG. 2, (A) to (C) correspond to the condition A, the condition B, and the condition C in order.

The condition A is that a locus with a certain degree of bending or more is input as shown in FIG. 2 (A). That is, the condition A is a condition based on the feature a. Whether or not there is bending above a certain level can be determined by various methods such as a method of measuring linearity by the least squares method and a method of calculating the curvature of a locus. , Not limited to a particular method. By setting the threshold value to a degree of bending that does not occur in normal UI operations (for example, drag scrolling), it is possible to determine whether or not the condition A is met.

Condition B is that when both of the two consecutively input loci are linear, the interval between the input times of the two loci is Ts or less for a certain period of time, and the difference between the positions of the two loci. (That is, the distance) is greater than or equal to the threshold. FIG. 2B shows two linear trajectories that are somewhat separated. That is, the condition B is a condition based on the feature b. Various methods can be considered as the method for measuring the distance, but the method applicable to the present embodiment is not limited to a specific method. For example, in the circumscribed rectangle of the two loci, a method is conceivable in which the larger of the horizontal and vertical intervals is set as the distance between the two loci. In the example of FIG. 2B, the interval of the vertical method is measured as the distance. The threshold value for the distance should be set to be larger than the average distance when the linear locus is quickly input twice in the normal UI operation. The threshold value may be statistically obtained from, for example, the average and standard deviation of the distances between the two loci when the linear locus is quickly input twice in a normal UI operation. "Quickly twice" means that the input time interval between the input loci is within Ts. In the present embodiment, it is determined that the locus that does not correspond to the condition A is linear.

Condition C is that when both of the two consecutively input loci are linear, the interval between the input times of the two loci is Ts or less for a certain period of time, and the difference between the directions of the two loci. (Difference in inclination) is above a certain level. FIG. 2C shows two linear trajectories whose directions are substantially vertical. That is, the condition C is a condition based on the feature c. The direction of the locus is not the traveling direction of the locus (the direction from the start point to the end point), but the slope of the line drawn by the locus. Various methods can be considered as a method of linearly approximating the locus, and examples thereof include a least squares method and a straight line connecting the start point and the end point. However, the method applicable to this embodiment is not limited to a specific method. As for the threshold value of the difference in direction, there is a method of statistically obtaining the threshold value of the two loci when the linear locus is quickly input twice in the normal UI operation.

Therefore, it is determined that the input locus as shown in FIG. 2D is not a handwriting input.

In the condition (B) and the condition (C), when both of the two consecutively input loci are linear, the interval between the input times of the two loci is Ts or less for a certain period of time. Moreover, it can be generalized as that the relative positional relationship between the two loci satisfies a predetermined condition.

FIG. 3 is a diagram showing a functional configuration example of the smart terminal 10 according to the embodiment of the present invention. In FIG. 3, the smart terminal 10 includes a coordinate sequence input unit 11, a normal UI processing unit 12, a time interval determination unit 13, a state reset unit 14, a locus shape determination unit 15, a locus-to-trajectory relationship determination unit 16, and a handwriting determination control unit 17. , A state recovery unit 18, a handwriting processing unit 19, and the like. Each of these parts is realized by a process of causing the CPU 101 to execute one or more programs installed in the smart terminal 10. The smart terminal 10 also uses the input locus storage unit 121 and the return information storage unit 122. Each of these storage units can be realized by using, for example, a memory 102, an auxiliary storage device 103, or the like.

The coordinate sequence input unit 11 inputs coordinate sequence information, which is information indicating an operation position with respect to the input device 112, from the input device 112. The coordinate sequence information is, for example, a time series set of coordinate values sampled in a predetermined sample period from one input locus (trajectory from the start of input to the end of input). In the present embodiment, the coordinate sequence input unit 11 inputs the coordinate sequence information for each input locus (for example, each time a finger or the like moves away from the touch panel 104).

The normal UI processing unit 12 starts normal UI processing according to an operation (general UI operation such as tapping, dragging, long pressing, etc.) based on the locus indicated by the coordinate string information input by the coordinate string input unit 11. The normal UI process (hereinafter referred to as "normal UI process") refers to a process executed when the screen (display screen) displayed on the display device 111 is operated. For example, scrolling the screen, moving the icon, starting an application corresponding to the icon, and the like are examples of normal UI processing. The normal UI processing unit 12 also cancels the normal UI processing executed in response to the operation when it is determined that the locus indicated by the coordinate string information input by the coordinate string input unit 11 is a handwriting input. Information (hereinafter referred to as "return information") required to enable the state (return to the process-unapplied state) (that is, undo of the normal UI processing) is stored in the return information storage unit 122. Remember in.

The time interval determination unit 13 determines whether or not the interval between the input time of each input locus and the immediately preceding input locus (the last input locus before each input locus is input) is Ts or less for a certain period of time. To judge. The coordinate sequence information indicating the input locus determined that the interval between the input time and the immediately preceding input locus is Ts or less for a certain period of time is stored in the input locus storage unit 121. Therefore, the input locus storage unit 121 stores the coordinate sequence information of each input locus whose input time interval is Ts or less.

When it is determined that the interval between the input time and the immediately preceding input locus exceeds Ts for a certain period of time, the state reset unit 14 resets the coordinate sequence information stored in the input locus storage unit 121 and stores the return information. The return information stored in the unit 122 is reset. Here, reset means, for example, deletion of stored information. However, for example, in the input locus storage unit 121 or the return information storage unit 122, the reset may be realized by shifting the pointer indicating the start position of valid information to the position behind the last information. When the reset is realized by the deletion, the position of the pointer is synonymous with moving to the head of the input locus storage unit 121 or the return information storage unit 122. That is, in this case, all the information stored after the deletion becomes the information after the reset time.

The locus shape determination unit 15 determines whether or not the shape of the input locus related to the latest coordinate sequence information stored in the input locus storage unit 121 is linear.

The locus-to-trajectory relationship determination unit 16 analyzes a plurality of input loci in which coordinate sequence information is stored in the input locus storage unit 121, and has a relative positional relationship (positional difference (that is, distance) or direction between the input loci). It is determined whether or not each of the differences) is within the threshold. Here, the plurality of input loci in which the coordinate sequence information is stored in the input locus storage unit 121 refer to the input loci related to the coordinate sequence information after the pointer with respect to the input locus storage unit 121.

When the locus shape determination unit 15 determines that the latest input locus is not linear, or when the inter-trajectory relationship determination unit 16 determines that the position difference or direction difference between the input loci is equal to or greater than the threshold value. If it is determined that there is, it is determined that the handwriting input has been performed.

When it is determined by the handwriting determination control unit 17 that the handwriting input has been performed, the state return unit 18 is executed by an operation related to the handwriting input based on the return information stored in the return information storage unit 122. Normally, a process for canceling the UI process (hereinafter referred to as "return process") is executed.

When it is determined by the handwriting determination control unit 17 that the handwriting input has been performed, the handwriting processing unit 19 executes the processing related to the handwriting input.

Hereinafter, the processing procedure executed by the smart terminal 10 will be described. FIG. 4 is a flowchart for explaining an example of a processing procedure executed by the smart terminal 10.

When the input device 112 detects an input (drag operation, tap operation, etc.) to the touch panel 104 (Yes in S101), the coordinate sequence input unit 11 inputs an input locus (hereinafter, referred to as “target locus”) related to the input. The indicated coordinate sequence information is input from the input device 112 (S102).

FIG. 5 is a diagram showing a configuration example of coordinate sequence information of the input locus. As shown in FIG. 5, the coordinate sequence information is an array of coordinate values and time information in chronological order, such as (x, y, t) for each sample point from the start point to the end point of the input locus. be. That is, x and y are the coordinate values of the points constituting the input locus, and t is the time information of the input time of the point. In FIG. 5, (x ₁ , y ₁ , t ₁ ) corresponds to the start point, and (x _n , y _n , t _n ) corresponds to the end point. That is, the coordinate sequence information in FIG. 5 indicates an input locus by the coordinate values and time information of n points.

It is assumed that the coordinate value and the time information are obtained once every short fixed cycle such as 30 ms. Any time information can be used, but it is desirable that the resolution is at least shorter than the sampling period of the pointing coordinates. For example, an integer value representing the elapsed time from the EPOC time (00:00:00 on January 1, 1970, which is the world standard time) in milliseconds may be used as the time information. It should be noted that the time information may be obtained at least for two points, a pressing point (start point) on the touch panel and a pressing release point (end point). The coordinate string input unit 11 stores at least the coordinate string information in which the time information is added to the coordinate value of the start point and the coordinate value of the end point in the variable S which is a temporary storage area.

Subsequently, the time interval determination unit 13 calculates the elapsed time Δt from the input time of the previous (immediately preceding) input locus for the target locus (S103). Specifically, the difference between the time information of the end point of the previous input locus and the time information of the start point of the target locus is calculated as the elapsed time Δt.

Subsequently, the time interval determination unit 13 compares the elapsed time Δt with the fixed time Ts (S104). When the elapsed time Δt is longer than the fixed time Ts (No in S104), the state reset unit 14 resets the contents of the variable U and the variable R (S105), and proceeds to step S106. This is because when the input time interval is longer than Ts for a certain period of time, the input locus group before the target locus is considered not to be handwriting input. Here, U is a variable (storage area) that functions as a return information storage unit 122. R is a variable (storage area) that functions as the input locus storage unit 121.

On the other hand, if the elapsed time Δt is Ts or less for a certain period of time (Yes in S104), step S105 is not executed and the process proceeds to step S106.

The fixed time Ts may be set to be slightly longer than the input time difference between strokes when characters are usually written. For example, it may be statistically obtained as Ts = avg + a × sdev from the average avg and the standard deviation sdev of the time difference between strokes. Here, a is a constant such as 1, 2, or 3, for example.

In step S106, the normal UI processing unit 12 processes the target locus as a normal UI operation. That is, the UI operation is usually speculatively executed before it is determined whether or not the target locus is a handwriting input. By doing so, it is possible to avoid deterioration of the operation response when the target locus is not handwriting input. For example, the normal UI processing unit 12 interprets the target locus as a drag scroll, interprets the target locus as a tap of an operation part such as an icon or a software keyboard, and performs processing according to the interpretation (drag scroll, icon Tap, tap on the software keyboard, etc.). When tapping an operation component such as an icon is executed as normal UI processing, the normal UI processing unit 12 takes time Ts for starting processing (for example, starting an application) corresponding to the tap of the operation component. You may wait for only a minute. By doing so, when it is determined that the target locus is a handwriting input, for example, the screen of the application is speculatively displayed, and then the screen is immediately deleted by the return process, which is not suitable for the user. It is possible to avoid performing natural actions. That is, in this case, it may be determined that the input is handwriting, and when the return process is executed, it may be decided to invalidate the normal UI process related to the standby.

Subsequently, the normal UI processing unit 12 adds the return information regarding the normal UI processing executed in step S106 to the end of the variable U (S107). For example, if drag scrolling is normally executed as UI processing, the scroll movement amount may be returned information. In this case, the original drag scroll can be canceled by inverting the sign of the movement amount and executing the drag scroll for the amount. If it is a tap of an operation component such as an icon as a normal UI process, a command or the like for canceling the process corresponding to the tap may be used as return information.

Subsequently, the time interval determination unit 13 adds the content of S to the end of the variable R (S108). If the elapsed time from the immediately preceding input locus exceeds Ts for a certain period of time, the contents of the variable R are reset. Therefore, the coordinate sequence information stored after the pointer of the variable R is the same as the immediately preceding input locus. It becomes the coordinate sequence information of the input locus whose interval is within Ts for a certain period of time. The variable R may be an array variable that can store the coordinate sequence information of each of the plurality of input loci in chronological order.

Subsequently, the locus shape determination unit 15 calculates the degree of bending of the target locus (S109). In the present embodiment, the degree of bending of the locus is an example of the degree of deviation from the straight line regarding the shape of the locus. The calculation method of the degree of bending is not limited to a specific one. For example, a method using the least squares method, a method of finding a point having a maximum distance from a straight line connecting a start point and an end point, and using the ratio of the maximum distance to the distance from the start point to the end point can be given as an example.

Subsequently, the locus shape determination unit 15 compares the degree of bending, which is the calculation result, with the threshold value α (S110). When the degree of bending is equal to or greater than the threshold value α (No in S110), the handwriting determination control unit 17 determines that the handwriting input has been performed and starts the handwriting input process (S116). The handwriting input process is a process of treating the input locus related to the coordinate sequence information after the pointer of the variable R as a handwriting. The details of the handwriting input process will be described later.

On the other hand, when the degree of bending is less than the threshold value α (Yes in S110), the inter-trajectory relationship determination unit 16 determines the last two coordinate sequence information (that is, the coordinate sequence information of the target locus and the target locus) from the variable R. (Coordinate sequence information of the immediately preceding input locus) is acquired (S111). The coordinate sequence information stored in the variable R is the coordinate sequence information related to the input in which the input time interval is Ts or less. Therefore, the two coordinate sequence information acquired in step S111 are the input coordinate sequence information before and after the input time interval is Ts or less. The acquired coordinate sequence information is not deleted from the variable R. Further, when there is only one coordinate sequence information in R, it is assumed that the locus-to-trajectory relationship determination unit 16 generates a duplicate of the one coordinate sequence information and extracts two identical coordinate sequence information. In the present embodiment, the locus whose bending degree is less than the threshold value α is treated as a linear locus.

Subsequently, the locus-to-trajectory relationship determination unit 16 calculates the difference in the direction of the input locus related to the acquired two coordinate sequence information (S112). Subsequently, the inter-trajectory relationship determination unit 16 compares the difference in the direction with the threshold value β (S113). Here, the handwriting input process is executed for the input locus whose bending degree is equal to or higher than the threshold value α. As will be described later, the variable R is reset in the handwriting input process. Therefore, after the pointer of the variable R, the coordinate sequence information of the linear locus (the degree of bending is less than the threshold value α) is stored. That is, each input locus indicated by the two coordinate sequence information acquired in step S111 is somewhat linear. Therefore, in order to calculate the difference between the directions of the two input loci, the inter-trajectory relationship determination unit 16 obtains a representative direction for each of the two input loci. As a method for obtaining a typical direction, any various methods such as the least squares method and the slope of a straight line connecting the start point and the end point can be adopted. The "direction" here is not the traveling direction of the input locus, but the slope of the shape (line) drawn by the input locus. Therefore, there is no difference in direction between the input locus traveling to the right and the input locus traveling to the left.

When the difference in the direction is equal to or greater than the threshold value β (No in S113), the handwriting determination control unit 17 determines that the handwriting input has been performed and starts the handwriting input process (S116). On the other hand, when the difference in the direction is less than the threshold value β (Yes in S113), the inter-trajectory relationship determination unit 16 calculates the difference (that is, the distance) between the positions of the two input loci (S114). Subsequently, the inter-trajectory relationship determination unit 16 compares the difference, which is the calculation result, with the threshold value γ (S115). The definition of the difference in position, that is, the distance, is not limited to a specific one. For example, the closest distance between the two input trajectories may be selected. Alternatively, in the circumscribed rectangles of the two input loci, the larger of the horizontal and vertical spacings may be selected. Alternatively, the distance of the center of gravity of each of the two input loci may be calculated.

When the difference is equal to or greater than the threshold value γ (No in S115), the handwriting determination control unit 17 determines that the handwriting input has been performed, activates the handwriting input process (S116), and returns to step S101. On the other hand, when the difference is less than the threshold value γ (Yes in S115), the handwriting input process is not started and the process returns to step S101.

If No in step S110, No in step S113, or No in step S115, the handwriting determination control unit 17 further determines whether or not the size of the target locus is larger than a certain value, and the size is greater than or equal to a certain value. Only in a certain case, it may be determined that the handwriting input has been performed and the handwriting input process may be started. As the size, for example, the length of the longest side of the circumscribed rectangle of the target locus may be adopted.

Further, in steps S109 and S110, the locus shape determination unit 15 determines that the input locus (target locus) as shown in FIG. 6 is exceptionally linear (the degree of bending is less than α). You may.

FIG. 6 is a diagram showing an example of an input locus that is exceptionally determined to be linear. When the input locus (target locus) is as shown in FIG. 6, the locus shape determination unit 15 obtains an average or representative direction A of a part or all of the input locus. Various methods such as the least squares method and the direction formed by the start point and the end point can be considered as a method of obtaining the direction A, but the present embodiment is not limited to a specific method.

The locus shape determination unit 15 obtains the width w1 in the direction A and the width w2 in the direction perpendicular to the direction A for the input locus. The locus shape determining unit 15 determines whether or not the condition that w2 / w1 is smaller than a certain value and that there are a certain number or more of bends that bend in the opposite direction in the input locus (hereinafter referred to as "condition X") is satisfied. do. If the input locus satisfies the condition X, the locus shape determination unit 15 determines that the input locus is linear (determines that the degree of bending is less than α). Alternatively, for the input locus determined by the locus shape determination unit 15 that the locus shape determination unit 15 has a bending degree α or more, the handwriting determination control unit 17 determines whether or not the condition X is satisfied, and the input locus is a condition. When X is satisfied, the handwriting determination control unit 17 may determine that the handwriting input is not performed (that is, the handwriting input process is not started).

By not executing the handwriting input process for the input locus as shown in FIG. 6, it is possible to avoid executing the handwriting input process for the operation of reciprocating the scroll up / down or left / right.

Further, in the description of FIG. 4, an example is shown in which the processes after step S101 are executed each time one locus from the start point to the end point is input (every time a finger or the like is separated from the touch panel 104). However, step S101 and subsequent steps may be executed every time one pointing coordinate is sampled until the finger or the like is separated from the touch panel 104. In this case, since the last input locus is updated at any time for each sampling, the information of the variable R and the variable U corresponding to the last input locus is also updated at any time. As a result, the normal UI processing is performed immediately before the finger or the like is separated from the touch panel 104, and the handwriting input determination and the processing related to the determination are also started in the middle of the drag operation, and the response is immediate. Can be improved.

Further, in FIG. 4, it is determined whether or not the handwriting input is performed based on the relative positional relationship of the last two input loci. However, it may be determined whether or not the input is handwriting based on the relative positional relationship between each input locus before the second from the last and the last input locus.

Specifically, each time one of the latest coordinate string information is input, the input locus related to the coordinate string information and each input locus related to the coordinate string information after the pointer, which is already stored in the variable R, The determination of steps S110, S113, and S115 may be performed between them. That is, when the coordinate sequence information stored in the variable R is n of X1, ..., Xn, in FIG. 4, only the relationship between Xn-1 and Xn is the determination target. , The relationship between X1 to Xn-1 and Xn may be the determination target. Compared with Xn one by one from X1 to Xn-1, if even one is No in step S110, S113, or S115, the handwriting input process may be started.

Further, in the period from the start of the locus input to the determination of whether or not the handwriting is input, a particle-like (particle-like) pattern around the input locus (the position of each particle is randomly determined). May be displayed. By doing so, the input locus can be shown so as not to be noticeable.

Subsequently, the details of step S116 will be described. FIG. 7 is a flowchart for explaining an example of the processing procedure of the handwriting input processing.

In step S201, the state return unit 18 cancels the process that normally occurs in the UI operation, that is, executes the return process, based on the contents of the variable U. In addition, the return process may be a cancellation of the operation of the application, but in this case, the return process may be performed by using the Undo function provided in the general application.

Subsequently, the handwriting processing unit 19 executes processing as handwriting input for each input locus related to all the coordinate sequence information after the pointer of the variable R (S202). The processing as handwriting input can take various forms depending on the implementation. For example, the handwriting processing unit 19 may display the input handwriting on the display device 111. Further, the handwriting processing unit 19 may store the coordinate sequence information (contents of the variable R) indicating the handwriting in a predetermined storage area. Further, the handwriting processing unit 19 may narrow down the display target on the display screen by using the characters obtained by executing the character recognition for the handwriting. For example, when handwriting is input on the home screen in which a large number of icons are arranged, the handwriting processing unit 19 searches for the icon starting with the character indicated by the input handwriting from the displayed icons. However, the icon to be displayed may be limited to the searched icon. By doing so, the user can efficiently find the desired icon. Here, an icon is taken as an example, but the same processing (narrowing down of display targets) is performed in a state where display elements related to a large number of options are displayed, for example, a state in which a list box is displayed. May be good.

Subsequently, the handwriting processing unit 19 resets the variable U and the variable R (S203). Subsequently, the handwriting processing unit 19 shifts the input mode in the smart terminal 10 to the handwriting input mode (S204). The handwriting input mode is a state in which all input by the user to the touch panel 104 is interpreted as handwriting input.

Therefore, after that, when the input is performed by the user and the coordinate string input unit 11 inputs the coordinate string information from the input device 112 (Yes in S205), the handwriting processing unit 19 processes the coordinate string information as a handwriting input. Execute (S206). The content of the process may be the same as in step S202. Step S206 is performed until the handwriting input mode ends (S207). The handwriting input mode may be terminated after a certain period of idle state (a state in which nothing is input). Alternatively, the handwriting input mode may be terminated based on a predetermined operation by the user. For example, at the time of transition to the handwriting input mode, the handwriting processing unit 19 displays a button or the like for receiving the end of the handwriting input mode on the display device 111, and pressing the button is the predetermined operation. good.

Further, in the above, an example is shown in which processing (S202, S206) as handwriting input is executed each time one locus is input. In this case, when the handwriting of a character having a plurality of strokes is input, the process as the handwriting input is executed a plurality of times before the character is input. If it is desired to avoid such a situation, the process as handwriting input may be executed at the timing when a plurality of loci are input. For example, in step S202, the handwriting processing unit 19 displays the handwriting input decision button on the display device without executing the processing as the handwriting input. In this case, the variable R is not reset in step S203. Further, in step S206, the handwriting processing unit 19 adds the input coordinate sequence information to the variable R. At the timing when the above enter button is pressed or when the handwriting input mode ends, the handwriting processing unit 19 executes processing as handwriting input for the coordinate string information stored after the pointer of the variable R, and the variable. Reset R.

As described above, according to the present embodiment, the locus is based on the relative positional relationship between a plurality of linear loci input at intervals (Ts) within a predetermined time interval (Ts) with respect to the display screen. It is determined whether or not the input of is a handwriting input. Therefore, in order to input the handwriting, no intentional operation by the user is required, and the handwriting input may be performed at an early timing after the input of the locus (for example, the timing during the input of one character). It is judged. Therefore, it is possible to improve the operability regarding the input of handwriting on the display screen.

Further, when it is determined that the handwriting input is performed, the user can reliably input any handwriting because the mode automatically shifts to the handwriting input mode in which the normal UI processing is not executed.

In addition, this embodiment may be applied to an input other than the input performed through the contact surface such as a touch panel and a touch pad. For example, the present embodiment may be applied to the locus of the mouse pointer when the left button is pressed. That is, the present embodiment may be applied to various input devices as long as they are input devices capable of inputting a locus.

In the present embodiment, the smart terminal 10 is an example of an information processing device or a computer. The time interval determination unit 13 is an example of the first determination unit. The locus shape determination unit 15 is an example of a second determination unit. The inter-trajectory relationship determination unit 16 and the handwriting determination control unit 17 are examples of the third determination unit.

Although the embodiments of the present invention have been described in detail above, the present invention is not limited to such specific embodiments, and various aspects are within the scope of the gist of the present invention described in the claims. It can be transformed and changed.

With respect to the above description, the following sections will be further disclosed.
(Appendix 1)
For the input time of each input of multiple times on the display screen, it is determined whether or not the interval from the input time of the immediately preceding input is within a predetermined time.
It is determined whether or not the degree of deviation from the straight line is less than the threshold value for the shape of the locus of each input before and after the interval within the predetermined time.
Based on the relative positional relationship of the loci of each input whose degree is less than the threshold value, it is determined whether or not each of the inputs is a handwriting input.
A program characterized by having a computer perform processing.
(Appendix 2)
The relative positional relationship is the difference in the positions of the loci.
The program described in Appendix 1 characterized by the above.
(Appendix 3)
The relative positional relationship is the difference in the direction of the locus.
The program described in Appendix 1 characterized by the above.
(Appendix 4)
Further, it is determined whether or not each input is a handwriting input based on the size of the locus of each input whose degree is less than the threshold value.
The program according to any one of Supplementary note 1 to 3, wherein the processing is executed by a computer.
(Appendix 5)
A first determination unit that determines whether or not the interval between the input time of each input of a plurality of times on the display screen and the input time of the immediately preceding input is within a predetermined time.
A second determination unit for determining whether or not the degree of deviation from the straight line is less than the threshold value for the shape of the locus of each input before and after the interval within the predetermined time.
A third determination unit that determines whether or not each input is a handwriting input based on the relative positional relationship of the loci of each input whose degree is less than the threshold value.
An information processing device characterized by having.
(Appendix 6)
The relative positional relationship is the difference in the positions of the loci.
The information processing apparatus according to Appendix 5, wherein the information processing apparatus is described above.
(Appendix 7)
The relative positional relationship is the difference in the direction of the locus.
The information processing apparatus according to Appendix 5, wherein the information processing apparatus is described above.
(Appendix 8)
The third determination unit further determines whether or not each input is a handwriting input based on the size of the locus of each input whose degree is less than the threshold value.
The information processing apparatus according to any one of Supplementary note 5 to 7, wherein the information processing apparatus is characterized by the above.
(Appendix 9)
For the input time of each input of multiple times on the display screen, it is determined whether or not the interval from the input time of the immediately preceding input is within a predetermined time.
It is determined whether or not the degree of deviation from the straight line is less than the threshold value for the shape of the locus of each input before and after the interval within the predetermined time.
Based on the relative positional relationship of the loci of each input whose degree is less than the threshold value, it is determined whether or not each of the inputs is a handwriting input.
A handwriting input determination method characterized in that a computer executes processing.
(Appendix 10)
The relative positional relationship is the difference in the positions of the loci.
The handwriting input determination method according to Appendix 9, characterized by the above.
(Appendix 11)
The relative positional relationship is the difference in the direction of the locus.
The handwriting input determination method according to Appendix 9, characterized by the above.
(Appendix 12)
Further, it is determined whether or not each input is a handwriting input based on the size of the locus of each input whose degree is less than the threshold value.
The handwriting input determination method according to any one of Supplementary note 9 to 11, wherein the process is executed by a computer.

10 Smart terminal 11 Coordinate sequence input unit 12 Normal UI processing unit 13 Time interval determination unit 14 State reset unit 15 Trajectory shape determination unit 16 Trajectory-to-trajectory relationship determination unit 17 Handwriting judgment control unit 18 State recovery unit 19 Handwriting processing unit 101 CPU
102 Memory 103 Auxiliary storage device 104 Touch panel 111 Display device 112 Input device 121 Input locus storage unit 122 Return information storage unit

Claims (6)

In response to the input on the display screen, start the process according to the input,
For each of the input times of the plurality of inputs to the display screen, it is determined whether or not the interval from the input time of the immediately preceding input is within a predetermined time.
It is determined whether or not the degree of deviation from the straight line is less than the threshold value for the shape of the locus of each input before and after the interval within the predetermined time.
Based on the relative positional relationship of the loci of each input whose degree is less than the threshold value, it is determined whether or not each input is a handwriting input.
When it is determined that each of the inputs is a handwriting input, the process corresponding to the input is cancelled.
A program characterized by having a computer perform processing. The relative positional relationship is the difference in the positions of the loci.
The program according to claim 1. The relative positional relationship is the difference in the direction of the locus.
The program according to claim 1. Further, it is determined whether or not each input is a handwriting input based on the size of the locus of each input whose degree is less than the threshold value.
The program according to any one of claims 1 to 3, wherein the processing is executed by a computer. A process starter that starts the process according to the input in response to the input on the display screen,
A first determination unit that determines whether or not the interval between the input time of each of the plurality of inputs to the display screen and the input time of the immediately preceding input is within a predetermined time.
A second determination unit for determining whether or not the degree of deviation from the straight line is less than the threshold value for the shape of the locus of each input before and after the interval within the predetermined time.
A third determination unit that determines whether or not each input is a handwriting input based on the relative positional relationship of the loci of each input whose degree is less than the threshold value.
When it is determined that each of the inputs is a handwriting input, a canceling unit that cancels the processing corresponding to the input, and a canceling unit.
An information processing device characterized by having. In response to the input on the display screen, the process corresponding to the input is started, and
For each of the input times of the plurality of inputs to the display screen, it is determined whether or not the interval from the input time of the immediately preceding input is within a predetermined time.
It is determined whether or not the degree of deviation from the straight line is less than the threshold value for the shape of the locus of each input before and after the interval within the predetermined time.
Based on the relative positional relationship of the loci of each input whose degree is less than the threshold value, it is determined whether or not each input is a handwriting input.
When it is determined that each of the inputs is a handwriting input, the process corresponding to the input is cancelled.
A handwriting input determination method characterized in that a computer executes processing.

Images