JP3353957B2 - Handwritten input display device and method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION The present invention relates to an electronic organizer,
The present invention relates to a handwriting input display device and a method suitable for use in a portable computer or the like.

[0002]

2. Description of the Related Art FIG. 66 is a plan view showing the structure of an example of a conventional handwritten input display device. As shown in the figure, a pen 42 is connected to the main body 41 via a cord 43. The main body 41 is provided with a display area 44 including a character display area 44a and an icon display area 44b, and a character, a figure, and the like are displayed in the character display area 44a. Also, a plurality of icons 45 are displayed in the icon display area 44b. The user can select a predetermined function by selecting a predetermined one of the icons 45 with the pen 42.

[0003] When the user, for entering the example text, a predetermined one of the icons 45 and pen-down to pen 42 to the icon I _1, as shown in FIG. 67, pen 42 pen down the left character display area 44a given the When the pen 42 is moved to the position and the pen 42 is pen-up at a predetermined position, the plate 46 is displayed at that position. When the user inputs a predetermined character by hand using the pen 42 in the plate 46, the character input by handwriting is recognized, and the character obtained as a result of the recognition is displayed on the plate 46.
Then, when the operation of confirming the character is performed, the plate 4
6 are displayed at predetermined positions in the display area 44.

When the input of characters is completed, the pen is pen-down on the plate 46 with the pen 42 and the pen 4
2 is moved to the icon display area 44b above the display area 44, and when the pen 42 is moved up, the display on the plate 46 is erased and the state returns to the state shown in FIG.

[0005]

As described above, in the conventional apparatus, the user can input the character display area 44a and the icon display area 4a.
4b, the pen 42 must be moved, so that the viewpoint must be moved from the character display position to a predetermined position each time, resulting in poor operability.

Also, the plate 46 is always displayed in a predetermined size, and characters displayed in the character display area 44a are hidden by the plate 46, and the character display area 44a is displayed.
There is a problem that it is difficult to see the sentence displayed as a whole.

[0007] The present invention has been made in view of such a situation, and aims to improve operability and display as many characters as possible.

[0008]

According to a first aspect of the present invention, there is provided a handwriting input / display apparatus comprising: an input unit for inputting a stroke including a character and an edit symbol by hand; a plate indicating a range for inputting the character; and an input unit. display means for displaying the stroke is to set the editing symbol input by the input means, detection means for detecting a parameter of editing symbols, corresponding to detected by the detecting means parameters, the display state of the plate The plate to the specified means
Control means for controlling the display to be displayed at the position .

[0009] The said detecting means, as the parameter, so as to detect the coordinates of the feature points of the editing symbols
And the control means detects
The display state of the plate based on the coordinates of the feature point
It can cause to control.

[0010] The controlling means may cause the control the width of the plate.

The control meansToIsSaidPlate height
To controlLetbe able to. The control meansTo
IsSaidBy means of detectionSaidThe first of the edit symbols
When a symbol is detected,SaidDisplay the plate,Said
By means of detectionSaidThe second editing symbol is
When issued,SaidTo erase the plateLet
be able to.

[0012] The control means may detect by the detection means.
The insertion position of the character corresponding to the issued parameter
Position can be further controlled. Said system
Control means, input into the plate by the input means
Recognizes the character from the stroke that has been
Is displayed in the plate and input by the detecting means.
If the edit symbol for termination is detected, the plate
Was erased and displayed on the plate
The character is inserted at the insertion position of the character.
Can be

[0013] The control means is controlled by the input means.
From the stroke entered in the writing plate to the character
, The characters are displayed in the plate,
The above-mentioned editing symbol of input cancellation is detected by the detecting means.
Is displayed in the plate and the plate
Erases the character, and inserts the
If the edit symbol for replacement is detected,
Change the insertion position, and use the detection means to
If the above edit symbol is detected, it is displayed on the plate.
Select the indicated characters for editing
Can be done. The detecting means includes the parameter
Speed of the input means for inputting the editing symbol
Degree, acceleration, and pen pressure information
Can be detected.

A handwritten input display method according to claim 10.
Can be used to input strokes including characters and editing symbols
The input step for more handwriting input and the range for inputting characters
Plate indicating the surrounding area and the input
A display step of displaying the applied stroke on the display means
And the editing symbol input by the processing of the input step,
A detection method for detecting the parameter of the edit symbol by the detection means.
Steps and parameters detected by the processing of the detection step
Control means to change the display state of the plate
Set and display the plate at a predetermined position on the display means
Control step for controlling
You. In the processing of the detection step, the parameter
To detect the coordinates of the feature points of the edit symbol.
In the processing of the control step,
Based on the coordinates of the feature points detected by the process,
It is possible to control the display state of the plate
Wear.

[0015]

In the handwriting input / display apparatus according to the first aspect and the handwriting input / display method according to the tenth aspect, when an editing symbol is detected, a parameter of the editing symbol is detected, and a parameter corresponding to the parameter is detected. , The width and height of the plate and the display position are adjusted. Therefore, the user only needs to look at the area in which the characters are displayed and perform the operation, and the operability is improved.

Further , a new shape can be input while looking at the already displayed shape as much as possible, and the operability is improved.

[0017]

FIG. 1 is a block diagram showing the configuration of an embodiment of the handwriting input display device of the present invention. CPU1 is RO
Each part is controlled in accordance with the program stored in M2 to execute a character input display operation.
The RAM 3 stores predetermined data and the like as needed. The backup RAM 4 is always supplied with a predetermined power from the battery 5, and stores information to be stored even when the power of the apparatus is turned off. The timer 6 always operates with the battery 5 based on the crystal resonator 7.

The display controller 11 develops data input via the bus line 8 into the V-RAM 12 and displays the developed image on the display unit 13. The input tablet 15
By operating the pen 16, the input coordinate position data is output to the tablet interface 14, and the tablet interface 14 outputs the data to the bus line 8.
CPU 1 or display controller 1
1 is output.

The microphone 18 outputs the collected audio signal to the solid-state recording processing circuit 17 and stores it. The audio signal output from the solid-state recording processing circuit 17 is supplied to a speaker 21 via an adder 20 and emitted. Dialer 19 is CPU1
, And outputs a predetermined dial signal to the speaker 21 via the adder 20.

A plurality of key switch groups 22 are operated when the operation of the apparatus is switched, and a signal corresponding to the operation is transmitted from the key interface 23 to the CP via the bus line 8.
The data is output to U1. The power supply circuit 25 is turned on by operating a predetermined one of the plurality of key switch groups 24 to supply power to each unit, and the recording, reproduction, stop,
It is possible to execute volume adjustment and the like.

Further, the socket 26 has an IC (not shown)
The card can be inserted, I
The C card interface 27 exchanges data with the IC card.

For example, a modem or the like can be connected to the pin connector 29, so that signals can be exchanged with the extension interface 28 via the modem.

The input tablet 15 is made of a transparent material and is formed on the display unit 13. As a result, the display on the display unit 13 can be viewed through the input tablet 15.

FIG. 2 shows an example of using the pen 16 in FIG.
The figure shows a processing procedure until an input is made on the input tablet 15 and displayed on the display unit 13.

As shown in the drawing, when the user touches the input tablet 15 with the pen 16, data of the coordinates touched by the pen 16 with the input tablet 15 is output from the tablet interface 14 to the CPU 1 via the bus line 8. . The CPU 1 reads from the ROM 2 a program composed of the handwriting management module M1, the input plate management module M2, the graphic character recognition module M3, and the display management module M4 in FIG. Is output to and displayed on the display unit 13 via.

The handwriting management module M1 compresses the pen coordinate data supplied from the input tablet 15, processes the data into handwriting data, and supplies it to the input plate management module M2. This handwriting data is supplied from the input plate management module M2 to the graphic character recognition module M3. The graphic character recognition module M3 determines from the input handwriting data whether the handwriting corresponds to a previously stored character or graphic. And
The determined result (character code or graphic code) is output to the input plate management module M2.

The input plate management module M2 outputs to the display management module M4 the handwriting data supplied from the handwriting management module M1, or the character code or graphic code (graphic data) supplied from the graphic character recognition module M3. Display management module M
4 outputs a control signal to the display unit 13 via the display controller 11 in accordance with the input data, and outputs a handwriting input by the pen 16 or a character or figure obtained as a result of recognizing the handwriting. It is displayed on the display unit 13.

Next, the operation of the embodiment of FIG. 1 will be described with reference to the flowchart of FIG.

First, in step S1, handwriting data for one image (stroke) input from the handwriting management module M1 is received. Then, a display corresponding to the handwriting is performed.

That is, when the user pen-downs on the input tablet 15 with the pen 16 and performs a predetermined input, the coordinate data is output from the tablet interface 14 to the CPU 1 via the bus line 8. The CPU 1 processes this data in the handwriting management module M1 and delivers it to the input plate management module M2 as handwriting data. The input plate management module M2 further passes the handwriting data to the display management module M4. The display management module M4 outputs data corresponding to the handwriting data to the display controller 11. The display controller 11 develops pixel data corresponding to the input signal on the V-RAM 12, reads out the pixel data, and outputs it to the display unit 13. As a result, the input tablet 15 is displayed on the display unit 13 with the pen 16.
Is displayed.

Next, the process proceeds to step S2, where the stroke (image) just taken in is the editing symbol (gesture) for insertion.
(See FIG. 6). That is, the input plate management module M2 converts the handwriting data supplied from the handwriting management module M1 into the graphic character recognition module M1.
Supply 3 The graphic character recognition module M3 compares the input handwriting data with a pre-stored editing symbol for insertion and determines whether or not the currently input editing symbol 51 is for insertion. . This determination process will be described later in detail with reference to FIG.

If it is determined in step S2 that the input character is not an edit symbol for insertion, the process is terminated. If it is determined that the input symbol is the edit symbol for insertion, the process proceeds from step S2 to step S3, and the feature points P0 to P0 of the handwriting (edit symbol 51) extracted in the processing of FIG. The position, width, height, and character insertion position (FIG. 8) of the character input plate 61 are determined from the coordinate values of P4 (FIG. 6). Details of this processing will be described later with reference to FIGS.

Next, proceeding to step S4, the character input plate 61 (see FIG. 8) is opened (displayed) at the position determined in step S3, and the handwriting input to the character input plate 61 is a character handwriting. That is, when a predetermined character is input by handwriting in the character input area 62 of the character input plate 61 using the pen 16, the handwriting is directly displayed in the character input area 62. In addition, the character input plate 61
Is displayed, the handwriting of the edit symbol that has been displayed is erased.

Next, the process proceeds to step S5, in which the handwriting data of the next one stroke input from the handwriting management module M1 is received and displayed. As a result, the next input handwriting is displayed on the display unit 13 as it is.

In step S6, it is determined whether or not the handwriting data input in step S5 is an edit symbol 52 for terminating input shown in FIG. This determination processing will be described later in detail with reference to FIG. In step S6,
If it is determined that the input symbol is not the input end editing symbol 52, the process proceeds to step S7, and the input handwriting data is supplied to the graphic character recognition module M3 as character handwriting. Graphic character recognition module M3
Is a graphic stored in advance,
It compares with a character and outputs the comparison result (character code or graphic data) to the input plate management module M2.

In step S8, the result recognized in step S7 is displayed in the character input area 62 of the character input plate 61, and the display of the handwriting displayed so far is erased. Thus, instead of the handwriting previously displayed in the character input area 62 of the character input plate 61, the character recognized from the handwriting is displayed in the character input area 62.

After step S8, the process returns to step S5.
The process waits for the input of the next handwriting, and when a new handwriting is input, the processing for determining the handwriting is repeated.

If it is determined in step S6 that the input is the edit symbol 52 for terminating the input, the flow advances to step S9 to insert the character input in the character input area 62 into the insertion position I. It is displayed (FIG. 8). At this time, if necessary, characters behind the insertion position I are sequentially shifted backward and displayed. At this time, the character input plate 61 is erased. Thus, the process is completed.

As described above, when the editing symbol 51 for inserting a character as shown in FIG. 6 is input, a character input plate 61 as shown in FIG. 8 is displayed at that position. Then, when the editing symbol 52 for terminating the input as shown in FIG. 7 is input, the character input plate 61 is erased.

Next, referring to the flowchart of FIG.
Using the pen 16, 1
The handwriting of the fraction is an editing symbol 51 for insertion as shown in FIG.
A process for determining whether or not the above is performed will be described. This processing is performed in step S2 in FIG. 3, as described above.

First, in step S21, it is determined whether or not the point P2 at which the coordinate in the vertical direction (y-axis direction) of the point sequence of the input handwriting data is the maximum is other than the start point P0 and the end point P4 of the handwriting. Is determined. That is, of the data of one stroke input in step S1 of FIG. 3, the writing start point is set as the start point P0, and the writing end point is set as the end point P0.
It is set to 4. Then, the point having the largest coordinate value in the y-axis direction is set as the point P2 (FIG. 6), and it is determined whether the point P2 matches the point P0 or the point P4.

If it is determined that the point P2 is different from the points P0 and P4, the process proceeds from the step S21 to a step S22.
From the starting point P0 to the point P2, it is determined whether or not the absolute value of the inclination of the tangent line of the handwriting monotonically increases within the range of the small error d. If it is determined that the increase is monotonous, the process proceeds to step S23. In step S23, it is determined whether or not the absolute value of the inclination of the tangent line of the handwriting increases monotonously in the range of the small error d from point P4 to point P2. If it is determined that the increase is monotonic, the process proceeds to step S24.

In step S24, the points P0 and P
A point at which the inclination of the tangent is 45 degrees between points 2 is defined as a point P1,
A point where the inclination of the tangent is 135 degrees between the points P4 and P2 is defined as a point P3 (FIG. 6). In this case, the angle of the tangent is the angle with the x-axis.

After the coordinates of the points P1 and P3 have been obtained in step S24, the flow advances to step S25 to output a determination result indicating that the input symbol 51 is the edit symbol 51 for insertion.

On the other hand, if it is determined in step S21 that the point P2 having the maximum y-coordinate value is the same as the start point P0 or the end point P4, then in step S22,
When it is determined that the absolute value of the inclination of the tangent of the handwriting between the points P0 and P2 is not monotonically increasing within the range of the small error d, or in step S23, the tangent of the handwriting between the points P4 and P2 is determined. If it is determined that the absolute value of the gradient is not monotonically increasing within the range of the small error d, the process proceeds to step S2.
Then, the process proceeds to step S6, where a determination result indicating that the input character is not the edit symbol 51 for insertion is output.

When the result of the determination in step S25 is obtained, the process proceeds from step S2 to step S3 in FIG. 3, and when the result of the determination in step S26 is obtained, the process proceeds to step S3.
Is terminated.

Next, the determination process performed in step S6 of FIG. 3, that is, the process of determining whether or not the input character is the edit symbol 52 (FIG. 7) for ending the input is now described.
This will be described with reference to FIG.

First, in step S31, the handwriting just input is located near the upper right of the character input plate 61 (FIG. 8), and a part of the handwriting is
It is determined whether or not it is outside the range of 1. When the handwriting is located near the upper right of the character input plate 61 and a part of the handwriting is outside the character input plate 61, the process proceeds to step S32. In step S32, the point Q2 at which the y coordinate of the point sequence of the handwriting data is maximum is:
It is determined whether the point is other than the start point Q0 and the end point Q3 (FIG. 7).

That is, as shown in FIG. 7, the input start point of one stroke input in step S5 is set to Q0, and the end point is set to Q3. Then, the point at which the y coordinate becomes the maximum is defined as point Q2. If it is determined that the point Q2 is different from the points Q0 and Q3, the process proceeds to step S33. In step S33, it is determined whether the absolute value of the y coordinate is monotonically increasing within the range of the small error e from the point Q0 toward the point Q2. If it is determined that the increase is monotonic, the process proceeds to step S34.

In step S34, it is determined whether or not the absolute value of the y coordinate is monotonically increasing from the point Q3 toward the point Q2 within the range of the small error e. If it is determined that the increase is monotonic, the process proceeds to step S35.

In step S35, the curve from the starting point Q0 to the point Q2 and the curve from the point Q3 to the point Q2 are:
It is determined whether or not there is one intersection Q1. Intersection Q1
If it is determined to have
, And what has just been input is the edit symbol 52 for ending the input.
Is output.

In step S31, what has just been input does not exist near the upper right of the character input plate 61.
Alternatively, if it is determined that part of the handwriting does not protrude outside the character input plate 61, the process proceeds to step S3.
In step S2, if it is determined that the point Q2 matches the point Q0 or the point Q3, the process proceeds to step S33.
From 0 to the point Q2, the absolute value of the y coordinate becomes a small error e.
If it is determined that the absolute value of the y coordinate is not monotonically increasing from the point Q3 toward the point Q2 within the range of the small error e in the step S34, In S35, the points Q0 and Q2
, And the curve between the points Q3 and Q2 do not have one point Q1, respectively.
Proceeds to step S5 in FIG.
A determination result indicating that the input end is not the edit symbol 52 as shown in FIG. 7 is output.

When the determination result of step S36 is obtained, the process proceeds from step S6 of FIG. 3 to step S9, and when the determination result of step S37 is obtained, the process proceeds from step S6 of FIG. 3 to step S7.

Next, referring to FIGS. 8 to 10, the processing in step S3 in FIG. 3, that is, the feature points P0 to P4 (the editing symbols 51) of the handwriting extracted in the processing shown in the flowchart in FIG. From the coordinate position of FIG. 6), the position for displaying the character input plate 61, the width W, the height H, and the insertion position I
(FIG. 8) will be described.

As shown in FIG. 8, the character input plate 61
Has a width W and a height H. The position P at which the character input plate 61 is opened is the upper left point of the character input area 62 defined by the width W and the height H. The insertion position I is a predetermined point above a position that is の of the width W.

That is, the width W and the height H of the character input area 62
Is calculated by the following equation. W = Kw (X (P0) −X (P4)) H = Kh ｛(Y (P1) −Y (P0)) + (Y (P3) −Y
(P4))｝ / 2 Here, Kw and Kh are proportional constants, respectively. X (Pi) and Y (Pi) represent the x coordinate and y coordinate of the point Pi, respectively.

That is, in this embodiment, the width W of the character input area 62 is set in proportion to the interval between the start point P0 and the end point P4 of the editing symbol 51 for insertion shown in FIG. Accordingly, when the user wants to increase the width W of the character input area 62, the user needs to increase the width of the start point P0 and the end point P4, and decrease the width of the start point P0 and the end point P4.

The height H is set in proportion to the average value of the difference between the height of the start point P0 and the point P1 and the difference between the heights of the end point P4 and the point P3. Accordingly, when the angle represented by the line between the points P1 and P2 and the line between the points P3 and P2 in FIG. 6 is reduced, the height H decreases, and when the angle is increased, the height H decreases.
The height H increases.

The coordinates of the position P (the upper left point of the character input area 62) for opening the character input plate 61 are calculated by the following equations. X (P) = X (P2) -W / 2 Y (P) = (Y (P0) + Y (P1) + Y (P2) + Y
(P3)) / 4 That is, the x coordinate of the position P is W from the x coordinate position of the point P2.
/ 2 to the left. The y coordinate is the point P0
To P3 as the average value of the y-coordinate values.

Further, an insertion position I at which a character input to the character input area 62 of the character input plate 61 is finally inserted.
Are calculated by the following equation. X (I) = Xmax (i, m) (however, Xmax (i, m) −X (P2) ≦ X (P2) −Xm
X (I) = Xmin (i, m) (where Xmax (i, m) −X (P2)> X (P2) −Xm
in (i, m)) Y (I) = Ymax (i, m) (however, Ymax (i, m) −Y (P2) ≦ Y (P2) −Ym
Y (I) = Ymin (i, m) (where Ymax (i, m) −Y (P2)> Y (P2) −Ym
in (i, m)

Here, Xmax (i, m), Xmin
As shown in FIG. 9, (i, m) is an enlarged view of FIG. 10 of the display area of the predetermined character of the m-th character in the i-th row (“East” in this embodiment). Thus, the rightmost coordinate and the leftmost coordinate are respectively meant. Also, Y
max (i, m) and Ymin (i, m) represent the coordinates of the uppermost point and the lowermost point of the character display area, respectively.

That is, as shown in FIG. 9, the display range of each Japanese character (full-width character) is fixed. On the other hand, for example, the width of the alphabet character in English changes (the display range in the x-axis direction) changes for each character. In the above equation, Xmax (i, m), Xmi
n (i, m), Ymax (i, m), Ymin (i,
m), the position closest to the point P2 is the insertion position I.

Further, referring to FIG. 11 and FIG.
A specific display example on the display unit 13 will be described. Now, in the state where the display as shown in FIG. 11A is performed on the display unit 13, between the character “as shown” and the character “triangle” on the first line,
It is assumed that a character “with a square vertex A22” is inserted.

At this time, as shown in FIG. 11B, the user uses the pen 16 to manually input the edit symbol 51 in front of the "triangle" character. The handwritten input editing symbol 51 is displayed once with its handwriting. And
When the input symbol is recognized as the edit symbol 51 for inserting a character according to the processing shown in FIG. 4, the handwriting of the edit symbol 51 is erased as shown in FIG. 11C, and the character " The character input plate 61 is displayed before the "triangle". As described above, the width W, the height H, and the insertion position I are set in accordance with the parameters of the edit symbol 51 in FIG.

Next, as shown in FIG. 12A, when a character is input by handwriting in the character input area 62 of the character input plate 61 with the pen 16, the handwriting is once displayed there. Thereafter, when the handwritten input character is recognized in the character input area 62, the recognized result is shown in FIG.
Is displayed instead of the handwriting as shown in FIG.

Then, as shown in FIG. 12B, when an edit symbol 52 indicating the end of the input is inputted by the pen 16 in the vicinity of the upper right corner of the character input plate 61, this is processed according to the processing shown in FIG. It is determined whether or not the edit symbol 52 has been input. And the edit symbol 5 of the end of input
If it is determined to be 2, the character previously displayed in the character input area 62 is inserted at the insertion position I (before the "triangle") as shown in FIG. Are sequentially moved backward. Further, the character input plate 61 is deleted.

FIG. 13 shows another embodiment of an edit symbol for inserting a character. FIG. 13A shows an example in which edit symbols are constituted by arrows. Also, FIG.
Shows an example in which a symbol similar to the character α is set as an editing symbol. Further, FIG. 6C shows an example in which a symbol obtained by inverting the editing symbol 51 shown in FIG.

In any case, by registering these symbols in advance, they can be recognized as edit symbols for inserting characters.

In the above embodiment, the coordinates of the edit symbol are detected as parameters of the edit symbol for insertion.
It is also possible to control the display state of the character input plate 61 from information such as speed, acceleration, pen pressure, and touching time. The writing speed of the pen 16 is
It can be obtained by calculation, for example, by counting the number of dots input per unit time. The acceleration can be obtained by differentiating the speed. The touching time can be measured by counting clocks. The pen pressure can be detected by providing a mechanism for detecting the pen pressure on the input tablet 15 or pen 16 side.

Thus, for example, when the speed is high, the proportionality constant Kw can be increased, and the size of the opened plate can be increased in proportion to the speed.

FIG. 14 shows another embodiment of the edit symbol of the end of input. FIG. 9A shows an example in which the cross mark is used as an edit symbol for ending character input. Also, in FIG. 6B, a dedicated area (end button) operated when instructing the end of input is provided in the upper right corner of the character input plate 61.
53 are provided. In this embodiment, by touching the end button 53 with the pen 16, it is possible to instruct the end of the character input.

In the above embodiment, the display position and size of the character input plate 61 are set in accordance with the parameters of the editing symbol (gesture) 51 for insertion. However, there is sufficient input space. If so,
This character input plate 61 can be prevented from being displayed.

FIG. 15 shows the processing operation in this case. That is, first, in step S41, a predetermined input of one image is performed using the pen 16. In step S42, it is determined whether or not the shape input in step S41 is an edit symbol 51 for insertion. If the input is not the edit symbol 51 for insertion, the process is terminated.

If it is determined in step S42 that the input is the edit symbol 51 for insertion, the flow advances to step S43 to enter a sufficient input area (in the vicinity of the edit symbol 51 for insertion). (Space) is determined. That is, for example, as shown in FIG.
Now, it is assumed that alphabet characters A to K are input by handwriting using the pen 16 and displayed on the display unit 13. In this state, in the case of this embodiment,
It is determined whether a character composed of a triangular figure or an edit symbol 51 for insertion has been input.

When it is determined that the editing symbol 51 for insertion has been input, a space (wider than the reference value) having a predetermined range of size (below the reference value) is provided below the base of the triangle of the editing symbol 51. It is determined whether or not (a space where no character is displayed) exists. The determination of the size of the space is performed by determining whether or not the space is capable of displaying M characters at a predetermined point P in the horizontal direction and N characters in the vertical direction. This size is set so that the user can change the size to an arbitrary value as needed.

If it is determined in step S43 that there is not enough space for inputting a character near the edit symbol 51 for insertion, the process advances to step S45 to change the edit symbol 51 for insert. Erase, FIG.
The character input plate 61 is displayed as shown in FIG. The user uses the pen 16 to input a character to be inserted on the character input plate 61 by handwriting.

Next, the flow advances to step S46, where the data of the next image input by the user is fetched. In steps S47 to S50, whether the image captured in step S46 is an edit symbol for canceling input, an edit symbol for changing the insertion position, or an edit symbol for instructing character editing Alternatively, it is determined whether the input symbol is an edit symbol indicating the end of the input.

If it is determined in steps S47 to S50 that the character is not any of these edit symbols, the process proceeds to step S51, and the handwriting captured in step S46 is treated as a character input handwriting. Then, the process returns to step S46, and the same processing is repeatedly executed for the next input data. In this way, for example, as shown in FIG. 18, the character “tegami-moji” is input into the character input plate 61.

In step S50, step S46
If it is determined that the handwriting input in step is an input-end editing symbol, the process proceeds to step S56, where the editing end symbol and the character input plate are deleted. Further, the process proceeds to step S57, where the character string input into the character input plate 61 is
Insert in place.

For example, as shown in FIG. 19, the edit symbol 52 indicating the end of input indicated by a circle in the figure is a character input plate 61.
If the input is performed so as to cover a part of
Then, the process proceeds to step S56, in which the edit symbol 52 and the character input plate 61 of the input end are deleted. As a result, the display state temporarily returns to a state where the editing symbol 51 for inserting a character is not written. That is, the state returns to the state where characters A to K are displayed.

Then, the flow advances to step S57 to insert and display the character input from the character input plate 61 at the insertion position as shown in FIG. In the case of this embodiment, a character of "Gekimoji" is inserted between the alphabetic characters B and C.

As described above, when there is no space for inputting a handwritten character near the position designated by the edit symbol 51 for insertion, the character input plate 6
1 is displayed, and the character to be inserted is input by handwriting.

On the other hand, when it is determined in step S43 that there is a space for inputting a character near the edit symbol 51 for insertion, processing as shown in FIGS. 21 to 25 is performed.

That is, as shown in FIG. 21, it is assumed that an editing symbol 51 for insertion is handwritten between the characters B and C while the alphabetic characters A to D are displayed. At this time, no character is displayed below the base of the triangle constituting the edit symbol 51. Even if a character is input by handwriting there, there is no character already displayed, so that the character is difficult to see. There is no such thing. Therefore, in this case, the process proceeds from step S43 to step S44, and the insertion position mark 71 is displayed at that position instead of the editing symbol 51 for insertion as shown in FIG.

Next, the flow advances to step S46 to fetch the data of the next image, and the same processing as described above is performed.
That is, as shown in FIG. 23, the user inputs characters by hand using the pen 16 below the insertion position mark 71. This input differs from the case shown in FIG. 18 in that the character input plate 61 is not displayed, so that a free address character is input. This input processing is performed in step S50.
Is repeatedly executed until the edit symbol 52 indicating the end of the input is written.

As shown in FIG. 24, the insertion position mark 71
When the edit symbol 52 indicating the end of input is handwritten with the pen 16 so that a part of the input symbol 52 is entered, the process proceeds from step S50 to step S56, where the edit symbol 52 indicating the end of input and the insertion position mark 71 are deleted. As a result, the display state temporarily returns to the state before the edit symbol 51 for character insertion is input. That is, the state temporarily returns to the state where the alphabetic characters A to D are displayed.

Then, the flow advances to step S57 to insert the character "tegami-moji" as shown in FIG. 23 at the position designated by the edit symbol 51 for insertion in FIG. 21, as shown in FIG. Is done.

As described above, when there is a sufficient space for input near the editing symbol 51 for insertion, the character input plate 61 is not displayed, and characters can be freely input in the empty space. be able to. Therefore, characters can be inserted as if writing characters on normal paper, and the user does not need to wait for the character input plate 61 to be opened (displayed), thereby enabling quick input. . Further, in this case, since the characters that have already been input are not displayed in the input space, the input characters do not become difficult to see.

In the above description, the case where a character is inserted is taken as an example. However, the same processing is performed when a figure is inserted.

FIGS. 26 to 30 show a state where a figure is inserted by the processing including step S45 shown in FIG. 15, and FIGS. 31 to 35 show steps S44.
Shows a state in which a figure is inserted by processing including.

In the embodiment shown in FIG. 26, a flowchart is about to be created, and blocks of steps indicating the processing 1 and the processing 2 have already been input. Now, consider a case where another processing step is inserted between the processing 1 and the processing 2 in this state. At this time, between the processing 1 and the processing 2 (at the position where it is desired to insert), the editing symbol 51 for insertion is handwritten with the pen 16. This editing symbol 5
The vertex of one triangle (vertex on the right side in the figure) represents a position to be inserted, and the bottom side (the left side in the figure) faces a space for inputting a figure to be inserted.

Therefore, it is determined whether or not there is a space near the base of the triangle of the edit symbol 51 (step S43).

In this case, since a vertical solid line is displayed on the left side of the base of the triangle of the edit symbol 51, there is no space for writing a new figure. Therefore, in this case, as shown in FIG. 27, the edit symbol 51 is deleted, and the graphic input plate 63 is displayed there (step S45).

When the graphic input plate 63 is displayed as described above, the user inputs a graphic to be inserted into the graphic input plate 63 with the pen 16 as shown in FIG. In the case of this embodiment, in order to insert a processing step for determination, a diamond-shaped figure and a character for determination are written on the figure input plate 63 (step S46).

Then, as shown in FIG. 29, when the edit symbol 52 indicating the end of the input is input by the pen 16 (step S50), the graphic input plate 63 and the edit symbol 52 are erased (step S56). As shown in FIG. 30, the graphic written in the graphic input plate 63 is inserted at the insertion position (in the case of this embodiment, between the block of processing 1 and the block of processing 2) (step S57).

Next, a display example in the case where a sufficient writing space exists will be described with reference to FIGS. As shown in FIG. 31, when an edit symbol 51 for insertion is input by handwriting between the processing blocks of the process 1 and the process 2, a space for handwriting input exists near the edit symbol 51. It is determined whether or not (step S43). In this case, since there is a blank space near the edit symbol 51, as shown in FIG. 32, the edit symbol 51 is deleted, and the insertion position mark 71 is displayed instead (step S44). ).

Then, as shown in FIG. 33, the user places a figure to be inserted near the insertion position mark 71 with the pen 16.
Is input by hand (step S46). In the case of this embodiment, as in the case shown in FIGS. 26 to 30, a figure in which a judgment character is inserted in a diamond-shaped figure representing a judgment processing block is input.

Then, as shown in FIG. 34, when the editing symbol 52 indicating the end of the input is inputted by the pen 16 so that the insertion position mark 71 is partially applied to the insertion position mark 71 (step S5).
0), as shown in FIG. 35, the insertion position mark 71 and the editing symbol 52 are erased (step S56), and the handwritten input graphic is moved to the position indicated by the insertion position mark 71 near the insertion position mark 71. It is inserted (step S57).

Next, when it is determined in steps S47 to S49 in FIG. 15 that the handwriting input in step S46 is an editing symbol for canceling input, an editing symbol for changing an insertion position, or an editing symbol for a character editing instruction. Will be described.

If it is determined in step S47 that the handwriting input in step S46 is an edit symbol for canceling the input, the flow advances to step S52 to invalidate the character being input, and to insert the insertion position mark 71 or the character. The input plate 61 or the graphic input plate 63 is deleted.

FIGS. 36 to 39 show the character input plate 6.
FIG. 40 shows a display example associated with this input canceling operation in a state where 1 is displayed. FIGS. 40 to 43 show a state where the character input plate 61 is not displayed.
13 shows a display example of an input cancel operation.

That is, as shown in FIG. 36, when an editing symbol 51 for inserting a character is input and another character is displayed in the vicinity thereof, the character input plate 61 is displayed as shown in FIG. Is displayed. Then, as shown in FIG. 38, the user inputs handwritten characters (E and F in this embodiment) to be inserted into the character input plate 61.

In this way, when a predetermined character is input into the character input plate 61 and it is desired to stop the input, the character input plate 61 is almost partially touched. An edit symbol 101 for cancellation having a V-shape is input (step S4).
7).

When such an edit symbol 101 is input, as shown in FIG. 39, the character input plate 61, the characters E and F input therein, and the edit symbol 51 for insertion are all erased. Then, the display returns to the original display state (step S52).

As shown in FIG. 40, when an edit symbol 51 for insertion is input and no character is displayed near the edit symbol 51, as shown in FIG. The insertion position mark 71 is displayed. Therefore, the user inputs a character EF to be inserted near the insertion position mark 71 as shown in FIG.

Then, after inputting such a character EF, if the user wants to cancel the input, he or she inputs an editing symbol 101 for cancellation so that a part of the editing symbol 101 overlaps the insertion position mark 71 (step S47). Then, as shown in FIG. 43, the insertion position mark 71, the inserted character EF, and the editing symbol 101 for cancellation are all erased.
The display returns to the original display state (step S52).

If it is determined in step S48 that the handwriting input in step S46 is an editing symbol for changing the insertion position, the flow advances to step S53 to move the insertion position editing symbol to the insertion point mark or arrow. Move the insertion position display section of the input plate. Then, the process returns to step S46 to be in a standby state for the next input.

When an instruction to change the insertion position is input while the character input plate 61 is displayed, FIG.
47 to FIG. 47 are executed. That is, FIG.
As shown in the figure, when the editing symbol 51 for insertion is input,
If a character is displayed in the vicinity, a character input plate 61 is displayed as shown in FIG. In this state, as shown in FIG. 46, when the edit symbol 102 for instructing the insertion position change is input, as shown in FIG. 47, the insertion position display section 61a indicating the insertion position of the character input plate 61 is edited. It is moved to the position indicated by the arrow of the symbol 102 (step S53).

In this embodiment, the editing symbol 102 for instructing to change the insertion position is input so that one end of the editing symbol 102 is placed on the insertion position display section 61a, and the other end is inserted into the insertion position. The position to which the position display section 61a is to be moved is indicated by a single arrow.

If the handwriting input in step S46 is determined to be an edit symbol for changing the insertion position while the character input plate 61 is not displayed, a display as shown in FIGS. Will be performed.

That is, as shown in FIG. 48, when the editing symbol for insertion 51 is input, if there is a space near which characters are to be input, the editing symbol 5 is displayed as shown in FIG.
The insertion position mark 71 is displayed instead of 1.

When the user wants to change the insertion position after the insertion position mark 71 is displayed, the user inserts an edit symbol 102 for instructing the insertion position change at one end as shown in FIG. The part is put on the insertion position mark 71, and the other end (single arrow) is input so as to indicate the new insertion position. Then, as shown in FIG. 51, the insertion position mark 71 is moved to the position specified by the edit symbol 102 (step S53).

The handwriting input in step S46 is
If it is determined in step S49 that the character is an edit symbol for a character edit instruction, the process proceeds to step S54 to highlight the character surrounded by the edit instruction symbol. And
Proceeding to step S55, various editing processes corresponding to the input editing symbol are executed. Then, thereafter, the process returns to step S46 to be in a standby state for a new input.

When an edit symbol for a character edit instruction is input while the character input plate 61 is displayed, the display as shown in FIGS. 52 to 58 is performed.

That is, as shown in FIG. 52, when an editing symbol 51 for insertion is inputted, if another character is displayed in the vicinity of the character, a character input plate 61 is displayed as shown in FIG.
Is displayed. Then, as shown in FIG. 54, after a character (“Ai” in this embodiment) is input into the character input plate 61, the character “Ai” is input.
When performing a predetermined editing process, as shown in FIG.
An edit symbol 103 for editing instructions that surrounds the character "Ai" twice in a loop is input (step S49).

As described above, when the editing symbol 103 is input, the character surrounded by the editing symbol 103 is selected as an object to be edited, and is highlighted as shown in FIG. 56 (step S54). Further, as shown in FIG. 57, for example, when it is desired to make the character "Ai" to be edited bold, an edit symbol 74 for making it bold
(Alphabet B in this embodiment) is input. When such an edit symbol 74 is input, FIG.
As shown in (5), the character "Ai" to be edited is displayed in bold (step S55).

On the other hand, when a character editing instruction is given while the character input plate 61 is not displayed, FIG.
The display as shown in FIGS.

That is, as shown in FIG. 59, when an edit symbol 51 for insertion is inputted, if there is a sufficient space in the vicinity of the edit symbol 51, as shown in FIG. 71 is displayed. In this state,
As shown in FIG. 61, the user inputs a character “Aoi” to be inserted near the insertion position mark 71.

After performing such an input, if it is desired to perform a predetermined edit on the inserted character “Ai”,
As shown in FIG. 62, an edit symbol 103 for editing instructions is input so as to surround this character "Ai" in a loop twice (step S49). Then, as shown in FIG.
The character "Ai" designated by the edit symbol 103 is highlighted (step S54).

In this state, as shown in FIG. 64, in the vicinity of the highlighted character “Ai”,
When the edit symbol 74 (character B) is input, the character "Ai" is displayed in bold as shown in FIG. 65 (step S55).

Although FIGS. 36 to 65 show only examples of displaying characters, figures to be inserted can be canceled,
Similar processing is performed when the insertion position is moved or edited.

As described above, this embodiment can be applied to input not only characters but also figures and other arbitrary shapes.

[0123]

As described above , according to the handwritten input display device of the first aspect and the handwritten input display method of the tenth aspect ,
For example, the size and display position of the plate can be changed by adjusting the editing symbol to be input . As a result, operability is improved, and quick input becomes possible.

Further, since the size of the plate can be changed, the size can be reduced as necessary, and the range of the display characters hidden by the plate can be reduced.

[0125] In addition, a character that has already been displayed, it is reduced to such figures is being obscured, it is possible to input while looking at the whole.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of an embodiment of a handwriting input display device of the present invention.

FIG. 2 is a diagram illustrating a process in which a result input to an input tablet 15 by a pen 16 is displayed on a display unit 13.

FIG. 3 is a flowchart illustrating an operation of the embodiment of FIG. 1;

FIG. 4 is a flowchart illustrating details of a process of determining an insertion symbol in step S2 of FIG. 3;

FIG. 5 is a flowchart illustrating details of a process of determining an edit symbol at the end of input in step S6 of FIG. 3;

FIG. 6 is a diagram illustrating editing symbols for inserting characters.

FIG. 7 is a diagram illustrating edit symbols for terminating input.

FIG. 8 is a diagram illustrating a character input plate.

FIG. 9 is a diagram illustrating a display state in Japanese and English.

FIG. 10 is a diagram illustrating a display range of one character.

FIG. 11 is a diagram illustrating a specific display example on the display unit 13 of FIG. 1;

FIG. 12 is a diagram illustrating a display example following FIG. 11;

FIG. 13 is a view for explaining another embodiment of an edit symbol for character insertion.

FIG. 14 is a view for explaining another embodiment of the input symbol for editing symbols.

FIG. 15 is a flowchart illustrating another operation example of the handwriting input display device of the present invention.

FIG. 16 is a diagram illustrating the processing operation in step S42 of FIG.

FIG. 17 is a diagram illustrating a display example in step S45 of FIG.

18 is a diagram illustrating a display example in step S46 of FIG.

FIG. 19 is a diagram illustrating a display example in step S56 of FIG.

FIG. 20 is a diagram illustrating a display example in step S57 of FIG.

FIG. 21 is a diagram illustrating a display example in step S42 of FIG.

FIG. 22 is a diagram illustrating a display example in step S44 of FIG.

FIG. 23 is a diagram illustrating a display example in step S46 of FIG.

24 is a diagram illustrating a display example in step S56 of FIG.

FIG. 25 is a diagram illustrating a display example in step S57 of FIG.

26 is a diagram illustrating a display example in step S42 of FIG.

FIG. 27 is a diagram illustrating a display example in step S45 of FIG.

FIG. 28 is a diagram illustrating a display example in step S46 of FIG.

FIG. 29 is a diagram illustrating a display example in step S50 of FIG.

30 is a diagram illustrating a display example in step S57 of FIG.

FIG. 31 is a diagram illustrating a display example in step S42 of FIG.

FIG. 32 is a diagram illustrating a display example in step S44 of FIG.

FIG. 33 is a diagram illustrating a display example in step S46 of FIG.

FIG. 34 is a diagram illustrating a display example in step S50 of FIG.

FIG. 35 is a diagram illustrating a display example in step S57 of FIG.

36 is a diagram illustrating a display example in step S42 of FIG.

FIG. 37 is a diagram illustrating a display example in step S45 of FIG.

FIG. 38 is a diagram illustrating a display example in step S47 of FIG.

39 is a diagram illustrating a display example in step S52 of FIG.

40 is a diagram illustrating a display example in step S42 of FIG.

FIG. 41 is a diagram illustrating a display example in step S44 of FIG.

FIG. 42 is a diagram illustrating a display example in step S47 of FIG.

FIG. 43 is a diagram illustrating a display example in step S52 of FIG.

FIG. 44 is a diagram illustrating a display example in step S42 of FIG.

FIG. 45 is a diagram illustrating a display example in step S45 of FIG.

FIG. 46 is a diagram illustrating a display example in step S48 of FIG.

FIG. 47 is a diagram illustrating a display example in step S53 of FIG.

FIG. 48 is a diagram illustrating a display example in step S42 of FIG.

FIG. 49 is a diagram illustrating a display example in step S44 of FIG.

50 is a diagram illustrating a display example in step S48 in FIG.

FIG. 51 is a diagram illustrating a display example in step S53 of FIG.

FIG. 52 is a diagram illustrating a display example in step S42 of FIG.

FIG. 53 is a diagram illustrating a display example in step S45 of FIG. 15;

FIG. 54 is a diagram illustrating a display example in step S46 of FIG.

FIG. 55 is a diagram illustrating a display example in step S49 of FIG.

FIG. 56 is a diagram illustrating a display example in step S54 of FIG.

FIG. 57 is a diagram illustrating a display example in step S55 of FIG.

58 is a diagram illustrating a display example in step S55 of FIG.

FIG. 59 is a diagram illustrating a display example in step S42 of FIG.

FIG. 60 is a diagram illustrating a display example in step S44 of FIG.

FIG. 61 is a diagram illustrating a display example in step S46 of FIG.

FIG. 62 is a diagram illustrating a display example in step S49 of FIG.

63 is a diagram illustrating a display example in step S54 of FIG.

FIG. 64 is a diagram illustrating a display example in step S55 of FIG.

FIG. 65 is a diagram illustrating a display example in step S55 of FIG. 15;

FIG. 66 is a plan view showing a configuration of an example of a conventional handwritten input display device.

FIG. 67 is a diagram illustrating a state in which the plate is drawn out of the icon in the conventional example shown in FIG. 66.

[Explanation of symbols]

 1 CPU 2 ROM 3 RAM 8 Bus line 11 Display controller 12 V-RAM 13 Display section 14 Tablet interface 15 Input tablet 16 Pen 41 Main body 42 Pen 44 Display area 44a Character display area 44b Icon display area 45 Icon 46 Plate 51, 52 Edit Symbol 61 Character input plate 62 Character input area 63 Graphic input plate 71 Insertion position mark 101 to 103 Editing symbol

Continuation of front page (56) References JP-A-60-75980 (JP, A) JP-A-61-107468 (JP, A) II. New OS for pen input in pursuit of portability: PenPoint, NIKKEI BYTE, Japan, April 1991, pp. 236-249 (58) Fields investigated (Int. Cl. ⁷ , DB name) G06K 9/00-9 / 82 G06F 3/03

Claims (11)

(57) [Claims] 1. A character input means for the stroke handwritten inputs including editing symbols, the plate shows a range in which to enter the letters, and a display means for displaying the strokes input by said input means, said input means and the editing symbol that has been input by, the Hen
Detecting means for detecting a parameter of a collection symbol , and setting a display state of the plate in accordance with the parameter detected by the detecting means ,
Control means for controlling the display to be displayed at a predetermined position on the display means. 2. The method according to claim 1, wherein the detecting unit detects, as the parameter, coordinates of a feature point of the edit symbol, and the control unit detects the feature detected by the detecting unit.
Control the display state of the plate based on the coordinates of the marking points
2. The handwriting input display device according to claim 1, wherein: 3. The handwriting input display device according to claim 2 , wherein said control means controls a width of said plate. 4. The handwriting input display device according to claim 2 , wherein said control means controls a height of said plate. 5. The control means displays the plate when the first edit symbol of the edit symbol is detected by the detection means, and controls the second edit symbol of the edit symbol by the detection means. 2. The handwriting input display device according to claim 1 , wherein the plate is erased when a symbol is detected. 6. The control means according to claim 1 , wherein
The insertion position of the character corresponding to the issued parameter
2. The method according to claim 1, further comprising controlling the position.
Handwriting input display device. 7. The control means is operated by the input means.
From the stroke entered in the writing plate to the character
, The characters are displayed in the plate,
The editing symbol for terminating the input is detected by the detecting means.
The plate is erased and the plate
The character displayed in the
Handwriting input according to claim 6, characterized in that the insert
Display device. 8. The control means is operated by the input means.
From the stroke entered in the writing plate to the character
, The characters are displayed in the plate,
The above-mentioned editing symbol of input cancellation is detected by the detecting means.
Is displayed in the plate and the plate
Erases the character, and inserts the
If the edit symbol for replacement is detected,
Change the insertion position, and use the detection means to
If the above edit symbol is detected, it is displayed on the plate.
Selecting said characters shown for editing
The handwriting input display device according to claim 6, characterized in that: 9. The method according to claim 8, wherein the detecting means includes the parameter as
Speed and acceleration of the input means for inputting the edit symbol
Detects any one of degree and pen pressure
The handwriting input display device according to claim 1, wherein
Place. 10. An input hand for manually inputting a stroke.
A plate indicating a range for inputting a column, a character, and the strike
Display means for displaying a rook, an edit symbol and the edit symbol
Detecting means for detecting a parameter; and
Corresponding to the detected parameter,
Provided with control means for setting the display state of the
In the handwriting input display method of a writing input display device, the stroke including the character and the editing symbol
An input step of handwriting input by the fill power means, said plate, and input by the processing of the input step
Display for displaying the pressed stroke on the display means
And the edit symbol input by the processing of the input step
And the parameters of the edit symbol are detected by the detection means.
A detection step to output, and the parameter detected by the processing of the detection step.
In response to the data, the display of the plate by the control means
Setting the state, the plate is displayed on the display
This and a control step of controlling to display at the position
And a handwriting input display method. 11. The processing of the detecting step includes the step of
As a meter, the coordinates of the feature point of the edit symbol are detected, and the processing in the control step is performed in the processing in the detection step.
Based on the coordinates of the feature points detected by the
Claim, characterized in that to control the display state of over preparative 10
Handwriting input display method described in.