JP4778720B2 - Digital pen and handwriting input system - Google Patents

Description

  The present invention relates to a digital pen and a handwriting input system, and more particularly to a digital pen and a handwriting input system having a transmission function.

  An input method for performing handwriting input with a writing instrument such as a pen has been used for a long time. In recent years, a method of digitizing handwritten information by handwriting input has been considered.

  An advantage of digitizing handwritten information is that handwritten information can be easily transmitted and received via a network. As a method for transmitting and receiving handwritten information, there are roughly two methods.

  One is a method of storing handwritten information in the memory of the pen and sending it together after handwriting input is completed. This method is suitable for cases where constant connection to the network is not possible or when it is not desirable to place a heavy load on the network. Yes.

  The other is a method of performing transmission at any time while handwriting input is being performed, and is suitable when the handwritten information is desired to be used immediately at the transmission destination or when the pen does not include a storage unit. This method also applies to handwriting input using a pen tablet.

Thus, there are two transmission / reception methods, and each method has advantages and disadvantages. Although it may be possible to switch the transmission / reception method depending on the situation, although there is such an information terminal (for example, Patent Document 1), it is possible to switch the transmission method of handwritten information performed by pen input. The pen never existed until now.
JP 2002-51312 A

  Thus, the conventional digital pen has a problem that the transmission method cannot be switched.

  The present invention has been made to solve such problems, and an object of the present invention is to provide a digital pen capable of switching a handwritten information transmission method according to a situation.

  The digital pen according to the present invention reads a pattern printed on a sheet and generates pattern information, a storage unit that stores pattern information generated by the reading unit, and the pattern information stored in the storage unit A digital pen having a transmission unit that transmits to a server connected to the server via a terminal or directly, and transmits the pattern information read by the reading unit to the server immediately after reading the pattern information. The digital pen includes a switching unit that switches between a streaming mode and an accumulation mode in which pattern information stored in the storage unit is accumulated until a transmission command is input. With such a configuration, the handwritten information transmission method can be switched according to the situation.

  The transmission unit may store the identification information unique to the digital pen and transmit the pattern information to the server in association with the identification information. This makes it possible to enhance security.

  The switching unit may switch between the streaming mode and the accumulation mode based on the input pattern information. By doing so, the user can switch the transmission method without being aware of the switching.

  The digital pen may include a transmission mode switching switch, and the switching unit may switch between a streaming mode and a storage mode based on the transmission mode switching switch. In this way, the user can arbitrarily switch the transmission method.

  The digital pen includes a receiving unit that receives a transmission mode determination signal, and the switching unit switches between a streaming mode and an accumulation mode based on the transmission mode determination signal received by the receiving unit. Also good. By doing in this way, it becomes possible to switch the transmission method from the outside.

The handwriting input system according to the present invention is a handwriting input system comprising a sheet, a digital pen that fills in the sheet, and a server that is communicably connected to the pen,
The paper is printed with a pattern indicating position information corresponding to the position where the pen is filled in, and the digital pen reads the pattern printed on the paper and generates pattern information; and A storage unit that stores pattern information generated by the reading unit, a transmission unit that transmits the pattern information stored in the storage unit to a connected server directly or via a terminal, and a reading unit that reads the pattern information A switching unit that switches between a streaming mode in which the transmitting unit transmits the pattern information to the server immediately after reading the received pattern information and an accumulation mode in which the pattern information stored in the storage unit is accumulated until a transmission command is input The server includes a receiving unit that receives the pattern information from the digital pen, and an information process that processes the received pattern information. Parts is a handwriting input system with. With such a configuration, the handwritten information transmission method can be switched according to the situation.

The transmitting unit transmits means for storing identification information unique to the digital pen and pattern information to the server in association with the identification information, and the receiving unit associates the position information with the identification information. A pattern information storage unit that receives and registers and stores the identification information of the digital pen in advance, the identification information associated with the received pattern information, and the identification information of the digital pen stored in the pattern information storage unit Including a determination unit that determines whether or not
The information processing unit may process the received pattern information only when they are matched as a result of the determination by the determination unit. This makes it possible to enhance security.

  The switching unit may switch between the streaming mode and the accumulation mode based on the input pattern information. By doing so, the user can switch the transmission method without being aware of the switching.

  The digital pen may include a transmission mode switching switch, and the switching unit may switch between a streaming mode and a storage mode based on the transmission mode switching switch. In this way, the user can arbitrarily switch the transmission method.

  The digital pen includes a receiving unit that receives a transmission mode determination signal, and the switching unit switches between a streaming mode and an accumulation mode based on the transmission mode determination signal received by the receiving unit. Also good. By doing in this way, it becomes possible to switch the transmission method from the outside.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide the digital pen which can switch the transmission method of handwritten information according to a condition.

  FIG. 1 is a schematic diagram showing an overall configuration of a handwriting input system according to the present invention. The handwriting input system according to the present invention includes a digital pen 11, annot paper 12, a PC 13, and a server 24. The PC 13 and the server 24 are connected via the Internet 10 and can communicate with each other. Further, the digital pen 11 and the PC 13 are connected wirelessly or by wire and can communicate with each other.

  The digital pen 11 is an input means for a user to input information by handwriting input. The digital pen 11 can communicate with the PC 13 by wireless communication or the like, and transmits input handwritten input information to the PC 13. The digital pen 11 stores individual identification information, and transmits the stored individual identification information to the PC 13 in association with handwritten input information.

  The Anoto sheet 12 is a dedicated sheet for inputting handwritten information with the digital pen 11. In this embodiment, handwritten input information is recorded by the Anoto method, and a dedicated sheet is required. The Anoto method will be described later.

  The PC 13 serves as a modem that receives handwritten input information from the digital pen 11 and transmits the received handwritten input information to the server 24 via the Internet 10. Although a PC is used here, it may be a portable terminal such as a PDA (Personal Digital Assistant) having a communication function, or may be a portable phone or a box dedicated to Bluetooth communication. If the digital pen 11 and the server 24 can directly communicate, the PC 13 may not be provided.

  The server 24 is a server that receives handwritten input information input to the digital pen 11 and performs a reservation process, and a commercially available PC or server can be used as it is. The server 24 transmits information necessary for reservation to the digital pen 11. The identification information of the digital pen 11 may be authenticated at the time of reception, and only handwritten input information transmitted from the authenticated digital pen 11 may be received.

 Here, an outline of a hardware configuration of the digital pen 11 will be described with reference to FIG. The digital pen 11 is wirelessly connected to a mobile phone or a personal computer using, for example, Bluetooth (registered trademark) or the like, but may be connected by wire using a USB (Universal Serial Bus) or the like. . Further, the digital pen 11 writes characters, pictures, drawings, etc. on the pattern surface 121 of the Anoto paper 12 by a normal method, and transmits the handwritten information to the PC at the same time. The pattern surface 121 is provided with a specific code pattern to be described later.

  As shown in FIG. 2, the digital pen 11 includes a ballpoint pen 110, a writing pressure sensor 112, an optical module 113, a signal processing unit 115, a control unit 116, a switch 117, a memory 118, a battery 119, and a communication control unit 120. Yes. The digital pen 11 is not limited to the shape of a pen as long as it can write characters, drawings, and the like, and may have any shape.

  The ballpoint pen 110 is a writing means, has a pen point 111 at one end, and is in contact with the writing pressure sensor 112 at the other end. The ballpoint pen 110 is filled with ink. The material and the color of the ink are not particularly limited as long as they do not affect the reading of the code pattern on the Anoto paper 12, but are preferably not those that absorb infrared rays, such as carbon. In addition, the ballpoint pen 110 can write characters or the like on the Anoto paper 12 or the normal paper in the same manner as a normal ballpoint pen. Further, the ballpoint pen 110 is not limited to the ballpoint pen, and may be a fluorescent pen, a sign pen, a fountain pen, or the like.

  The pen pressure sensor 112 is in contact with the ballpoint pen 110 and is connected to, for example, the signal processing unit 115. The writing pressure sensor 112 detects the writing pressure of the ballpoint pen 110 and outputs it to the signal processing unit 115 as described later. The pen pressure sensor 112 may be any sensor that can detect the pen pressure of the ballpoint pen 110, may be a contact sensor such as a pressure sensor, or may be a non-contact sensor such as an optical sensor or an ultrasonic sensor. If it is a type | mold sensor, it does not need to contact the ball-point pen 110. FIG. Furthermore, the writing pressure sensor 112 may detect not only the writing pressure but also the amount of ink of the ballpoint pen 110 and the like.

  For example, the optical module 113 is connected to the signal processing unit 115. As will be described later, the optical module 113 detects the code pattern of the detection range 114 in the vicinity of the pen tip 111 by optical means, and outputs it to the signal processing unit 115. The optical module 113 only needs to be able to detect the code pattern of the detection range 114, and may be, for example, a CMOS camera, a CCD camera, a light emitting element, a light receiving element, or the like. Furthermore, the optical module 113 may detect not only the code pattern but also the distance between the pen tip 111 and the pattern surface, the angle of the ballpoint pen 110, and the like. The optical module 113 preferably has a performance capable of detecting the code pattern even when the pen tip 111 is about 5 mm away from the pattern surface, but is not limited thereto.

  The signal processing unit 115 is connected to, for example, the writing pressure sensor 112, the optical module 113, the control unit 116, and the memory 118. As will be described later, the signal processing unit 115 includes a normalization unit, a decoder unit, an ADC, and the like, and converts the detection signal of the writing pressure sensor 112 into a digital signal and decodes the detection signal of the optical module 113. . Further, the signal processing unit 115 outputs the converted / decoded signal to the control unit 116 and the memory 118.

  For example, the control unit 116 is connected to the signal processing unit 115, the switch 117, and the memory 118. For example, the control unit 116 may control ON / OFF of the power supply of the entire digital pen 11 according to ON / OFF of the switch 117. Further, the control unit 116 outputs a signal from the signal processing unit 115 to the memory 118.

  The switch 117 is connected to the control unit 116, for example. The switch 117 may be a power switch, a switch for detecting the writing pressure sensor 112 and the optical module 113, a switch for the communication control unit 120 to communicate, and the like. Further, a switch for switching whether the current mode is the streaming mode or the accumulation mode may be used. The mode will be described in detail later.

  The memory 118 is connected to the signal processing unit 115 and the control unit 116, for example. As will be described later, the memory 118 stores information input from the signal processing unit 115 and the control unit 116, and outputs the stored information to the communication control unit 120. The memory 118 only needs to be able to store information input from the signal processing unit 115 or the control unit 116, and may be a RAM, an EEPROM, a memory card, or the like.

  The battery 119 supplies operating power to each element of the digital pen 11. The battery 119 may be a primary battery such as a dry battery, a secondary battery such as a lithium ion battery, and may be another device or an interface having a power supply capability such as a USB.

  The communication control unit 120 is connected to the memory 118, for example. As will be described later, the communication control unit 120 transmits information input from the memory 118 to a PC or the like by wireless or wired communication. The communication control unit 120 only needs to be communicably connected to a PC or the like. In the case of wireless connection, a communication control circuit or a wireless antenna that enables communication by Bluetooth or the like may be used. A communication control circuit or a communication port that enables communication may be used. In addition, the concrete system and realization means of each component mentioned above are not limited to a specific thing.

  The Anoto paper 12 is an example of electronic paper that employs the Anoto digitizing method. This method is a digitizing method developed by Anoto, a Swedish company. Specifically, in the Anoto method, a point is printed on a sheet with a slight shift from the intersection of a 0.3 mm grid, and this point is photographed by a microminiature camera provided in the digital pen 11. The Anoto method is a digitizing method that calculates absolute coordinates based on how 6 points × 6 points, that is, 36 points are displaced from the lattice.

  The Anoto paper 12 has a code pattern 122 printed on a pattern surface 121 that is a writing surface. Further, the Anoto paper 12 is not limited to paper, but may be wood, a plastic plate, glass, or the like.

  As shown in FIG. 3, the code pattern 122 is composed of a plurality of dots 123 arranged in a lattice pattern. The dots 123 only need to be recognized by the optical module 113 and may not be recognized by human vision. For example, the dots 123 may be printed with carbon ink or the like. For example, the diameter of the dot 123 is 0.1 mm and the interval of the lattice is 0.3 mm, but any other value may be used.

  As shown in FIG. 3, the dots 123 may be arranged shifted vertically and horizontally from the position of the lattice. For example, the dots 123 shifted vertically and horizontally are equivalent to four codes “0”, “1”, “2”, and “3”, that is, a 2-bit code in a binary number. For example, if the codeword of the pattern is a 6 × 6 code in the vertical and horizontal directions, a value of 6 × 6 × 2 bits, that is, 72 bits per codeword can be represented.

  Then, by representing the coordinate data of the X-axis coordinate and the Y-axis coordinate from the only code pattern indicated by the code pattern 122, the absolute position of the Anoto sheet 12 can be detected. The code pattern 122 is not limited to the coordinate data, and may include information on the Anoto sheet 12. The code pattern 122 is not limited to a specific code method / code pattern, its recording method, and pattern detection method as long as the position coordinate of the pen tip 111 can be detected.

  The digital pen 11 captures 50 to 100 images per second and transmits the coordinate values at that time. By printing point sequences in different coordinate spaces on the Anoto paper 12, the Anoto paper 12 can be distinguished by an absolute address. Using this, a function called paper lookup is realized. This function analyzes the coordinate data of the paper sent from the pen and identifies the application assigned to the Anoto paper 12 from the absolute address. As a result, the application can be specified using only the paper and the pen, so that it is not necessary to switch the application depending on the paper (content) as before.

  Next, the functional configuration of the digital pen according to the present invention will be specifically described. FIG. 4 is a block diagram showing a functional configuration of the handwriting input system according to the present invention. The handwriting input system according to the present invention includes a digital pen 11, annot paper 12, a PC 13, and a server 24.

  The digital pen 11 includes an input unit 1100, a storage unit 1101, a transmission unit 1102, and a switching unit 1103.

  The input unit 1100 is a reading unit that performs reading by recognizing the code pattern 122 printed on the Anoto sheet 12 by the optical module 113. The input unit 1100 generates pattern information from the read code pattern 122. The input unit 1100 stores the generated pattern information in the storage unit 1101.

  The storage unit 1101 is a storage unit that stores pattern information generated from the code pattern read by the input unit 1100. The storage unit 1101 is configured by the memory 118. Whether the current mode is a streaming mode in which the transmission unit 1102 transmits the pattern information to the server 24 immediately after reading the pattern information, or an accumulation mode in which the stored pattern information is accumulated until a transmission command is input. Information may be stored.

  The transmission unit 1102 transmits the pattern information stored in the storage unit 1101 to the PC 13. At this time, after converting the pattern information into pattern information such as coordinate information, the converted pattern information may be transmitted. If not converted, the code pattern becomes the pattern information as it is.

  The switching unit 1103 determines whether the current mode is the streaming mode or the accumulation mode by referring to the storage unit 1101 or the like, and determines whether to cause the transmission unit 1102 to perform transmission based on the determination result. . It is also possible to cause the transmission unit 1102 to perform transmission when a separate transmission command is received.

  The server 24 includes a receiving unit 240 and an information processing unit 241.

  The receiving unit 240 is means for receiving the code pattern transmitted from the digital pen 11 via the PC 13 and is realized by a modem provided in the server 24.

  The information processing unit 241 is means for actually processing the received pattern information, and is realized by a CPU provided in the server. The content of the processing is not particularly limited, and examples thereof include conversion of input input information into image data as handwritten information.

  Next, the flow of processing of the digital pen 11 in the present invention will be described using the flowchart shown in FIG.

  First, the input unit 1100 inputs the code pattern of the Anoto sheet 12 (S1). Next, pattern information is generated from the code pattern input by the input unit 1100, and the generated pattern information is output to the storage unit 1101. The storage unit 1101 stores the pattern information input from the input unit 1100 (S2).

  The switching unit 1103 determines whether or not to transmit the pattern information input and stored earlier to the PC 13 (S3). The switching unit 1103 determines that transmission is performed when the streaming mode is selected or when a separate transmission command is received, and otherwise determines that transmission is not performed. If it is determined not to transmit, the input unit 1100 inputs the code pattern again.

  If it is determined to be transmitted, the pattern information input by the transmission unit 1102 is transmitted to the PC 13 (S4). At this time, the converted input information may be transmitted after converting the code pattern into input information such as coordinate information.

  Subsequently, switching of whether or not to perform transmission by the switching unit 1103 will be specifically described. The switching unit 1103 is determined in advance according to the code pattern of the annotation sheet 12. Code pattern data on which code pattern of the anoto sheet 12 is to be transmitted when input is stored in the memory 118 of the digital pen 11.

  FIG. 6 is a diagram showing a specific example of an annotation sheet. Anoto sheet 30 shown in FIG. 6 is a sheet used when a seat reservation is made. The Anoto sheet 30 has a start area 301, a seat layout area 302, a reservation person information input area 303, and a transmission area 304.

  The start area 301 is an area checked by the digital pen 11 when input is started. The seat layout area 302 is an area indicating the position of a seat to be reserved. By checking with the digital pen 11, it is possible to confirm whether or not a seat corresponding to the checked position can be reserved. The reservation person information input area 303 is an area in which information such as the name, address, and payment method of the reservation person is input by hand when actually making a reservation. The transmission area 304 is an area to be checked when handwritten information input in the reservation person information input area 303 is transmitted to the server 24.

  When the seat reservation is performed using the Anoto sheet 30 shown in FIG. 6, the switching unit 1103 immediately transmits to the server 24 when the input code pattern is the pattern printed in the reservation person information input area 303. Not performed. If the input code pattern is a pattern printed in any of the start area 301, the seat layout area 302, and the transmission area 304, the pattern information is immediately transmitted to the server 24.

  When the server 24 receives the pattern information by the receiving unit 240, the information processing unit 241 performs processing according to the received pattern information. For example, if the received pattern information is pattern information corresponding to the seat layout area 302, a query (not shown) provided in the server 24 is inquired as to whether or not the corresponding seat in the seat layout area can be reserved, and the reservation is made. Information indicating whether or not it is possible is generated. The generated information indicating whether or not reservation is possible is transmitted to the PC 13 or a separately connected display terminal, and the user can confirm whether or not reservation is possible.

  If the received pattern information is the pattern information corresponding to the transmission area 304, it is in the accumulation mode, so that the handwritten information input to the reservation person information input area 303 and accumulated in the storage unit 1101 of the digital pen 11 Are received together. Therefore, the information processing unit 241 performs a reservation process using the received handwritten information as reservation person information.

  Another example will be described. FIG. 7 is a diagram illustrating a specific example of an annotation sheet. Annot paper 31 shown in FIG. 7 is a paper used as a catalog capable of displaying detailed information by PC 13 or a separately connected display terminal. The Anoto paper 31 has a product display area 310 and a check area 311.

  The product display area 310 is an area in which products to be displayed in the catalog are displayed. The check area 311 has a one-to-one correspondence with the merchandise display area 310, and if the merchandise displayed in the corresponding merchandise display area 310 is to be confirmed in more detail, if the digital pen 11 is used to check the detailed information from the server 24 Is transmitted, and detailed information is displayed on the PC 13 or a separately connected display terminal.

  When browsing the catalog using the Anoto paper 31 shown in FIG. 7, the switching unit 1103 immediately transmits to the server 24 when the input code pattern is a pattern printed in the check area 311. If the pattern is printed in any other area, transmission is not immediately performed.

  When the server 24 receives the pattern information by the receiving unit 240, the information processing unit 241 performs processing according to the received pattern information. For example, if the received pattern information is pattern information corresponding to the pattern printed in the check area 311, detailed information on the corresponding product is acquired from a database (not shown) provided in the server 24. The generated information indicating whether or not reservation is possible is transmitted to the PC 13 or a separately connected display terminal, and the user can confirm whether or not reservation is possible.

  In this way, it is possible to determine whether to immediately transmit the information input by the digital pen 11 based on the printed pattern.

Other Embodiments of the Invention
In the above-described example, whether or not to immediately transmit the information input by the digital pen 11 is determined by the code pattern printed on the anoto sheet, but the digital pen 11 includes a changeover switch, and the changeover switch. You may make it determine by. In this way, the user can arbitrarily switch the transmission method.

  In the above example, whether or not to immediately transmit the information input by the digital pen 11 is determined by the code pattern printed on the anoto sheet, but this is a signal that is input by inputting a signal from the outside. You may make it determine by. By doing in this way, it becomes possible to switch the transmission method from the outside. This method is suitable, for example, for checking only the answer of a specific student when the student uses a digital pen to perform a class.

It is a schematic diagram which shows an example of schematic structure of the handwriting input system concerning this invention. It is a schematic diagram which shows the structural example of the digital pen concerning this invention. It is a schematic diagram which shows an example of the Anoto paper concerning this invention. It is a block diagram which shows the function structure of the handwriting input system concerning this invention. It is a flowchart which shows the flow of a process of the digital pen concerning this invention. It is a figure which shows the specific example of the Anoto paper concerning this invention. It is a figure which shows the specific example of the Anoto paper concerning this invention.

Explanation of symbols

10 Internet 11 Digital pen 12 Anoto paper 13 PC
24 server 30 anoto paper 31 anoto paper 110 ballpoint pen 111 pen tip 112 writing pressure sensor 113 optical module 114 detection range 115 signal processing unit 116 control unit 117 switch 118 memory 119 battery 120 communication control unit 121 pattern surface 122 code pattern 123 dot 240 reception Section 241 Information processing section 301 Start area 302 Seat layout area 303 Reserving person information input area 304 Transmission area 310 Product display area 311 Check area 1100 Input section 1101 Storage section 1102 Transmission section 1103 Switching section

Claims (4)

A reading unit that reads patterns printed on paper and generates pattern information, a storage unit that stores pattern information generated by the reading unit, and a server that is connected to the pattern information stored in the storage unit A digital pen equipped with a transmitter for transmitting directly or via a terminal,
Either a streaming mode in which the transmission unit transmits the pattern information read by the reading unit to the server immediately after reading, or an accumulation mode in which the pattern information stored in the storage unit is stored until a transmission command is input. A switching unit for switching between,
A receiving unit for receiving a transmission mode determination signal,
The digital pen , wherein the switching unit switches between a streaming mode and a storage mode based on the transmission mode determination signal received by the receiving unit .   2. The digital pen according to claim 1, wherein the transmission unit includes means for storing identification information unique to the digital pen, and transmits the pattern information to the server in association with the identification information. A handwriting input system comprising a sheet, a digital pen that fills in the sheet, and a server that is communicably connected to the pen,
The paper is printed with a pattern indicating position information corresponding to the position where the pen is filled in,
The digital pen connects a reading unit that reads a pattern printed on paper and generates pattern information, a storage unit that stores pattern information generated by the reading unit, and the pattern information stored in the storage unit A transmission unit that transmits the received server directly or via a terminal; a streaming mode that transmits the pattern information read by the reading unit to the server immediately after reading the pattern information; and storage in the storage unit A switching unit that switches between the accumulation modes for accumulating the pattern information until a transmission command is input, and a reception unit that receives the transmission mode determination signal,
The switching unit switches between the streaming mode and the accumulation mode based on the transmission mode determination signal received by the receiving unit,
The server includes a receiving unit that receives the pattern information from the digital pen, and an information processing unit that processes the received pattern information. The transmission unit includes means for storing identification information unique to the digital pen, transmits pattern information to the server in association with the identification information,
The receiving unit receives the pattern information in association with the identification information;
Whether the pattern information storage unit for registering and storing the identification information of the digital pen in advance, the identification information associated with the received pattern information, and the identification information of the digital pen stored in the pattern information storage unit match A determination unit for determining
4. The handwriting input system according to claim 3 , wherein the information processing unit processes the received pattern information only when both of them match as a result of the determination by the determination unit.

Images