JP6203398B2 - System and method for processing stroke data - Google Patents

Description

  The embodiments described herein relate to techniques for sharing handwritten information.

  In recent years, various electronic devices such as tablets, PDAs, and smartphones have been developed. Many electronic devices of this type are equipped with a touch screen display to facilitate an input operation by a user.

  Recently, a system for sharing handwritten information among a plurality of terminals has been developed.

JP 2010-157098 A

  However, conventionally, when different users perform handwriting input on the same terminal in a business scene such as a meeting, it may be difficult to identify the stroke data of these users.

  An object of one aspect of the present invention is to provide a system and method capable of identifying stroke data of different users input by handwriting on the same terminal.

  According to the embodiment, the system includes receiving means and display processing means. The receiving means receives first stroke data input by handwriting in any of a plurality of terminals. The display processing means can identify an identifier of a transmission source terminal added to the first stroke data or a pen used for handwriting input of the first stroke data added to the first stroke data. The first stroke data is displayed on the screen in a form in which it is possible to identify which user has input by hand according to one of the pen identifiers. The display processing means adds the first stroke data to the first stroke data when the identifier of the transmission source terminal is added to the first stroke data and the identifier of the pen is not added. When it is displayed on the screen in an identifiable form that the handwriting input by the user corresponding to the identifier of the first identifier and both the identifier of the transmission source terminal and the identifier of the pen are added to the first stroke data, The one-stroke data is displayed on the screen in a form in which it is possible to identify that it has been input by handwriting by the user corresponding to the pen identifier added to the first stroke data.

FIG. 1 is an exemplary perspective view showing an appearance of an electronic apparatus according to the embodiment. FIG. 2 is an exemplary diagram showing connections between terminals using the handwriting sharing service. FIG. 3 is an exemplary diagram showing a data flow between the electronic device (handwriting collaboration server system) of FIG. 1 and each terminal. FIG. 4 is an exemplary diagram illustrating an example of a screen displaying handwritten information of a plurality of terminals. FIG. 5 is an exemplary diagram illustrating an example of a handwritten document handwritten on the touch screen display of the electronic apparatus of FIG. 1. FIG. 6 is an exemplary diagram showing time-series information (handwritten page data) corresponding to the handwritten document of FIG. FIG. 7 is an exemplary block diagram showing a system configuration of the electronic apparatus of FIG. FIG. 8 is an exemplary block diagram showing a functional configuration of a handwriting sharing application program executed by the electronic device of FIG. FIG. 9 is an exemplary diagram showing the contents of information stored in the stroke database of the electronic device of FIG. FIG. 10 is an exemplary diagram showing a display style management table generated by the electronic apparatus of FIG. FIG. 11 is an exemplary diagram for explaining a process of displaying stroke data input by handwriting in any of a plurality of terminals in a form determined according to either the terminal ID or the pen ID. FIG. 12 is an exemplary diagram for explaining a process of displaying a plurality of stroke data input by handwriting by a plurality of users in the same terminal in different forms. FIG. 13 is an exemplary flowchart showing a procedure of display style setting processing executed by the electronic apparatus of FIG. FIG. 14 is an exemplary flowchart showing a procedure of stroke delivery processing executed by the electronic apparatus of FIG.

Hereinafter, embodiments will be described with reference to the drawings.
FIG. 1 is a perspective view illustrating an external appearance of an electronic apparatus according to an embodiment. This electronic device is, for example, a pen-based portable electronic device capable of handwriting input with a pen (stylus) or a finger. This electronic device can be realized as a tablet computer, a notebook personal computer, a smartphone, a PDA, or the like. Below, the case where this electronic device is implement | achieved as the tablet computer 10 is assumed. The tablet computer 10 is a portable electronic device that is also called a tablet or a slate computer. As shown in FIG. 1, the tablet computer 10 includes a main body 11 and a touch screen display 17. The touch screen display 17 is attached to be superposed on the upper surface of the main body 11.

  The main body 11 has a thin box-shaped housing. The touch screen display 17 incorporates a flat panel display and a sensor. The sensor is configured to detect a contact position of a pen or a finger on the screen of the flat panel display. The flat panel display may be, for example, a liquid crystal display (LCD). As the sensor, for example, a capacitive touch panel, an electromagnetic induction digitizer, or the like can be used. In the following, it is assumed that two types of sensors, a digitizer and a touch panel, are incorporated in the touch screen display 17.

  The touch screen display 17 can detect not only a touch operation on a screen using a finger but also a touch operation on a screen using the pen 100. The pen 100 may be, for example, an electromagnetic induction pen (digitizer pen). The user can perform a handwriting input operation on the touch screen display 17 using the pen 100. During the handwriting input operation, the trajectory of the movement of the pen 100 on the screen, that is, the stroke trajectory (handwriting) handwritten by the handwriting input operation is drawn in real time, whereby the trajectory of each stroke is displayed on the screen. . The locus of movement of the pen 100 while the pen 100 is in contact with the screen corresponds to one stroke. A set of many strokes corresponding to handwritten characters or figures, that is, a set of many trajectories (handwriting) constitutes a handwritten document.

  In the present embodiment, this handwritten document is stored in the storage medium as time-series information indicating the coordinate sequence of the trajectory of each stroke and the order relationship between the strokes, not image data. Details of this time-series information will be described later with reference to FIG. 6. This time-series information indicates the order in which a plurality of strokes are handwritten, and includes a plurality of stroke data respectively corresponding to the plurality of strokes. In other words, this time-series information means a set of time-series stroke data respectively corresponding to a plurality of strokes. Each stroke data corresponds to a certain stroke, and includes a coordinate data series (time series coordinates) corresponding to each point on the locus of this stroke. The order of arrangement of the stroke data corresponds to the order in which the strokes are handwritten, that is, the stroke order.

  Furthermore, the tablet computer 10 has an editing function. This editing function deletes or deletes arbitrary strokes or arbitrary handwritten characters in the displayed handwritten document according to the editing operation by the user using the “eraser” tool, range specification tool, and other various tools. Can move. Further, this editing function includes a function for canceling a history of some handwriting operations.

  In this embodiment, the time series information can be managed as one or a plurality of pages. In this case, a group of time-series information that fits on one screen may be recorded as one page by dividing the time-series information into area units that fit on one screen. Alternatively, the page size may be variable. In this case, since the page size can be expanded to an area larger than the size of one screen, a handwritten document having an area larger than the screen size can be handled as one page. When one entire page cannot be displayed simultaneously on the display, the page may be reduced, or the display target portion in the page may be moved by vertical and horizontal scrolling.

  As described above, since the time series information can be managed as page data, hereinafter, the time series information is also referred to as handwritten page data or simply handwritten data.

  Furthermore, the tablet computer 10 can also hand-write objects such as characters and figures on web pages, texts, images, and other various contents. In this case, the handwritten stroke can be drawn on the transparent layer set on the displayed content. Thereby, this handwritten stroke can be displayed over the above-mentioned content.

  Furthermore, the tablet computer 10 has a handwriting collaboration function. The handwriting collaboration function executes a handwriting sharing service for sharing handwritten information (handwriting stroke) between a plurality of terminals and performing collaborative work by handwriting. This handwriting sharing service transmits stroke data input by handwriting in any of a plurality of terminals logged in to the handwriting sharing service to other terminals in real time. As a result, the contents of the display screens of the plurality of terminals can be synchronized. In this case, strokes handwritten by different users are displayed on the screen of each terminal in different forms (for example, different colors, different thicknesses, different pen types (pencils, ballpoint pens, fountain pens, markers, etc.)). Can do. Changing the display form of the stroke data for each user makes it possible to identify which stroke is handwritten by which user. Moreover, you may display the guide which shows the display form allocated to each terminal (each user) logged into the handwriting sharing service on the display screen of each terminal.

FIG. 2 shows a connection example between terminals using the handwriting sharing service.
The terminal 10A is a tablet computer used by the user A. Terminal B is a tablet computer used by user B. The terminal 10C is a tablet computer used by the user C. Each of the terminals 10A, 10B, and 10C has a handwriting collaboration function equivalent to the tablet computer 10 of the present embodiment.

  Terminals 10A, 10B, and 10C are wirelessly connected to each other. As a method for this wireless connection, any wireless connection standard capable of wirelessly connecting a plurality of terminals to each other can be used. For example, Wi-Fi Direct (registered trademark) or Bluetooth (registered trademark) may be used for wireless connection between terminals. In the following, it is assumed that Wi-Fi Direct (registered trademark) is used as an example.

  Each terminal (device) corresponding to Wi-Fi Direct (registered trademark) can be connected to each other on a one-to-one basis or on a one-to-other basis. Each of the terminals 10A, 10B, and 10C can function as a terminal (device) corresponding to Wi-Fi Direct (registered trademark).

  Any one of the terminals 10A, 10B, and 10C can function as a server (handwriting collaboration server system) configured to manage the handwriting sharing service. This handwriting collaboration server system can invite each other terminal to a group of handwriting sharing services. In this case, the handwriting collaboration server system may transmit an invitation signal for encouraging participation in the handwriting sharing service group to each of the other terminals. In addition, the handwriting collaboration server system determines whether or not each terminal requesting participation in the group is permitted to join the group, that is, log in to the handwriting collaboration server system (handwriting sharing service). You can also Only each terminal that receives permission from the handwriting collaboration server system may be permitted to log in to the handwriting sharing service, that is, join the group and connect to other terminals in the group.

  Here, as a method for each terminal to log in to the handwriting collaboration server system (handwriting sharing service), a method of logging in to the handwriting sharing service using the ID (account) of the terminal itself, or a user using this terminal Any method of logging in to the handwriting sharing service using an ID (account) may be used. That is, the login and logout for the handwriting sharing service may be either login and logout using the ID (account) of the terminal itself or login and logout using the user ID (account).

  Assume that the terminals 10A, 10B, and 10C are currently logged in to the handwriting sharing service, that is, the terminals 10A, 10B, and 10C are connected to each other. In the group of handwritten sharing services including the terminals 10A, 10B, and 10C, the contents of the display screens of these terminals 10A, 10B, and 10C are synchronized.

  The stroke data handwritten input by each of the users A, B, and C on the terminal is not only displayed on the screen of the terminal of the user but also reflected in real time on the screens of the terminals of the other users. Thereby, mutual handwritten information (handwritten characters, handwritten figures, etc.) can be exchanged and shared between users participating in the handwriting sharing service group.

  Furthermore, the terminals 10A, 10B, and 10C participating in the handwriting sharing service group can also display the same content such as conference materials on the screen. In this case, stroke data input by handwriting at each terminal is displayed on this content. Users A, B, and C can exchange and share handwritten information (handwritten characters, handwritten figures, etc.) handwritten on the content while viewing the same content among the users A, B, and C.

  FIG. 3 shows a data flow between the handwriting collaboration server system and each terminal.

  In FIG. 3, it is assumed that the terminal 10A operates as a handwriting collaboration server system. The terminal 10A is one of a plurality of terminals logged into the handwriting sharing service.

  The handwriting collaboration server system (terminal 10A) has a capability of communicating with each of the terminals 10B and 10C on a one-to-other basis. The handwriting collaboration server system (terminal 10A) is directly connected to the terminal 10B in the login state. Furthermore, the handwriting collaboration server system (terminal 10A) is directly connected to the terminal 10C in the login state.

  The handwriting collaboration server system (terminal 10A) receives stroke data input by handwriting on the terminal 10B from the terminal 10B. The handwriting collaboration server system (terminal 10A) receives stroke data input by handwriting on the terminal 10C from the terminal 10B.

  Furthermore, the handwriting collaboration server system (terminal 10A) transmits stroke data input by handwriting on the terminal 10A and stroke data received from the terminal 10C to the terminal 10B. Furthermore, the handwriting collaboration server system (terminal 10A) transmits stroke data input by handwriting on the terminal 10A and stroke data received from the terminal 10B to the terminal 10C.

  Therefore, not only the handwritten object of the user A but also the handwritten object of the user B and further the handwritten object of the user C are displayed in real time on the display of the terminal 10A.

  Similarly, on the display of the terminal 10B, not only the handwritten object of the user B but also the handwritten object of the user A and further the handwritten object of the user C are displayed in real time.

  Similarly, on the display of the terminal 10C, not only the handwritten object of the user C but also the handwritten object of the user A and further the handwritten object of the user B are displayed in real time.

  The handwriting collaboration server system (terminal 10A) stores each of a plurality of stroke data input by handwriting in each terminal in the database 12 in association with the identifier (terminal ID) of the transmission source terminal. The identifier of the transmission source terminal (hereinafter referred to as the transmission source terminal identifier) may be any information as long as the information can identify the terminal. For example, the transmission source terminal identifier (terminal ID) may be existing information such as a MAC address or an IP address, or information set in a handwriting sharing service, and may be set by the handwriting collaboration server system (terminal 10A). It may be information given to the terminals 10A, 10B, 10C, or may be information set for each terminal based on random numbers.

  For example, a terminal ID corresponding to the terminal 10B may be added as a transmission source terminal identifier to individual stroke data received from the terminal 10B. Individual stroke data received from the terminal 10B is stored in the database 12 in association with the terminal ID corresponding to the terminal 10B. Similarly, a terminal ID corresponding to the terminal 10C may be added as a transmission source terminal identifier to individual stroke data received from the terminal 10C. The individual stroke data received from the terminal 10C is stored in the database 12 in association with the terminal ID corresponding to the terminal 10C. Further, individual stroke data input by handwriting on the terminal 10A is stored in the database 12 in association with the terminal ID corresponding to the terminal 10A.

  Each stroke data may include not only a transmission source terminal identifier (terminal ID) but also a pen identifier (pen ID) that can identify a pen used for handwriting input of the stroke data. When the pen used for handwriting input has a function of transmitting the pen ID unique to the pen to the terminal, the terminal can acquire the pen ID of the pen from the pen. When each terminal 10A, 10B, 10C can acquire a pen ID of a pen used for handwriting input of stroke data in the terminal, the terminal 10A, 10B, 10C can obtain stroke data to which the terminal ID of the terminal and the acquired pen ID are added. Send. On the other hand, when the pen ID of the pen used for handwriting input of stroke data at the terminal cannot be acquired, each terminal 10A, 10B, 10C transmits the stroke data to which the terminal ID of the terminal is added.

  The handwriting collaboration server system (terminal 10A), based on the transmission source terminal identifier (terminal ID) added to the received stroke data, converts the received stroke data into the transmission source terminal of the received stroke data. To each other terminal. In other words, the handwriting collaboration server system (terminal 10A) can determine a terminal to which individual stroke data should be distributed based on a terminal ID corresponding to the individual stroke data.

  FIG. 4 shows an example of a terminal screen (handwriting sharing screen) in a login state. In the display area of the handwriting sharing screen 30A of each terminal, a transparent layer (handwriting layer) 30B capable of handwriting input is set. The stroke data (handwritten stroke) of each user is displayed on the handwritten sharing screen 30A.

  For example, on the handwriting sharing screen 30A of the terminal 10A, stroke data (handwriting stroke of the user A) 40 input by the user A using the pen 100A on the handwriting sharing screen 30A of the terminal 10A is displayed. Further, stroke data received from other terminals is displayed on the shared screen 30A of the terminal 10A. Stroke data received from another terminal includes stroke data (handwritten stroke of user B) 42 handwritten by user B and stroke data (handwritten stroke of user C) 44 handwritten by user C. included.

  As described above, stroke data of different users is displayed on the handwriting sharing screen 30A in different forms. In this embodiment, the form for displaying the received stroke data is determined according to either the terminal ID or the pen ID added to the received stroke data. More specifically, based on either the terminal ID or the pen ID added to the received stroke data, the received stroke data is displayed on the handwriting sharing screen 30A in a form in which it is possible to identify which user has input the handwriting. Is displayed. Next, the relationship between stroke data (handwritten characters, handwritten marks, handwritten figures, handwritten tables, etc.) input by handwriting and time series information will be described with reference to FIGS. FIG. 5 shows an example of a handwritten document (handwritten character string) handwritten on the touch screen display 17 using the pen 100 or the like.

  In FIG. 5, the handwritten character string “ABC” is handwritten in the order of “A”, “B”, “C”, and then the handwritten arrow is handwritten in the immediate vicinity of the handwritten character “A”. The case is envisaged.

  The handwritten character “A” is represented by two strokes (“∧” shape trajectory, “−” shape trajectory) handwritten using the pen 100 or the like. The trajectory of the first “∧” -shaped pen 100 handwritten is sampled in real time, for example, at equal time intervals, thereby obtaining the time-series coordinates SD11, SD12,... SD1n of the “∧” -shaped stroke. Similarly, the trajectory of the “−” shaped pen 100 to be handwritten next is also sampled in real time at equal time intervals, thereby obtaining the time series coordinates SD21, SD21,... SD2n of the “−” shaped stroke.

  The handwritten character “B” is expressed by two strokes handwritten using the pen 100 or the like. The handwritten character “C” is expressed by one stroke handwritten using the pen 100 or the like. The handwritten “arrow” is expressed by two strokes handwritten using the pen 100 or the like.

  FIG. 6 shows time-series information 200 corresponding to the handwritten document of FIG. The time series information includes a plurality of stroke data SD1, SD2,. In the time series information 200, these stroke data SD1, SD2,..., SD7 are arranged in time series in the order of handwriting, that is, the order in which a plurality of strokes are handwritten.

  In the time series information 200, the first two stroke data SD1 and SD2 indicate two strokes of the handwritten character “A”, respectively. The third and fourth stroke data SD3 and SD4 indicate two strokes constituting the handwritten character “B”, respectively. The fifth stroke data SD5 indicates one stroke constituting the handwritten character “C”. The sixth and seventh stroke data SD6 and SD7 indicate two strokes constituting the handwritten “arrow”, respectively.

  Each stroke data includes a coordinate data series (time series coordinates) corresponding to one stroke, that is, a plurality of coordinates corresponding to a plurality of points on the trajectory of one stroke. In each stroke data, a plurality of coordinates are arranged in time series in the order in which the strokes are written. For example, for the handwritten character “A”, the stroke data SD1 is a coordinate data series (time series coordinates) corresponding to each point on the locus of the stroke of the “∧” shape of the handwritten character “A”, that is, n coordinates. Data SD11, SD12,... SD1n are included. The stroke data SD2 includes coordinate data series corresponding to each point on the trajectory of the stroke of the “−” shape of the handwritten character “A”, that is, n pieces of coordinate data SD21, SD22,. Note that the number of coordinate data may be different for each stroke data.

  Each coordinate data indicates an X coordinate and a Y coordinate corresponding to a certain point in the corresponding locus. For example, the coordinate data SD11 indicates the X coordinate (X11) and the Y coordinate (Y11) of the start point of the “∧” -shaped stroke. SD1n indicates the X coordinate (X1n) and Y coordinate (Y1n) of the end point of the “∧” -shaped stroke.

  Furthermore, information (Z) indicating writing pressure may be added to each coordinate data.

FIG. 7 shows a system configuration of the tablet computer 10.
As shown in FIG. 7, the tablet computer 10 includes a CPU 101, a system controller 102, a main memory 103, a graphics processing unit (GPU) 104, a BIOS-ROM 105, a nonvolatile memory 106, a wireless communication device 107, and an embedded controller (EC). 108 and the like.

  The CPU 101 is a processor that controls the operation of various modules in the tablet computer 10. The CPU 101 executes various programs loaded from the nonvolatile memory 106 that is a storage device to the main memory 103. These programs include an operating system (OS) 201 and various application programs. The application program includes a handwriting sharing application program 202. The handwriting sharing application program 202 is configured to execute the above-described handwriting collaboration function for sharing handwritten information among a plurality of terminals.

  The CPU 101 also executes a basic input / output system (BIOS) stored in the BIOS-ROM 105. The BIOS is a program for hardware control.

  The system controller 102 is a device that connects the local bus of the CPU 101 and various components. The system controller 102 also includes a memory controller that controls access to the main memory 103. The system controller 102 also has a function of executing communication with the graphics processing unit (GPU) 104 via a PCI EXPRESS serial bus or the like.

  The GPU 104 is a display processor that controls the LCD 17 </ b> A used as a display monitor of the tablet computer 10. A display signal generated by the GPU 104 is sent to the LCD 17A. The LCD 17A displays a screen image based on the display signal. A touch panel 17B is disposed on the upper surface side of the LCD 17A. A digitizer 17C is disposed on the lower surface side of the LCD 17A. The touch panel 17B is a capacitance-type pointing device for inputting on the screen of the LCD 17A. The touch position on the screen where the finger is touched and the movement of the touch position are detected by the touch panel 17B. The digitizer 17C is an electromagnetic induction type pointing device for inputting on the screen of the LCD 17A. The digitizer 17C detects the contact position on the screen where the pen 100 is touched, the movement of the contact position, and the like.

  The wireless communication device 107 is a device configured to perform wireless communication. The wireless communication device 107 may be configured to perform wireless communication corresponding to the above-described Wi-Fi Direct (registered trademark).

  The EC 108 is a one-chip microcomputer including an embedded controller for power management. The EC 108 has a function of turning on or off the tablet computer 10 in accordance with the operation of the power button by the user.

  Next, a functional configuration of the handwriting sharing application program 202 will be described with reference to FIG.

  The handwriting sharing application program 202 is a function execution module for sharing handwritten information, such as a handwriting input interface 300, a display processing unit 301, a stroke data generation unit 302, a transmission processing unit 304, a reception processing unit 305, and a processing unit 305. including.

  The handwriting sharing application program 202 creates, displays, and edits handwritten page data by using stroke data that is input using the touch screen display 17. The digitizer 17C of the touch screen display 17 is configured to detect occurrence of events such as “touch”, “move (slide)”, “release” and the like. “Touch” is an event indicating that the pen has touched the screen. “Move (slide)” is an event indicating that the contact position has been moved while the pen is in contact with the screen. “Release” is an event indicating that the pen is released from the screen.

  The handwriting input interface 300 is an interface configured to perform handwriting input in cooperation with the digitizer 17 </ b> C of the touch screen display 17. The handwriting input interface 300 receives a “touch” or “move (slide)” event from the digitizer 17 </ b> C of the touch screen display 17, thereby detecting a handwriting input operation. The “touch” event includes the coordinates of the contact position. The “movement (slide)” event also includes the coordinates of the contact position of the movement destination. Therefore, the handwriting input interface 300 can receive the coordinate sequence corresponding to the movement locus of the contact position from the touch screen display 17.

  The display processing unit 301 receives a coordinate string from the handwriting input interface 300, and displays each stroke data input by handwriting by a handwriting input operation using the pen 100 on the screen of the LCD 17A based on the coordinate string. Furthermore, the display processing unit 301 displays stroke data received from another terminal on the screen of the LCD 17A under the control of the processing unit 305.

  The stroke data generation unit 302 receives the above-described coordinate sequence from the handwriting input interface 300, and generates time-series information having the structure described in detail in FIG. 6 based on the coordinate sequence. In this case, the time series information may be stored in the stroke database 12.

  The transmission processing unit 304 performs processing for transmitting each stroke data in the stroke database 12 to another terminal using the wireless communication device 107 under the control of the processing unit 305. The reception processing unit 305 executes processing for receiving stroke data from another terminal using the wireless communication device 107 under the control of the processing unit 305.

  The processing unit 305 executes processing for sharing handwritten information among a plurality of terminals. The processing unit 305 includes a pen ID acquisition unit 311, a member management unit 312, a stroke management unit 313, a display style management unit 314, and the like.

  The pen ID acquisition unit 311 acquires a pen ID from a pen used for handwritten input of stroke data. In a terminal using a pen having a pen ID, that is, a pen that can transmit the pen ID, the pen ID acquisition unit 311 can acquire the pen ID of the pen currently used for handwriting input.

  The member management unit 312 manages each member (terminal) logged into the handwriting sharing service. The member management unit 312 can determine whether or not to permit login to a terminal that requests login to the handwriting sharing service. In this case, the member management unit 312 may inquire each member as to whether or not to permit login of a new terminal, and permit login of a new terminal on condition that permission is received from all members. The terminal that has received permission from the member management unit 312 is permitted to log in to the handwriting sharing service, and is thereby connected to other terminals that are logged in to the handwriting sharing service. Furthermore, the member management unit 312 also executes a process of acquiring a pen ID from each terminal permitted to log in. This pen ID may be, for example, the pen ID of a pen used in handwriting input for login at each terminal. The function of the member management unit 312 may be executed only in a terminal that operates as a handwriting collaboration server system.

  The stroke management unit 313 manages stroke data received from each terminal participating in the handwriting sharing service, that is, each terminal in the login state, using the stroke database 12. The stroke management unit 313 may be executed only in a terminal that operates as a handwriting collaboration server system.

  The display style management unit 314 manages the relationship between the terminal ID or pen ID and the stroke data display mode for each logged-in terminal (user). The display style management unit 314 of the terminal that operates as the handwriting collaboration server system generates a display style management table that is form information that defines the relationship between the terminal ID or pen ID and the display form of the stroke data for each terminal. The display style management table can be transmitted to other terminals. During execution of the handwriting sharing service, each terminal uses the display style management table to determine the form used for displaying individual stroke data.

  By the way, in the case of using the handwriting sharing service described above in a business scene, it is assumed that the terminals 10A, 10B, and 10C corresponding to the users A, B, and C described in FIG. 3 are used at a relatively close distance from each other. The For example, a scene in which users A, B, and C perform a meeting and collaborate in the same conference space or the same room is considered as a main use case.

  In order to display stroke data of different users in different forms (color, thickness, etc.), a mechanism for identifying the stroke data of individual users on the system is required. This mechanism may be realized using, for example, a terminal ID corresponding to each stroke data. In this case, any stroke data input by handwriting in the terminal 10A is recognized as the stroke data of the user A, and any stroke data input by handwriting in the terminal 10B is recognized as the stroke data of the user B and input by handwriting in the terminal 10C. Any stroke data is recognized as user C's stroke data.

  However, a plurality of users in the same place are not always handwritten on a terminal that they own. For example, while discussing at a meeting, a user (a participant) may be handwritten on a terminal of another user (another participant) nearby. In this case, user (stroke data) identification based only on the terminal ID is broken, and individual stroke data cannot be displayed in a correct form. This is because all stroke data input by handwriting in the same terminal is handled as user stroke data corresponding to this terminal.

  Therefore, in the present embodiment, as described above, not only the terminal ID but also the pen ID is considered, and the form (color, thickness, etc.) to be applied to the stroke data is determined.

  For example, when a certain terminal logs in to the handwriting sharing service, this terminal acquires the pen ID of the pen currently used for handwriting input. If the currently used pen has a function of transmitting the pen ID to the terminal by electromagnetic waves or the like, the terminal can acquire the pen ID. If the pen ID can be acquired, the terminal transmits the acquired pen ID to the handwriting collaboration server system (terminal 10A) together with the terminal ID of the terminal as the pen ID of the pen associated with the terminal. If the pen ID cannot be acquired, this terminal transmits only the terminal ID of this terminal to the handwriting collaboration server system (terminal 10A). The handwriting collaboration server system (terminal 10A) generates the above-described display style management table which is form information that defines the relationship between the terminal ID or pen ID and the display form of the stroke data for each terminal. The display style management table is distributed from the handwriting collaboration server system (terminal 10A) to other terminals.

  In the handwriting sharing service, each terminal uses the received stroke data as the received stroke data when both the terminal ID and the pen ID are added to the stroke data received from the other terminals. It is displayed in an identifiable form that the user corresponding to the pen ID added to is input by handwriting. In other words, the pen ID is used in preference to the terminal ID in order to identify the user corresponding to the received stroke data.

  On the other hand, when the terminal ID is added to the stroke data received from another terminal but the pen ID is not added, each terminal adds the received stroke data to the received stroke data. The user ID corresponding to the terminal ID is displayed in an identifiable form.

  Thereby, handwritten strokes (stroke data) input by handwriting by different users on the same terminal can be displayed in different forms. Furthermore, even when a pen owned by a certain user does not support the pen ID transmission function, the stroke data handwritten by the user at his / her terminal can be displayed in a form assigned to the terminal ID of the terminal. it can.

  FIG. 9 shows the contents of the stroke database 12 of the handwriting collaboration server system (terminal 10A). The stroke database 12 includes a large number of records (a large number of storage areas) each assigned a record ID. One stroke data (one stroke) is assigned to one record. In each record, a terminal ID (device ID), stroke data (coordinate sequence), and the like are stored. Furthermore, a user ID and a pen ID corresponding to the stroke data may be stored in each record.

  In FIG. 9, each record of record ID = 1, record ID = 2,..., Record ID = 102 stores stroke data input by handwriting on the terminal 10A (terminal ID = A). The record with record ID = 3 stores stroke data input by handwriting on the terminal 10B (terminal ID = B). In each record of record ID = 4,..., Record ID = 100, and record ID = 101, stroke data input by handwriting in the terminal 10C (terminal ID = C) is stored.

  FIG. 10 shows a display style management table 400 generated by the display style management unit 314 of the terminal that operates as the handwriting collaboration server system.

  As described above, the display style management table 400 defines the relationship between the terminal ID or pen ID and the display mode (color, thickness, etc.) of the stroke data for each terminal (user).

  In FIG. 10, it is assumed that the terminals 10A, 10B, 10C, and 10D are logged in to the handwriting sharing service.

  Here, in terminal 10A (terminal ID = A), a pen with pen ID = PEN1 is used for handwriting input, and in terminal 10B (terminal ID = B), a pen having no pen ID is used for handwriting input. In the terminal 10C (terminal ID = C), the pen with the pen ID = PEN3 is used for handwriting input, and in the terminal 10D (terminal ID = D), the pen with the pen ID = PEN11 is used for handwriting input. It is assumed that it is used.

  The display style management table 400 includes a record (storage area) corresponding to each user who logs in to the handwriting sharing service. Each record includes a “terminal ID” field, a “pen ID” field, a “stroke color” field, a “stroke thickness” field, and an “other” field. The “terminal ID” field stores the terminal ID of the corresponding user (terminal). The “pen ID” field stores the pen ID of the pen used at the time of login by the corresponding user (terminal). The “stroke color” field stores information indicating the color to be used to display the corresponding user stroke. The “stroke thickness” field stores information indicating the thickness to be used for displaying the stroke of the corresponding user.

  For example, for the record corresponding to user A, terminal ID “A” is stored in the “terminal ID” field, pen ID “PEN1” is stored in the “pen ID” field, and color “black” is “stroke color”. "Field.

  For the record corresponding to user B, the terminal ID “B” is stored in the “terminal ID” field, the pen ID “none” is stored in the “pen ID” field, and the color “red” is the “stroke color” field. Stored in When a pen with pen ID = PEN2 is used at the time of login in terminal 10B (terminal ID = B), pen ID “PEN2” is stored in the “pen ID” field instead of pen ID “none”. The

  For the record corresponding to user C, the terminal ID “C” is stored in the “terminal ID” field, the pen ID “PEN3” is stored in the “pen ID” field, and the color “green” is the “stroke color” field. Stored in

  For the record corresponding to user D, terminal ID “D” is stored in the “terminal ID” field, pen ID “PEN11” is stored in the “pen ID” field, and color “blue” is the “stroke color” field. Stored in

  The display form (color, thickness, etc.) of the stroke assigned to the terminal ID or pen ID of each user (each terminal) is selected from the forms (color, thickness, etc.) that are not currently used by each user. May be. Or the terminal which operate | moves as a handwriting collaboration server system may determine the form of the stroke which should be allocated to each user (each terminal).

  In the present embodiment, as described above, the display style management table 400 is distributed to each terminal in the login state. Therefore, any terminal can display stroke data written by different users in different forms.

  Next, a process of displaying stroke data input by handwriting in any of a plurality of terminals in a form determined according to either the terminal ID or the pen ID will be described with reference to FIG.

  In FIG. 11, it is assumed that the pen 100B owned by the user B does not have a pen ID, and the pen 100C owned by the user C has a pen ID “PEN3”. Further, the display style management table 400 described with reference to FIG. 10 has already been distributed to each terminal.

  When stroke data (for example, handwritten character string “TABLET”) is input by handwriting with the pen 100B at the terminal 10B, the stroke data of the user B, that is, the terminal ID “B” of the terminal 10B is added as the transmission source terminal identifier. The stroke data to which no pen ID is added is transmitted from the terminal 10B to the terminal 10A. The terminal 10A displays the stroke data to which the terminal ID “B” of the terminal 10B is added on the screen of the terminal 10A and transmits it to each terminal other than the terminal 10B, for example, the terminal 10C.

  Since the pen ID is not added to the stroke data of the user B, the stroke data of the user B is displayed in a form determined according to the terminal ID “B”. Therefore, in each of the terminals 10A, 10B, and 10C, the stroke data of the user B, that is, the handwritten character string “TABLET” is displayed in a form corresponding to the terminal ID “B” (here, red).

  When stroke data (for example, handwritten character string “ABC”) is input by hand with the pen 100C at the terminal 10C, the stroke data of the user C, that is, the terminal ID “C” of the terminal 10C is added as the transmission source terminal identifier. The stroke data to which the pen ID “PEN3” is added is transmitted from the terminal 10C to the terminal 10A. The terminal 10A displays the stroke data to which the terminal ID “C” and the pen ID “PEN3” are added on the screen of the terminal 10A, and transmits the stroke data to each terminal other than the terminal 10C, for example, the terminal 10A. To do.

  Since the pen ID “PEN3” is added to the stroke data of the user C, the stroke data of the user C is displayed in a form determined according to the pen ID “PEN3”, not the terminal ID “C”. Accordingly, in each of the terminals 10A, 10B, and 10C, the stroke data of the user C, that is, the handwritten character string “ABC” is displayed in a form corresponding to the pen ID “PEN3” (here, green).

  Now, as shown in FIG. 12, it is assumed that the user C inputs stroke data (for example, the handwritten character string “STROKE123”) in the terminal 10B using the pen 100C.

  If a method of specifying a user corresponding to each stroke data using only the terminal ID is used, any stroke data corresponding to the handwritten character string “STROKE123” is handled as the stroke data of the user A. End up. For this reason, in any terminal, the handwritten character string “STROKE123” is displayed in red.

  In this embodiment, in the terminal 10B, when stroke data is input by handwriting using a pen having a pen ID associated with any of the terminals logged in to the handwriting sharing service, the terminal of the terminal 10B The stroke data to which the ID “B” is added as the transmission source terminal identifier and the pen ID “PEN3” is added is transmitted from the terminal 10B to the terminal 10A.

  For example, when stroke data is input by hand with the pen 100C in the terminal 10B, the stroke data to which the terminal ID “B” of the terminal 10B is added as the transmission source terminal identifier and the pen ID “PEN3” is added 10B is transmitted to the terminal 10A. The terminal 10A displays the stroke data to which the terminal ID “B” and the pen ID “PEN3” are added on the screen of the terminal 10A, and displays the stroke data on each terminal other than the terminal 10B, for example, the terminal 10C. Send to.

  A record including a combination of the terminal ID “B” and the pen ID “PEN3” does not exist in the display style management table 400. In this embodiment, if both the terminal ID and the pen ID are added to the stroke data, the pen ID has priority over the terminal ID in determining the form to be used for displaying the stroke data. Used.

  Therefore, when a mismatch occurs in which the combination of the terminal ID and the pen ID does not exist in the display style management table 400, the pen ID is used preferentially. That is, the stroke data to which the terminal ID “B” and the pen ID “PEN3” are added is displayed in a form determined according to the pen ID “PEN3”, not the terminal ID “B”.

  Therefore, in each of the terminals 10A, 10B, and 10C, the stroke data, that is, the handwritten character string “STROKE123” is not in the form corresponding to the terminal ID “B” (here, red), but in the pen ID “PEN3”. The corresponding form (here, green) is displayed.

  Therefore, it becomes possible to handle the stroke data handwritten by the user C on the terminal 10B of the user B as the stroke data of the user C.

  Note that the pen 100B owned by the user B may have a pen ID (pen ID transmission function). In this case, in the record corresponding to the user B in the display style management table 400, the terminal ID “B” is stored in the “terminal ID” field, and for example, the pen ID “PEN2” is stored in the “pen ID” field. Is done.

  When the user C uses the pen 100C to input handwritten stroke data at the terminal 10B, the stroke data to which the terminal ID “B” of the terminal 10B is added as the transmission source terminal identifier and the pen ID “PEN3” is added. Is transmitted from the terminal 10B to the terminal 10A. On the other hand, when the user B uses the pen 100B to input stroke data by handwriting on the terminal 10B, the terminal ID “B” of the terminal 10B is added as the transmission source terminal identifier and the pen ID “PEN2” is added. The stroke data is transmitted from the terminal 10B to the terminal 10A.

  As described above, if the terminal ID and the pen ID are added to the stroke data, the pen ID is used preferentially over the terminal ID in determining the form to be used for displaying the stroke data. Is done. Therefore, if the pen ID “PEN3” is added to the stroke data, the stroke data is displayed in a form corresponding to the pen ID “PEN3”. That is, the stroke data is displayed in a form in which it can be identified that the handwriting input is performed by the user corresponding to the pen ID “PEN3”. On the other hand, if the pen ID “PEN2” is added to the stroke data, the stroke data is displayed in a form corresponding to the pen ID “PEN2”. That is, the stroke data is displayed in a form in which it can be identified that the handwriting input is performed by the user corresponding to the pen ID “PEN2”.

  The flowchart of FIG. 13 shows the procedure of the display style setting process executed by the processing unit 305 of the handwriting collaboration server system (terminal 10A).

  The processing unit 305 requests a pen ID from each terminal that is permitted to log in to the handwriting sharing service, and receives the pen ID from each terminal that has acquired the pen ID (step S11). The processing unit 305 assigns a stroke display form (color, thickness, etc.) to the terminal ID or pen ID of each terminal permitted to log in (step S12).

  For the terminal that has transmitted the pen ID to the handwriting collaboration server system, the processing unit 305 registers the pen ID of this terminal in the “pen ID” field in the corresponding record of the display style management table 400. Then, the processing unit 305 assigns a stroke display form to the pen ID. In the “stroke color” field and the “stroke thickness” field, information indicating the stroke color and information indicating the stroke thickness are registered.

  For a terminal that does not transmit a pen ID to the handwriting collaboration server system, the processing unit 305 does not register any pen ID in the “pen ID” field in the corresponding record of the display style management table 400. Then, the processing unit 305 assigns a stroke display form to the terminal ID of this terminal. In the “stroke color” field and the “stroke thickness” field, information indicating the stroke color and information indicating the stroke thickness are registered.

  The processing unit 305 distributes the created display style management table 400 to each terminal (step S13).

  The flowchart of FIG. 14 shows the procedure of the stroke delivery process executed by the processing unit 305 of the handwriting collaboration server system (terminal 10A).

  The processing unit 305 receives stroke data input by handwriting at any of the plurality of terminals (step S21). The processing unit 305 determines the received stroke data in accordance with either the transmission source terminal ID added to the received stroke data or the pen ID added to the received stroke data. Is displayed on the screen of the terminal 10A (steps S22 to S24). That is, according to either the transmission source terminal ID added to the received stroke data or the pen ID added to the received stroke data, the processing unit 305 can identify which user has input by handwriting. The received stroke data is displayed on the screen in various forms.

  First, the processing unit 305 determines whether a pen ID as well as a transmission source terminal ID is added to the received stroke data (step S22).

  If not only the transmission source terminal ID but also the pen ID is added to the received stroke data (YES in step S22), the processing unit 305 converts the received stroke data into the received stroke data. It is displayed in a form (color, thickness, etc.) that can be identified as being handwritten input by the user corresponding to the added pen ID (step S23). In step S23, the form for displaying the received stroke data is determined based on the pen ID added to the received stroke data and the display style management table 400 described above. In this case, first, a record having a “pen ID” field that matches the pen ID added to the received stroke data is specified. Then, the color and thickness indicated by the “stroke color” field and the “stroke thickness” field in the specified record are determined as a form for displaying the received stroke data.

  If the transmission source terminal ID is added to the received stroke data and no pen ID is added (NO in step S22), the processing unit 305 converts the received stroke data into the received stroke data. Is displayed in a form (color, thickness, etc.) that can be identified as being handwritten by the user corresponding to the transmission source terminal ID added to (step S24). In step S24, the form for displaying the received stroke data is determined based on the transmission source terminal ID added to the received stroke data and the display style management table 400 described above. In this case, first, a record having a “terminal ID” field that matches the source terminal ID added to the received stroke data is specified. Then, the color and thickness indicated by the “stroke color” field and the “stroke thickness” field in the specified record are determined as a form for displaying the received stroke data.

  Thereafter, the processing unit 305, based on the transmission source terminal ID added to the received stroke data, converts the received stroke data into other terminals other than the transmission source terminal of the received stroke data. (Step S25).

  In FIG. 14, the operation executed by the handwriting collaboration server system (terminal 10 </ b> A) has been described, but each terminal other than the terminal 10 </ b> A also executes the processes of steps S <b> 22 to S <b> 24 when the stroke data is received.

  Each of the terminals 10A, 10B, and 10C executes the following processing when stroke data is input by handwriting on the terminal.

  When the pen ID of a pen used for handwritten input of stroke data can be acquired, each terminal displays the stroke data input by handwriting in a form corresponding to the pen ID. Each terminal adds the terminal ID of the terminal and the acquired pen ID to the stroke data input by handwriting, and uses the handwritten collaboration server system (terminal 10A) as the stroke data to which the terminal ID and the pen ID are added. ).

  When a pen ID of a pen used for handwriting input of stroke data cannot be acquired, each terminal displays the stroke data input by handwriting in a form corresponding to the terminal ID of the terminal. Each terminal adds the terminal ID of the terminal to the stroke data input by handwriting, and transmits the stroke data to which the terminal ID is added to the handwriting collaboration server system (terminal 10A).

  In addition, although the above description illustrated the case where one of the plurality of handwritten terminals that logged into the handwriting sharing service functions as a handwritten collaboration server system, the handwritten collaboration server system includes one or more terminals other than the handwritten terminals. It may be realized by a server.

  As described above, in this embodiment, the form (color, thickness, etc.) to be applied to the stroke data is determined in consideration of the pen ID as well as the ID of the transmission source terminal. Thereby, stroke data input by handwriting by different users on the same terminal can be displayed in different forms. Furthermore, even when a pen owned by a certain user does not support the pen ID transmission function, the stroke data handwritten by the user at his / her terminal can be displayed in a form assigned to the terminal ID of the terminal. it can.

  Therefore, even when different users perform handwriting input on the same terminal in a business scene such as a meeting, it becomes possible to identify the stroke data of these users.

  Note that each function of the processing unit 305 of the handwriting collaboration server system (terminal 10A) of the present embodiment can be realized by a computer program, so that the computer program is stored in a computer through a computer-readable storage medium storing the computer program. The effect similar to that of the present embodiment can be easily realized simply by installing and executing the software.

  The GPU in the computer in which this computer program is installed can function as a display processor configured to display the stroke data described above. In addition, the wireless communication device in the computer in which the computer program is installed can function as a receiving unit configured to receive stroke data input by handwriting in each terminal, and can further receive each received stroke data. It can function as a transmission unit that transmits to each terminal other than the transmission source of the stroke data.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

Claims (15)

Receiving means for receiving first stroke data input by handwriting in any of a plurality of terminals;
Either the identifier of the transmission source terminal added to the first stroke data or the identifier of a pen that is added to the first stroke data and can identify the pen used for handwriting input of the first stroke data Display processing means for displaying the first stroke data on the screen in a form in which it is possible to identify which user has input by handwriting,
The display processing means includes
When the identifier of the transmission source terminal is added to the first stroke data and the identifier of the pen is not added, the user corresponding to the identifier of the transmission source terminal added to the first stroke data is the first stroke data. Is displayed on the screen in a form that can be identified as handwritten input by
When both the sender terminal identifier and the pen identifier are added to the first stroke data, the first stroke data is input by handwriting by the user corresponding to the pen identifier added to the first stroke data. A system that displays on the screen in an identifiable form.   The system according to claim 1, wherein the pen identifier added to the first stroke data is one of one or more pen identifiers respectively associated with one or more terminals in the plurality of terminals. Each of the plurality of terminals is
When an identifier of a pen that can identify a pen used for handwritten input of stroke data in the terminal is acquired, the stroke data to which the identifier of the terminal and the acquired pen identifier are added is transmitted.
The system according to claim 1, wherein when a pen identifier capable of identifying a pen used for handwriting input of stroke data in the terminal cannot be obtained, stroke data to which the terminal identifier is added is transmitted. . When the sender terminal identifier is added to the first stroke data and the pen identifier is not added, the form used for displaying the first stroke data is the sender terminal identifier or the pen identifier and stroke. It is determined based on the form information that defines the relationship with the form of data display for each terminal, and the identifier of the transmission source terminal added to the first stroke data,
When both the identifier of the transmission source terminal and the identifier of the pen are added to the first stroke data, the form used for displaying the first stroke data is the form information and the first stroke data. The system according to claim 1, wherein the system is determined based on an identifier of a pen to be added.   And a transmission section configured to transmit the first stroke data to each terminal other than the transmission source terminal of the first stroke data based on an identifier of the transmission source terminal added to the first stroke data. Item 1. The system according to Item 1. Receiving first stroke data input by handwriting in any of a plurality of terminals;
Either the identifier of the transmission source terminal added to the first stroke data or the identifier of a pen that is added to the first stroke data and can identify the pen used for handwriting input of the first stroke data And displaying the first stroke data on the screen in a form in which it is possible to identify which user has input by handwriting,
The display is
When the identifier of the transmission source terminal is added to the first stroke data and the identifier of the pen is not added, the user corresponding to the identifier of the transmission source terminal added to the first stroke data is the first stroke data. Display on the screen in an identifiable form that the handwritten input by
When both the sender terminal identifier and the pen identifier are added to the first stroke data, the first stroke data is input by handwriting by the user corresponding to the pen identifier added to the first stroke data. Displaying on the screen in an identifiable form.   The method according to claim 6, wherein the pen identifier added to the first stroke data is one of one or more pen identifiers respectively associated with one or more terminals in the plurality of terminals. Each of the plurality of terminals is
When an identifier of a pen that can identify a pen used for handwritten input of stroke data in the terminal is acquired, the stroke data to which the identifier of the terminal and the acquired pen identifier are added is transmitted.
The method according to claim 6, wherein when a pen identifier capable of identifying a pen used for handwriting input of stroke data at the terminal cannot be obtained, stroke data to which the terminal identifier is added is transmitted. . When the sender terminal identifier is added to the first stroke data and the pen identifier is not added, the form used for displaying the first stroke data is the sender terminal identifier or the pen identifier and stroke. It is determined based on the form information that defines the relationship with the form of data display for each terminal, and the identifier of the transmission source terminal added to the first stroke data,
When both the identifier of the transmission source terminal and the identifier of the pen are added to the first stroke data, the form used for displaying the first stroke data is the form information and the first stroke data. The method according to claim 6, wherein the method is determined based on an identifier of a pen to be added.   The apparatus further comprises: transmitting the first stroke data to each terminal other than the transmission source terminal of the first stroke data based on an identifier of the transmission source terminal added to the first stroke data. 6. The method according to 6. A program executed by a computer, the program being
Receiving first stroke data input by handwriting in any of a plurality of terminals;
Either the identifier of the transmission source terminal added to the first stroke data or the identifier of a pen that is added to the first stroke data and can identify the pen used for handwriting input of the first stroke data And controlling the computer to execute the function of displaying the first stroke data on the screen in a form in which it is possible to identify which user has input by handwriting,
The display is
When the identifier of the transmission source terminal is added to the first stroke data and the identifier of the pen is not added, the user corresponding to the identifier of the transmission source terminal added to the first stroke data is the first stroke data. Display on the screen in an identifiable form that the handwritten input by
When both the sender terminal identifier and the pen identifier are added to the first stroke data, the first stroke data is input by handwriting by the user corresponding to the pen identifier added to the first stroke data. And displaying on the screen in a form identifiable.   The program according to claim 11, wherein the pen identifier added to the first stroke data is one or more pen identifiers respectively associated with one or more terminals in the plurality of terminals. Each of the plurality of terminals is
When an identifier of a pen that can identify a pen used for handwritten input of stroke data in the terminal is acquired, the stroke data to which the identifier of the terminal and the acquired pen identifier are added is transmitted.
12. The program according to claim 11, wherein when a pen identifier capable of identifying a pen used for handwritten input of stroke data in the terminal cannot be acquired, stroke data to which the terminal identifier is added is transmitted. . When the sender terminal identifier is added to the first stroke data and the pen identifier is not added, the form used for displaying the first stroke data is the sender terminal identifier or the pen identifier and stroke. It is determined based on the form information that defines the relationship with the form of data display for each terminal, and the identifier of the transmission source terminal added to the first stroke data,
When both the identifier of the transmission source terminal and the identifier of the pen are added to the first stroke data, the form used for displaying the first stroke data is the form information and the first stroke data. 12. The program according to claim 11, wherein the program is determined based on an identifier of a pen to be added.   Based on an identifier of a transmission source terminal added to the first stroke data, the function of transmitting the first stroke data to each terminal other than the transmission source terminal of the first stroke data is executed. The program according to claim 11, further controlling the computer.

Images