JP6131111B2 - Communication terminal control system - Google Patents

Description

  The present invention relates to a communication terminal control system used when learning is performed using a communication terminal in education at an educational institution such as a school or training at a company.

  In recent years, so-called e-learning, in which education is performed using a computer, is being expanded in education at educational institutions and training at companies. In particular, with the advent of tablet computers, it is expected to spread because it can be directly written on a touch panel display device without using a keyboard.

  There are two types of e-learning. The first method is a method in which the contents of a lesson are recorded in advance, distributed as streaming, and viewed by students and students (hereinafter simply referred to as “learners”). The second method is a place where a class or lecture (hereinafter simply referred to as “class”) is being held, a communication terminal such as a tablet computer operated by the learner, and a teacher or lecturer (hereinafter simply “ This is a method of conducting classes while exchanging various data with a communication terminal operated by a teacher.

  In the second method, the teacher and the learner interact with each other using the communication terminal on the spot. Unlike the first method, which is merely watching the screen of the communication terminal, the conventional method is used. There are features that make it more interactive. In this case, for example, operations performed by the teacher on the communication terminal are distributed to each learner's communication terminal, or operations performed by the learner are distributed to the teacher's communication terminal. It needs to be shared between teachers and learners. Therefore, a system sharing such information processing is disclosed, for example, in Patent Document 1 below.

Japanese Patent No. 5086486

  By using the information output sharing system of Patent Document 1, information can be shared between a teacher and a learner. However, when the operations performed by a teacher or learner are reflected on the other party, all operations are reflected, so even if a relative operation such as opening a window or closing a window is performed. Is also reflected in the other party. Therefore, there is a technical problem that even if operations that are substantially meaningless are performed, each operation is reflected and wasteful communication occurs. In addition, the other party who viewed such a display may be confused.

  Furthermore, when a connection is cut off at any terminal, operations performed during that time cannot be reflected. Therefore, there is a technical problem that teachers or learners who use a disconnected terminal cannot know information during that time. Furthermore, for disconnected operations, it is possible to store the operations in the meantime on the server and resend them after the connection is restored, but in that case, there is a possibility that unnecessary operations will be sent. is there. This means that unnecessary operations are reflected on the communication terminals of teachers and learners, which can cause confusion for teachers and learners. In addition, useless communication is generated by sending unnecessary operations.

  In view of the above problems, the present inventors have invented a communication terminal control system.

The first invention, the image displayed by the display device control instruction communication terminal during the cutting of the connection between the control side communication terminal, via the management server the after restoration of connection with the controlled-side communication terminal wherein A communication terminal control system for reflecting on a controlled communication terminal, wherein the management server is operated among screens divided into a plurality of areas displayed on a display device of the control instruction communication terminal. A control instruction information receiving unit that receives control instruction information including image information and date / time information of the selected area from the control instruction side communication terminal, a connection state monitoring unit that monitors a connection state between the controlled side communication terminal, A control information processing unit that generates control information based on the received control instruction information; a control information storage unit that stores the generated control information and identification information indicating whether the control information has been transmitted; Above When it is determined by connection state monitoring in the connection state monitoring unit that the connection with the controlled communication terminal has not been disconnected, control information that has not been transmitted among control information stored in the control information storage unit If there is a control information reflection processing unit that waits if there is a connection with the controlled communication terminal, and there is corresponding untransmitted control information in the same area Includes a final control information determination processing unit that determines new control information as control information to be transmitted to the controlled communication terminal among the untransmitted control information, and the control information reflection processing unit includes: wherein the control information determined as to the controlled side communication terminal Ri sent to the controlled side communication terminal, to change the identification information indicating whether it has transmission in the control information storage unit, a communication terminal control system.

  When marking is performed on the screen at the control instruction side communication terminal, it is often useless to send all of them to the controlled side communication terminal. Therefore, as in the present invention, it is preferable to identify the final control information and send it to the controlled communication terminal. As a result, unnecessary operations can be avoided. Therefore, it is possible to prevent teachers and learners from being confused and to prevent unnecessary communication.

Each above-mentioned invention can be performed by executing the program of the present invention with a computer. That is, to reflect the image displayed by the display device control instruction communication terminal during the cutting of the connection between the control side communication terminal, in the controlled-side communication terminal the after restoration of connection between the control side communication terminal The control instruction information including image information and date / time information of the area in which the operation is performed among the screens divided into a plurality of areas displayed on the display device of the control instruction side communication terminal. A control instruction information receiving unit that receives from the control instruction side communication terminal, a connection state monitoring unit that monitors a connection state with the controlled side communication terminal, and generates control information based on the received control instruction information, the generated control information processing unit to be stored in the storage device and identification information indicating whether to transmit control information and the control information associated with, the monitoring of the connection state in the connection state monitoring unit, said controlled side When it is determined that the connection with the communication terminal is not disconnected, it is determined whether there is untransmitted control information among the control information stored in the storage device, and the connection with the controlled communication terminal is disconnected If there is a control information reflection processing unit that waits if it is determined that there is corresponding control information that has not been transmitted in the same area , the new control information is sent to the controlled side. A communication terminal control program that functions as a final control information determination processing unit that is determined as control information to be transmitted to a communication terminal, wherein the control information reflection processing unit outputs control information that is determined to be transmitted to the controlled communication terminal. wherein Ri sent to the controlled side communication terminal, to change the identification information indicating whether it has transmission in the storage device can be configured as the communication terminal control program.

  According to the present invention, an operation finally performed can be specified and only the operation can be reflected on the other party. Even when the connection is disconnected, unnecessary operations can be omitted and the operations during that time can be reflected. In this way, unnecessary communication can be prevented by omitting unnecessary operations.

It is a figure which shows typically an example of the conceptual diagram of the whole communication terminal control system of this invention. It is a conceptual diagram which shows typically an example of the system configuration | structure of the communication terminal control system of this invention. It is a figure which shows an example of the hardware constitutions of a computer typically. It is a figure which shows typically an example of the hardware constitutions of the computer provided with the touchscreen type display apparatus. It is a flowchart which shows an example of the process of this invention typically. It is a figure which shows typically that the area | region which can be marked is divided | segmented into the several rectangular area. It is a figure which shows the identification information with respect to a rectangular area. It is a figure which shows typically the process which produces | generates the control instruction information containing the image of the changed rectangular area. It is a figure which shows an example of the screen as which marking operation was performed. It is a figure which shows an example of a control instruction information storage part typically. It is a figure which shows an example of a control information storage part typically. It is a figure which shows typically an example of the state which memorize | stored the control information including execution of an operation lock in the control information storage part. It is a figure which shows typically an example of the state which memorize | stored the control information including cancellation | release of operation lock | rock in the control information storage part. It is a figure which shows typically an example of the state which memorize | stored in the control information storage part the control information including execution of operation lock newly. It is a figure which shows notionally the process of the last control information determination process part, when operation content is marking operation. It is a figure which shows an example of a login screen typically. In Example 1, it is a figure which shows typically the state of the control information storage part which memorize | stored the control information of execution of operation lock. It is a figure which shows typically the state from which the control information was sent from the state of FIG. It is a figure which shows typically an example of the screen before and after operation lock is performed. It is a figure which shows typically the state of the control-information memory | storage part which memorize | stored newly the control information of operation lock cancellation | release from the state of FIG. FIG. 21 is a diagram schematically showing a state in which control information is sent from the state of FIG. 20. It is a figure which shows typically the state of the control-information memory | storage part which memorize | stored newly the control information of operation lock execution from the state of FIG. It is a figure which shows typically the state to which control information was sent from the state of FIG. It is a figure which shows notionally the process of Example 1. FIG. In Example 2, it is a figure which shows typically the state of the control information storage part which memorize | stored the control information of execution of a camera and an electronic blackboard. FIG. 26 is a diagram schematically showing a state in which control information is sent from the state of FIG. 25. It is a figure which shows typically an example of the screen before and behind starting of the application of a camera and an electronic blackboard. It is a figure which shows typically the state of the control-information memory | storage part which memorize | stored newly the control information of execution of a personal folder from the state of FIG. FIG. 29 is a diagram schematically showing a state in which control information is sent from the state of FIG. 28. It is a figure which shows typically an example of the screen before and after starting of the application of a personal folder is performed. It is a figure which shows typically the state of the control information memory | storage part which memorize | stored the control information of the completion of a camera and an electronic blackboard newly from the state of FIG. FIG. 32 is a diagram schematically showing a state in which control information is sent from the state of FIG. 31. It is a figure which shows the process of Example 2 notionally. 10 is a diagram illustrating a marking operation performed in Example 3. FIG. In Example 3, it is a figure which shows typically the state of the control information storage part which memorize | stored the control information of execution of marking operation. FIG. 36 is a diagram schematically showing a state in which control information is sent from the state of FIG. It is a figure which shows typically the state of the control information memory | storage part which memorize | stored newly the control information of deletion of marking operation from the state of FIG. It is a figure which shows typically the state to which control information was sent from the state of FIG. It is a figure which shows typically the relationship between marking operation performed in FIG.34 (d) and a rectangular area. It is a figure which shows typically the state of the control information memory | storage part which memorize | stored newly the control information of execution of marking operation from the state of FIG. It is a figure which shows typically the state from which the control information was sent from the state of FIG. It is a figure which shows the process of Example 3 notionally. It is a figure which shows typically an example of the conceptual diagram of the whole communication terminal control system in Example 4. FIG. It is a figure which shows typically the state which displays a different screen simultaneously.

  An example of the overall conceptual diagram of the communication terminal control system 1 of the present invention is shown in FIG. A conceptual diagram of an example of the system configuration of the communication terminal control system 1 is shown in FIG.

  The communication terminal control system 1 includes a management server 2 used by a company or the like that manages the system, a control instruction side communication terminal 3 that is a side that sends a control instruction, and a control instruction that is executed by the control instruction side communication terminal 3. And a controlled communication terminal 4 that executes control processing based on the control processing. For convenience of explanation, the functions of the control instruction side communication terminal 3 and the controlled side communication terminal 4 described later are functions for giving a control instruction in the control instruction side communication terminal 3, and in the controlled side communication terminal 4, respectively. Although the case where it has a function for performing control processing based on the received control instruction will be described, not only unidirectional control but also bidirectional control may be performed. That is, by providing each function in the control instruction side communication terminal 3 and each function in the controlled side communication terminal 4 in each communication terminal, in some cases, it becomes the control instruction side communication terminal 3, and in some cases, the controlled side The communication terminal 4 can be configured.

  The management server 2, the control instruction side communication terminal 3, and the controlled side communication terminal 4 of the communication terminal control system 1 are realized by various computers such as a server, a personal computer, and a portable communication terminal having a touch panel display device. . FIG. 3 shows an example of a hardware configuration of a normal computer (a computer other than a computer having a touch panel display device). When the management server 2, the control instruction side communication terminal 3 and the controlled side communication terminal 4 in the communication terminal control system 1 are ordinary computers, an arithmetic unit 70 such as a CPU for executing the arithmetic processing of the program and information are stored. A storage device 71 such as a RAM or a hard disk, a display device 72 such as a display, an input device 73 such as a keyboard or a pointing device (such as a mouse or a numeric keypad), a processing result of the arithmetic device 70, and information stored in the storage device 71. And a communication device 74 that transmits and receives via a network such as the Internet or a LAN.

  Of the computers constituting the communication terminal control system 1, the control instruction side communication terminal 3 and the controlled side communication terminal 4 may be portable communication terminals provided with a touch panel type display device. FIG. 4 shows an example of a hardware configuration of a computer that is a portable communication terminal provided with a touch panel display device 82. In this case, an arithmetic device 80 such as a CPU that executes arithmetic processing of a program, a storage device 81 such as a RAM or a hard disk that stores information, a touch panel display device 82 such as a touch panel display that can be input by a touch panel, A communication device 83 that transmits and receives processing results of the arithmetic device 80 and information stored in the storage device 81 via a network such as the Internet or a LAN.

  The arithmetic devices 70 and 80, the storage devices 71 and 81, the communication devices 74 and 83, etc. in FIGS. 3 and 4 have the same functions. The touch panel display device 82 is a display in which the display device 72 and the input device 73 are integrated, and has the same function in terms of displaying. The touch panel type display device 82 is an apparatus in which the functions of the display device 72 and the input device 73 are integrated in that input can be performed directly on the display by a predetermined input device (such as a touch panel pen).

  1 and 2 show the case where the management server 2 is realized by a single computer, the functions may be distributed and realized in a plurality of computers.

  Each means in the present invention is only logically distinguished in function, and may be physically or virtually the same area.

  The control instruction side communication terminal 3 includes a condition setting reception unit 30, an operation reception unit 31, a control instruction information generation unit 32, and a control instruction information transmission unit 33.

  The condition setting accepting unit 30 accepts the setting of the condition to which the controlled communication terminal 4 the operation for the control instruction side communication terminal 3 received by the operation accepting unit 31 described later is sent. The conditions at this time can be arbitrarily set for all controlled communication terminals 4 and controlled communication terminals 4 belonging to a certain group.

  The operation receiving unit 31 receives an operation input from the input device 73 or the touch panel display device 82 of the control instruction side communication terminal 3. Based on the received operation, control instruction information is generated by a control instruction information generating unit 32 described later and sent to the controlled communication terminal 4 so that the operation is reflected on the controlled communication terminal 4. .

  The control instruction information generation unit 32 includes a condition setting reception unit that receives the operation content received by the operation reception unit 31, such as marking a certain image file, starting an application, and starting functions of various devices such as a camera. And generated as control instruction information including the conditions received at 30. At this time, the date and time information on each operation is included in the control instruction information.

  Further, the control instruction information generating unit 32 needs to send the written screen as image information in the case of an operation of directly writing the contents on the screen displayed on the display device 72 or the touch panel type display device 82 as in marking. is there. In this case, the control instruction information generation process is performed by the following method.

  When a screen for performing an operation such as marking is displayed, the display device 72 and the touch panel display device 82 of the control instruction side communication terminal 3 and the controlled side communication terminal 4 have a plurality of screens or areas that can be marked. Are divided into rectangular areas, and identification information (area identification information) for making each rectangular area identifiable is attached. FIG. 6 schematically shows that the markable region of the screen displayed on the display device 72 and the touch panel type display device 82 is divided into a plurality of rectangular regions. The broken line in FIG. 6 indicates a rectangular area to be divided, but this line is not actually displayed and is used for processing in each of the communication terminals 3 and 4. FIG. 7 shows identification information for the rectangular area.

  The control instruction information generation unit 32 determines a region in which input is performed by the input device 73 and the touch panel display device 82 in the rectangular region, and acquires a screen displayed in the region as image information. Then, the image information, the area identification information, the information indicating the operation content indicating that the marking operation has been performed on the area, and the condition received by the condition setting receiving unit 30 are generated as control instruction information. FIG. 8 schematically shows the processing of the control instruction information generation unit 32. For example, when a marking operation (trajectory indicated by an arrow) as shown in FIG. 9 is performed, the control instruction information generation unit 32 displays the area identification information “41” to “45”, “49”, “53”, The screens of the rectangular areas “57”, “58”, “60”, “61”, “66” to “68” are acquired as image information, and each is generated as control instruction information.

  Note that the control instruction information can be sequentially changed according to the operation content, and it is sufficient that at least the operation content is included. Further, the control instruction information may be composed of one piece of information or a plurality of pieces of information.

  The control instruction information transmission unit 33 sends the control instruction information generated by the control instruction information generation unit 32 to the management server 2.

  The management server 2 includes a connection state monitoring unit 20, a control instruction information receiving unit 21, a control instruction information storage unit 22, a terminal identification processing unit 23, a control information processing unit 24, a control information storage unit 25, a control information reflection processing unit 26, A final control information determination processing unit 27 and a relative operation setting processing unit 28 are included.

  The connection state monitoring unit 20 monitors the connection state between the management server 2, the control instruction side communication terminal 3, and the management server 2 and the controlled side communication terminal 4.

  The control instruction information receiving unit 21 acquires the control instruction information sent from the control instruction side communication terminal 3 and stores it in the control instruction information storage unit 22 described later.

  The control instruction information storage unit 22 stores the control instruction information received by the control instruction information receiving unit 21. Note that the control instruction information storage unit 22 sequentially stores the received control instruction information. An example of the control instruction information storage unit 22 is shown in FIG.

  Based on the condition information in the control instruction information, the terminal identification processing unit 23 identifies the controlled communication terminal 4 that sends information including the operation content.

  The control information processing unit 24 generates control information to be sent to the controlled communication terminal 4 specified by the terminal specifying processing unit 23 based on the control instruction information received by the control instruction information receiving unit 21, and will be described later. The information is stored in the information storage unit 25. Although the case where the control information processing unit 24 generates control information based on the control instruction information has been described here, the control instruction information may be directly used as control information.

  Note that the control information can be sequentially changed according to the operation content, and it is sufficient that at least the operation content is included. Further, the control information may be composed of one piece of information or a plurality of pieces of information.

  The control information storage unit 25 stores, for each controlled communication terminal 4, control information generated by the control information processing unit 24 and sent to the terminal specified by the terminal specification processing unit 23. Since the control information storage unit 25 is used for the determination process in the final control information determination processing unit 27, the opposite operation is stored for each key grouping the set. When there is no opposite operation, it is stored as general control information. An example of the control information storage unit 25 sent to each controlled communication terminal 4 is shown in FIG.

  The control information reflection processing unit 26 sends the control information generated by the control information processing unit 24 to the controlled communication terminal 4 specified by the terminal specification processing unit 23, and performs control processing corresponding to the control information. It is executed in the control side communication terminal 4.

  The final control information determination processing unit 27 determines the final control instruction from the control instruction side communication terminal 3 performed while the connection between the controlled communication terminal 4 and the management server 2 is disconnected. Control information is determined and sent to the controlled communication terminal 4.

  Processing in the final control information determination processing unit 27 will be described. The final control information determination processing unit 27 first groups a set of opposing operations and sets it as a key. Then, based on the date and time information for each operation in the key, the finally executed operation is transferred. FIG. 11 schematically shows an example of a set of operations opposed to each other.

  FIG. 11A shows a case where an operation lock is performed in the controlling communication terminal so that the controlled communication terminal 4 cannot be operated. “Execute” operates the operation lock on the controlled communication terminal 4, and “release” releases the operation lock on the controlled communication terminal 4.

  FIG. 11B shows a case where some writing operation (marking) is performed on the image in the control side communication terminal. “Execute” is a case where marking is performed, and “Erase” is an operation for erasing the marking.

  FIG. 11C shows a case where various applications are activated in the control side communication terminal. Examples of applications include “personal folder”, “browser (Internet browser)”, “camera / electronic blackboard”, “voice memo”, and “self-study application”. For each application, there are “display” and “non-display” as the operation contents. The display is an operation for displaying (executing) the application, and the “non-display” is for displaying (executing) the application. It is an operation.

  FIG. 11D shows general control information that does not have an opposing operation. In this control information, when communication is disconnected, determination processing in a final control information determination processing unit 27 described later is not performed, and control information during communication disconnection is sent as it is.

  The control information processing unit 24 generates control information based on the operation content and the date / time information in the control instruction information received by the control instruction information receiving unit 21. Then, the generated control information is extracted, and it is determined whether there is an operation corresponding to each key. In some cases, the contents of each operation are updated and stored. If not, it is stored as general control information.

  For example, when “control lock” of the controlled communication terminal 4 is performed at the control instruction side communication terminal 3, the operation content “execution of operation lock” and date / time information of the operation from the control instruction side communication terminal 3, for example, Since control instruction information including date and time information “December 13, 2012 13:45:10” is received, control information is generated based on the received control instruction information, and the generated control information is stored in “execute” of key A . In this state, since the control information has not yet been sent to the controlled communication terminal 4, the flag indicating whether or not it has been sent is “not yet”. FIG. 12 schematically shows this state. In addition, when the “control lock” of the controlled communication terminal 4 is “released” by the control instruction side communication terminal 3, the operation details of the “operation lock release” and its operation are Since control instruction information including date and time information, for example, date and time information “December 13, 2012 13:46:34” is received, control information is generated based on the control instruction information, and the generated control information is “released” To remember. In this state, since the control information has not yet been sent to the controlled communication terminal 4, the flag indicating whether or not it has been sent is “not yet”. On the other hand, if the control information stored in FIG. 12 is connected to the controlled communication terminal 4, the control information is already sent to the controlled communication terminal 4, so that the flag is “done” and the disconnection is performed. Since it cannot be sent if it is done, it will be “not yet”. FIG. 13 schematically shows this state. Further, when the “control lock” of the controlled communication terminal 4 is performed at the control instruction side communication terminal 3, the operation contents of “operation lock execution” and the date and time information of the operation, for example, from the control instruction side communication terminal 3, for example, Since control instruction information including date and time information “December 13, 2012 13:47:08” is received, control information is generated based on the received control instruction information, and the generated control information is stored in “execute” of key A . FIG. 14 schematically shows this state.

  If the communication connection is cut for some reason between the management server 2 and the controlled communication terminal 4 between FIGS. 12 to 14, the control information based on these control instruction information is It is not sent to the controlled communication terminal 4. Therefore, when the communication connection between the management server 2 and the controlled communication terminal 4 is recovered after the state of FIG. 14, the final control information determination processing unit 27 executes “execute” or “ Among the “released”, the control information including the new date and time information with the flag “not yet” is determined as the control information including the final operation content. For example, in FIG. 14, the control information including the operation content of “execution of operation lock” associated with the date and time information of “December 13, 2012 13:47:08” is used as control information including the final operation content. The control information is sent from the control information reflection processing unit 26 to the controlled communication terminal 4 and the operation lock is executed.

  As described above, the final control information determination processing unit 27 establishes a connection between the controlled communication terminal 4 and the management server 2 for the control information grouped as a set of opposing operation contents, and then performs the operation on the operation contents. It is configured to determine whether the date and time information is new or old, and to send the operation contents associated with the new date and time information to the controlled communication terminal 4 as control information. As a result, as described above, when multiple operations are performed, such as “operation lock execution”, “operation lock release”, and “operation lock execution”, instead of sending all of them, Only processes that are finally executed can be sent.

  When the operation content is a marking operation, the final control information determination processing unit 27 includes the latest date / time information for each area identification information because the control information includes area identification information, its image information, and date / time information. Control information may be determined and sent from the control information reflection processing unit 26 to the controlled communication terminal 4 to display the image information in the corresponding rectangular area. This is schematically shown in FIG.

  The relative operation setting processing unit 28 receives a setting of a set of opposing operations set as a key. This setting accepts an operation from the control instruction side communication terminal 3, the controlled side communication terminal 4, or the management server 2. In addition to the management server 2, it may be received from a computer for managing the management server 2 (for example, a computer of a company that develops and maintains the communication terminal control system 1).

  For example, when setting the execution and release of operation lock as opposed operations, a setting screen is displayed by performing a predetermined operation on a computer operated by the setter. Then, on the screen, the opposite operations (here, “operation lock execution” operation and “operation lock release” operation) are selected, and the information is sent to the management server 2. The relative operation setting processing unit 28 of the management server 2 receives this information, and stores the opposing operations as one key based on the received information in the control information storage unit 25. That is, the control information storage unit 25 stores an operation group that cancels the previous operation for each key. In this way, it is possible to arbitrarily set operations. Note that the operations (combining operations) set here are not limited to two operations, but may be two or more operations, for example, three operations or four operations.

  The controlled communication terminal 4 includes a control information acquisition unit 40 and a control information execution processing unit 41.

  The control information acquisition unit 40 acquires control information sent from the management server 2.

  The control information execution processing unit 41 executes a control process corresponding to the operation content in the control information acquired by the control information acquisition unit 40. For example, when the operation content in the acquired control information is “operation lock execution”, a process of “operation lock” on the controlled communication terminal 4 is executed. When the operation content is “marking operation”, the image information in the control information is displayed in the rectangular area of the area identification information in the control information.

  By executing the processing as described above, the operation performed on the control instruction side communication terminal 3 can be performed on the controlled side communication terminal 4. Even when the communication between the controlled communication terminal 4 and the management server 2 is disconnected, control information based on the latest control instruction information is sent, so that control instructions for all operations being disconnected are sent. Control information based on the information is not sent to the controlled communication terminal 4. Therefore, even when the connection is disconnected, unnecessary operations can be omitted and the operations during that time can be reflected. Also, unnecessary communication can be prevented by omitting unnecessary operations.

  Note that the determination method in the above-described final control information determination processing unit 27 is an example, and other methods may be used. For example, the control instruction information is stored in the control instruction information storage unit 22 of the management server 2 for a predetermined time, and the final control information determination processing unit 27 performs a determination process in response to a control information transmission request from the controlled communication terminal 4. May be performed. In addition to the predetermined time, only the predetermined control instruction information may be stored, and the determination process may be performed based on the information.

  Next, an example of the processing process of the communication terminal control system 1 of the present invention will be described with reference to the flowchart of FIG. In the following description, a case where a teacher operates the control instruction side communication terminal 3 and each learner operates the controlled side communication terminal 4 will be described. Further, it is assumed that learners A to D are learners, learner A and learner B are group 1, learner C and learner D are group 2. In addition, it is assumed that information of learners A to D and learners constituting each group is stored in the control instruction side communication terminal 3 in advance. The teacher and learner information is registered, for example, as information on the user who uses the communication terminal control system 1 in the management server 2, and the information is acquired in advance in the control instruction side communication terminal 3. . Also, who is using which control instruction side communication terminal 3 or controlled side communication terminal 4 is determined from the authentication information (ID or ID) when logging into the control instruction side communication terminal 3 or controlled side communication terminal 4. The input or selection of the password) is accepted, and the teacher or the learner is associated with the identification information of the control instruction side communication terminal 3 and the controlled side communication terminal 4 used by each person. Here, learner A associates controlled communication terminal 4A, learner B associates with controlled communication terminal 4B, learner C associates with controlled communication terminal 4C, and learner D associates with controlled communication terminal 4D. Suppose that

  First, the teacher inputs and selects the authentication information and logs in from the control instruction side communication terminal 3 and each learner from the controlled side communication terminal 4 as described above. FIG. 16 shows an example of a login screen. FIG. 16A is a screen for selecting a grade and a group, and FIG. 16B is a screen for selecting its own name. Note that after selection, input of a password as authentication information may not be accepted as shown in FIG. When the authentication process is normally performed, a connection is established between the control instruction side communication terminal 3 and the management server 2, and the controlled side communication terminal 4 and the management server 2 (S100). Then, the connection state monitoring unit 20 of the management server 2 starts monitoring the connection state between the management server 2, the control instruction side communication terminal 3, and the controlled side communication terminal 4 (S110). Further, when the connection state monitoring unit 20 detects that the communication is disconnected, the connection state monitoring unit 20 stores the communication terminal and the date and time of the disconnection. Then, the management server 2 and the controlled communication terminal 4 wait until receiving a control instruction from the control instruction side communication terminal 3 (S120).

  When it is desired to reflect the operation performed by the teacher on the control instruction side communication terminal 3 on the controlled communication terminal 4 of the learner, conditions for specifying the learner to be the target are set (S130). For example, the condition setting accepting unit 30 inputs conditions such as “all”, “group 1”, “group 2”, “learner A”, “learner B”, “learner C”, “learner D”. Is received and stored (S130). The conditions accepted here are preferably valid until a new condition is entered.

  When the teacher performs an operation on the control instruction side communication terminal 3, the operation reception unit 31 receives the operation (S140). Then, the control instruction information generation unit 32 generates control instruction information including the operation content of the received operation and the condition received in S130, and the control instruction information transmission unit 33 sends the control instruction information to the management server 2. (S150).

  For example, when performing an operation of “operation lock” for all learners, the teacher performs a predetermined operation on the control instruction side communication terminal 3 and selects “all” as a condition. It is received by the condition setting receiving unit 30. When the teacher performs an operation of performing “lock operation of the controlled communication terminal 4 of the learner” on the control instruction side communication terminal 3, the operation reception unit 31 receives the operation.

  The control instruction information generation unit 32 includes date and time information (for example, 13:45:10 on December 13, 2012) when the operation of “operation lock” is performed, “operation lock” as the operation content, and the condition “all”. And the control instruction information transmission unit 33 sends the generated control instruction information to the management server 2.

  The control instruction information sent from the control instruction side communication terminal 3 in S150 is received by the control instruction information receiving unit 21 of the management server 2 and stored in the control instruction information storage unit 22 (S160). The terminal identification processing unit 23 refers to the condition in the received control instruction information, and identifies to which controlled communication terminal 4 the control instruction information is sent (S170). Here, since “all” is set as the condition in the control instruction information, the controlled communication terminals 4A to 4D used by the learners A to D are specified as transmission destinations.

  Then, the control information processing unit 24 generates control information including these based on the operation content and date / time information in the control instruction information (S180). Here, control information including “operation lock” and date information “December 13, 2012 13:45:10” is generated as the operation content. Since the condition is “all”, the control information generated in association with the controlled communication terminal 4 used by each learner is stored in the control information storage unit 25 (S190). FIG. 17 schematically shows an example of the control information storage unit 25 in this state. Since control information has not yet been sent to the controlled communication terminal 4 at the time of FIG. 17, “not yet” indicating that it has not been transmitted is stored as a flag indicating whether it has been transmitted.

  Then, the control information reflection processing unit 26 confirms the connection status of each controlled communication terminal 4 and determines whether there is a controlled communication terminal 4 that is not disconnected (S200). Here, for example, it is assumed that the connection is disconnected between the controlled communication terminal 4B of the learner B and the management server 2 (note that the connection status monitoring unit 20 manages the date and time information of the disconnection). To do). Then, since the control information reflection processing unit 26 cannot send the control information generated in S180 to the controlled communication terminal 4B, it waits as it is (S120). On the other hand, since the connection is established with respect to the controlled communication terminals 4A, 4C, and 4D, the control information reflection processing unit 26 refers to the control information storage unit 25, so It is determined whether there is control information (S210). Here, in any of the controlled communication terminals 4A, 4C, and 4D, there is no untransmitted control information in addition to the control information generated in S180, so that the control is performed without performing the process in the final control information determination processing unit 27. The information reflection processing unit 26 sends the control information to the controlled communication terminals 4A, C, and D (S220). Then, the control information reflection processing unit 26 changes the flag indicating whether or not the control side communication terminals 4A, C and D are transmitted in the control information storage unit 25 to “completed” indicating that the transmission is performed. Remember. An example of the control information storage unit 25 in this state is shown in FIG.

  Then, the controlled communication terminals 4A, C and D acquire the control information sent from the management server 2 by the control information acquisition unit 40 (S250), and the control information execution processing unit 41 corresponds to the operation content in the control information. Control, here "operation lock" is executed (S260). As a result, the operation lock is executed in the controlled communication terminals 4A, 4C, and 4D, and the screen of FIG. 19B is displayed. Note that the controlled communication terminal 4B is disconnected from the management server 2 and has not acquired control information, and therefore remains in an operable state (the screen remains as shown in FIG. 19A).

  Next, it is assumed that the teacher performs an operation of releasing the operation lock on the learners of “Group 1”. In this case, the teacher inputs “Group 1” as a condition at the control instruction side communication terminal 3, and receives and stores it as the condition setting reception unit 30 (S130).

  Then, when the teacher performs an “operation unlock” operation on the control instruction side communication terminal 3, the operation accepting unit 31 accepts the operation (S 140), and the control instruction information generating unit 32 operates the operation content “operation” Control instruction information including “unlocked”, the condition “group 1” received in S130, and date information “December 13, 2012 13:46:34” is generated. Then, the control instruction information transmission unit 33 sends this control instruction information to the management server 2 (S150).

  The control instruction information sent from the control instruction side communication terminal 3 in S150 is received by the control instruction information receiving unit 21 of the management server 2 and stored in the control instruction information storage unit 22 (S160). And the terminal specific process part 23 uses the learners A and B which belong to the group 1 as the controlled side communication terminal 4 which becomes a transmission destination by referring to the condition “group 1” in the received control instruction information. The controlled communication terminal 4A and the controlled communication terminal 4B are specified (S170).

  Then, the control information processing unit 24 generates control information including them based on the operation content “operation unlock” in the control instruction information and the date information “December 13, 2012 13:46:34” ( S180), the control information storage unit 25 stores the control side communication terminals 4A and B in association with the key A (operation lock) (S190). FIG. 20 schematically shows an example of the control information storage unit 25 in this state. Note that since the control information has not yet been sent to the controlled communication terminal 4 at the time of FIG. 20, “not yet” is stored as a flag indicating whether or not the control information is transmitted.

  When the control information reflection processing unit 26 confirms the connection status of the controlled communication terminals 4A and 4B and determines whether there is a controlled communication terminal 4 that is not disconnected (S200), the learner B still If the connection between the controlled communication terminal 4B and the management server 2 is disconnected, the control information generated in S180 cannot be sent to the controlled communication terminal 4B of the learner B, so (S120).

  On the other hand, since the connection is established with respect to the controlled communication terminal 4A, the control information reflection processing unit 26 refers to the control information storage unit 25 so that there is other untransmitted control information. Is determined (S210). Since there is no untransmitted control information in addition to the control information generated in S180 for the controlled communication terminal 4A, the control information reflection processing unit 26 is not subjected to the processing in the final control information determination processing unit 27. Sends the control information to the controlled communication terminal 4A (S220). Then, the control information reflection processing unit 26 changes, in the control information storage unit 25, the flag indicating whether the transmission is performed for the controlled communication terminal 4A, and stores it. An example of the control information storage unit 25 in this state is shown in FIG.

  The controlled communication terminal 4A acquires the control information sent from the management server 2 by the control information acquisition unit 40 (S250), and the control information execution processing unit 41 performs control corresponding to the operation content in the control information, here Then, “operation lock release” is executed (S260). As a result, the controlled communication terminal 4A is released from the operation lock and returns from the screen of FIG. 19B to the display of the screen of FIG. 19A. Since the controlled communication terminal 4B is disconnected from the management server 2 and has not acquired control information, it remains in an operable state (FIG. 19A). Further, the controlled communication terminals 4C and 4D have not acquired the control information of “operation lock release”, and thus remain in the control lock state (FIG. 19B).

  Next, it is assumed that the teacher performs the “operation lock” operation for the learners of “group 1”. In this case, the teacher inputs “Group 1” as a condition at the control instruction side communication terminal 3, and receives and stores it as the condition setting reception unit 30 (S130).

  Then, when the teacher performs the “operation lock” operation on the control instruction side communication terminal 3, the operation reception unit 31 receives the operation (S 140), and the control instruction information generation unit 32 displays the operation content “operation lock” of the received operation. ”, The condition“ Group 1 ”received in S130, and the date and time information“ December 13, 2012 13:47:08 ”are generated. Then, the control instruction information transmission unit 33 sends this control instruction information to the management server 2 (S150).

  The control instruction information sent from the control instruction side communication terminal 3 in S150 is received by the control instruction information receiving unit 21 of the management server 2 and stored in the control instruction information storage unit 22 (S160). And the terminal specific process part 23 uses the learners A and B which belong to the group 1 as the controlled side communication terminal 4 which becomes a transmission destination by referring to the condition “group 1” in the received control instruction information. The controlled communication terminal 4A and the controlled communication terminal 4B are specified (S170).

  Then, based on the operation content “operation lock” in the control instruction information and the date and time information “December 13, 2012 13:47:08”, the control information processing unit 24 generates control information including them (S180). ), Stored in correspondence with the key A (operation lock) of the controlled communication terminals 4A and B in the control information storage unit 25 (S190). FIG. 22 schematically shows an example of the control information storage unit 25 in this state. Since control information has not been sent to the controlled communication terminal 4 yet at the time of FIG. 22, “not yet” is stored as a flag indicating whether or not the control information has been transmitted.

  When the control information reflection processing unit 26 confirms the connection status of the controlled communication terminals 4A and 4B and determines whether there is a controlled communication terminal 4 that is not disconnected (S200), When the connection between the controlled communication terminal 4B and the management server 2 is restored, the control information generated in S180 can be sent to the controlled communication terminals 4A and B of learners A and B . Therefore, the control information reflection processing unit 26 determines whether there is other untransmitted control information by referring to the control information storage unit 25 (S210). Here, since there is no untransmitted control information in addition to the control information generated in S180 for the controlled communication terminal 4A, the control information reflection process is performed without performing the process in the final control information determination processing unit 27. The unit 26 sends the control information to the controlled communication terminal 4A (S220).

  On the other hand, for the controlled communication terminal 4B, it can be determined that there is untransmitted control information of “release operation lock” in addition to “execution of operation lock” (S210). The processing in the unit 27 is performed. That is, the operation content associated with the new date / time information among “execution of operation lock” and “release of operation lock” associated with each other as the opposite operation in the key A, in this case, the date / time The operation content of “execution of operation lock” associated with the date and time information whose information is “December 13, 2012 13:47:08” is determined as the final operation content (S230). The control information reflection processing unit 26 receives control information including “execution of operation lock” as the operation content and “13:47:08” on December 13, 2012 from the control information reflection processing unit 26 as the date and time information. The data is sent to the control side communication terminal 4B (S240).

  Then, the control information reflection processing unit 26 changes, in the control information storage unit 25, the flag indicating whether the transmission is performed for the controlled communication terminal 4A, and stores it. Further, for the controlled communication terminal 4B, the flags for “execution of operation lock” and “release of operation lock” that are the targets of the final control information determination process are changed to “done” and stored. An example of the control information storage unit 25 in this state is shown in FIG.

  Then, the controlled communication terminal 4A and the controlled communication terminal 4B acquire the control information sent from the management server 2 by the control information acquisition unit 40 (S250), and the control information execution processing unit 41 operates the control information in the control information. Control corresponding to the contents, here, “operation lock” is executed (S260). As a result, the operation side lock is executed in the controlled communication terminals 4A and B, and the screen shown in FIG. 19B is displayed instead of the screen shown in FIG. Further, the controlled communication terminals 4C and 4D have not acquired the control information of “execution of operation lock”, and therefore remain in the operation locked state (FIG. 19B).

  By executing the processing as described above, even when operations such as “execution of operation lock”, “release of operation lock”, “execution of operation lock” are repeated in the communication terminal 3 on the control instruction side, Conventionally, all processing while the connection was disconnected was sent to the controlled communication terminal 4, so after the connection was restored, “execution of operation lock”, “release operation lock”, “operation lock Although the process such as “execution” is performed in the controlled communication terminal 4, the latest state can be reflected without such a situation. In addition, the amount of communication can be reduced. This is schematically shown in FIG.

  In the first embodiment, the case of repetition of “execution of operation lock” and “release of operation lock” which are opposite operations on the same key A has been described. However, while the opposite operation on the same key is performed, A case where another operation is performed will be described. Specifically, after starting the “camera / electronic blackboard” application, the teacher starts the “personal folder” application and then closes the “camera / electronic blackboard” application. The case where it carries out by is demonstrated.

  First, the teacher inputs or selects the authentication information from the control instruction side communication terminal 3 and each learner from the controlled side communication terminal 4 as described above, and logs in. Thereby, a connection is established between the control instruction side communication terminal 3 and the management server 2, and the controlled side communication terminal 4 and the management server 2 (S100). Then, the connection state monitoring unit 20 of the management server 2 starts monitoring the connection state between the management server 2, the control instruction side communication terminal 3, and the controlled side communication terminal 4 (S110). Further, when the connection state monitoring unit 20 detects that the communication is disconnected, the connection state monitoring unit 20 stores the communication terminal and the date and time of the disconnection. Then, the management server 2 and the controlled communication terminal 4 wait until receiving a control instruction from the control instruction side communication terminal 3 (S120).

  When the teacher first performs the operation of starting the “camera / electronic blackboard” application for all the learners, the teacher selects “all” as a condition by performing a predetermined operation on the communication terminal 3 on the control instruction side. Then, the input is received and stored by the condition setting receiving unit 30 (S130). When the teacher performs an operation of “execution of application for camera / electronic blackboard application” on the control instruction side communication terminal 3, the operation reception unit 31 receives the operation (S140).

  The control instruction information generation unit 32 includes date / time information (for example, 13:45:10 on December 13, 2012) when the operation of “execution of camera / electronic blackboard application activation” is performed, and “camera” The control instruction information including the “execution of application on the electronic blackboard” and the condition “all” is generated, and the control instruction information transmitting unit 33 sends the generated control instruction information to the management server 2 (S150).

  The control instruction information sent from the control instruction side communication terminal 3 in S150 is received by the control instruction information receiving unit 21 of the management server 2 and stored in the control instruction information storage unit 22 (S160). Since “all” is set as the condition in the control instruction information, the terminal identification processing unit 23 identifies the controlled communication terminals 4A to 4D used by the learners A to D as transmission destinations (S170). .

  Then, the control information processing unit 24 performs the operation based on the operation content “execution of the application of the camera / electronic blackboard application” in the control instruction information and the date / time information “13:45:10 on December 13, 2012”. The control information including is generated (S180). Since the condition is “all”, the control information generated in association with the controlled communication terminal 4 used by each learner is stored in the control information storage unit 25 (S190). FIG. 25 schematically shows an example of the control information storage unit 25 in this state. Since control information has not yet been sent to the controlled communication terminal 4 at the time of FIG. 25, “not yet” indicating that it has not been transmitted is stored as a flag indicating whether it has been transmitted.

  Then, the control information reflection processing unit 26 confirms the connection status of each controlled communication terminal 4 and determines whether there is a controlled communication terminal 4 that is not disconnected (S200). Here, for example, if the connection between the controlled communication terminal 4B of the learner B and the management server 2 is disconnected, the control information reflection processing unit 26 generates the control communication terminal 4B in S180. Since control information cannot be sent, the process waits as it is (S120). On the other hand, since the connection is established with respect to the controlled communication terminals 4A, 4C, and 4D, the control information reflection processing unit 26 refers to the control information storage unit 25, so It is determined whether there is control information (S210). Here, in any of the controlled communication terminals 4A, 4C, and 4D, there is no untransmitted control information in addition to the control information generated in S180, so that the control is performed without performing the process in the final control information determination processing unit 27. The information reflection processing unit 26 sends the control information to the controlled communication terminals 4A, C, and D (S220). Then, the control information reflection processing unit 26 changes the flag indicating whether or not the control side communication terminals 4A, C and D are transmitted in the control information storage unit 25 to “completed” indicating that the transmission is performed. Remember. An example of the control information storage unit 25 in this state is shown in FIG.

  Then, the controlled communication terminals 4A, C and D acquire the control information sent from the management server 2 by the control information acquisition unit 40 (S250), and the control information execution processing unit 41 corresponds to the operation content in the control information. In this case, “execution of camera / electronic blackboard application activation” is executed (S260). As a result, the camera / electronic blackboard application is activated on the controlled communication terminals 4A, 4C, and 4D, and the screen in FIG. 27B is displayed from the screen in the initial state in FIG. Since the controlled communication terminal 4B is disconnected from the management server 2 and has not acquired control information, it remains in the initial state (FIG. 27A).

  Next, it is assumed that the teacher performs a “start application of personal folder” operation for learners of “group 1”. In this case, the teacher inputs “Group 1” as a condition at the control instruction side communication terminal 3, and receives and stores it as the condition setting reception unit 30 (S130).

  Then, when the teacher performs an operation of “activate personal folder” on the control instruction side communication terminal 3, the operation reception unit 31 receives the operation (S 140), and the control instruction information generation unit 32 operates the operation content “ Control instruction information including the “activation of personal folder application”, the condition “group 1” received in S130, and date information “December 13, 2012 13:46:34” is generated. Then, the control instruction information transmission unit 33 sends this control instruction information to the management server 2 (S150).

  The control instruction information sent from the control instruction side communication terminal 3 in S150 is received by the control instruction information receiving unit 21 of the management server 2 and stored in the control instruction information storage unit 22 (S160). And the terminal specific process part 23 uses the learners A and B which belong to the group 1 as the controlled side communication terminal 4 which becomes a transmission destination by referring to the condition “group 1” in the received control instruction information. The controlled communication terminal 4A and the controlled communication terminal 4B are specified (S170).

  Then, the control information processing unit 24 generates control information including them based on the operation content “application activation” in the control instruction information and the date information “December 13, 2012 13:46:34” ( S180), and stored in association with the key C (activation of the personal folder application) of the controlled communication terminals 4A and B in the control information storage unit 25 (S190). FIG. 28 schematically shows an example of the control information storage unit 25 in this state. Incidentally, since control information has not yet been sent to the controlled communication terminal 4 at the time of FIG. 28, “not yet” is stored as a flag indicating whether or not it has been sent.

  When the control information reflection processing unit 26 confirms the connection status of the controlled communication terminals 4A and 4B and determines whether there is a controlled communication terminal 4 that is not disconnected (S200), the learner B still If the connection between the controlled communication terminal 4B and the management server 2 is disconnected, the control information generated in S180 cannot be sent to the controlled communication terminal 4B of the learner B, so (S120).

  On the other hand, since the connection is established with respect to the controlled communication terminal 4A, the control information reflection processing unit 26 refers to the control information storage unit 25 so that there is other untransmitted control information. Is determined (S210). Since there is no untransmitted control information in addition to the control information generated in S180 for the controlled communication terminal 4A, the control information reflection processing unit 26 is not subjected to the processing in the final control information determination processing unit 27. Sends the control information to the controlled communication terminal 4A (S220). Then, the control information reflection processing unit 26 changes, in the control information storage unit 25, the flag indicating whether the transmission is performed for the controlled communication terminal 4A, and stores it. An example of the control information storage unit 25 in this state is shown in FIG.

  The controlled communication terminal 4A acquires the control information sent from the management server 2 by the control information acquisition unit 40 (S250), and the control information execution processing unit 41 performs control corresponding to the operation content in the control information, here Then, “Activation of Personal Folder Application” is executed (S260). As a result, the personal folder application is activated on the controlled communication terminal 4A, and the screen shown in FIG. 30 (a) is changed to the screen shown in FIG. 30 (b). Since the controlled communication terminal 4B is disconnected from the management server 2 and has not acquired control information, it remains in the initial state (FIG. 27A). Further, the controlled communication terminals 4C and 4D have not acquired the control information of “Activation of Personal Folder Application”, so that the “Launch Application of Camera / Electronic Blackboard” screen (FIG. 27B) is displayed. State.

  Next, it is assumed that the teacher performs an operation of “end application of camera / electronic blackboard” to “all” learners. In this case, the teacher inputs “all” as a condition at the control instruction side communication terminal 3, and receives and stores it as the condition setting reception unit 30 (S130).

  Then, when the teacher performs an operation of “end of the camera / electronic blackboard application” on the control instruction side communication terminal 3, the operation reception unit 31 receives the operation (S140), and the control instruction information generation unit 32 receives the received operation. Control instruction information including “End of application of camera / electronic blackboard application”, condition “all” accepted in S130, and date and time information “December 13, 2012 13:47:08” is generated. . Then, the control instruction information transmission unit 33 sends this control instruction information to the management server 2 (S150).

  The control instruction information sent from the control instruction side communication terminal 3 in S150 is received by the control instruction information receiving unit 21 of the management server 2 and stored in the control instruction information storage unit 22 (S160). Then, the terminal identification processing unit 23 refers to the condition “all members” in the received control instruction information, so that the controlled side used by the learners A to D as the controlled side communication terminal 4 that is the transmission destination. The communication terminal 4A to the controlled communication terminal 4D are specified (S170).

  Then, the control information processing unit 24, based on the operation content “end of camera / electronic blackboard application” in the control instruction information and the date and time information “December 13, 2012 13:47:08” Information is generated (S180) and stored in association with the key C (camera / electronic blackboard application) of the controlled communication terminals 4A to 4D in the control information storage unit 25 (S190). FIG. 31 schematically shows an example of the control information storage unit 25 in this state. In addition, since the control information has not been sent to the controlled communication terminal 4 at the time of FIG. 31, “not yet” is stored as a flag indicating whether or not the control information is transmitted.

  When the control information reflection processing unit 26 confirms the connection status of the controlled communication terminals 4A to 4D and determines whether there is a controlled communication terminal 4 that is not disconnected (S200), When the connection is restored between the controlled communication terminal 4B and the management server 2, the control information generated in S180 can be sent to the controlled communication terminals 4A to D of the learners A to D . Therefore, the control information reflection processing unit 26 refers to the control information storage unit 25 to determine whether there is untransmitted control information other than the control information generated in S180 (S210). Here, since there is no untransmitted control information in addition to the control information generated in S180 for the controlled communication terminal 4A and the controlled communication terminals 4C and D, the processing in the final control information determination processing unit 27 is performed. Instead, the control information reflection processing unit 26 sends the control information to the controlled communication terminals 4A, 4C, and 4D (S220).

  On the other hand, the controlled communication terminal 4B can determine that there is untransmitted control information of “execution of camera / electronic blackboard application” in addition to “end of camera / electronic blackboard application” (S210). Processing in the final control information determination processing unit 27 is performed. That is, the operation associated with the new date and time information among “execution of the camera / electronic blackboard application” and “end of the camera / electronic blackboard application” associated with each other in the key C. Content, in this case, the operation content of “End Camera / Electronic Blackboard Application” associated with the date / time information of “December 13, 2012 13:47:08” is the final operation content. (S230). In this case, since the determined operation is “end” of the application and is not an operation in which substantial processing is performed, control information is not generated or sent to the controlled communication terminal 4B. Also good. In this specification, it is assumed that control information is not generated and is not transmitted.

  In addition to the control information that has not been transmitted in the key C, the control information including “activation of personal folder application” and date and time information “13:46:34 on December 13, 2012” as operation contents is relative. Since there is no operation to be performed, it is determined as final control information.

  Therefore, the control information reflection processing unit 26 displays the control information including “start of personal folder application” and date information “December 13, 2012 13:46:34” as the operation content. To the controlled communication terminal 4B (S240).

  Then, the control information reflection processing unit 26 changes the flag indicating whether it has been transmitted to the controlled communication terminals 4A, C, and D in the control information storage unit 25 to “done” and stores it. For the controlled communication terminal 4B, the “execution of the camera / electronic blackboard application”, “end of the camera / electronic blackboard application”, and “activation of the application of the personal folder” which are the targets of the final control information determination processing Is changed to “Done” and stored. An example of the control information storage unit 25 in this state is shown in FIG.

  Then, the controlled communication terminal 4A to the controlled communication terminal 4D acquire the control information sent from the management server 2 by the control information acquisition unit 40 (S250), and the control information execution processing unit 41 operates the control information in the control information. In the control corresponding to the contents, here, the controlled communication terminals 4A, 4C, and 4D execute “end application of camera / electronic blackboard”. In addition, the controlled communication terminal 4B executes “activate personal folder” (S260). Accordingly, the screen of FIG. 30B is displayed on the controlled communication terminals 4A and 4B, and the screen of FIG. 27A is displayed on the controlled communication terminals 4C and D.

  By executing the processing as described above, even if a different operation is performed between the opposing operations at the control instruction side communication terminal 3, conventionally, all the processing while the connection is disconnected is all controlled. Since it was sent to the communication terminal 4, after the connection is restored, processes such as “execute camera / electronic blackboard application”, “start personal folder”, and “end camera / electronic blackboard application” Although it was performed by the terminal 4B, it does not happen and the latest state can be reflected. In addition, the amount of communication can be reduced. This is schematically shown in FIG.

  Next, a case where a marking operation and its erasure are performed will be described. Specifically, a marking operation as shown in FIG. 34 (b) is performed on the screen shown in FIG. 34 (a), and the marking shown in FIG. 34 (b) is deleted as shown in FIG. 34 (c). Further, a case will be described in which the teacher performs the marking operation as shown in FIG. 34D on the control instruction side communication terminal 3 on the screen of FIG.

  First, the teacher inputs or selects the authentication information from the control instruction side communication terminal 3 and each learner from the controlled side communication terminal 4 as described above, and logs in. Thereby, a connection is established between the control instruction side communication terminal 3 and the management server 2, and the controlled side communication terminal 4 and the management server 2 (S100). Then, the connection state monitoring unit 20 of the management server 2 starts monitoring the connection state between the management server 2, the control instruction side communication terminal 3, and the controlled side communication terminal 4 (S110). Further, when the connection state monitoring unit 20 detects that the communication is disconnected, the connection state monitoring unit 20 stores the communication terminal and the date and time of the disconnection. Then, the management server 2 and the controlled communication terminal 4 wait until receiving a control instruction from the control instruction side communication terminal 3 (S120).

  When the teacher first performs “marking operation” for all the learners, the teacher performs a predetermined operation on the communication terminal 3 on the control instruction side and selects “all” as a condition. It is received and stored by the setting receiving unit 30 (S130). And if a teacher performs "marking operation" with the display apparatus 72 and the touchscreen type display apparatus 82 with the control instruction side communication terminal 3, the operation will be received with the operation reception part 31 (S140).

  For example, when the teacher performs the marking operation as shown in FIG. 34B on the screen in the initial state shown in FIG. 34A, the control instruction information generation unit 32 is an area on the screen among the rectangular areas. Rectangular areas of identification information “41” to “45”, “49”, “53”, “57”, “58”, “60”, “61”, “66” to “68” are acquired as image information. (Refer to FIG. 9), date and time information (for example, 13:45:10 on December 13, 2012) on which “marking operation” was performed, “marking operation” as operation content, image information, and condition “all” And the control instruction information transmission unit 33 sends the generated control instruction information to the management server 2 (S150).

  The control instruction information sent from the control instruction side communication terminal 3 in S150 is received by the control instruction information receiving unit 21 of the management server 2 and stored in the control instruction information storage unit 22 (S160). Since “all” is set as the condition in the control instruction information, the terminal identification processing unit 23 identifies the controlled communication terminals 4A to 4D used by the learners A to D as transmission destinations (S170). .

  The control information processing unit 24 then identifies the area identification information “41” to “45”, “49”, “53”, “57”, “58”, “60”, “61”, “66” to “68”. Control information including the operation content “marking operation” in the control instruction information, image information, and date and time information “December 13, 2012, 13:45:10” is generated for each rectangular area (S180). Since the condition is “all”, the control information generated in association with the controlled communication terminal 4 used by each learner is stored in the control information storage unit 25 (S190). FIG. 35 schematically shows an example of the control information storage unit 25 in this state. In the present embodiment, only the key B corresponding to the marking operation is shown for convenience of drawing. Further, the controlled communication terminals 4C and D are the same as the controlled communication terminal 4A, and therefore will be omitted (the same applies to the present embodiment).

  Then, the control information reflection processing unit 26 confirms the connection status of each controlled communication terminal 4 and determines whether there is a controlled communication terminal 4 that is not disconnected (S200). Here, for example, if the connection between the controlled communication terminal 4B of the learner B and the management server 2 is disconnected, the control information reflection processing unit 26 generates the control communication terminal 4B in S180. Since control information cannot be sent, the process waits as it is (S120). On the other hand, since the connection is established with respect to the controlled communication terminals 4A, 4C, and 4D, the control information reflection processing unit 26 refers to the control information storage unit 25, so It is determined whether there is control information (S210). Here, since there is no untransmitted control information in addition to the control information generated in S180 in any of the controlled communication terminals 4A, 4C, and 4D, the control information as it is without performing the process in the final control information determination processing unit 27. The reflection processing unit 26 sends the control information to the controlled communication terminals 4A, C, and D (S220). Then, the control information reflection processing unit 26 changes the flag indicating whether or not the control side communication terminals 4A, C and D are transmitted in the control information storage unit 25 to “completed” indicating that the transmission is performed. Remember. An example of the control information storage unit 25 in this state is shown in FIG.

  Then, the controlled communication terminals 4A, C and D acquire the control information sent from the management server 2 by the control information acquisition unit 40 (S250), and the control information execution processing unit 41 corresponds to the operation content in the control information. Control, in this case, rectangular areas of area identification information “41” to “45”, “49”, “53”, “57”, “58”, “60”, “61”, “66” to “68” Then, a process for displaying each image information in the control information is executed (S260). As a result, the controlled communication terminals 4A, 4C, and 4D display the screen shown in FIG. 34B instead of the initial screen shown in FIG. Note that the controlled communication terminal 4B is disconnected from the management server 2 and has not acquired control information, and therefore remains in the initial state (FIG. 34A).

  Next, it is assumed that the teacher performs the “marking erasure” operation (FIG. 34C) on “all” learners.

  When the teacher performs the “marking erase” operation on the control instruction side communication terminal 3, the operation accepting unit 31 accepts the operation (S 140), and the control instruction information generating unit 32 performs the operation content “marking erased” of the accepted operation. ”And the deleted marking area identification information“ 41 ”to“ 45 ”,“ 49 ”,“ 53 ”,“ 57 ”,“ 58 ”,“ 60 ”,“ 61 ”,“ 66 ”to“ 68 ”. Control instruction information including the image information and the condition “all” received in S130 and the date information “December 13, 2012 13:46:34” is generated. Then, the control instruction information transmission unit 33 sends this control instruction information to the management server 2 (S150).

  The control instruction information sent from the control instruction side communication terminal 3 in S150 is received by the control instruction information receiving unit 21 of the management server 2 and stored in the control instruction information storage unit 22 (S160). Then, the terminal identification processing unit 23 refers to the condition “all members” in the received control instruction information, so that the controlled side communication terminal used by the learners A to D as the controlled side communication terminal 4 that is the transmission destination. 4A to controlled communication terminal 4D is specified (S170).

  The control information processing unit 24 then deletes the area identification information “41” to “45”, “49”, “53”, “57”, “58”, “60”, “61”, “66” of the deleted marking. ”To“ 68 ”, control information including the operation content“ marking deletion ”in the control instruction information, image information, and date information“ December 13, 2012 13:46:34 ”is generated. (S180), the data is stored in association with the key B of the controlled communication terminals 4A to 4D in the control information storage unit 25 (S190). FIG. 37 schematically shows an example of the control information storage unit 25 in this state.

  When the control information reflection processing unit 26 confirms the connection status of the controlled communication terminals 4A to 4D and determines whether there is a controlled communication terminal 4 that is not disconnected (S200), the learner B still If the connection between the controlled communication terminal 4B and the management server 2 is disconnected, the control information generated in S180 cannot be sent to the controlled communication terminal 4B of the learner B, so (S120).

  On the other hand, since the connection is established with respect to the controlled communication terminals 4A, 4C, and 4D, the control information reflection processing unit 26 refers to the control information storage unit 25, thereby generating the control generated in S180. It is determined whether there is untransmitted control information other than information (S210). For the controlled communication terminals 4A, 4C, and 4D, there is no untransmitted control information in addition to the control information generated in S180, so that the control information is processed as it is without performing the process in the final control information determination processing unit 27. The reflection processing unit 26 sends the control information to the controlled communication terminals 4A, C, and D (S220). Then, the control information reflection processing unit 26 changes the flag indicating whether it has been transmitted to the controlled communication terminals 4A, C, and D in the control information storage unit 25 to “done” and stores it. An example of the control information storage unit 25 in this state is shown in FIG.

  Then, the controlled communication terminals 4A, C and D acquire the control information sent from the management server 2 by the control information acquisition unit 40 (S250), and the control information execution processing unit 41 corresponds to the operation content in the control information. Control, in this case, rectangular areas of area identification information “41” to “45”, “49”, “53”, “57”, “58”, “60”, “61”, “66” to “68” Then, a process for displaying each image information in the control information is executed (S260). As a result, the controlled communication terminals 4A, 4C, and 4D display the screen of FIG. 34C instead of the screen of FIG. Note that the controlled communication terminal 4B is disconnected from the management server 2 and has not acquired control information, and therefore remains in the initial state (FIG. 34A).

  Next, it is assumed that the teacher performs “execution of marking operation” (FIG. 34D) for “all” learners.

  And if a teacher performs "execution of marking operation" with the control instruction side communication terminal 3, the operation reception part 31 will receive the operation (S140). When the teacher performs the marking operation as shown in FIG. 34 (d), as shown in FIG. 39, the markings are the area identification information “13” to “16”, “20”, “21”, “24”, Since “28”, “29”, “32”, “37” to “40” are performed, those rectangular areas are acquired as image information, and date / time information (“marking operation”) is performed ( For example, on December 13, 2012, 13:47:08), control instruction information including “marking operation”, image information, and condition “all” as operation contents is generated, and the generated control instruction information is The control instruction information transmission unit 33 sends it to the management server 2 (S150).

  The control instruction information sent from the control instruction side communication terminal 3 in S150 is received by the control instruction information receiving unit 21 of the management server 2 and stored in the control instruction information storage unit 22 (S160). Then, the terminal identification processing unit 23 refers to the condition “all members” in the received control instruction information, so that the controlled side used by the learners A to D as the controlled side communication terminal 4 that is the transmission destination. The communication terminal 4A to the controlled communication terminal 4D are specified (S170).

  The control information processing unit 24 then identifies the area identification information “13” to “16”, “20”, “21”, “24”, “28”, “29”, “32”, “37” to “40”. Control information including the operation content “marking operation” in the control instruction information, image information, and date and time information “December 13, 2012, 13:47:08” is generated for each rectangular area (S180). Since the condition is “all”, the control information generated in association with the controlled communication terminal 4 used by each learner is stored in the control information storage unit 25 (S190). FIG. 40 schematically shows an example of the control information storage unit 25 in this state.

  When the control information reflection processing unit 26 confirms the connection status of the controlled communication terminals 4A to 4D and determines whether there is a controlled communication terminal 4 that is not disconnected (S200), When the connection is restored between the controlled communication terminal 4B and the management server 2, the control information generated in S180 can be sent to the controlled communication terminals 4A to D of the learners A to D . Therefore, the control information reflection processing unit 26 refers to the control information storage unit 25 to determine whether there is other untransmitted control information other than the control information generated in S180 (S210). Here, since there is no untransmitted control information in addition to the control information generated in S180 for the controlled communication terminal 4A and the controlled communication terminals 4C and D, the processing in the final control information determination processing unit 27 is performed. Instead, the control information reflection processing unit 26 sends the control information to the controlled communication terminals 4A, 4C, and 4D (S220).

  On the other hand, in the controlled communication terminal 4B, in addition to the “execution of marking operation” generated in S180, there is untransmitted control information of “execution of marking operation” and “deletion of marking operation” for another rectangular area. (S210), the final control information determination processing unit 27 performs processing. That is, “marking” for the rectangular areas of the area identification information “41” to “45”, “49”, “53”, “57”, “58”, “60”, “61”, “66” to “68”. “Execution of operation” and rectangles of area identification information “41” to “45”, “49”, “53”, “57”, “58”, “60”, “61”, “66” to “68” Since the “erasing marking operation” for a region is a marking operation for the same rectangular region, the operation content associated with any new date and time information, in this case, the date and time information is “December 13, 2012 13:46. The operation content of “deletion of marking operation” associated with the date information of “34 minutes” is determined as the final operation content (S230). In this case, since the determined operation is “deletion of marking operation” and is not an operation in which substantial processing is performed, control information is not generated or sent to the controlled communication terminal 4B. Anyway. In this specification, it is assumed that control information is not generated and is not transmitted.

  Therefore, the control information reflection processing unit 26 performs the area identification information “13” to “16”, “20”, “21”, “24”, “28”, “29”, “32”, “37” to “37”. Control information including “40” image information and “execution of marking operation” and date and time information “December 13, 2012 13:47:08” from the control information reflection processing unit 26 to the controlled communication terminal Send to 4B (S240).

  Then, the control information reflection processing unit 26 changes the flag indicating whether it has been transmitted to the controlled communication terminals 4A, C, and D in the control information storage unit 25 to “done” and stores it. For the controlled communication terminal 4B, the area identification information “41” to “45”, “49”, “53”, “57”, “58”, “60”, “61”, “Execution of marking operation” and “Erasing marking operation” of “66” to “68”, region identification information “13” to “16”, “20”, “21”, “24”, “28”, “Execute marking operation” of “29”, “32”, “37” to “40” is changed to “Done” and stored. An example of the control information storage unit 25 in this state is shown in FIG.

  Then, the controlled communication terminal 4A to the controlled communication terminal 4D acquire the control information sent from the management server 2 by the control information acquisition unit 40 (S250), and the control information execution processing unit 41 operates the control information in the control information. In the control corresponding to the contents, here in the controlled communication terminals 4A to 4D, the area identification information “13” to “16”, “20”, “21”, “24”, “28”, “29”, “ “Execute marking operation” of “32”, “37” to “40” is executed (S260). As a result, the controlled communication terminals 4A to 4D display the screen shown in FIG.

  By executing the processing as described above, the latest state can be reflected even when communication is disconnected at the connected communication terminal B. In addition, the amount of communication can be reduced. This is schematically shown in FIG.

  In the above-described third embodiment, the control instruction information generating unit 32 of the control instruction side communication terminal 3 divides the screen displayed on the display device 72 or the touch panel type display device 82 of the control instruction side communication terminal 3 into rectangular areas. , The changed rectangular area is sent to the management server 2 as control instruction information together with the operation content. In the present embodiment, a case will be described in which rectangular area division processing or the like is performed by the management server 2. An example of the system configuration in this case is shown in FIG.

  In this embodiment, the control instruction side communication terminal 3 includes an operation information transmission unit 34 instead of the control instruction information generation unit 32 and the control instruction information transmission unit 33. The management server 2 includes an operation information receiving unit 50 and an operation information storage unit 51 instead of the control instruction information receiving unit 21 and the control instruction information storage unit 22.

  When the marking operation is performed on the image file displayed on the control instruction side communication terminal 3, the operation information transmission unit 34 in the control instruction side communication terminal 3 of FIG. 43 displays the operation contents and the control instruction side communication terminal 3. Information including at least all or part of the image file to be processed and the condition received by the condition setting receiving unit 30 is sent to the management server 2 as operation information. At this time, the date and time information on each operation is included in the operation information.

  The operation information receiving unit 50 in the management server 2 acquires the operation information sent from the control instruction side communication terminal 3 and stores it in the operation information storage unit 51 described later.

  The operation information storage unit 51 stores the operation information received by the operation information receiving unit 50.

  The control information processing unit 24 ′ generates control information to be sent to the controlled communication terminal 4 specified by the terminal specifying processing unit 23 based on the operation information received by the operation information receiving unit 50, and controls information described later. The data is stored in the storage unit 25. Although the case where the control information processing unit 24 ′ generates control information based on the operation information has been described here, the operation information may be directly used as control information.

  That is, the control information processing unit 24 ′ divides the image information in the operation information into rectangular areas as shown in FIGS. 6 and 7 and determines an input area. The difference between the previous operation information and the image information is detected, and if there is a difference, it can be determined as an input area.

  Then, control information is generated based on the image information of the area determined to have been input, the area identification information of the area, the information indicating that the marking operation has been performed on the area, and the date and time information. At the same time, it is stored in the control information storage unit 25.

  Based on the control information generated as described above, processing is executed in the same manner as in the above-described embodiments. By performing such processing, processing for a high-load image can be performed by the management server 2 having high processing capability without being performed by the control instruction side communication terminal 3.

  Another embodiment of the above-described first to fourth embodiments will be described.

  In this case, control instruction information is received from the control instruction side communication terminal 3 and stored in the control instruction information storage unit 22. In the controlled communication terminal 4, the control information acquisition unit 40 of the controlled communication terminal 4 sends a control information transmission request to the management server 2 periodically or at a predetermined timing. This transmission request includes the date and time information when the control information was acquired from the management server 2 last time.

  When the control information transmission unit 24 of the management server 2 receives this control information transmission request, the control information processing unit 24 is control instruction information after the date and time information in the transmission request, and the controlled communication terminal 4 Is extracted from the control instruction information storage unit 22. Then, control information is generated from the extracted control instruction information, the final control information determination processing unit 27 performs control information determination processing, and the control information after the processing is used as control information of the management server 2. The reflection processing unit 26 sends it to the controlled communication terminal 4.

  By executing such processing, processing can be performed without using a flag. In this case, the control information storage unit 25 may not be provided.

  Further, the control instruction information and control information may include unique information (control instruction information order code and control information order code) indicating the order of the information instead of the date and time information. In this case, the controlled communication terminal 4 sends the control information sequence code in the control information last acquired by the control information acquisition unit 40 of the controlled communication terminal 4 to the management server 2. The management server 2 extracts control instruction information up to the latest control instruction information order code from the control instruction information storage unit 22 based on the control information order code, generates the control information, and receives the final control information. It can also be configured to send to the control side communication terminal 4. When the control information is already stored in the control information storage unit 25, the management server 2 stores the control information up to the latest control information order code based on the control information order code. And the final control information may be sent to the controlled communication terminal 4.

  As still another embodiment, the following configuration can be adopted.

  The control instruction information storage unit 22 and the control information storage unit 25 are configured to sequentially update and store the control instruction information and the control information in each of the above-described embodiments. However, when a relative operation is performed, Only the control instruction information and control information that are finally performed may be stored. In this case, a dictionary database (relative operation key information storage unit) (not shown) of opposing operations included in the same key is provided, and the control instruction information including the contents of the opposing operations is referred to the dictionary database. Alternatively, control information is specified and unnecessary control instruction information or control information (not control instruction information or control information of the operation content that was finally performed out of the control instruction information or control information of the opposite operation content) Configure to delete.

  In this case, the relative operation setting processing unit 28 causes the control information storage unit 25 to store the received key in the above-described dictionary database, instead of storing the relative operation to be set as a key.

  The processing timing in the final control information determination processing unit 27 may be performed at an arbitrary timing. For example, the timing at which the control instruction information receiving unit 21 receives control instruction information, the timing at which the control information processing unit 24 generates control information, or the like. You can go.

  The shape and size of the rectangle in the third embodiment may not be uniform. For example, the rectangle may be configured so that the vicinity of the center is fine and the vicinity is large. Moreover, it does not need to be rectangular.

  In each of the above-described embodiments, the case where the control instruction information generation unit 32 is provided in the control instruction side communication terminal 3 has been described, but the management server 2 may be provided. In this case, the control instruction side communication terminal 3 sends, for example, information including image information, information indicating operation contents, and conditions received by the condition setting receiving unit 30 to the management server 2 to control the management server 2. The instruction information generating unit 32 may generate control instruction information.

  Further, in each of the above-described embodiments, one screen is displayed on one display device 72 and touch panel type display device 82. However, a plurality of screens may be displayed. In this case, as shown in FIG. 44, when the display contents are different for each screen, a different key set (opposing operation) may be provided for each screen. For example, in the case of FIG. 44, the content of the textbook is displayed on the upper screen, and the corresponding problem is displayed on the lower screen. Therefore, it may be configured to have a key pair (opposite operation) for the upper screen and a key pair (opposite operation) for the lower screen.

  By the communication terminal control system 1 of the present invention, it is possible to identify the finally performed operation and reflect only the operation to the other party. Even when the connection is disconnected, unnecessary operations can be omitted and the operations during that time can be reflected. In this way, unnecessary communication can be prevented by omitting unnecessary operations.

1: Communication terminal control system 2: Management server 3: Control instruction side communication terminal 4: Controlled side communication terminal 20: Connection state monitoring unit 21: Control instruction information receiving unit 22: Control instruction information storage unit 23: Terminal specification processing unit 24, 24 ′: Control information processing unit 25: Control information storage unit 26: Control information reflection processing unit 27: Final control information determination processing unit 30: Condition setting reception unit 31: Operation reception unit 32: Control instruction information generation unit 33: Control instruction information transmission unit 34: operation information transmission unit 40: control information acquisition unit 41: control information execution processing unit 50: operation information reception unit 51: operation information storage unit 70: arithmetic device 71: storage device 72: display device 73: Input device 74: Communication device 80: Arithmetic device 81: Storage device 82: Touch panel type display device 83: Communication device

Claims (2)

An image displayed on the display device of the control instruction side communication terminal during disconnection of the connection with the controlled side communication terminal is displayed on the controlled side communication terminal via the management server after the connection with the controlled side communication terminal is restored. A communication terminal control system for reflecting,
The management server
Control instruction information including image information and date / time information of an area where an operation is performed among screens divided into a plurality of areas displayed on the display device of the control instruction side communication terminal is transmitted from the control instruction side communication terminal. A control instruction information receiving unit for receiving;
A connection state monitoring unit for monitoring a connection state with the controlled communication terminal;
A control information processing unit for generating control information based on the received control instruction information ;
A control information storage unit that stores the generated control information and identification information indicating whether the control information has been transmitted;
When it is determined by the connection state monitoring in the connection state monitoring unit that the connection with the controlled communication terminal is not disconnected, control information that has not been transmitted among the control information stored in the control information storage unit A control information reflection processing unit that waits when it is determined that the connection with the controlled communication terminal is disconnected ,
A final control information determination processing unit for determining new control information as control information to be transmitted to the controlled communication terminal among the untransmitted control information when there is corresponding untransmitted control information in the same area; ,
Have
The control information reflection processing unit
Wherein the control information determined as to the controlled side communication terminal Ri sent to the controlled side communication terminal, to change the identification information indicating whether it has transmission in the control information storage unit,
A communication terminal control system. Processing for reflecting the image displayed by the display device control instruction communication terminal during the cutting of the connection between the control side communication terminal, in the controlled-side communication terminal the after restoration of connection between the control side communication terminal A computer that performs
Control instruction information including image information and date / time information of an area where an operation is performed among screens divided into a plurality of areas displayed on the display device of the control instruction side communication terminal is transmitted from the control instruction side communication terminal. Receiving control instruction information receiving unit,
A connection state monitoring unit for monitoring a connection state with the controlled communication terminal;
A control information processing unit that generates control information based on the received control instruction information, and stores the generated control information and identification information indicating whether the control information has been transmitted in association with each other in a storage device ;
When it is determined that the connection with the controlled communication terminal is not disconnected by monitoring the connection state in the connection state monitoring unit, there is untransmitted control information among the control information stored in the storage device A control information reflection processing unit that waits when it is determined that the connection with the controlled communication terminal is disconnected ,
A final control information determination processing unit that determines new control information as control information to be transmitted to the controlled communication terminal among the untransmitted control information when there is corresponding untransmitted control information in the same area;
A communication terminal control program to function as
The control information reflection processing unit
Ri send the control information is determined to be transmitted to the controlled-side communication terminal to the controlled side communication terminal, to change the identification information indicating whether the transmission in said storage device,
A communication terminal control program.

Images