JP7632193B2 - Display Control Program - Google Patents

Description

The present invention relates to a display control program.

A conventional display control program controls pointer movement when multiple terminal devices connected via a communication line share and display the same window among multiple windows for collaborative editing. Specifically, in accordance with the display control program, when the pointer displayed on the display unit of the terminal device is outside the frame of the shared window, the terminal device determines the destination window from the change in distance between the pointer and each of the multiple windows. The terminal device transmits pointer data including information about the destination window to the other terminal device. The terminal device that receives the pointer data moves the other terminal device's pointer toward the destination window based on the pointer data.

JP 2010-224872 A

When collaborative editing is being performed among multiple terminal devices, the terminal devices can display a display area that is different from that of the other devices. In a terminal device that controls a pointer according to a conventional display control program, if the position of the pointer notified from another device is outside the display area of the user's own terminal device, the user is unaware that the pointer is being operated on another device.

The object of the present invention is to provide a display control program that allows a user to grasp operations performed by other devices outside the display area, even when different display areas are displayed on each terminal device.

The display control program of the first aspect is a display control program executed by the control unit of a terminal device having a display unit that displays an image, a communication unit that communicates with another device, and a control unit that controls the display unit and the communication unit, and includes instructions to cause the control unit to execute an arrangement acquisition process that acquires arrangement information indicating the arrangement of a display area displayed on the display unit with respect to an editing area shared with the other device, a reception process that receives pointer information indicating the position of a pointer with respect to the editing area from the other device via the communication unit, a judgment process that judges whether the pointer is within the display area based on the received pointer information and the acquired arrangement information, a first display process that displays the pointer at the position indicated by the arrangement information in the display area when it is judged that the pointer is within the display area, and a second display process that displays a mark indicating that the pointer is not within the display area on the display unit when it is not judged that the pointer is within the display area. The terminal device that executes the display control program of the first aspect can execute the first display process and the second display process according to the judgment result of the judgment process. Therefore, even if different display areas are displayed on each terminal device, the user of the terminal device can know whether or not the pointer is being operated on another device by the mark displayed in the second display process.

The display control program of the second aspect is a display control program executed by the control unit of a terminal device having a display unit that displays an image, a communication unit that communicates with other devices, and a control unit that controls the display unit and the communication unit, and includes instructions to the control unit to execute an arrangement acquisition process that acquires arrangement information indicating the arrangement of a display area displayed on the display unit relative to an editing area shared with the other device, a reception process that receives operation information indicating an operation position and operation content relative to the editing area from the other device via the communication unit, a determination process that determines whether the operation position is within the display area based on the received operation information and the acquired arrangement information, a display process that, if it is determined that the operation position is within the display area, displays according to the operation content at the operation position indicated by the arrangement information in the display area, and a change process that, if it is not determined that the operation position is within the display area, changes the arrangement of the display area relative to the editing area so that the operation position indicated by the operation information is within the display area, and displays according to the operation content at the operation position indicated by the arrangement information. A terminal device that executes the display control program of the second aspect can execute a display process and a change process according to the result of the determination process. Therefore, even if a different display area is displayed for each terminal device, the user of the terminal device can understand the operation on the other device because the display area for the editing area is changed in the change process and a display according to the operation content is displayed at the operation position.

FIG. 1 is an explanatory diagram of a system 15 including terminal devices 1A to 1C. 13 is a flowchart of an invitation process. 2A to 2C are explanatory diagrams of a collaborative editing start screen 21, a collaborative editing screen 25, and a collaborative editing end screen 45. 13 is a flowchart of a joint editing process. FIG. 13 is an explanatory diagram of a process performed when a pointer 54 is operated in a state in which display areas 51 to 53 are different from an editing area 50. FIG. 11 is an explanatory diagram of a process performed when a pointer 54 is operated in a state in which display areas 51 to 53 are different from an editing area 50 in the first and second modified examples. FIG. 13 is an explanatory diagram of a process performed when a pointer 54 is operated in a state in which display areas 51 to 53 are different from an editing area 50 in a third modified example. 13 is a flowchart of a collaborative editing process according to a fourth modified example. FIG. 13 is an explanatory diagram of a process performed when an object 96 is operated in a state in which display areas 51 to 53 are different from an editing area 50. FIG. 13 is an explanatory diagram of a process in which a field 42 on a screen 25 displayed on a terminal device 1C is switched from an image 100 to an image 103 in a collaborative editing process of a fourth modified example.

An embodiment of the present disclosure will be described with reference to the drawings. As shown in FIG. 1, a system 15 includes terminal devices 1A to 1C. In the system 15, a display control program described below is executed in each of the terminal devices 1A to 1C, so that the same window can be shared and displayed between the terminal devices 1A to 1C connected via a communication line, and collaborative editing can be performed. Each of the terminal devices 1A to 1C is a portable terminal device such as a mobile phone (e.g., a smartphone), a PDA, or a tablet PC. The terminal device 1A is operated by a user A, the terminal device 1B is operated by a user B, and the terminal device 1C is operated by a user C. Hereinafter, when the terminal devices 1A to 1C are not to be distinguished from each other, they are also referred to as terminal device 1.

Each terminal device 1 comprises a CPU 2, ROM 3, RAM 4, a memory unit 5, a communication unit 6, an input/output interface (I/O) 7, a display unit 9, and an input unit 10. The CPU 2 is connected to the ROM 3, RAM 4, the memory unit 5, the communication unit 6, and the I/O 7 via a bus 8. The CPU 2 controls the terminal device 1. A boot program and a BIOS are stored in the ROM 3. Temporary data is stored in the RAM 4. Various setting values are stored in the memory unit 5. The communication unit 6 is an interface for connecting to the network 11. The CPU 2 can transmit and receive data to and from other terminal devices 1 connected to the network 11 via the communication unit 6 and the access point 12. The display unit 9 and the input unit 10 are connected to the I/O 7. The display unit 9 is capable of displaying images and is, for example, a liquid crystal display. The input unit 10 is a touch panel provided on the surface of the display unit 9, and outputs a detection signal according to the position of a pointer such as a stylus pen 14 or a finger.

The invitation process executable by each terminal device 1 will be described with reference to Figures 2 and 3. In the invitation process, a process of adding a user of another terminal device 1 to the members of the collaborative editing, starting the collaborative editing, and ending the collaborative editing are executed. As an example, a case will be described in which the invitation process is executed on terminal device 1A of user A, and users B and C are added to the members of the collaborative editing. When the CPU 2 detects an instruction to start the invitation process, it reads a program for executing the invitation process from the storage unit 5 to the RAM 4. The CPU 2 executes the invitation process having the following steps according to the instructions contained in the program read to the RAM 4. Various data obtained during the invitation process are appropriately stored in the RAM 4. Hereinafter, steps are abbreviated as S.

As shown in FIG. 2, the CPU 2 of the terminal device 1A displays a collaborative editing start screen 21 (hereinafter simply referred to as screen 21) shown in FIG. 3 on the display unit 9 (S2). As shown in FIG. 3, screen 21 displays keys 22 to 24. Key 22 is selected when canceling the start of the collaborative editing process. Key 23 is selected when instructing the start of the collaborative editing process. Key 24 is selected when adding a user of another terminal device 1 as a member of the collaborative editing. Based on the detection signal of the input unit 10, the CPU 2 determines whether selection of key 24 has been detected (S3). If selection of key 24 has not been detected (S3: NO), the CPU 2 performs the process of S5 described below.

User A selects key 24 to input an instruction to add users B and C to the members of the collaborative editing. When the selection of key 24 is detected (S3: YES), CPU 2 outputs an invitation notification to the collaborative editing to the terminal device 1 of the selected member via communication unit 6 (S4). Although not shown, a screen is displayed on terminal devices 1B and 1C that received the invitation notification, allowing the user to select whether to accept or reject the invitation to the collaborative editing sent from terminal device 1A. When acceptance is selected on terminal devices 1B and 1C, an acceptance notification is sent to terminal device 1A, and when rejection is selected, a rejection notification is sent to terminal device 1A. CPU 2 of terminal device 1A judges whether the acceptance notification has been received via communication unit 6 (S5). When the acceptance notification has been received (S5: YES), CPU 2 of terminal device 1A starts the collaborative editing process described below and displays the collaborative editing screen 25 (hereinafter simply referred to as screen 25) shown in FIG. 3 on the display unit 9 (S6).

Screen 25 displays icons 26 to 41 and field 42. Icon 26 is selected when instructing to switch the display screen. Icon 27 is selected when returning the display area for the editing area to the initial state. In this example, the initial state is a state in which the entire editing area is included in the display area. Icon 28 is selected when returning to the previous operation. Icon 29 is selected when redoing the next operation. Icon 30 is selected when outputting the contents of the editing area. Icon 31 is selected when adding strokes with a pen to the display area. Icon 32 is selected when deleting an object in the display area. Icon 33 is selected when adding strokes with a marker to the display area. Icon 34 is selected when selecting an object in the display area. Icon 35 is selected when inserting text into the display area. Icon 36 is selected when adding a figure to the display area. Icon 37 is selected when adding a file, figure, photo, etc. to the display area. Icon 38 is selected when operating the pointer. Icons 39 to 41 indicate figures that can be inserted into the display area when icon 36 is selected. Icon 39 is selected to add a rectangle to the display area. Icon 40 is selected to add a circle to the display area. Icon 41 is selected to add a triangle to the display area. The icon displayed to the right of icon 38 changes depending on which icon is selected among icons 31 to 38. Column 42 displays the display area of the editing area.

If the acceptance notification is not received (S5: NO), or after S6, the CPU 2 of the terminal device 1A judges whether an end instruction has been detected (S7). The end instruction is input from a collaborative editing end screen 45 (hereinafter simply referred to as screen 45) that is displayed when "End collaborative editing" is selected after the icon 26 is selected. The end instruction may be received from another terminal device 1 that is currently performing collaborative editing. The screen 45 displays keys 46 and 47. The key 46 is selected to cancel the end of the collaborative editing process. The key 47 is selected to end the collaborative editing process. If the selection of the key 47 is not detected (S7: NO), the CPU 2 returns the process to S3. If the selection of the key 47 is detected (S7: NO), the CPU 2 of the terminal device 1A returns the process to S3. If the selection of the key 47 is detected (S7: YES), the CPU 2 of the terminal device 1A ends the collaborative editing process (S8), and the invitation process is thus ended.

3 to 5, the collaborative editing process of the terminal device 1 will be described. As an example, the collaborative editing process is executed in each of the terminal devices 1A to 1C, and a process corresponding to the operation of the pointer is executed in each of the terminal devices 1A to 1C based on the pointer 54 operated in the terminal device 1A. When the CPU 2 of each terminal device 1 detects a start instruction to start the collaborative editing process, it reads a display control program for executing the collaborative editing process from the storage unit 5 to the RAM 4. The start instruction is output in S6, and is also transmitted from the other terminal device 1 after accepting an invitation notification from the other terminal device 1. The CPU 2 executes the collaborative editing process having the following steps according to the instructions included in the display control program read to the RAM 4. Various data obtained in the process of the collaborative editing process is appropriately stored in the RAM 4. Hereinafter, steps are abbreviated as S. The collaborative editing processes in the terminal devices 1A to 1C are executed individually in each device, but will be described in parallel to simplify the explanation.

4, the CPU 2 of each terminal device 1 displays the screen 25 of FIG. 3 on the display unit 9 (S11). The CPU 2 of each terminal device 1 determines whether editing of an object has been detected based on the detection signal of the input unit 10 (S12). When editing an object in the display area displayed in the column 42, the user selects one of the icons 31 to 37 according to the editing content, and then operates the column 42. The CPU 2 of each terminal device 1 detects that an operation of the column 42 has been detected while one of the icons 31 to 37 is selected, as a case in which an object has been edited. In the terminal device 1A, when the column 42 is operated during the selection of the icon 35, and input of the objects 55 to 58 shown in FIG. 5 is detected (S12: YES), the CPU 2 of the terminal device 1A transmits object information to the other terminal devices 1 that are co-editing, that is, the terminal devices 1B and 1C (S13). The object information includes the type of object according to the type of icon, the editing content, and the editing position of the object relative to the editing area 50. The editing contents include adding, deleting, enlarging, reducing, rotating, and transforming objects. Object 55 is the alphabetical character "A", object 56 is the alphabetical character "B", object 57 is the alphabetical character "C", and object 58 is the alphabetical character "D". Based on the detected object information, CPU 2 of terminal device 1A performs an object editing process that reflects the editing of the object in editing area 50 and updates column 42 (S15).

If no object editing is detected (S12: NO), the CPU 2 of each terminal device 1 determines whether object information has been received from another terminal device 1 via the communication unit 6 (S14). If object information has been received from terminal device 1A in each of terminal devices 1B and 1C (S14: YES), the CPU 2 of terminal devices 1B and 1C each performs object editing processing based on the received object information (S15). As a result of the processing of S15, the editing results of objects 55 to 58 inputted in terminal device 1A are reflected in the editing area 50 of each terminal device 1 in each of terminal devices 1A to 1C, and the column 42 of each terminal device 1 is updated.

If no object information is received (S14: NO), or after S15, the CPU 2 of each terminal device 1 determines whether an operation to change the display area is detected based on the detection signal of the input unit 10 (S16). The user of each terminal device 1 can move the display area relative to the editing area 50 by dragging on the field 42. The user of each terminal device 1 can reduce the display area relative to the editing area 50 by pinching in on the field 42, and can enlarge the display area relative to the editing area 50 by pinching out. If an operation to change the display area is detected (S16: YES), the CPU 2 of each terminal device 1 changes the display area relative to the editing area 50 in accordance with the detected operation to change the display area (S17). As shown in FIG. 5, in the specific example, the processing of S16 and S17 changes the display area relative to the editing area 50 to the display area 51 in the terminal device 1A, to the display area 52 in the terminal device 1B, and to the display area 53 in the terminal device 1C.

If no operation to change the display area is detected (S16: NO), or after S17, the CPU 2 of each terminal device 1 judges whether or not the use of the pointer has been detected based on the detection signal of the input unit 10 (S18). The CPU 2 of each terminal device 1 judges that the use of the pointer has been detected when an operation of the field 42 is detected while the icon 38 is selected based on the detection signal of the input unit 10. In a specific example, the use of the pointer 54 is detected in the terminal device 1A (S18: YES), and the CPU 2 of the terminal device 1A transmits pointer information to each of the other terminal devices 1 that are performing collaborative editing, that is, the terminal devices 1B and 1C (S19). The pointer information includes the identification information of the terminal device 1A and the position where the pointer 54 has been operated relative to the editing area 50. The CPU 2 of the terminal device 1A performs a pointer display process to display the pointer 54 in the display area 51 displayed in the field 42 of the terminal device 1A, as in the image 71, based on the operation of the pointer 54 detected based on the detection signal of the input unit 10 (S27).

If no pointer use is detected (S18: NO), the CPU 2 of each terminal device 1 determines whether it has received pointer information indicating the position of the pointer relative to the editing area 50 from the other device via the communication unit 6 (S20). If no pointer information has been received (S20: NO), the CPU 2 of each terminal device 1 performs the process of S28 described below. The CPU 2 of each terminal device 1B and 1C determines that it has received pointer information from terminal device 1A (S20: YES) and acquires arrangement information indicating the arrangement of the display area displayed on the display unit 9 relative to the editing area 50 shared with the other terminal device 1 (S21). The CPU 2 of each terminal device 1B and 1C determines whether the pointer 54 is within the display area based on the pointer information received in S20 and the arrangement information acquired in S21 (S22). The CPU 2 of the terminal device 1B determines that the pointer 54 is within the display area 52 (S22: YES), and performs a pointer display process to display the pointer 54 at the position indicated by the placement information within the display area 52 displayed in the field 42 of the terminal device 1B, as shown in image 72 in FIG. 5 (S27).

The CPU 2 of the terminal device 1C determines that the pointer 54 is not in the display area 53 (S22: NO) and acquires the display position of the mark according to the pointer information received from the terminal device 1A (S23). When the CPU 2 of each terminal device 1 in this example does not determine that the pointer 54 is in the display area 53, it acquires the intersection 64 between the position of the pointer 54 and the line segment 61 connecting the center 60 of the display area 53 and the outer edge of the display area 53. When the CPU 2 of the terminal device 1C does not determine that the pointer 54 is in the display area 53 (S22: NO), it displays a mark 63 indicating that the pointer 54 is not in the display area 53 on the display unit 9 (S24). The CPU 2 of the terminal device 1C displays the mark 63 at the intersection 64 acquired in S23, as in the image 73 shown in FIG. 5. The mark 63 is a figure in which the pointer 54 is surrounded by a teardrop-shaped figure. The positional relationship between the intersection 64 and the mark 63 may be set as appropriate, and in this example, the center of the mark 63 is the position of the intersection 64. The orientation of the tip of the teardrop shape relative to the center of the pointer 54 (slightly upward and to the left) indicates the direction of the display position of the pointer 54 relative to the display area 53.

The CPU 2 of the terminal device 1C judges whether the mark 63 has been selected based on the output result of the input unit 10 (S25). The CPU 2 of the terminal device 1C judges that the mark 63 has been selected based on the output result of the input unit 10 when an operation in which the indicator touches the input unit 10 for several seconds, that is, a tap, is detected. If the selection of the mark 63 is not detected (S25: NO), the CPU 2 of the terminal device 1C performs the process of S28 described later. If the CPU 2 of the terminal device 1C detects the selection of the mark 63 via the input unit 10 (S25: YES), the CPU 2 of the terminal device 1C changes the arrangement of the display area relative to the editing area 50 displayed on the display unit 9 of the terminal device 1C so that the position of the pointer 54 indicated by the pointer information received in S20 is within the display area (S26). The CPU 2 of the terminal device 1C in this example changes the arrangement of the display area relative to the editing area 50 to the display area 62 arranged around the position of the pointer 54 indicated by the pointer information, as shown in the image 74 shown in FIG. 5 (S26). The CPU 2 of the terminal device 1C displays the pointer 54 at the position indicated by the pointer information in the display area 62 (S27).

After S27, the CPU 2 of each terminal device 1 determines whether an end instruction to end the collaborative editing process has been detected via the input unit 10 (S28). The end instruction is output in S8, and is also transmitted from the other terminal devices 1. If an end instruction has not been detected (S28: NO), the CPU 2 of each terminal device 1 returns the process to S12. If an end instruction has been detected (S28: YES), the CPU 2 of each terminal device 1 ends the collaborative editing (S29), and the collaborative editing process is now complete.

In the above embodiment, the terminal device 1, CPU 2, communication unit 6, display unit 9, and input unit 10 are examples of the terminal device, control unit, communication unit, display unit, and input unit of the present invention, respectively. The process of S21 is an example of the layout acquisition process of the present invention. The process of S20 is an example of the reception process of the present invention. The process of S22 is an example of the judgment process of the present invention. The process of S27 after S20 is an example of the first display process of the present invention. The process of S24 is an example of the second display process of the present invention. The process of S26 is an example of the change process of the present invention. The process of S23 is an example of the intersection acquisition process of the present invention.

With reference to FIG. 6, a case will be described in which the process of S26 in the collaborative editing process of the first modified example is executed by the terminal device 1C of the specific example described above. In the collaborative editing process of the first modified example, the CPU 2 of the terminal device 1C calculates the reduction ratio at which the position of the pointer 54 is within the display area, and by reducing the display area by the calculated reduction ratio, changes the arrangement of the display area relative to the editing area 50 so that the position of the pointer 54 indicated by the pointer information is within the display area (S26). Specifically, the CPU 2 of the terminal device 1C reduces the display area 53 by a reduction ratio at which the position of the pointer 54 is within the display area, to set it as the display area 66. The process of S26 in the collaborative editing process of the first modified example is an example of the change process of the present invention.

With reference to FIG. 6, the process of S26 in the collaborative editing process of the second modified example will be described taking as an example a case where it is executed by terminal device 1C, which is a specific example of the above embodiment. In the collaborative editing process of the second modified example, CPU 2 of terminal device 1C changes the arrangement of the display area relative to editing area 50 by moving the display area from display area 53 to display area 65 relative to editing area 50 so that the position of pointer 54 is within the display area (S26). The process of S26 in the collaborative editing process of the second modified example is an example of the change process of the present invention.

With reference to FIG. 7, the process of S11 and S24 of the collaborative editing process of the third modified example will be described by taking as an example a case where the process is executed by the terminal device 1C of the specific example of the above embodiment. In the collaborative editing process of the third modified example, the CPU 2 of the terminal device 1C displays a screen 81 in S11 (S11). The screen 81 includes icons 26 to 41 and columns 43 and 44. Column 43 displays the names of other users who are collaboratively editing, that is, user A and user B. Column 44 displays the display area 53. In S24, the CPU 2 of the terminal device 1C displays a mark 49 indicating that the pointer 54 is not in the display area 53 to the right of user A of the terminal device 1A who sent the pointer information, among the users displayed in column 43 (S24). The process of S24 of the collaborative editing process of the third modified example is an example of the second display process of the present invention.

8 and 9, a collaborative editing process executed according to a display control program of the fourth modified example will be described using an example in which the process is executed by each of the terminal devices 1A to 1C. The collaborative editing process of the fourth modified example receives operation information indicating the operation position and operation content relative to the editing area from another device, and performs processing according to whether the operation position is within the display area. The operation information is object information and pointer information, for example. The collaborative editing process of the fourth modified example differs from the collaborative editing process of the above embodiment in that S31 to S33 are performed between S14 and S15, and S23 to S25 are omitted. A description of the same processes as in the above embodiment will be omitted, and the following describes processes that differ from the above embodiment. The collaborative editing processes of the terminal devices 1A to 1C are each executed individually by each device, but will be described in parallel to simplify the description.

In the specific example of FIG. 9, when the icons 36 and 40 are selected on the terminal device 1A and the field 42 is operated, a circular object 96 is placed between the objects 55 and 56 (S12: YES), the CPU 2 of the terminal device 1A transmits the object information to the other terminal devices 1B and 1C that are co-editing (S13). Based on the object information, the CPU 2 of the terminal device 1A displays the object 96 in the field 42 of the display unit 9 within the display area 51 of the terminal device 1A, as in the image 101 (S15). The CPU 2 of the terminal devices 1B and 1C that have received the object information from the terminal device 1A each (S14: YES) acquires the placement information in the same manner as in S21 (S31). Based on the received object information, the CPU 2 of the terminal devices 1B and 1C each determines whether the object 96 has been edited within the display area (S32). The CPU 2 of the terminal device 1B determines that editing of the object 96 has been performed within the display area 52 of the terminal device 1B (S32: YES), and performs an object editing process to display the object 96 within the display area 52 of the terminal device 1B based on the received object information, as shown in image 102 (S15).

The CPU 2 of the terminal device 1C does not determine that the editing of the object 96 was performed within the display area 53 of the terminal device 1C (S32: NO), and changes the arrangement of the display area relative to the editing area 50 so that the operation position indicated by the object information received in S14 is within the display area (S33). The CPU 2 of the terminal device 1C changes the arrangement of the display area relative to the editing area 50, for example, by at least one of a process of changing the reduction ratio of the display area relative to the editing area 50 and a process of changing the position of the display area relative to the editing area 50. For example, as in image 103, the CPU 2 of the terminal device 1C changes the arrangement of the display area 53 relative to the editing area 50 by moving the display area from the display area 53 to the display area 67 relative to the editing area 50 so that the center of the object 96 is the center of the display area 53. The CPU 2 of the terminal device 1C performs an object editing process to display the object 96 within the display area 67 of the terminal device 1C based on the received object information, as shown in image 103 (S15). As shown in FIG. 10, by the processing of S33 and S15, the field 42 on the screen 25 of the terminal device 1C is switched from the image 100 representing the display area 53 to the image 103 representing the display area 67.

When the CPU 2 of terminal device 1C, which is displaying display area 53 of the specific example in Figure 5 in column 42, receives pointer information of pointer 54 from terminal device 1A (S20: YES), the CPU 2 of terminal device 1C determines that pointer 54 is not in display area 53 (S22: NO) and, without displaying mark 63, changes the arrangement of the display area relative to the editing area 50 so that the position of pointer 54 indicated by the pointer information received in S20 is within the display area, as shown in image 74 in Figure 5 (S26). The CPU 2 of terminal device 1C displays pointer 54 at the position indicated by the pointer information within the changed display area 62 (S27).

The processes of S21 and S31 executed according to the display control program of the fourth modified example are an example of the layout acquisition process of the present invention. The processes of S20 and S14 are an example of the reception process of the present invention. The processes of S22 and S32 are an example of the judgment process of the present invention. The process of S27 after S20 and the process of S15 after S14 are an example of the display process of the present invention. The processes of S26 and S33 are an example of the change process of the present invention.

As shown in FIG. 1, the terminal device 1 of the above embodiment has a display unit 9 that displays an image, a communication unit 6 that communicates with other terminal devices 1, and a CPU 2 that controls the display unit 9 and the communication unit 6. As shown in FIG. 4, the display control program includes instructions for causing the CPU 2 of the terminal device 1 to execute a layout acquisition process (S21), a reception process (S20), a judgment process (S22), a first display process (S27), and a second display process (S24). In the layout acquisition process, the CPU 2 acquires layout information indicating the layout of the display area displayed on the display unit 9 relative to the editing area 50 shared with the other terminal devices 1. In the reception process, the CPU 2 receives pointer information indicating the position of the pointer 54 relative to the editing area 50 from the other device via the communication unit 6. In the judgment process, the CPU 2 judges whether the pointer 54 is within the display area based on the pointer information received in S20 and the layout information acquired in S21. In the first display process, if the CPU 2 determines that the pointer 54 is within the display area (S22: YES), the CPU 2 displays the pointer 54 at the position indicated by the placement information within the display area. In the second display process, if the CPU 2 does not determine that the pointer 54 is within the display area (S22: NO), the CPU 2 displays a mark 63 indicating that the pointer 54 is not within the display area on the display unit 9. The terminal device 1 executing the display control program can execute the first display process (S27) and the second display process (S24) depending on the determination result in S22. Therefore, even if different display areas are displayed for each terminal device 1, the user C of the terminal device 1C can know whether the pointer 54 is being operated on the terminal device 1A from the mark 63 displayed in the second display process.

When the CPU 2 of the terminal device 1C detects the selection of the mark 63 via the input unit 10 of the terminal device 1C in accordance with the display control program (S25: YES), it executes a change process to change the position of the display area relative to the editing area 50 so that the position of the pointer 54 indicated by the pointer information is within the display area of the terminal device 1C (S26), as shown in image 74 in FIG. 5. The display control program can reduce the effort required of user C to change the display area to include the pointer 54. User C can confirm the pointer 54 displayed within the display area 62 whose position has been changed.

In the change process, the CPU 2 of the terminal device 1C changes the arrangement of the display area relative to the editing area 50 to a display area 62 that is centered on the position of the pointer 54 indicated by the pointer information, as shown in image 74 in FIG. 5 (S26). The display control program can reduce the effort required by user C to change the arrangement of the display area relative to the editing area 50 so that the pointer 54 becomes the center 60 of the display area 53. The display control program can make it easier for user C to find the pointer 54 in the display area compared to when the position of the pointer 54 in the display area is not specified.

When the CPU 2 of the terminal device 1C does not determine that the pointer 54 is within the display area (S22: NO), as shown in FIG. 5, it performs an intersection acquisition process to acquire an intersection 64 between a line segment 61 connecting the position of the pointer 54 and the center 60 of the display area 53 and the outer edge of the display area 53 (S23). As shown in image 73 of FIG. 5, the CPU 2 of the terminal device 1C displays a mark 63 at the intersection 64 acquired in S23 (S24). The display control program can notify the user C of the direction of the position of the pointer 54 operated on the terminal device 1A relative to the display area 53 based on the display position of the mark 63. Even when the user C manually changes the display area 53, the user C can efficiently perform an operation to change the display area so that the pointer 54 is located within the display area, using the display position of the mark 63 as a clue.

In the first modified example, the CPU 2 of the terminal device 1C, in the change process of S26, reduces the display area 53 at a reduction ratio that brings the position of the pointer 54 within the display area, as in the specific example shown in FIG. 6, to set it as the display area 66 (S26). The terminal device 1C executing the display control program of the first modified example can reduce the effort required of the user C to reduce the display area so that the pointer 54 is within the display area.

The terminal device 1 of the fourth modified example has a display unit 9 that displays an image, a communication unit 6 that communicates with other devices, and a CPU 2 that controls the display unit 9 and the communication unit 6, as shown in FIG. 1. The CPU 2 of the terminal device 1 executes a display control program. The CPU 2 of the terminal device 1 executes each of the layout acquisition process (S21, S31), reception process (S14, S20), judgment process (S32, S22), display process (S15, S27), and change process (S32, S26) of the collaborative editing process shown in FIG. 8 in accordance with the display control program. In the layout acquisition process, the CPU 2 acquires layout information indicating the layout of the display area displayed on the display unit 9 relative to the editing area 50 shared with the other terminal devices 1. In the reception process, the CPU 2 receives operation information indicating the operation position and operation content relative to the editing area 50 from the other device via the communication unit 6. In the determination process, the CPU 2 determines whether the operation position is within the display area based on the received operation information and the acquired arrangement information (S32, S22). In the display process, if the CPU 2 determines that the operation position is within the display area (S32: YES, S22: YES), the CPU 2 displays the operation content at the operation position indicated by the arrangement information in the display area. In the change process, if the CPU 2 does not determine that the operation position is within the display area (S32: NO, S22: NO), the CPU 2 changes the arrangement of the display area relative to the editing area 50 so that the operation position indicated by the operation information is within the display area, and displays the operation content at the operation position indicated by the arrangement information. The terminal device 1 that executes the display control program of the fourth modified example can execute the display process and the change process according to the determination result in the determination process. Therefore, in the specific example shown in FIG. 9, the user C of the terminal device 1C can grasp the editing operation of the object on the terminal device 1A of the user A even if different display areas are displayed for each terminal device 1. In the specific example shown in FIG. 5, user C of terminal device 1C can understand the operation of pointer 54 on terminal device 1A of user A, even if different display areas are displayed on each terminal device 1.

The display control program of the present invention is not limited to the above-described embodiment, and various modifications may be made without departing from the spirit of the present invention. For example, the following modifications may be made as appropriate. The present invention can be implemented in various forms, and may be realized, for example, in the form of a non-transitory computer-readable medium storing a display control program, and a display control method executed by the CPU 2 of the terminal device 1.

The configuration of the terminal device 1 may be changed as appropriate. The display unit 9 of the terminal device 1 may be, for example, an organic EL display, a plasma display, a plasma tube array display, an electronic paper display using electrophoresis, etc., as long as it is capable of displaying images. The input unit 10 of the terminal device 1 may be a touch panel, a keyboard, a mouse, a joystick, etc.

The programs including instructions for executing the processes of Figures 2, 4, and 8 may be stored in the storage device of each terminal device 1 before the CPU 2 executes the corresponding program. Therefore, the program acquisition method, acquisition path, and device that stores the program may each be changed as appropriate. The programs executed by each terminal device 1 may be received from another device via a cable or wireless communication and stored in a storage device such as a memory unit. The other devices include, for example, a PC and a server connected via a network.

The steps of the collaborative editing process in FIG. 4 and FIG. 8 are not limited to being executed by the CPU 2, and may be executed in part or in whole by another electronic device (e.g., an ASIC). The steps of the collaborative editing process may be distributed and processed by multiple electronic devices (e.g., multiple CPUs). The order of the steps of the collaborative editing process may be changed, steps may be omitted, or steps may be added, as necessary. The following modifications may be made to the collaborative editing process as appropriate.

The layout of the screen displayed on the display unit 9 and the display items may be changed as appropriate. The type of editable object may be changed as appropriate. The CPU 2 may omit the processes of S25 and S26 and may not detect the selection of the mark 63. The display position, shape, size, etc. of the mark 63 may be changed as appropriate. The mark 63 may include information of the user of the terminal device 1 that transmitted the pointer information, or may be a mark of a type corresponding to the terminal device 1 that transmitted the pointer information. The mark 63 may not indicate the direction of the display position of the pointer 54 relative to the display area 53. The positional relationship between the intersection 64 and the mark 63 may be changed as appropriate. For example, the representative point of the mark 63 may be a position that is the intersection 64. The representative point of the mark 63 is, for example, the tip of the mark 63. The mark 63 may be placed at a position that does not overlap with the intersection 64 and in a region near the intersection 64. The area near the intersection 64 may be appropriately determined in consideration of the size of the mark 63 and the size of the display area, and may be, for example, an area that satisfies the condition that the shortest distance between the intersection 64 and the mark 63 is smaller than the maximum diameter of the mark 63. The CPU 2 may omit the process of S25 and execute the process of S26 after a predetermined time has elapsed since the mark 63 was displayed. When the CPU 2 detects the selection of the mark 63 (S25: YES), the CPU 2 may switch the arrangement of the display area relative to the editing area 50 so that the position of the pointer indicated by the pointer information is within the display area, may move the display area relative to the editing area 50, or may reduce the display area at a reduction ratio at which the position of the pointer is within the display area. The position of the pointer relative to the display area displayed in S26 may be appropriately changed. In S26, the CPU 2 may change the arrangement of the display area relative to the editing area 50 to the same display area as that of the terminal device 1 of the user who transmitted the pointer information, or may change it to the display area in the initial state. In S26, the arrangement of the display area relative to the editing area 50 may be preset or may be selectable by the user. The above modifications may be combined as appropriate within a range that does not cause any inconsistencies.

1: Terminal device, 2: CPU, 3: ROM, 4: RAM, 5: Storage unit, 6: Communication unit, 9: Display unit, 10: Input unit

Claims (7)

A display control program executed by a control unit of a terminal device having an input unit, a display unit that displays an image, a communication unit that communicates with another device, and a control unit that controls the display unit and the communication unit,
The control unit,
an arrangement acquisition process for acquiring arrangement information indicating an arrangement of a display area displayed on the display unit with respect to an editing area shared with the other device, the editing area being capable of editing an object;
a receiving process of receiving pointer information indicating a position of a pointer relative to the editing area from the other device via the communication unit;
a determination process of determining whether the pointer is within the display area based on the received pointer information and the acquired placement information;
a first display process for displaying the pointer at the position indicated by the arrangement information within the display area when it is determined that the pointer is within the display area;
a second display process for displaying, on the display unit, a mark indicating that the pointer is not within the display area when the editing area is larger than the display area and when it is not determined that the pointer is within the display area ;
a transmission process of transmitting pointer information indicating a position of the pointer to the other device via the communication unit when the use of the pointer is detected in the terminal device via the input unit;
A display control program comprising instructions for executing the above. The display control program according to claim 1, further comprising an instruction to the control unit to execute a change process for changing the arrangement of the display area relative to the editing area so that the position of the pointer indicated by the pointer information is within the display area when selection of the mark is detected via the input unit provided in the terminal device. The display control program according to claim 2, characterized in that, in the change process, the control unit changes the arrangement of the display area relative to the editing area to an arrangement centered on the position of the pointer indicated by the pointer information. The control unit is
if it is determined that the pointer is not within the display area, an instruction to execute an intersection point acquisition process to acquire an intersection point between a line segment connecting the position of the pointer and a center of the display area and an outer edge of the display area,
4. The display control program according to claim 1, wherein the mark is displayed at the acquired intersection in the second display process. The display control program according to claim 2, characterized in that, in the change process, the control unit reduces the display area at a reduction ratio such that the position of the pointer is within the display area. The display control program according to claim 1, characterized in that, in the second display process, when it is determined that the editing area is larger than the display area and the pointer is not within the display area, the control unit displays the mark and the user name of the other device that sent the pointer information next to the mark. A display control program executed by a control unit of a terminal device having an input unit, a display unit that displays an image, a communication unit that communicates with another device, and a control unit that controls the display unit and the communication unit,
The control unit,
an arrangement acquisition process for acquiring arrangement information indicating an arrangement of a display area displayed on the display unit with respect to an editing area shared with the other device, the editing area being capable of editing an object;
a receiving process of receiving operation information indicating an operation position and an operation content with respect to the object in the editing area from the other device via the communication unit;
a determination process of determining whether the operation position is within the display area based on the received operation information and the acquired arrangement information;
a display process for displaying the object according to the operation content at the operation position within the display area indicated by the layout information when the operation position is determined to be within the display area;
a change process in which, when the editing area is larger than the display area and when it is not determined that the operation position is within the display area, the layout of the display area relative to the editing area is changed so that the operation position indicated by the operation information is within the display area, and the object according to the operation content is displayed at the operation position indicated by the layout information;
a transmission process of transmitting, when editing of the object is detected in the terminal device via the input unit, operation information indicating an operation position and an operation content for the object to the other device via the communication unit;
A display control program comprising instructions for executing the above.

Images