JP7147322B2 - Image management server, program, information sharing system, information sharing method - Google Patents

Description

The present disclosure relates to an image management server, a program, an information sharing system, and an information sharing method.

2. Description of the Related Art At meetings such as conferences, meetings, presentations, etc., where a plurality of participants gather for some purpose, materials are displayed using, for example, a shared terminal with a large screen. Materials are displayed on a large-screen shared terminal, and participants discuss and explain the materials based on the materials. At this time, materials are often displayed not only on a large-screen shared terminal but also on a dedicated terminal brought in by each participant so that the participants can view the materials at hand and wish to participate in the meeting.

Therefore, it is necessary for the participants to obtain the materials. Conventionally, the materials are sent by e-mail or downloaded from a predetermined URL (Uniform Resource Locator). There is also known a technique in which a shared terminal displays a method for identifying the material together with the material, and a participant who needs the material acquires the material based on the method for identifying the material (see, for example, Patent Document 1). . Patent Literature 1 discloses an information processing system that projects a QR code containing information for identifying the file being projected, and downloads the file being projected by capturing the QR code with a dedicated terminal of any participant. ing.

However, the method disclosed in Patent Document 1 has a problem that the screen displayed by the shared terminal cannot be acquired by the dedicated terminal used by the user viewing the screen. In other words, in the conventional method, the user can obtain the entire file, but even if he wants to display the screen currently being displayed by the shared terminal, it is possible to obtain this screen and display it on the user's dedicated terminal. I couldn't do it.

SUMMARY OF THE INVENTION An object of the present invention is to provide an information processing apparatus in which a screen displayed by a shared terminal can be displayed by a dedicated terminal.

In view of the above problems, the present invention provides an image management server capable of communicating with a shared terminal and a dedicated terminal via a network, wherein the shared terminal receives from the dedicated terminal an acquisition request for a screen to be displayed on a display device. In addition, using the identification information for identifying the shared terminal displayed on the screen by the shared terminal and input to the dedicated terminal by the user, and the image data of the screen input to the dedicated terminal by the user an acquisition request receiving means for receiving at least one of URLs for accessing screen information transmitted to the dedicated terminal; and an image data acquisition request to the shared terminal in response to the acquisition request received by the acquisition request receiving means. and screen information for updating the screen information transmitted to the dedicated terminal using the screen image data acquired by the image acquisition means. and updating means.

It is possible to provide an image management server that allows a dedicated terminal to display a screen displayed by a shared terminal.

FIG. 4 is a diagram illustrating an outline of a procedure for a dedicated terminal to display a screen displayed on a display by a large-screen shared terminal; 1 is an example of a schematic configuration diagram of an information sharing system of the present embodiment; FIG. 1 is an example of a hardware configuration diagram of a shared terminal or a dedicated terminal; FIG. 1 is an example of a schematic hardware configuration diagram of an image management server; FIG. FIG. 2 is a diagram showing an example of software configuration of software operating on a shared terminal and a dedicated terminal; FIG. 2 is an example of a functional block diagram showing functions of a shared terminal, a dedicated terminal, and an image management server in block form; FIG. 10 is a diagram showing an example of auxiliary application IDs displayed on the display by the shared terminal; FIG. 10 is a diagram showing an example of a menu and an information display bar displayed by the electronic canvas application of the dedicated terminal; It is an example of the figure explaining the outline of creation of an electronic canvas. FIG. 10 is an example of a diagram for explaining an overview of screen capture; FIG. 11 is an example of a sequence diagram showing a procedure of notifying an auxiliary application ID to an image management server when a shared terminal is activated; FIG. 10 is an example of a sequence diagram showing a procedure for a dedicated terminal to create an electronic canvas; FIG. 10 is an example of a sequence diagram showing a procedure in which a shared terminal captures a screen and a dedicated terminal displays image data of a material display application screen. FIG. 2 is an example of a functional block diagram showing functions of a shared terminal, a dedicated terminal, and an image management server in block form; It is an example of the figure explaining the outline of creation of an electronic canvas. FIG. 10 is an example of a diagram for explaining an overview of screen capture; FIG. 10 is an example of a sequence diagram showing a procedure for registering the URL of the electronic canvas and the IP address of the shared terminal in association with each other when the shared terminal is activated. FIG. 10 is an example of a sequence diagram showing a procedure in which a shared terminal captures a screen and a dedicated terminal displays image data of a material display application screen. FIG. 10 is an example of a diagram for explaining capture when a preview is displayed on a dedicated terminal; FIG. 10 is an example of a sequence diagram showing a procedure in which a shared terminal captures a screen and a dedicated terminal displays image data of a material display application screen. It is the figure which showed the layer structure of the screen which a dedicated terminal displays. It is the figure which showed the screen example of the proprietary terminal. It is the figure which showed the screen example of the proprietary terminal. It is the figure which showed the screen example of the proprietary terminal. It is the figure which showed the screen example of the proprietary terminal. It is the figure which showed the screen example of the proprietary terminal. It is the figure which showed the screen example of the proprietary terminal. It is the figure which showed the screen example of the proprietary terminal. It is the figure which showed the screen example of the proprietary terminal.

Hereinafter, an information sharing system and an information sharing method performed by the information sharing system will be described as an example of a mode for carrying out the present invention with reference to the drawings.

<Outline of operation of information sharing system>
First, with reference to FIG. 1, the outline of the operation of the information sharing system of this embodiment will be described. FIG. 1 is a diagram for explaining an outline of a procedure for displaying a screen displayed by a shared terminal 10 having a large screen on a dedicated terminal 30. As shown in FIG. A shared terminal is a computer that can be used and viewed by a plurality of users jointly. The dedicated terminal 30 is a computer that can be individually (dedicatedly) used and viewed by a user.

First, as a premise, on the shared terminal 10, the material display application (hereinafter simply referred to as the "material display application 11") displays the content (image) of the material, and the auxiliary application 13 for capturing the screen is running. there is A browser application (hereinafter simply referred to as browser application 15 ) is running on the dedicated terminal 30 .

(1) First, the shared terminal 10 is connected to the image management server 50 when it is activated. The dedicated terminal 30 connects to a predetermined URL of the image management server 50 by the methods of the first and second embodiments, which will be described later. This URL is for the dedicated terminal 30 to share the screen with the shared terminal 10 .

(2) The user of the dedicated terminal 30 wants to use the screen displayed by the shared terminal 10 exclusively, and presses a predetermined button.

(3) As a result, the dedicated terminal 30 transmits a capture request (an example of a screen acquisition request) to the image management server 50 .

(4) The image management server 50 transmits a capture request to the shared terminal 10 by designating the IP address, which is one of the address information of the shared terminal 10 acquired when the shared terminal 10 is connected.

(5) When the auxiliary application 13 acquires the capture request, it captures (captures) the screen displayed on the screen by the material display application 11 .

(6) The auxiliary application 13 of the shared terminal 10 transmits screen image data to the image management server 50 .

(7) The image management server 50 performs processing for adding image data to the screen information (web page) transmitted to the browser application 15 .

(8) The browser application 15 of the dedicated terminal 30 acquires screen information including screen image data from the image management server 50 .

(9) Thereby, the dedicated terminal 30 displays the screen displayed by the shared terminal 10 on the display.

As described above, in the information sharing system of the present embodiment, by connecting the shared terminal 10 and the dedicated terminal 30 to the image management server 50, the screen displayed by the shared terminal 10 can be displayed on the dedicated terminal 30. can.

<Terms>
A display device is a device that displays an image. Sometimes called a display. Also, the display device may be a projector.

An electronic canvas app is a program, and an electronic canvas is a function realized by the electronic canvas app or a screen displayed by the electronic canvas app. Here, the “electronic canvas” is a virtual canvas created on the image management server 50 rather than plain-woven thick cloth. For example, a Web application that allows a user to write handwritten information or display an image using a Canvas element and JavaScript (registered trademark) corresponds to the electronic canvas. However, the electronic canvas app and the electronic canvas are almost the same and may not be clearly distinguished.

Acquiring a screen means capturing a screen or generating screen image data. The entire screen may be captured, or a portion of the image may be obtained by dividing the image data of the screen or clipping a portion. Acquiring the screen is sometimes called “trimming” or “capturing”.

<System configuration example>
FIG. 2 is an example of a schematic configuration diagram of the information sharing system of this embodiment. The information sharing system has a shared terminal 10, a dedicated terminal 30, and an image management server 50 that can communicate via a network N. FIG. Although only one shared terminal 10 and one dedicated terminal 30 are illustrated in FIG. 2, two or more shared terminals 10 and two or more dedicated terminals 30 may be provided.

Since the shared terminal 10 and the dedicated terminal 30 have different roles in this embodiment, they are described with different names, but both may be information processing devices. In FIG. 1, the display of the shared terminal 10 that displays information is drawn larger than that of the dedicated terminal 30. may be larger than the display of That is, the shared terminal 10 is a device that displays and captures information.

The shared terminal 10 and the dedicated terminal 30 preferably have a touch panel, but the touch panel is not essential in the present embodiment. However, if the dedicated terminal 30 has a touch panel, there is an advantage that the user can handwrite on the image data acquired from the shared terminal 10 with a finger or an electronic pen. However, the handwriting function can be substituted with a mouse or trackball.

The shared terminal 10 may be a general-purpose information processing device, such as a tablet terminal, a smart phone, a notebook PC (Personal Computer), a PDA (Personal Digital Assistant), etc., but is not limited to these. The shared terminal 10 may be any device as long as the material display application 11 and the auxiliary application 13 operate. Also, the shared terminal 10 may be an electronic blackboard (or an electronic board, an information board, an electronic whiteboard, or the like) that displays handwritten information or a screen acquired from a PC. Alternatively, a device that projects an image, such as a projector, may be used. Also, it may be a device such as a teleconference terminal that displays images of each site, or it may be a television receiver.

As with the shared terminal 10, an example of the dedicated terminal 30 may be a tablet terminal, a smart phone, a notebook PC, a PDA, or the like. The dedicated terminal 30 may be any device that runs a browser application. Therefore, for example, it may be a multifunction machine, a car navigation device, a game machine, a television receiver, or the like.

The image management server 50 is one or more information processing devices having a function as a Web server (or HTTP server) that transmits screen information to the dedicated terminal 30 . Note that the screen information is provided as a web page generated by the web application. A web application refers to software or its mechanism that operates through cooperation between a script language (for example, JavaScript (registered trademark)) program that operates on a browser application and a program on the web server side, and that is used on the browser.

The image management server 50 provides the dedicated terminal 30 with a Web application that allows the dedicated terminal 30 to be used like an electronic canvas. In this embodiment, this web application is called an electronic canvas application. The electronic canvas application can be used with the dedicated terminal 30 on which the browser application 15 operates.

Note that the image management server 50 may be compatible with cloud computing. Cloud computing is a form of usage in which resources on a network are used without being conscious of specific hardware resources.

The network N may be one or more LANs (Local Area Networks) inside the firewall, or it may include the Internet outside the firewall in addition to the LAN. In addition, VPN (Virtual Private Network) and Wide Area Ethernet (registered trademark) may be included. The network N may be constructed as either wired or wireless, or may be a combination of wired and wireless. Also, when connecting via a mobile phone network such as 3G, LTE (Long Term Evolution), or 4G, a LAN may be omitted.

<Hardware configuration example>
<< Dedicated terminal >>
The hardware configurations of the shared terminal 10 and the dedicated terminal 30 of this embodiment will be described with reference to FIG. FIG. 3 is a hardware configuration diagram of the shared terminal 10 or the dedicated terminal 30. As shown in FIG. In FIG. 3, it is assumed that the shared terminal 10 or the dedicated terminal 30 is a general information processing device.

As shown in FIG. 3, the shared terminal 10 or the dedicated terminal 30 includes a CPU 101 that controls the overall operation of the shared terminal 10 or the dedicated terminal 30, a ROM 102 that stores programs used to drive the CPU 101 such as IPL, RAM 103 used as a work area for CPU 101, SSD 104 storing various data such as programs for shared terminal 10 or dedicated terminal 30, network controller 105 controlling communication with network N, and communication with USB memory 5 It has an external storage controller 106 to control.

The shared terminal 10 or the dedicated terminal 30 also includes a GPU (Graphics Processing Unit) 112 that specializes in graphics, and a display controller 113 that controls and manages screen display in order to output an output image from the GPU to the display 3. It has

Further, the shared terminal 10 or the dedicated terminal 30 includes a sensor controller 114 that controls processing of the contact sensor 115 and a contact sensor 115 that detects that the electronic pen 4 or the user's hand touches the display 3 . The contact sensor 115 detects the coordinates touched by the user by, for example, a change in capacitance (implements a touch panel). The contact sensor 115 is not limited to the method of detecting a change in capacitance, and may be a resistive film type touch panel that identifies a contact position by a voltage change of two opposing resistive films, or a contact object that touches the display unit. Various detection means such as an electromagnetic induction type touch panel that detects the generated electromagnetic induction and specifies the contact position may be used.

Furthermore, shared terminal 10 or dedicated terminal 30 electrically connects CPU 101, ROM 102, RAM 103, SSD 104, network controller 105, external storage controller 106, capture device 111, GPU 112, sensor controller 114, and electronic pen controller 116. A bus line 120 such as an address bus and a data bus is provided for this purpose.

The program for the shared terminal 10 or the dedicated terminal 30 may be recorded on a computer-readable recording medium such as a CD-ROM and distributed, or may be distributed from a program distribution server. .

<<Image Management Server>>
FIG. 4 is an example of a schematic hardware configuration diagram of the image management server 50. As shown in FIG. The image management server 50 includes a CPU 201 and a memory 202 that enables high-speed access of data used by the CPU 201 . CPU 201 and memory 202 are connected via system bus 203 to other hardware elements of image management server 50 , such as graphics driver 204 and network driver (NIC) 205 .

Graphics driver 204 is connected to LCD 206 via a bus to monitor processing results by CPU 201 . Also, the network driver 205 connects the image management server 50 to the network N at the transport layer level and the physical layer level, and establishes a session between the shared terminal 10 and the dedicated terminal 30 .

Also connected to system bus 203 is I/O bus bridge 207 . On the downstream side of the I/O bus bridge 207, IDE (Integrated Drive Electronics), ATA (AT Attachment), ATAPI (AT Attachment Packet Interface), Serial ATA, SCSI, etc. are provided via an I/O bus 208 such as PCI. A storage device such as an HDD (Hard Disk Drive) 209 is connected via (Small Computer System Interface), USB (Universal Serial Bus), or the like. The HDD 209 stores a program 209p for controlling the image management server 50 as a whole. The HDD 209 may be an SSD (Solid State Drive).

An input device 210 such as a key canvas and a mouse (referred to as a pointing device) is connected to the I/O bus 208 via a bus such as USB to accept inputs and commands from an operator such as a system administrator. ing.

The hardware configuration of the illustrated image management server 50 does not need to be housed in one housing or provided as a set of devices. elements. Further, in order to support cloud computing, the physical configuration of the image management server 50 of this embodiment does not have to be fixed, and hardware resources can be dynamically connected or disconnected according to the load. may consist of

<Software configuration example>
Next, software configurations of the shared terminal 10 and the dedicated terminal 30 will be described with reference to FIG. FIG. 5A shows an example of the software configuration of software that operates on the shared terminal 10. FIG. An OS (Operating System) 14 operates on the shared terminal 10 , and a material display application 11 and an auxiliary application 13 operate on the OS 14 .

The OS 14 is, for example, Android (registered trademark), iOS (registered trademark), Windows (registered trademark), UNIX (registered trademark), LINUX (registered trademark), macOS (registered trademark), or the like. However, it is not limited to these. Moreover, it may differ depending on the model of the shared terminal 10 .

The material display application 11 is an application that displays conference materials, for example. The materials displayed by the material display application 11 are shared by each user. Since what is used as a material varies depending on the user's attributes and circumstances, the material display application 11 may be any application that operates on the OS 14 and displays some kind of screen. For example, in a conference, the presentation application can be the material display application 11 . The material display application 11 can also be a browser application that can display information on the Internet, a word processor application that edits or displays documents, a spreadsheet application, or the like. Further, the material display application 11 can be a photo application for displaying photographs, a game application such as a local game or an online game, a paint application for a user to draw pictures, a file management application, and the like. It should be noted that these material display applications 11 are merely examples and are not limited to these.

The auxiliary application 13 provides an auxiliary function for the dedicated terminal 30 to display the screen image data generated by the material display application 11 . For example, it communicates with the image management server 50 and captures a screen generated by the material display application 11 by calling an API (Application Interface) of the OS 14 . With the auxiliary application 13, restrictions on the material display application 11 are reduced, and the user can use a general-purpose material display application 11. - 特許庁Since the material display application 11 does not require any special function, any application can be used. Therefore, the auxiliary application 13 and the electronic canvas application 12 can cooperate with each other via the image management server 50 .

Since the auxiliary application 13 acquires the image data of the screen generated by the material display application 11 using the function of the OS 14, it takes charge of a function that is strongly dependent on the model. Therefore, the auxiliary application 13 is a native application. A native application, which is a term used in contrast to a web application, is an application that is installed and executed on the shared terminal 10, uses functions of the OS 14, and is capable of hardware control. Say.

Since the auxiliary application 13 of the present embodiment only needs to operate inside the shared terminal 10, it does not need to display a screen in principle. .

FIG. 5(b) is an example of a software configuration that operates on the dedicated terminal 30. As shown in FIG. The OS 14 runs on the dedicated terminal 30 and the electronic canvas application 12 runs on the OS 14 . Note that the OSs of the shared terminal 10 and the dedicated terminal 30 may not be of the same type.

The electronic canvas application 12 is realized when the browser application 15 designates the URL of the electronic canvas, acquires the script that operates on the browser application 15 from the server device 50, and executes the script. The electronic canvas application 12 is a web application that provides users with electronic canvas functions. As described above, it has a function of displaying screen image data generated by the material display application 11 and a function of displaying handwritten information. If the browser application 15 has the function of displaying the image data of the screen of the material display application 11, the electronic canvas application 12 does not have to have the electronic canvas function (it does not have the handwriting function). good). Further, the electronic canvas application 12 may simply acquire image data from the server device 50 and display it. In this case, the script is not necessarily required. It is sufficient if there is a function of acquiring information including from the server device 50 . Therefore, the browser application 15 does not have to execute the script. Alternatively, an application having functions equivalent to those of the browser application 15 may be used.

Since the electronic canvas application 12 is executed on the browser application, there is little dependence on the model of the dedicated terminal 30 . The electronic canvas application 12 is a web application and operates by executing a script sent from the image management server 50, so no installation is required. On the other hand, it is often difficult for Web applications to use functions of the OS 14 and control hardware.

[First embodiment]
In this embodiment, an example will be described in which an electronic canvas is created from the dedicated terminal 30 and image data of a screen displayed by the shared terminal 10 is displayed on the electronic canvas. Since the created electronic canvas is not associated with the shared terminal 10, the user of the dedicated terminal 30 needs to inform the image management server 50 of the shared terminal 10 that he or she is viewing. Therefore, the auxiliary application 13 resident on the shared terminal 10 displays the auxiliary application ID. The user transmits this auxiliary application ID to the image management server 50, so that the image management server 50 identifies the shared terminal 10 and adds the screen displayed by the shared terminal 10 to the screen information of the electronic canvas created by the dedicated terminal 30. can do.

<About functions>
Functions of the electronic canvas application 12, the auxiliary application 13, and the image management server 50 will be described with reference to FIG. FIG. 6 is an example of a functional block diagram showing functions of the shared terminal 10, the dedicated terminal 30, and the image management server 50 in block form. Since the material display application 11 only needs to have a function of displaying a screen, the function will be described as necessary.

<<Electronic Canvas App>>
The electronic canvas application 12 has a display control section 21 , a communication section 22 , a stroke generation section 23 and an operation reception section 24 . Each of these units of the dedicated terminal 30 is configured such that one of the components shown in FIG. It is a function or means realized by operating by

The communication unit 22 transmits and receives various information to and from the image management server 50 . For example, the communication unit 22 receives screen information written in HTML, CSS (Cascade Style Sheet), and JavaScript (registered trademark) from the image management server 50 . The communication unit 22 also transmits handwritten information input by handwriting by the user to the image management server 50 .

The operation reception unit 24 receives various user operations on the electronic canvas app 12 . For example, the operation accepting unit 24 accepts pressing of a button displayed on a menu or handwritten information on a touch panel.

The stroke generation unit 23 generates strokes based on the handwritten information for the touch panel received by the operation reception unit 24 . Since the handwritten information received by the operation receiving unit 24 is a list of coordinates of points, displaying it as it is only displays a plurality of points. Therefore, the stroke generation unit 23 generates a stroke by connecting points with the color, thickness, line type, etc. specified by the user.

The display control unit 21 analyzes the screen information received by the communication unit 22 and displays the web page on the display device (display 3 or LCD 206). The display control unit 21 also displays the strokes generated by the stroke generation unit 23 on the display device.

<<Auxiliary App>>
The auxiliary application 13 has a communication section 31 , an ID notification section 32 , an ID display section 33 and a screen capturing section 34 . Each of these units of shared terminal 10 has a function realized by any of the components shown in FIG. It is a means.

Further, the auxiliary application 13 has a storage unit 35 constructed in the SSD 104, the RAM 103, or the like shown in FIG.

The communication unit 31 transmits and receives various information to and from the image management server 50 . In this embodiment, the communication unit 31 transmits the auxiliary application ID to the image management server 50 and transmits screen image data to the image management server 50 .

The ID notification unit 32 notifies the image management server 50 of the auxiliary application ID 35a via the communication unit 31, for example, when the shared terminal 10 is activated or in response to an operation from the user. The auxiliary application ID 35 a is identification information for identifying or specifying the auxiliary application 13 , and is used as identification information for identifying or specifying the shared terminal 10 in this embodiment. Since the auxiliary application ID is set in the auxiliary application 13 at the time of shipment from the factory, it is basically a fixed value, but exceptionally can be changed by the user. At the time of change, the ID notification unit 32 inquires of the image management server 50 via the communication unit 31, and the change is accepted when it is confirmed that there is no duplication.

ID display unit 33 displays the auxiliary application ID on at least part of display 3 of shared terminal 10 . The display surface of the display 3 is called a screen, and it can be said that the auxiliary application ID is displayed on the screen. The ID display unit 33 displays the auxiliary application ID, for example, on a transparent layer on the frontmost side (on the user side) of the shared terminal 10 . It is preferably translucent and displayed at one of the four corners so as not to interfere with the material display application 11 . It should be noted that it is not always necessary to display, it may be displayed periodically, or it may be displayed when the user performs an operation for display.

The screen capturing unit 34 requests the OS 14 to capture the screen. As a result, the OS 14 returns image data including at least the material displayed by the material display application 11 to the screen capture unit 34 . In this embodiment, it is assumed that the material display application 11 displays the material on the entire display 3 . When the material is displayed only on a part of the display 3, the material part is cut (trimmed) from the image data of the entire display 3 (entire screen) according to the display range generated by the material display application 11.例文帳に追加

<<Image Management Server>>
The image management server 50 has a first communication section 51 , a second communication section 52 , an IP address management section 53 , an image acquisition section 54 and a canvas screen creation section 55 . These units of the image management server 50 are functions realized by any one of the components shown in FIG. or means.

The first communication unit 51 transmits and receives various information to and from the shared terminal 10 . For example, it receives the auxiliary application ID and screen image data from the shared terminal 10 and transmits a capture request to the shared terminal 10 .

The second communication unit 52 transmits and receives various information to and from the dedicated terminal 30 . For example, screen information written in HTML, CSS, and JavaScript (registered trademark) is transmitted to the dedicated terminal 30 . Also, handwritten information input by handwriting by the user is received from the dedicated terminal 30 .

The IP address management unit 53 associates the IP address of the shared terminal 10 with the auxiliary application ID and registers them in the ID/IP address storage unit 56 . Since the IP address of shared terminal 10 can be acquired when the auxiliary application ID is notified, this IP address and the notified auxiliary application ID are registered in ID/IP address storage unit 56 .

In response to a capture request specifying an auxiliary application ID from the dedicated terminal 30 via the first communication unit 51 , the image acquisition unit 54 receives an auxiliary application ID from the IP address management unit 53 via the IP address management unit 53 . acquires the IP address of the shared terminal 10 , and transmits a screen capture request to the shared terminal 10 via the first communication unit 51 . Also, the image data of the material display application 11 acquired from this shared terminal 10 is transmitted to the dedicated terminal 30 .

The canvas screen creating unit 55 manages the electronic canvas. First, the canvas screen creation unit 55 creates and deletes the electronic canvas screen. For example, when there is a request to create a new electronic canvas from the dedicated terminal 30, the electronic canvas is created. For ease of explanation, it is assumed that one URL corresponds to one electronic canvas. Create an electronic canvas.

Further, when there is a request to delete the electronic canvas from the dedicated terminal 30, the canvas screen creating section 55 deletes the electronic canvas.

Note that the canvas screen creating unit 55 manages data for each electronic canvas. Since the data is data displayed on the electronic canvas, it is, for example, handwritten information, text memos, and image data. These contents and display positions are managed for each electronic canvas.

In addition, the canvas screen creation unit 55 creates screen information using the managed data. For example, when multiple strokes overlap, the multiple strokes are combined into one object. By doing this, the quality of the image is improved for enlargement, reduction, rotation, and the like.

There is a Canvas element as an HTML element suitable for the electronic canvas. The Canvas element is used to draw figures and the like by scripting using JavaScript (registered trademark). Canvas screen creation unit 55 updates screen information each time data such as handwriting is added.

When the screen information is updated, the second communication unit 52 notifies each dedicated terminal 30 (excluding the dedicated terminal 30 that transmitted the handwritten information) indicated by the URL of the electronic canvas of the update. Since the dedicated terminal 30 goes to the URL of the electronic canvas to obtain the screen information, the data displayed by the electronic canvas application 12 can be shared almost in real time.

Since one electronic canvas is shared by a plurality of dedicated terminals 30 in this way, it can be used in various meetings such as conferences, meetings, and presentations.

Table 1 shows an example of information stored in the ID/IP address storage unit 56. The auxiliary application ID and the IP address of the shared terminal 10 are associated and registered in the ID/IP address storage unit 56 . Therefore, the image management server 50 can specify the IP address of the shared terminal 10 from the auxiliary application ID.

<Display example of auxiliary application ID>
FIG. 7 shows an example of the auxiliary application ID displayed on the display 3 by the shared terminal 10. As shown in FIG. In FIG. 7, the auxiliary application ID 35a indicated by "0123" is displayed at the lower left of the display 3 as an example. The user of the dedicated terminal 30 can input the auxiliary application ID 35a to the dedicated terminal 30 by viewing this.

Note that the auxiliary application ID may be displayed as a bar code (one-dimensional code) or a two-dimensional code such as a QR code (registered trademark). Further, instead of displaying the auxiliary application ID on the screen, the shared terminal 10 may transmit it to the dedicated terminal 30 by short-range wireless communication such as NFC (Near Filed Communication) or Bluetooth (registered trademark).

Further, the display position of the auxiliary application ID may be the four corners of the display 3 or the like. As a result, it is possible to reduce the possibility that the characters of the material display application 11 and the auxiliary application ID overlap. Further, it is more preferable to display the auxiliary application ID in a translucent manner so that it may be duplicated.

<Screen example of dedicated terminal>
FIG. 8 is a diagram showing an example of the menu 401 and the information display bar 450 displayed by the electronic canvas application 12 of the dedicated terminal 30. As shown in FIG. The menu 401 has a pen button 402 , an eraser button 403 , a screen move button 404 , a back button 405 , a forward button 406 , a capture button 407 , a character memo button 408 , a business application cooperation button 409 , and a setting button 410 . Each button will now be described.

The pen button 402 is a button for drawing handwritten information (strokes). The eraser button 403 is a button for erasing handwritten information. The screen move button 404 is a button for displaying on the display 3 a range that cannot be displayed on the display 3 (the electronic canvas application 12 can theoretically have an infinite size). A return button 405 is a button for discarding the contents of the operation and returning to the state before the operation. A forward button 406 is a button for restoring the contents of the operation and returning to the state after the operation. A capture button 407 is a button for capturing image data of the screen of the material display application 11 . A character memo button 408 is a button for displaying a soft key canvas and inputting text. A business application cooperation button 409 is a button for calling a cloud service (a cloud service other than the image management server 50 of the present embodiment), or for sending an auxiliary application ID or an electronic canvas (meeting) URL by e-mail. be. The setting button 410 is a button for accepting various settings.

Also, the user can press the import button 407 of the menu to import the image data of the screen of the material display application 11 . The information display bar 450 is an area for indicating the current display range of the electronic canvas by coordinates and displaying the current reduction rate or enlargement rate. The electronic canvas is created to have a wide area that can be slid so that the user's thinking is not interrupted by screen switching, etc., so by displaying the current display range, you can see which part you are looking at. I can grasp it. Note that the coordinate values displayed on the information display bar 450 are the coordinates of the upper left corner of the display range for the entire electronic canvas, the coordinates of the center of the display range, or the like.

<Overview of processing>
Below, an overview of creating an electronic canvas and an overview of capturing a screen will be described.

<<Overview of creating an electronic canvas>>
FIG. 9 is an example of a diagram explaining an overview of creation of an electronic canvas.

S1: The user of the dedicated terminal 30 connects the dedicated terminal 30 to the URL of the image management server 50 . The URL of the image management server 50 is known to the user. As a result, the dedicated terminal 30 displays the top page.

S2: A button 460 displaying a message such as "Do you want to create an electronic canvas?" is displayed on the top page, and the user presses this button 460. When the operation accepting unit 24 of the dedicated terminal 30 accepts pressing of the button 460 , the communication unit 22 transmits an electronic canvas creation request to the image management server 50 .

S3: Since the second communication unit 52 of the image management server 50 receives the electronic canvas creation request, the canvas screen creation unit 55 creates the electronic canvas.

S4: The second communication unit 52 of the image management server 50 transmits screen information of the electronic canvas to the dedicated terminal 30 .

S5: The communication unit 22 of the dedicated terminal 30 receives the screen information of the electronic canvas. When the dedicated terminal 30 executes screen information on the browser application, the electronic canvas application 12 operates. The electronic canvas in the initial state is a white screen on which a menu 401 and an information display bar 450 are displayed.

Thus, the user can create an electronic canvas by connecting the dedicated terminal 30 to the image management server 50 .

<<Overview of screen capture>>
FIG. 10 is an example of a diagram for explaining an outline of screen capture.

S11: A user who wants to display the screen of the shared terminal 10 on the dedicated terminal 30 presses the import button 407 of the menu 401 . The operation accepting unit 24 accepts pressing of the capture button 407 .

S12: In response to pressing of the import button 407, the display control unit 21 pops up the auxiliary application ID input field 420, for example. The user sees the auxiliary application ID displayed on the display 3 of the shared terminal 10 and inputs it in the input field 420 . The operation accepting unit 24 accepts the auxiliary application ID. The user can specify the shared terminal 10 by inputting the auxiliary application ID.

S<b>13 : The communication unit 22 of the dedicated terminal 30 transmits a capture request including the auxiliary application ID to the image management server 50 . This capture request is transmitted based on the screen information generated by the image management server 50 . In other words, the import button 407 is generated by the canvas screen creation unit 55 of the image management server 50 .

S14: When the second communication unit 52 of the image management server 50 receives the capture request, the image acquisition unit 54 acquires the IP address associated with the auxiliary application ID via the IP address management unit 53 . Thereby, the shared terminal 10 is specified.

S15: The first communication unit 51 of the image management server 50 transmits a capture request to the shared terminal 10 specified by the IP address.

S16: The communication unit 31 of the shared terminal 10 receives the capture request, and the screen capturing unit 34 requests the OS 14 to capture the screen, thereby generating screen image data.

S<b>17 : The communication unit 31 of the shared terminal 10 transmits the captured image data of the screen to the image management server 50 .

S18: The first communication unit 51 of the image management server 50 receives the image data of the screen, and the canvas screen creation unit 55 updates the screen information of the electronic canvas by adding the image data.

S19: As a result, the second communication unit 52 of the image management server 50 notifies that the electronic canvas has been updated.

S20: Since the communication unit 22 of the dedicated terminal 30 requests the screen information of the updated electronic canvas in response to the update notification, the same screen as the screen of the document display application 11 displayed on the shared terminal 10 is displayed on the dedicated terminal. 30 electronic canvas applications 12 can be displayed.

<Sequence>
In the following, the flow of each process of starting up the shared terminal 10, creating an electronic canvas, and capturing a screen will be described with reference to a sequence diagram.

<<When the shared terminal starts up>>
FIG. 11 is an example of a sequence diagram showing a procedure for notifying the image management server 50 of the auxiliary application ID when the shared terminal 10 is activated.

S101: When using the shared terminal 10, the user activates the shared terminal 10. FIG. For example, the power is turned on.

S102: First, the OS 14 is activated in the shared terminal 10, and when the OS 14 is activated, the auxiliary application 13 is automatically activated. A user may start the auxiliary application 13 .

S103: The auxiliary application 13 activates various functions (services) according to instructions from the OS .

S104: First, the ID display unit 33 acquires the auxiliary application ID 35a stored in the storage unit 35 and displays it on the screen (display 3).

S<b>105 : Next, the ID notification unit 32 transmits the auxiliary application ID to the image management server 50 via the communication unit 31 . Thereby, the image management server 50 acquires the IP address of the shared terminal 10 .

S106: The first communication unit 51 of the image management server 50 acquires the auxiliary application ID and the IP address of the shared terminal 10, and the IP address management unit 53 associates the auxiliary application ID with the IP address of the shared terminal 10 to obtain an ID/IP address. Stored in the storage unit 56 .

In this manner, when the shared terminal 10 is activated, the IP addresses of the auxiliary application 13 and the shared terminal 10 are automatically stored in the image management server 50 . In this embodiment, the shared terminal 10 is not associated with a specific electronic canvas, and the screen of the shared terminal 10 is transmitted to the dedicated terminal 30 each time the dedicated terminal 30 transmits the auxiliary application ID. Note that, when the shared terminal 10 is powered off, the ID notification unit 32 may request the image management server 50 to delete the auxiliary application ID and the IP address of the shared terminal 10 .

<<Creating an electronic canvas>>
FIG. 12 is an example of a sequence diagram showing a procedure for the dedicated terminal 30 to create an electronic canvas.

S201: The user of the dedicated terminal 30 operates the dedicated terminal 30 to input the previously known URL of the image management server 50 into the dedicated terminal 30 . The operation accepting unit 24 accepts the URL of the image management server 50 .

S202: When the operation accepting unit 24 accepts the user's operation of pressing the button 460 in FIG.

S203: Since the second communication unit 52 of the image management server 50 receives the electronic canvas creation request, the canvas screen creation unit 55 creates the electronic canvas (screen information).

An electronic canvas is created at a predetermined URL so that one or more dedicated terminals 30 can access it. One URL corresponds to one electronic canvas (the URL is different for each electronic canvas). An example of the URL of the electronic canvas is shown below.
http://server/kaigi/k001
S204 : The second communication unit 52 of the image management server 50 transmits the URL of the electronic canvas to the dedicated terminal 30 .

S205: The communication unit 22 of the dedicated terminal 30 receives the URL of the electronic canvas and accesses (connects to) this URL.

S206 : When the communication unit 22 of the dedicated terminal 30 accesses the URL of the electronic canvas, the second communication unit 52 of the image management server 50 transmits screen information of the electronic canvas created by the canvas screen creating unit 55 to the dedicated terminal 30 . The communication unit 22 of the dedicated terminal 30 receives the screen information of the electronic canvas.

S207: When the dedicated terminal 30 executes display processing of screen information on the browser application, the electronic canvas application 12 operates, and the display control unit 21 displays the electronic canvas on the display 3. FIG. The electronic canvas in the initial state is a white screen on which a menu 401 and an information display bar 450 are displayed.

Since one URL corresponds to one electronic canvas, the same electronic canvas can be displayed from any dedicated terminal 30 by accessing the URL of the electronic canvas. When writing or the like is performed on the electronic canvas from the dedicated terminal 30, the communication unit 22 of the dedicated terminal 30 notifies the canvas screen creation unit 55 of the change via the second communication unit 52, and the canvas screen creation unit 55 transmits the screen information. Update. The canvas screen creation unit 55 notifies the other dedicated terminals 30 of the change. Alternatively, the electronic canvas is updated by periodically accessing the URL of the electronic canvas from the dedicated terminal 30 side.

<<screen capture>>
FIG. 13 is an example of a sequence diagram showing a procedure in which the shared terminal 10 captures the screen and the dedicated terminal 30 displays the image data of the screen of the material display application 11. As shown in FIG.

S401: A user who wants to display the screen of the shared terminal 10 on the dedicated terminal 30 presses the import button 407 of the menu 401 . The operation accepting unit 24 accepts pressing of the capture button 407 .

S402: In response to pressing of the import button 407, the display control unit 21 pops up the auxiliary application ID input field 420, for example.

S403: The user sees the auxiliary application ID 35a displayed on the display 3 by the shared terminal 10 and inputs it in the input field 420. The operation accepting unit 24 accepts the auxiliary application ID.

S<b>404 : The communication unit 22 of the dedicated terminal 30 transmits a capture request including the auxiliary application ID to the image management server 50 . The destination is the URL of the electronic canvas. Note that the display control unit 21 may display a message such as "capturing" until the image data of the screen of the material display application 11 is acquired.

S405: When the second communication unit 52 of the image management server 50 receives the capture request, the canvas screen creation unit 55 sends the auxiliary application ID to the IP address management unit 53 to inquire about the IP address of the shared terminal 10 .

S406: The IP address management unit 53 acquires the IP address associated with the auxiliary application ID from the ID/IP address storage unit 56. FIG. This IP address is notified to canvas screen creation unit 55 . Thereby, the shared terminal 10 is specified.

S407: Canvas screen creation unit 55 sends a capture request together with the IP address of shared terminal 10 to image acquisition unit .

S408: The image acquisition unit 54 assigns a unique capture number, and sends the capture number and capture request to the shared terminal 10 specified by the IP address via the first communication unit 51 of the image management server 50. The capture number is identification information for specifying the electronic canvas that returns the screen image data. Therefore, the image acquisition unit 54 associates the URL of the electronic canvas with the capture number. As a result, even if a plurality of electronic canvases are created, screen image data can be returned to the electronic canvas connected to the dedicated terminal 30 that requested the capture.

S409: The communication unit 31 of the shared terminal 10 receives the capture request, and the screen capturing unit 34 requests the OS 14 to capture the screen. As a result, the screen capture unit 34 acquires image data of the screen (the material displayed by the material display application 11).

S410: The screen capture unit 34 compresses the screen image data. Thereby, the size of the image data can be reduced. If the size of the image data is small, compression may not be performed.

S<b>411 : The communication unit 31 of the shared terminal 10 transmits the screen image data and the capture number to the image management server 50 .

S<b>412 : The first communication unit 51 of the image management server 50 receives the screen image data and the capture number, and the image acquisition unit 54 saves the screen image data in the storage of the image management server 50 . The image acquisition unit 54 identifies the electronic canvas (canvas screen creation unit 55 ) that requested the screen image data by the capture number, and sends the screen image data to the canvas screen creation unit 55 .

S413: Next, the canvas screen creation unit 55 updates the screen image data by adding the screen image data to the screen information of the electronic canvas. That is, the screen information already generated by the canvas screen creation unit 55 is updated using the image data of the screen. The canvas screen creating unit 55 performs a process of adding to the screen information of the electronic canvas specified by the URL or the like when the capture request is received in step S404. As a result, the screen information of the screen on which the import button 407 was displayed in step S401 is updated. That is, the screen information corresponding to the URL in step S205 of FIG. 12 on the screen where the import button 407 in step S401 was displayed is updated.

S414: Accordingly, the canvas screen creation unit 55 of the image management server 50 notifies the browser application 15 (communication unit 22) of the proprietary terminal 30 via the second communication unit 52 of the update of the electronic canvas.

S415: In response to the update notification, the communication unit 22 of the dedicated terminal 30 instructs the display control unit 21 to update the electronic canvas.

S416: Then, the display control unit 21 requests the updated screen information of the electronic canvas from the URL of the electronic canvas via the communication unit 22, so that the display control of the screen of the material display application 11 displayed by the shared terminal 10 is performed. section 21 can be displayed.

Note that the auxiliary application ID is assumed to be manually input by the user each time in the sequence of FIG. May be omitted.

Also, the shared terminal 10 can display two or more material display applications 11 . In this case, as many auxiliary applications 13 as the material display applications 11 are activated and the user inputs the auxiliary application ID to the dedicated terminal 30, any screen displayed by the plurality of material display applications 11 can be displayed on the dedicated terminal. 30 can be displayed.

<Summary>
As described above, in the information sharing system of the present embodiment, the shared terminal 10 and the dedicated terminal 30 are connected to the image management server 50 so that the screen displayed by the shared terminal 10 is acquired by the dedicated terminal 30. be able to. Also, the screen displayed by the shared terminal 10 can be acquired without the need to introduce a special application to the dedicated terminal 30 . The user can share the screen displayed by the shared terminal 10 by inputting the auxiliary application ID. In the information sharing system of the present embodiment, since the user creates the electronic canvas, the relationship between the electronic canvas and the shared terminal 10 is not fixed, and the user inputs the auxiliary application ID to display the screen of any shared terminal 10 on the electronic canvas. can be displayed. In other words, since screens of different shared terminals 10 can be displayed on the electronic canvas, the user can use the electronic canvas as a memo.

<Modification>
In this embodiment, the screen is not captured unless the image management server 50 requests the shared terminal 10 to capture the screen. It may be uploaded to the image management server 50 . In this case, the image acquisition unit 54 holds the image data of the screen in association with the IP address of the shared terminal 10, and transmits the held latest image data of the screen in response to the request from the dedicated terminal 30. do it.

[Second embodiment]
In this embodiment, an information sharing system in which a shared terminal 10 creates an electronic canvas will be described. Since the shared terminal 10 creates the electronic canvas, the shared terminal 10 and the electronic canvas are associated when the shared terminal 10 is activated. On the other hand, the user of the dedicated terminal 30 does not know which URL to connect to in order to use the electronic canvas created by the shared terminal 10 . Therefore, the shared terminal 10 displays the URL of the created electronic canvas. By inputting this URL into the dedicated terminal 30 , the user can specify the electronic canvas created by the shared terminal 10 and acquire the image data of the screen of the material display application 11 .

<About functions>
FIG. 14 is an example of a functional block diagram showing in blocks the functions of the shared terminal 10, the dedicated terminal 30, and the image management server 50 in this embodiment. Note that the explanation of FIG. 14 mainly explains the difference from FIG.

<<Auxiliary App>>
The auxiliary application 13 has a communication section 31 , an electronic canvas creation request section 36 , a URL display section 37 , and a screen capturing section 34 . Accordingly, an electronic canvas creation request section 36 and a URL display section 37 are newly provided.

The electronic canvas creation request unit 36 requests the image management server 50 to create an electronic canvas, for example, when the shared terminal 10 is activated or in response to a user's operation. As a result, the electronic canvas creation request unit 36 acquires the URL of the electronic canvas from the image management server 50, and stores the URL 35b of the electronic canvas in the storage unit 35. FIG. The URL display unit 37 displays the URL 35b of this electronic canvas on the display 3. FIG.

<<Server>>
The functions of the image management server 50 are the same as in the first embodiment. However, the function of the canvas screen creating section 55 is different. The canvas screen creation unit 55 of this embodiment associates the URL of the electronic canvas created in response to a request from the shared terminal 10 with the IP address of the shared terminal 10 and registers them in the URL/IP address storage unit 57 .

Table 2 shows an example of information stored in the URL/IP address storage unit 57. The URL of the electronic canvas and the IP address of the shared terminal 10 are associated and registered in the URL/IP address storage unit 57 . Therefore, the image management server 50 can specify the IP address of the shared terminal 10 from the URL of the electronic canvas.

<Overview of processing>
Below, an overview of creating an electronic canvas and an overview of capturing a screen will be described.

<<Overview of creating an electronic canvas>>
FIG. 15 is an example of a diagram outlining the creation of an electronic canvas.
S41: The user turns on the power of the shared terminal 10 .
S42: When the shared terminal 10 is activated, the shared terminal 10 transmits an electronic canvas creation request to the image management server 50 . The URL of the image management server 50 is set in the auxiliary application 13 in advance. At this time, the IP address of shared terminal 10 is also notified.
S43: The image management server 50 receives the electronic canvas creation request, and creates the electronic canvas at the determined URL using a predetermined creation method.
S44: The image management server 50 associates the URL of the electronic canvas with the IP address of the shared terminal 10 and registers them in the URL/IP address storage unit 57 .
S 45 : The image management server 50 transmits the URL of the electronic canvas to the shared terminal 10 .
S46: When the shared terminal 10 receives the URL of the electronic canvas, it stores it in the storage unit 35, and the auxiliary application 13 displays it on the display 3.

By displaying the URL in this manner, the user of the dedicated terminal 30 can access the electronic canvas and display the screen of the material display application 11 on the dedicated terminal 30 .

<<Overview of screen capture>>
FIG. 16 is an example of a diagram illustrating an overview of screen capture.

S50 : First, the user inputs the URL of the electronic canvas displayed by the shared terminal 10 into the dedicated terminal 30 . As a result, first, the electronic canvas in its initial state (or to which another user has handwritten or added screen image data) is displayed on the dedicated terminal 30 .

S51: Next, the user who wants to display the screen of the shared terminal 10 on the dedicated terminal 30 presses the import button 407 of the menu 401 . The operation accepting unit 24 accepts pressing of the capture button 407 . Since the URL of the electronic canvas has been entered, the entry field for the auxiliary application ID is not displayed in this embodiment.

S53: The communication unit 22 of the dedicated terminal 30 transmits a capture request to the URL of the electronic canvas.

S54: When the second communication unit 52 of the image management server 50 receives the capture request, the canvas screen creation unit 55 acquires from the URL/IP address storage unit 57 the IP address associated with the URL of the electronic canvas. Thereby, the shared terminal 10 is specified.

S55: The first communication unit 51 of the image management server 50 transmits a capture request to the shared terminal 10 specified by the IP address.

S56: The communication unit 31 of the shared terminal 10 receives the capture request, and the screen capturing unit 34 requests the OS 14 to capture the screen, thereby generating image data of the screen (material displayed by the material display application 11).

S<b>57 : The communication unit 31 of the shared terminal 10 transmits the screen image data to the image management server 50 .

S58: The first communication unit 51 of the image management server 50 receives the image data of the screen, and the canvas screen creation unit 55 updates the screen information of the electronic canvas by adding the image data.

S59: As a result, the second communication unit 52 of the image management server 50 notifies the update of the electronic canvas.

S60: In response to the update notification, the communication unit 22 of the dedicated terminal 30 requests the updated screen information of the electronic canvas. can be done.

<Sequence>
In the following, the flow of processing when the shared terminal 10 is activated and when capturing a screen will be described with reference to a sequence diagram.

<<When the shared terminal starts up>>
FIG. 17 is an example of a sequence diagram showing a procedure for registering the URL of the electronic canvas and the IP address of the shared terminal 10 in association with each other when the shared terminal 10 is activated.

S501 : When using the shared terminal 10 , the user activates the shared terminal 10 . For example, the power is turned on.

S502: First, the OS 14 is activated on the shared terminal 10, and when the OS 14 is activated, the auxiliary application 13 is automatically activated. A user may start the auxiliary application 13 .

S503: The auxiliary application 13 activates various functions (services) according to instructions from the OS .

S504: First, the electronic canvas creation request unit 36 requests the image management server 50 to create an electronic canvas together with the IP address of the shared terminal 10 .

S505: The first communication unit 51 of the image management server 50 receives the electronic canvas creation request, and the canvas screen creation unit 55 creates a new electronic canvas in association with the URL. It is preferable that this URL does not duplicate any URL created in the past. On the other hand, since the electronic canvas is wide, the same URL may be used.

S506 : The canvas screen creating unit 55 associates the URL of the electronic canvas with the IP address of the shared terminal 10 and registers them in the URL/IP address storage unit 57 .

S507 : The first communication unit 51 of the image management server 50 transmits the URL of the electronic canvas to the auxiliary application 13 of the shared terminal 10 .

S508: The communication unit 31 of the shared terminal 10 receives the URL of the electronic canvas, and the electronic canvas creation request unit 36 causes the storage unit 35 to store the URL 35b of the electronic canvas. As a result, the URL display unit 37 causes the display 3 to display the URL 35b of the electronic canvas.

In this way, when the shared terminal 10 is activated, the shared terminal 10 automatically creates an electronic canvas and displays the URL of the electronic canvas. Therefore, the user can connect to the electronic canvas by inputting this URL. In this embodiment, when the shared terminal 10 is activated, the URL of the electronic canvas is associated with the shared terminal 10. Therefore, if the URL is known, the screen of the shared terminal 10 can be shared by the dedicated terminal 30. FIG. When the shared terminal 10 is powered off, the electronic canvas creator may request the image management server 50 to delete the URL of the electronic canvas and the IP address of the shared terminal 10 .

<<screen capture>>
FIG. 18 is an example of a sequence diagram showing a procedure in which the shared terminal 10 captures the screen and the dedicated terminal 30 displays the image data of the screen of the material display application 11. As shown in FIG. Note that in the description of FIG. 18, differences from FIG. 13 will be mainly described.

S601: A user who wants to use the electronic canvas created by the shared terminal 10 to display the screen of the shared terminal 10 on the dedicated terminal 30 inputs the URL 35b of the electronic canvas displayed by the shared terminal 10 to the dedicated terminal 30. .

S602: The communication unit 22 of the dedicated terminal 30 connects to the URL 35b of the electronic canvas. As a result, the screen information of the electronic canvas is transmitted to the dedicated terminal 30, and the dedicated terminal 30 executes the screen information to operate the electronic canvas application 12. FIG.

S603: Next, the user presses the import button 407 of the menu 401 in order to display the screen of the shared terminal 10 on the electronic canvas application 12. FIG. The operation accepting unit 24 accepts pressing of the capture button 407 .

S604: The communication unit 22 of the dedicated terminal 30 specifies the URL of the electronic canvas and transmits a capture request to the image management server 50 . Note that the display control unit 21 may display a message such as "capturing" until the image data of the screen of the material display application 11 is acquired.

S605: When the second communication unit 52 of the image management server 50 receives the capture request, the canvas screen creation unit 55 acquires the IP address of the shared terminal 10 associated with the URL of the electronic canvas from the URL/IP address storage unit 57. do.

S607: Canvas screen creation unit 55 sends a capture request together with the IP address of shared terminal 10 to image acquisition unit . Subsequent processing may be the same as steps S408 to S416 in FIG.

When the shared terminal 10 creates the electronic canvas in this way, it is necessary to specify the electronic canvas in order to acquire the screen of the material display application 11. However, since the shared terminal 10 displays the URL of the electronic canvas, the dedicated The terminal 30 can access the electronic canvas.

<Summary>
As described above, in the information sharing system of the present embodiment, the shared terminal 10 and the dedicated terminal 30 are connected to the image management server 50 so that the screen displayed by the shared terminal 10 is acquired by the dedicated terminal 30. be able to. The user can share the screen displayed by the shared terminal 10 by inputting the URL of the electronic canvas. In the information sharing system of this embodiment, since the shared terminal 10 creates the electronic canvas, the relationship between the electronic canvas and the shared terminal 10 is fixed, and the user who wants to display the screen of the shared terminal 10 on the dedicated terminal 30 can use the same electronic canvas. to use. Therefore, each user can write information on the same electronic canvas. It is possible to use a method in which many users view the shared terminal 10 with a large screen and write the contents of the discussion on the electronic canvas and share it.

Also in the present embodiment, the shared terminal 10 may periodically upload screen image data to the image management server 50 in advance by detecting changes in the screen.

[Third embodiment]
In both the first and second embodiments, the dedicated terminal 30 can always display a preview of the screen of the shared terminal 10 . Then, when the user presses the capture button 407, the dedicated terminal 30 copies the image data of the previewed screen to the electronic canvas and displays it.

FIG. 19 is an example of a diagram illustrating capture when the dedicated terminal 30 is displaying a preview. A screen image data preview 430 is always displayed on the dedicated terminal 30 by the screen capture procedure of either the first or second embodiment. An outline of the processing will be described.
(1) First, at the stage of displaying the preview 430, the dedicated terminal 30 does not need to make a capture request. However, in the method of the first embodiment, the dedicated terminal 30 transmits the auxiliary application ID to the image management server 50 at least once. In the method of the second embodiment, the dedicated terminal 30 connects to the URL of the electronic canvas.
(2) The image management server 50 periodically transmits a capture request to the shared terminal 10 . Even if there is no periodical capture request, the shared terminal 10 may upload screen image data captured periodically or by detecting changes in the screen.
(3) The shared terminal 10 uploads the screen image data to the image management server 50 .
(4) The image management server 50 updates the preview 430 (image data of the screen of the shared terminal 10) displayed in the preview field 431 of the dedicated terminal 30 among the screen information of the electronic canvas to the latest one.
(5) The dedicated terminal 30 can always display the preview 430 of the screen of the shared terminal 10 by periodically requesting the URL of the electronic canvas for screen information.

In this case, the screen of the electronic canvas is divided into, for example, a preview field 431 and a handwriting field 432 . When the user presses the capture button 407 , the image data in the preview field 431 is copied and displayed in the handwriting field 432 . Since the dedicated terminal 30 transmits the copied image data to the image management server 50, the screen information on the image management server 50 side is also updated.

FIG. 20 is an example of a sequence diagram showing a procedure in which the shared terminal 10 captures the screen and the dedicated terminal 30 displays the image data of the screen of the material display application 11. As shown in FIG. In addition, the difference from FIG. 13 will be explained in the explanation of FIG.

S401-2: A user who wants to preview the screen of the shared terminal 10 on the dedicated terminal 30 presses a preview button displayed on the menu 401, for example. The operation accepting unit 24 accepts pressing of the preview button. Note that the electronic canvas app may start displaying the preview without the operation for displaying the preview.

The processing of steps S402 to S407 may be the same as in FIG. Also, the image management server 50 periodically repeats the processing of steps S408 to S413. The load may be monitored and may be performed when the load is low, or may be performed irregularly. In step S413, the canvas screen creating unit 55 updates the preview column 431 of the screen information to the latest screen image data. Step S414 and subsequent steps may be the same as in FIG.

Therefore, the sequence diagram may be substantially the same as in the first embodiment. Also, in FIG. 20, although the sequence diagram of the first embodiment is used as an example, almost the same processing can be performed using the sequence diagram of the second embodiment. With such a method, the user's waiting time until the image data of the screen is displayed can be shortened.

Note that when the user actually presses the import button 407, instead of copying the image data in the preview field 431, the processing in the sequence diagram of FIG. 13 or FIG. You may Since the image quality of the preview 430 may be degraded due to compression or the like, the dedicated terminal 30 acquires the image data again, thereby suppressing deterioration in image quality of the image data displayed by the electronic canvas.

<Summary>
According to this embodiment, the dedicated terminal 30 can display a preview of the screen of the shared terminal 10 even if the user does not press the capture button, so the user can determine whether or not to capture the screen after seeing it on the dedicated terminal 30 .

[Fourth Embodiment]
Next, modified examples of screens displayed by the dedicated terminal 30 will be described with reference to FIGS. 21 to 29. FIG. FIG. 21 is a diagram showing a layer structure of a screen displayed by a dedicated terminal. 22 to 29 are diagrams showing screen examples of the proprietary terminal.

As shown in FIG. 21, the dedicated terminal 30 displays a screen consisting of four layers. First, the lowest layer is the ground layer (electronic canvas layer or SVG (Scalable Vector Graphics) drawing layer). One layer above this is the View Port layer (tool palette layer). The next higher layer is the screen sharing layer (video streaming layer). The next layer above this is the browser's modal dialog layer. The display control unit 21 performs the following display processing, and the operation reception unit 24 receives operations of a mouse, an electronic pen, or the like.

As shown in FIG. 22 , the display control unit 21 of the dedicated terminal 30 displays the ground area 500 on the display 3 . A view port area 510 , a screen sharing area 520 , and a scaling designation area 530 are included on the ground area 500 .

The View Port area 510 includes a screen move button 511 having the same function as the screen move button 404, a pen button 513 having the same function as the pen button 402, and the like.

The screen sharing area 520 includes a sharing area 521 for displaying screen-shared information, a capture button 522 having the same function as the capture button 407, and a transmission/reception switching button 523 for switching between receiving and transmitting screen image data. , a shrink button 524 for shrinking the normal size screen sharing area 520 , and an enlarge button 525 for enlarging the screen sharing area 520 .

A scaling designation area 530 is an area where a slide bar for changing the size of the ground area 500 is displayed.

In FIG. 22 , the image “A” of the screen being displayed on the shared terminal 10 is displayed in the lower right shared area 521 in the ground area 500 . That is, the screen of the image data of the image “A” is shared between the shared terminal 10 and the proprietary terminal 30 . In this state, when the user presses the capture button 522 with the cursor c1 using a mouse or the like, a captured image display area including the image "A" appears in the center left portion of the ground area 500, as shown in FIG. 501a and a character input area 501b to the right of which characters can be input are simultaneously displayed. A caret c2 is displayed in the character input area 501b from the beginning, so that the user can immediately input a comment. It should be noted that the cursor c1 is positioned over the capture button 522 so that the user can easily capture immediately following.

As shown in FIG. 23, when the user continues to press the capture button 522 while the image "B" is being displayed in the shared area 521, as shown in FIG. , a captured image display area 502a including the image "B" and a character input area 502b in which characters can be input are simultaneously displayed on the right side. In this case, the previously captured image moves to the upper left side within the ground area 500 so that the captured image display area 502 a is displayed in the left center portion of the ground area 500 . In this case as well, the caret c2 is displayed in the character input area 502b from the beginning, and the cursor c1 is positioned on the capture button 522. FIG.

As shown in FIG. 24, when the user continues to press the screen shift button 511 with the cursor c1 while the image "C" is displayed in the shared area 521, the mode is switched to the screen shift mode as shown in FIG. , a slide icon s1 for sliding the ground area 500 is displayed. Here, when the user moves the slide icon s1 with the cursor c1, the entire image within the ground area 500 is moved according to this movement. FIG. 25 shows a case where the entire image is moved to the right side compared to FIG. Note that the position of the screen sharing area 520 remains unchanged.

As shown in FIG. 25, while the image “C” is displayed in the shared area 521, if the user continues to press the enlargement button 525 with the cursor c1, the ground area 500 will be enlarged as shown in FIG. A shared area 521b enlarged over the entire area is displayed. In this case, the display density of the enlargement button 525 becomes light, indicating that the button is disabled and cannot be enlarged any more. In this state, when the user presses the capture button 522 with the cursor c1, the captured image display area of the image "C" and the characters on the right side of the captured image display area of the ground area 500 hidden in the lower layer of the shared area 521b are displayed. An input area has been added. Also, by pressing the enlargement button 525 once,
Instead of displaying the shared area 521b covering almost the entire area of the ground area 500, each time the enlargement button 525 is pressed, the size of the shared area 521b may gradually approach the size of the shared area 521b in several steps.

<Modification 1>
From the state of FIG. 24, the user may be able to independently move each captured image display area and each character input area with the cursor c1. FIG. 27 shows a state in which the character input area 502b is being moved to the left after the captured image display area 502a is moved to the right.

<Modification 2>
As shown in FIG. 28, even if the latest captured image display area 502A and character input area 502B are displayed in a larger size than the other captured image display areas 501a and character input areas 502a, good. In this case, the shared area 521 is displayed in a higher layer (front) than the captured image display area 502A and the character input area 502A.

Also, as shown in FIG. 29, when the user presses the reduction button 524 with the cursor c1, the shared area 521 may not be displayed as shown in FIG. In this case, the display density of the reduction button 524 is reduced, indicating that the button is disabled and cannot be reduced any further.

<Summary>
According to this embodiment, when the user captures the screen being screen-shared, a character input area is also displayed so that the captured screen image and comment can be immediately entered. This has the effect of allowing the user to quickly input a comment.

<Other application examples>
Although the best mode for carrying out the present invention has been described above using the embodiments, the present invention is not limited to such embodiments in any way, and various modifications can be made without departing from the scope of the present invention. and substitutions can be added.

For example, in this embodiment, the Canvas element of HTML5 was used, but WebGL, SVG (Scalable Vector Graphics), FLASH (registered trademark), etc. may be used.

Further, the electronic canvas application 12 may be provided as a Web application or as an application that does not require a browser application.

Moreover, it is preferable that the user of the dedicated terminal 30 exists in the same space as the shared terminal 10 , but the user of the dedicated terminal 30 does not have to exist in the same space as the shared terminal 10 . The auxiliary application ID or the URL of the electronic canvas is notified to users outside the company by e-mail or the like, and the users outside the company can also share the screen.

6 and the like are divided according to main functions in order to facilitate understanding of processing by the shared terminal 10, the dedicated terminal 30, and the image management server 50. FIG. The present invention is not limited by the division method or name of the unit of processing. The processing of the shared terminal 10, the dedicated terminal 30, and the image management server 50 can also be divided into more processing units according to the content of the processing. Also, one processing unit can be divided to include more processing.

The second communication unit is an example of acquisition request receiving means, the image acquisition unit 54 is an example of image acquisition means, the canvas screen creation unit 55 is an example of screen information update means, and the communication unit 22 is an example of reception means. The display control section 21 is an example of display control means, the ID/IP address storage section 56 is an example of first correspondence information storage means, and the URL/IP address storage section 57 is an example of second correspondence information storage means. The IP address management unit 53 is an example of an information storage unit, the material display application 11 is an example of a first application, and the auxiliary application 13 is an example of a second application.

3 display 10 shared terminal 11 material display application 12 electronic canvas application 13 auxiliary application 15 browser application 30 dedicated terminal 50 image management server information sharing system

JP 2014-199657 A

Claims (12)

An image management server capable of communicating with a shared terminal and a dedicated terminal via a network,
Identification information for identifying the shared terminal, which is displayed on the screen by the shared terminal while receiving from the dedicated terminal a request for acquisition of a screen displayed on the display device by the shared terminal, and input by a user to the dedicated terminal; and acquisition request receiving means for receiving at least one of URLs for accessing screen information transmitted to the dedicated terminal using the image data of the screen input to the dedicated terminal by the user ;
image acquisition means for transmitting an image data acquisition request to the shared terminal in response to the acquisition request received by the acquisition request receiving means and acquiring image data of the screen from the shared terminal;
screen information updating means for updating screen information transmitted to the dedicated terminal using the image data of the screen acquired by the image acquisition means;
An image management server characterized by comprising: 2. The image management server according to claim 1, wherein the screen information updated by the screen information updating means is transmitted to the dedicated terminal so that the screen information is displayed on the dedicated terminal. The address associated with the identification information of the shared terminal acquired together with the acquisition request from the first correspondence information storage means for storing the identification information identifying the shared terminal and the address information of the shared terminal in association with each other. an address information obtaining means for obtaining information,
3. The image management server according to claim 1, wherein said image acquisition means transmits said acquisition request to said shared terminal of said address information acquired by said address information acquisition means. In the shared terminal, a first application for displaying materials on the screen and a second application in which identification information of the shared terminal is set operate,
The address information obtaining means associates the identification information of the shared terminal transmitted from the second application with the address information of the shared terminal, and stores them in the first correspondence information storage means. 4. The image management server according to claim 3. The screen information updating means creates a URL for the dedicated terminal to access the screen information,
Associate the URL for accessing the screen information received together with the acquisition request from a second correspondence information storage means for storing the URL for accessing the screen information and the address information of the shared terminal in association with each other an address information acquiring means for acquiring the address information obtained from the
3. The image management server according to claim 1, wherein said image acquisition means transmits said acquisition request to said shared terminal of said address information acquired by said address information acquisition means. In the shared terminal, a first application for displaying materials on the screen and a second application for requesting creation of a URL for accessing the screen information operate,
The address information acquisition means creates a URL for accessing the screen information in response to a request from the second application, associates the URL with the address information of the shared terminal, and obtains the second correspondence information. 6. The image management server according to claim 5 , wherein the image management server is stored in storage means. The image acquisition means repeatedly transmits the acquisition request to the shared terminal even if there is no acquisition request from the dedicated terminal, and acquires image data of the screen transmitted from the shared terminal;
The screen information updating means updates the preview field of the screen information using the image data of the screen acquired by the image acquiring means,
7. The image management server according to any one of claims 1 to 6 , wherein the screen information in which the updated image data of the screen is displayed in a preview column is transmitted to the dedicated terminal. 8. The acquisition request according to any one of claims 1 to 7 , wherein the acquisition request from the dedicated terminal received by the acquisition request receiving means is transmitted based on a screen generated by the image management server. Image management server. 9. The screen information update means updates the screen information already generated by the image management server by using the image data of the screen acquired by the image acquisition means. or the image management server according to item 1. an image management server capable of communicating with shared terminals and dedicated terminals via a network;
Identification information for identifying the shared terminal, which is displayed on the screen by the shared terminal while receiving from the dedicated terminal a request for acquisition of a screen displayed on the display device by the shared terminal, and input by a user to the dedicated terminal; and acquisition request receiving means for receiving at least one of URLs for accessing screen information transmitted to the dedicated terminal using the image data of the screen input to the dedicated terminal by the user ;
image acquisition means for transmitting an image data acquisition request to the shared terminal in response to the acquisition request received by the acquisition request receiving means and acquiring image data of the screen from the shared terminal;
screen information updating means for updating screen information transmitted to the dedicated terminal using the image data of the screen acquired by the image acquisition means;
A program characterized by functioning as An information sharing system in which a shared terminal, a dedicated terminal, and an image management server communicate via a network,
Identification information for identifying the shared terminal, which is displayed on the screen by the shared terminal while receiving from the dedicated terminal a request for acquisition of a screen displayed on the display device by the shared terminal, and input by a user to the dedicated terminal; and acquisition request receiving means for receiving at least one of URLs for accessing screen information transmitted to the dedicated terminal using the image data of the screen input to the dedicated terminal by the user ;
image acquisition means for transmitting an image data acquisition request to the shared terminal in response to the acquisition request received by the acquisition request receiving means and acquiring image data of the screen from the shared terminal;
screen information updating means for updating screen information transmitted to the dedicated terminal using the image data of the screen acquired by the image acquisition means;
receiving means for receiving the screen information from the image management server;
display control means for displaying the screen on a display based on the screen information received by the receiving means;
An information sharing system characterized by having: An information sharing method performed by an information sharing system in which a shared terminal, a dedicated terminal, and an image management server communicate via a network,
Acquisition request receiving means receives, from the dedicated terminal, an acquisition request for a screen to be displayed on a display device by the shared terminal, and the shared terminal displayed on the screen by the user and inputted to the dedicated terminal. and a URL for accessing screen information transmitted to the dedicated terminal using the image data of the screen input to the dedicated terminal by the user ;
an image acquisition means transmitting an image data acquisition request to the shared terminal in response to the acquisition request acquired by the acquisition request receiving means, and acquiring image data of the screen from the shared terminal;
a step in which the screen information updating means updates the screen information transmitted to the dedicated terminal using the image data of the screen acquired by the image acquiring means;
receiving means for receiving the screen information from the image management server;
a step in which the display control means displays the screen on a display based on the screen information received by the reception means;
An information sharing method characterized by comprising:

Images