JP6021177B2 - Content sharing system, content sharing expansion system, content sharing method, and content sharing program - Google Patents

Description

  The present invention relates to a content sharing system, a content sharing expansion system, a content sharing method, and a content sharing program for exchanging messages between terminals.

  Network environments such as ISDN (Integrated Services Digital Network), optical communication using optical fibers, or LAN (Local Area Network) are generally widespread, and video conferencing is generally performed using such network environments. Has been done.

  Here, a video conference is a video signal captured by a camera or an audio signal picked up by a microphone is transmitted to a communication destination via a network, and video and audio are output by a destination TV monitor or speaker. Is. Video conferencing is generally realized by two-way communication, and one video signal and audio signal are transmitted to each other. This makes it possible to communicate with a person at a remote location while on the spot.

  A conference is a means for executing information transmission and decision making through communication. Therefore, in a meeting where people actually meet together (hereinafter referred to as a “normal meeting” in order to clarify that the meeting is different from a video conference) In addition to general materials such as printed documents, various types of materials (that is, contents) such as videos, photographs, drawings, prototype models, etc. are used depending on the contents of the conference.

  As in such a normal conference, a video conference is required to proceed with a conference using such materials.

  In this regard, the video conference environment is different from the normal conference environment, so there are places where the organizer side makes great efforts, but in a form that substitutes different parts, so that it does not differ from the content that can be achieved in the normal conference Can proceed. For example, sending materials in advance and understanding each other before attending a video conference, or transmitting a PC monitor screen on which a presentation material is displayed instead of a camera image is performed.

  Here, a device that realizes a video conference is referred to as a “video conference device” in the following description. In a video conference, band compression is performed so that video signals and audio signals can be smoothly transmitted and received over a network. In the band compression, encoding / decoding processing is performed on the video signal and the audio signal. This encoding / decoding process requires a large amount of calculation. Therefore, it is common to use hardware dedicated to encoding / decoding processing. Therefore, in order to conduct a video conference, a dedicated device equipped with the dedicated hardware is usually used. However, in recent years, the performance of PCs (Personal computers) has improved, and the use of dedicated applications that perform equivalent processing on PCs has been increasing.

  Here, the former apparatus equipped with dedicated hardware for the purpose of video conferencing is called a video conferencing apparatus.

  The video conference device confirms the common functions that can be used for communication with each other by exchanging information such as the functions possessed with the video conference device of the partner station immediately after the start of communication, and the function to use The video data and audio data are transmitted after the determination. The procedure used in this information exchange is called a communication protocol and its contents are defined.

  In the video conference apparatus, several international standards have already been established regarding communication protocols that are generally used. As a specific example, H.264 standardized by ITU-T (International Telecommunication Union Telecommunication Standardization Sector). H.323, SIP (Session Initiation Protocol) standardized by IETF (Internet Engineering Task Force), and the like are used.

  Further, not only the exchange of video data and audio data but also the exchange of control data is defined. For example, a camera used in a video conference is often an electric camera that can be moved vertically and horizontally and zoomed. Then, when it is desired to move the electric camera connected to the partner terminal after the communication is started, it is possible to move to a desired position through an operation of a remote controller or the like. This movement is realized by transmitting movement information operated by the remote controller to the counterpart terminal in accordance with a predetermined standard.

  On the other hand, cloud computing has recently become widespread, and PC data (that is, content) such as documents stored on each individual or corporation-owned PC or server can be used on the Internet. This data is often stored on a server owned by a service provider.

  In such a service, access is made to a server owned by a service provider from an application that runs on a personal computer or a mobile terminal such as a smartphone or tablet owned by an individual or a corporation, Can be used.

  Here, a service provided via a network such as the Internet that can be accessed from such a PC or a portable terminal will be referred to as an “online service”. By using the online service, contents such as document data and presentation data as well as contents such as video data and photo data necessary for the conference can be stored on a server owned by the service provider. In order to view these data, access may be made on a server owned by a service provider via a PC or server owned by each individual or a certain corporation. In addition, the contents of the accessed data can be expanded on the entire screen with a simple operation such as one click. In addition, recent online services have been prepared with abundant service contents useful for business purposes, and the use of these services is being expanded.

  For example, Google Inc. The Google document (registered trademark) provided by, provides a service that enables online document creation and sharing member browsing. Evernote (registered trademark) provided by Evernote Corporation provides a service capable of storing and managing data such as documents and text photographs. Flickr (registered trademark) provided by Yahoo! Inc. in the United States provides a community service that allows photo data to be shared with strangers online.

  Video conferences are also increasingly being implemented using online services such as these. Here, both the video conference and the online service are common in that they are services performed using a network. Therefore, it is desirable that the user can use both the video conference and the online service at the same time.

  However, it has not been easy to use both video conferencing and online services at the same time. This point will be described with reference to FIG.

  As shown in FIG. 1, a video conference is performed on each network (router 1002, WAN (Wide Area Network) 1003 and router 1005) for communication between video conference devices (video conference device 1001 and video conference device 1006). This is realized by connecting a video conference device. On the other hand, the online service is realized by connecting a terminal and a server to a network (router 1008, Internet 1009 and router 1010) for communication between a terminal (PC 1011) to be accessed and a server (online service server 1007). The

  That is, a video conference network and an online service network are often provided separately.

  The reason will be described. The Internet 1009 used for the online service is not guaranteed so that the communication band is always stable, and since video conferencing is weak in error tolerance of video data and audio data, a dedicated network (for example, WAN 1003) that secures the communication band. ) Is often used. On the other hand, online services are provided via the Internet. For this reason, it is necessary to prepare separate networks for using video conferencing and for using online services.

  Here, there is a video conference apparatus that accepts an operation from a PC or a portable terminal and realizes a video conference using an IP network. In the following description, a PC or a portable terminal capable of operating the video conference device is referred to as a “control terminal”, and an application that realizes the operation of the video conference device installed in the control terminal is referred to as a “control application”. To.

  It is assumed that the video conference apparatus and the control terminal are connected via an IP network, and the video conference apparatus can be operated from the control terminal.

  A specific example of a connection configuration between such a video conference device and a control terminal is shown. Since the IP address used between the video conference apparatuses and the IP address domain used between the video conference apparatus and the control terminal may be different, two types of configurations are taken up.

  In the configuration shown in FIG. 2, two ports are prepared for the video conference device 1006. Specifically, a communication port for performing a video conference communication and a communication port for communicating with a control terminal are prepared in the video conference apparatus 1006. As a result, the video conference apparatus 1006 and the control terminal 1013 can simultaneously communicate with each other via the hub 1012 via the IP network (Internet 1009).

  In FIG. 3, the video conference apparatus 1006 is connected to a router (NAT / router 1014) having a NAT (Network Address Translation) function, which is a technique for converting an IP address, thereby controlling the video conference apparatus 1006. The terminal 1013 can be connected to and communicate with the nearest IP network (WAN 1003), and in the case of video conference communication, the video conference apparatus 1006 and the control terminal 1013 are simultaneously connected via the IP network via the NAT / router 1014. It is configured to allow communication.

  It is assumed that a control application for controlling the video conference is installed in the control terminal 1013 from an application accessible by the online service. Assume that the control terminal 1013 can control the video conference apparatus 1006 from the installed control application via the IP network having the connection configuration shown in FIG. 2 or FIG.

  In addition, the present situation is that the control terminal is found useful for the control of the video conference recently, and the reason will be described below. In the control of the video conference apparatus, it is usual to operate according to an operation screen GUI (Graphical User Interface) displayed on the TV monitor using a dedicated remote controller attached to the video conference apparatus. However, as I often encounter, if I operate the remote control during a video conference, it will switch from the screen showing the other party's video to the operation screen GUI, so the conference flow will be interrupted and the conference will be interrupted. There is a problem of breaking the mood. In addition, there is another inconvenience of management because the battery used for the remote control is a consumable item, although it is a trivial point. From these viewpoints, another means for realizing an equivalent operation function that does not block a video conference has been demanded. Recently, PCs have become widespread, and regular use of notebook PCs instead of notebooks has increased. Therefore, it has been found that by using a control terminal such as a PC installed with a control application for controlling a video conference, control of the video conference device can be realized without blocking the other party's video from the operation screen GUI. Yes.

  Under such circumstances, the control application is required to be configured to access and control the video conference device and simultaneously access the online service in consideration of the recent spread of online services. Since the control terminal is connected to the IP network, it can be connected not only to the video conferencing apparatus but also to the Internet. Therefore, the online service can be accessed from the control terminal. Therefore, since many online services are accessed using a web browser, it is conceivable that the online service can be accessed by incorporating a web browser function in the control application. . As a specific display method, as shown in FIG. 4, it is conceivable that the control screen 2001 of the video conference apparatus and the document screen 2002 of the online service are displayed in parallel on the control application display screen 2000. By concentrating the functions in the control application in this way, the control of the video conference apparatus is not stopped as much as possible, and it is also possible to access the online service at the same time.

  Now, during the video conference, it is necessary to confirm both the new data on the online service server. If the storage position is in a simple place, a user who knows the storage position may transmit the storage position verbally to the other user of the conference partner. However, there are times when you encounter a scene that cannot be fully communicated with words. In such a case, in order to indicate the location indicating the storage position in a procedure or as a link address, it is often exchanged after writing it down in a text memo. For example, the text memo can be exchanged by e-mail, or saved as a text file on an online service, and the other party can confirm the file.

  Here, for the purpose of exchanging files, data such as a text memo in which information about the storage location is written down is called a “text message”. For example, link information on a server that provides an online service is an example of a text message. The text message may include information (ID, password, etc.) for logging in to the online service.

  In this regard, means for exchanging text messages using a communication network has been developed since the era of voice telephones. Today, when communication via the Internet has become mainstream, systems using servers are used.

  An example of such a system is described in Patent Document 1 and Patent Document 2.

  Patent Document 1 proposes a system in which text messages are exchanged between terminals connected to a communication network via a storage device installed in the communication network. In the system described in Patent Document 1, a voice message is transmitted through a terminal connected to a circuit switching network, and a text message is transmitted through a text terminal connected to a packet switching network. When a text message needs to be exchanged, a text terminal can be used to input the required text message and communicate it to the other party's text terminal.

  Patent Document 2 proposes a conference system that realizes exchange and accumulation of messages and documents via an asynchronous communication server, and exchange and accumulation of information such as characters, voices, and moving pictures via a synchronous communication server. The message information can be transmitted via the asynchronous communication server, and the message information is displayed in a form as in the message list on the web page. When a text message needs to be exchanged, a text message is registered from the web page from the user terminal, the registered text message is added to the message list, and the other party confirming the same web page receives the registered message from the message list. Realized by opening.

Japanese Patent Laid-Open No. 03-079139 JP 2006-113886 A

  If the techniques described in Patent Document 1 and Patent Document 2 described above are used, text messages can be exchanged via a device connected to a communication network. That is, if the functions realized in Patent Document 1 and Patent Document 2 are implemented in the control terminal shown in FIG. 2 or 3 and the functions can be operated from the control application, the communication partner can communicate with the control application. A text message can be easily transmitted.

  However, when a text message is exchanged using a device connected to a communication network using a general technique represented by Patent Document 1 or Patent Document 2, there are many elements that are prevented from being used. It is a fact.

  One of the factors that hinders its use is that the online service does not necessarily have a private information exchange function. Since video conferencing is a means for realizing private conversations, private exchanges limited to text messages are also required. In other words, a framework that realizes limiting the exchange of text messages between parties is necessary.

  In this regard, in the exchange of text messages using an online service, the text messages are stored in a server that is accessible to anyone of the service users connected to the Internet accessible to everyone. For this reason, it is not possible to limit the exchange of text messages as described above between parties.

  However, in the system described in Patent Document 2, the asynchronous communication server has a message registration function for limiting the disclosure destination to participants. Therefore, private text messages can be exchanged.

  Private text messages can be exchanged if all online services have similar message registration functions as in Patent Document 2, but such private text message exchange functions are available depending on the service provider. Often it is not prepared. For example, Flickr provided by Flickr has a function to add a message from a stranger who can access online for each photo data and anyone can view the comment, but a registration function to limit the publication destination Is not provided. This is largely due to the nature of the service, but it is true that there are services that do not have such a message registration function that limits their disclosure. Therefore, in an online service that cannot be privately exchanged, text messages must be exchanged via another route, not via the online service.

  In this regard, if the online service does not have a function for registering a message for limiting the release destination, such a function may be newly added, but this is not easy. This would be feasible if the online service was handled and operated by the company, but it was a part of the service provider's existence whether it could be realized when a function addition was requested to a major online service handled by another company. Is big. There are many online services in the world, and there are many service providers in proportion to the number of online services. It also requires individual service providers who handle online services without a message registration function, which requires a great deal of effort to realize.

  On the other hand, when exchanging text messages, another element that is prevented from being used is that another device for exchanging text messages needs to be provided in the communication network. That is, there is a restriction that text messages cannot be exchanged only with a device operated by a user.

  In the system described in Patent Document 1, a storage device for exchanging text messages is provided in a packet switching network to which a text terminal is connected, and text messages are exchanged via the storage device. That is, in Patent Document 1, it is assumed that a storage device exists in the communication network in order to realize text exchange.

  Also, in Patent Document 2, all message information is registered in an asynchronous communication server, and message exchange can be realized by a user terminal accessing a web page generated by the asynchronous communication server. That is, in Patent Document 2, it is premised that a non-communication server exists in the communication network in order to realize text exchange.

  As described above, in the configuration described in each cited document, it is necessary to provide another device for exchanging text messages in the communication network, and text messages cannot be exchanged only by devices operated by the user.

  Therefore, the present invention provides a content sharing system, a content sharing expansion system, and a content that can exchange text messages privately only between parties without providing a dedicated device in the communication network only for exchanging text messages. It is an object to provide a sharing method and a content sharing program.

  According to a first aspect of the present invention, there is provided a content sharing system for sharing content with a content sharing system existing on the counterpart station side, comprising a first device and a second device, wherein the first device To communicate with the first device on the partner station side of the content sharing system on the partner station existing on the partner station side and further communicate with the second device via the first network. For the second device to access the content to be shared by the first communication means, the content sharing system, and the content sharing system existing on the partner station side via the second network. Storage means for storing snap share information, storage control means for accessing the snap share information to the storage means, and the first communication means, First control means for performing control including causing the storage control means to perform the access relating to the snap sharing information, and causing the storage control means to perform communication relating to the snap sharing information. The second communication means for communicating with the first communication means and connecting to the second network; and the control of the content based on an instruction from a user; The first control unit performs communication via the second communication unit, and further communicates the snap sharing information with the first control unit via the first communication unit and the second communication unit. Based on the snap sharing information obtained by the communication related to the snap sharing information by the second control means, and the second communication means and the second network And content sharing system characterized by and an access means for accessing to the content is provided.

  According to a second aspect of the present invention, there is provided a content sharing method performed by a local content sharing system for sharing content with a content sharing system existing on the counterpart station side, wherein the local content sharing system includes: A partner station provided in a partner station-side content sharing system that is provided on the partner station side via the first network, the first communication means including the first device and the second device; Communicating with the first apparatus on the side, further communicating with the second apparatus, and storing means of the first apparatus includes the content sharing system on the local station side and content existing on the partner station side Storing snap sharing information for the second device to access the content to be shared with the sharing system via the second network; and A storage control unit that accesses the storage unit with respect to the snap sharing information; and a first control unit of the first device transmits the snap sharing to the first communication unit. A step for performing control including causing communication related to information to be performed and causing the storage control unit to perform the access regarding the snap sharing information; and a second communication unit of the second device includes the first communication unit, Communicating with the second communication means and further connecting to the second network, and the second control means of the second device controls the content based on an instruction from the user. And the first control unit via the first communication unit and the second communication unit, and further, the first communication unit and the second communication unit perform communication related to the snap sharing information. System And the second communication means based on the snap sharing information obtained by the communication related to the snap sharing information by the second control means. And accessing the content via the second network. A content sharing method is provided.

  According to a third aspect of the present invention, the first device in the content sharing system comprising the first device and the second device and sharing content with the content sharing system existing on the partner station side. As a content sharing program for causing a computer to function as a communication device, the computer communicates with the first device on the partner station side in the partner station content sharing system existing on the partner station side via the first network. Furthermore, for the content to be shared between the first communication means for communicating with the second device, the content sharing system, and the content sharing system existing on the partner station side, the second Storage means for storing the snap sharing information for the device to access via the second network, and the storage means A storage control unit that performs access related to the snap share information, and a communication that relates to the snap share information to the first communication unit and the storage control unit that performs the access related to the snap share information. And a first control means for performing control including the content sharing program.

  According to a fourth aspect of the present invention, the second device in the content sharing system comprising the first device and the second device and sharing the content with the content sharing system existing on the partner station side. As a content sharing program for causing a computer to function as the second communication for communicating with the first communication means included in the first device and for connecting to the second network. And control of contents based on an instruction from the user is performed by the first control means included in the first device via the first communication means and the second communication means, and The second device accesses the content to be shared between the content sharing system on the side and the content sharing system on the other station side via the second network Second control means for performing communication related to the snap shared information between the first control means and the first control means via the first communication means, and the snap by the second control means. The second apparatus comprising: the second communication unit and an access unit that accesses the content via the second network based on the snap shared information obtained by communication related to shared information A content sharing program is provided which is characterized by functioning as:

  According to the present invention, it is possible to exchange text messages privately only between parties without providing a dedicated device in the communication network only for exchanging text messages.

It is a figure showing an example of the network structure between video conference apparatuses, and an example of the network structure between the server of an online service, and PC. It is a figure showing an example of the connection structure between a video conference apparatus and a control terminal when the video conference apparatus is equipped with two communication ports. It is a figure showing an example of the connection structure between a video conference apparatus and a control terminal in case the video conference apparatus is connected to NAT. It is a figure showing an example of the display screen which a control application produces | generates. It is a figure showing an example of the connection structure of the video conference apparatus which is embodiment of this invention, and a control terminal. It is a block diagram showing the functional block of the video conference apparatus which is embodiment of this invention, and a control terminal. It is a figure showing the list of functional operation | movement of this invention. It is a sequence diagram for demonstrating the reception operation between a video conference apparatus and a video conference apparatus. It is a sequence diagram for demonstrating the transmission operation | movement between a video conference apparatus and a video conference apparatus. It is a sequence diagram for demonstrating the deletion operation | movement between a video conference apparatus and a video conference apparatus. It is a sequence diagram for demonstrating the synchronization operation | movement between a video conference apparatus and a video conference apparatus. It is a sequence diagram for demonstrating the information list acquisition operation between a control terminal and a video conference apparatus. It is a sequence diagram for demonstrating the information transmission operation between a control terminal and a video conference apparatus. It is a sequence diagram for demonstrating the information acquisition operation between a control terminal and a video conference apparatus. It is a sequence diagram for demonstrating the information deletion operation | movement between a control terminal and a video conference apparatus. It is a sequence diagram for demonstrating the information synchronization operation | movement between a control terminal and a video conference apparatus. It is a sequence diagram for demonstrating the information notification operation | movement between a control terminal and a video conference apparatus. It is a block diagram showing a functional block at the time of using an ISDN network line for this embodiment.

  First, an outline of an embodiment of the present invention will be described.

  In the embodiment of the present invention, when a text message is to be exchanged between control terminals accessible to the online service during a video conference, a private information exchange means is not necessarily provided for the online service. One of the objects is to solve the problem that it is necessary to provide another device in the communication network for the exchange.

  In this embodiment, in order to solve this problem, a text message is exchanged via the video conference apparatus from the control terminal connected to the video conference apparatus, and the exchanged text message is read out. And in order to implement | achieve this exchange and reading, a controller is provided in a video conference apparatus and a control terminal.

  This makes it possible to exchange text messages via the video conference device connected to the control terminal. For example, the link information of the online service opened on the control application running on the control terminal of the local station can be transmitted to the control terminal of the partner station via the video conference apparatus.

  The above is the outline of the embodiment of the present invention.

  Next, embodiments of the present invention will be described in detail with reference to the drawings. In the following description, an operation in which a control terminal connected to a video conference device exchanges text messages via the video conference device is referred to as “snap sharing”. A text message exchanged by snap sharing is referred to as “snap sharing information”.

  First, the connection configuration between the video conference apparatus and the control terminal according to the embodiment of the present invention will be described.

  Referring to FIG. 5, the present embodiment includes a video conference device 110 and a video conference device 210, a control terminal 120 and a control terminal 220, and an online service server 330. In this description, the video conference device 110 and the control terminal 120 are referred to as “own station side”, and the video conference device 210 and the control terminal 220 are referred to as “other station side”. In addition, this time there is one “own station side” and one “partner station side”, but this is not intended to exclude the presence of multiple “partner station side”. It can be realized as a system having a plurality of “sides”.

  These components are connected via the IP network 310 and the IP network 320, and the router 311, the router 312, the router 321, and the router 322. Specifically, the control terminal 120 is connected to the video conference apparatus 110, and the control terminal 220 is connected to the video conference apparatus 210 in a communicable state. In addition, the video conference apparatus 110 and the video conference apparatus 210 are connected in a communicable state via the IP network 310. Furthermore, the control terminal 120, the control terminal 220, and the online service server 330 are connected to a communicable state via the IP network 320. These connections may be wired, but some or all of them may be wireless, and the communication method is not particularly limited.

  In FIG. 5, the video conference device 110 is connected to the control terminal 120 via the router 321, and similarly, the video conference device 210 is connected to the control terminal 220 via the router 322. Of course, this is just one connection example. For example, the control terminal 120 is provided with two communication ports (interfaces), and the communication port (interface) for connecting the control terminal 120 and the video conference apparatus 110 is connected to the control terminal 120 and the IP network 320. A communication port (interface) may be provided separately. In this case, the control terminal 120 and the video conference device 110 may be directly connected, may be connected via a relay device such as a hub, or may be connected via a wireless LAN access point or the like. Also good. In the present embodiment, the video conference device 110 and the IP network 320 are not necessarily connected. Therefore, the video conference apparatus 110 may not be connected to a device for connecting to the IP network 320 such as the router 321. These descriptions also apply to the video conference apparatus 210, the control terminal 220, and the router 322.

  Furthermore, although the IP network 310 and the IP network 320 are illustrated as independent networks in FIG. 5, this limits the implementation method of the present embodiment to those networks being physically completely separated. Not the purpose.

  It is also possible to realize both the IP network 310 and the IP network 320 by a single network (for example, the Internet). However, as described above, the background art has been described above. In particular, the connection between the video conference apparatus and the video conference apparatus is preferably realized by a secure method. If possible, the communication between the control terminal and the online service server is preferably fast. For this reason, even if the same Internet is used, the connection between the video conference apparatus and the video conference apparatus uses encryption technology such as VPN (Virtual Private Network) and HTTPS (Hypertext Transfer Protocol over Secure Socket Layer). A secure network is preferred.

  In that case, the IP network 310 is realized as a secure network provided inside the IP network 320. In other words, the IP network 310 and the IP network 320 can be logically and virtually separate networks constructed on the same network. In that case, the router 321 and the router 322 may be omitted.

  Here, the video conference device 110 and the video conference device 210 are devices for realizing a video conference. In addition, the control terminal 120 and the control terminal 220 are terminals that directly receive an operation from a user who performs a video conference. Further, the online service server 330 is a server device that realizes a server for realizing an online service. Each of these devices and terminals is realized by cooperation of dedicated hardware and software, but can also be realized by incorporating software unique to the present embodiment into a general-purpose PC or server device.

  The video conference apparatus 110, the video conference apparatus 210, the control terminal 120, and the control terminal 220 of the present embodiment each include a controller for realizing snap sharing.

  Specifically, the video conference device 110 controls the snap sharing information controller 112, the video conference device 210 controls the snap sharing information controller 212, the control terminal 120 controls the snap sharing client controller 121, and the control terminal 220 controls the snap sharing client control. A container 221 is included.

  Furthermore, the video conference apparatus 110 includes a snap shared information mailbox 111 that stores the replaced snap shared information. Similarly, the video conference apparatus 210 includes a snap shared information mailbox 211 that stores the replaced snap shared information. Contains.

  A snap sharing function for executing snap sharing is added to the control application 130 and the control application 230 installed in each control terminal.

  Specifically, it is possible to perform control related to a general video conference by using the video conference control screen 131 and the video conference control screen 231.

  Further, when it is desired to transmit the snap sharing information, the snap sharing information can be transmitted by pressing the snap sharing button 133 and the snap sharing button 233. When it is desired to browse the snap sharing information, the snap sharing information can be browsed by pressing the snap sharing information browsing button 132 and the snap sharing information browsing button 232. These buttons may be realized by assigning functions to physical keys, but may be realized by keys displayed on a display screen by software.

  Further, it is possible to present information related to the online service on the online service screen 134 and the online service screen 234.

  Next, the snap sharing information controller 112 and the snap sharing information controller 212, the snap sharing client controller 121, and the snap sharing client controller 221 shown in FIG. A detailed configuration will be described.

  FIG. 6 is a block diagram showing a functional configuration of the video conference apparatus 110 and the control terminal 120 and the snap sharing information controller 112 and the snap sharing client controller 121 included therein. In this example, the video conference apparatus 110 and the control terminal 120, and the snap sharing information controller 112 and the snap sharing client controller 121 included therein will be described as examples. The included snap sharing information controller 212 and the snap sharing client controller 221 also include the same functional configuration.

  Referring to FIG. 6, the snap sharing information controller 112 includes a snap sharing information mailbox controller 112-1, a snap sharing information communication controller 112-2, and a snap sharing information system controller 112-3.

  The snap sharing information communication controller 112-2 performs control for exchanging snap sharing information with a partner station and control for exchanging snap sharing information with the control terminal 120. In order to exchange the snap sharing information, the snap sharing information communication controller 112-2 is connected to the IP network interface 114 and the IP network interface 115 of the video conference apparatus 110.

  The snap shared information mailbox controller 112-1 reads / writes / deletes the snap shared information in the snap shared information mailbox 111 based on an instruction from the snap shared information system controller 112-3.

  Here, the snap shared information mailbox 111 indicates a memory for storing the snap shared information, and the snap shared information read / written / deleted from the snap shared information mailbox controller 112-1 is stored. Is done. The snap shared information mailbox 111 can be realized by an arbitrary storage device such as an HDD (Hard Disk Drive) or a Flash SSD (Solid State Drive). In the figure, the snap shared information mailbox 111 is included in the video conference device 110, but the snap shared information mailbox 111 may be realized by a storage device connected to the outside. Further, the snap shared information mailbox 111 may be realized by a single storage device, but may also be realized by cooperation of a plurality of storage devices.

  The snap shared information system controller 112-3 performs overall control for exchanging snap shared information with the video conference device or the control terminal 120 of the other station. The snap shared information system controller 112-3 is related to system control of the video conference apparatus 110 main body. Therefore, the snap shared information system controller 112-3 is also connected to the system controller 113 that controls the entire video conference apparatus 110. In addition, although it is a functional block to which the system controller 113 is connected, in FIG. 6, it is illustrated using a broken line for the purpose of not limiting a specific configuration.

  The IP network interface 114 and the IP network interface 115 are interfaces for performing communication via the IP network 310 and the IP network 320, respectively.

  In FIG. 5, for convenience of explanation, the system controller 113, the IP network interface 114, and the IP network interface 115 are not shown. In addition, the constituent elements shown in the drawings are only parts particularly relevant to the operation of the present embodiment, and may include functional blocks other than those shown in the drawings.

  Next, the control terminal 120 will be described with reference to FIG. A snap sharing client controller 121 is added to the control terminal main body 120 as a function unique to this embodiment.

  Here, the snap sharing client controller 121 includes a snap sharing client system controller 121-1 and a snap sharing client communication controller 121-2.

  The snap sharing client communication controller 121-2 performs control for exchanging snap sharing information with the video conference apparatus 110. Further, in order to exchange snap sharing information, the snap sharing client communication controller 121-2 is connected to the IP network interface 123 of the control terminal main body 120.

  The snap sharing client system controller 121-1 performs overall control for handling snap sharing information and exchanging snap sharing information with the video conference device 110 in the control terminal. The snap sharing client system controller 121-1 is related to the system control of the control terminal body. Therefore, the snap sharing client system controller 121-1 is also connected to the system controller 122 that controls the entire control terminal 120. In addition, although it is a functional block which the system controller 122 connects, in FIG. 6, it has illustrated using the broken line with the meaning which does not limit a specific structure.

  Next, each controller included in the present embodiment (the snap sharing information controller 112, the snap sharing information controller 212, the snap sharing client controller 121, and the snap sharing client controller 221 shown in FIG. 5) cooperates. The operation realized by will be described.

  Referring to FIG. 7, the operation in the present embodiment is divided into an operation between the video conference device and the video conference device and an operation between the control terminal and the video conference device. Here, the operation shown in FIG. 7 is roughly divided into three.

  The first operation among the three operations is an operation for transmitting the snap sharing information from the own station to the partner station. This is an operation provided to transmit from the control terminal of the local station to the video conference apparatus of the partner station.

  Specifically, the information transmission operation 7-6 is an operation between the control terminal of the local station and the video conference device of the local station, and the transmission operation is an operation between the video conference device of the local station and the video conference device of the partner station. 7-2 is prepared.

  The second operation of the three operations is an operation for the control terminal of the local station to acquire snap sharing information from the video conference device of the local station. Since the snap sharing information transmitted from the partner station is stored in the snap sharing information mailbox of the own station, the operation is provided for browsing the snap sharing information from the control terminal of the own station.

  Specifically, the information list acquisition operation 7-5 is an operation between the control terminal and the video conference device for the purpose of acquiring a list of how much snap sharing information is stored in the snap sharing information mailbox. It is prepared. Further, an information acquisition operation 7-7 is prepared as an operation between the control terminal and the video conference device for the purpose of acquiring the snap sharing information from the snap sharing information mailbox. An information notification operation 7-10 is prepared as an operation between the control terminal and the video conference device for the purpose of notifying the control terminal of information from the snap shared information system controller.

  The third operation of the three operations is an operation for maintaining the snap shared information mailboxes in the local station and the partner station. It is assumed that unnecessary snap share information needs to be deleted from the snap share mailbox.

  Considering the actual operation, it is assumed that the operating conditions of the video conference device of the own station and the video conference device of the other station are different, and the contents of the snap shared mailboxes of the own station and the other station do not match. This is an operation provided for the purpose of eliminating such a scene.

  Specifically, for the purpose of deleting the snap sharing information, an information deleting operation 7-8 is prepared as an operation between the control terminal and the video conference device, and a deleting operation 7-3 is prepared as an operation between the video conference devices. For the purpose of eliminating the discrepancy in the snap shared information mailbox, an information synchronization operation 7-9 is provided as an operation between the control terminal and the video conference device, and a synchronization operation 7-4 is provided as an operation between the video conference devices.

  Subsequently, each operation represented by FIG. 7 performed by each functional block represented by FIGS. 5 and 6 will be described with reference to the sequence diagrams of FIGS.

  The receiving operation 7-1 is an operation performed between the video conference apparatus of the local station and the partner station, and is an operation for receiving the snap sharing information stored in the snap sharing information mailbox 211 of the communication destination.

  The operation of the receiving operation 7-1 will be described on the assumption that the local station receives the snap sharing information from the partner station. A description will be given with reference to FIG. 8, which is a diagram showing the sequence.

  When the reception operation 7-1 is performed in the own station, the snap sharing information controller 112 first enters a sequence for requesting the other station to receive the snap sharing information. The snap sharing information system controller 112-3 instructs the snap sharing information communication controller 112-2 to transmit a snap sharing information reception request packet (step S1). In response to this instruction, the snap sharing information communication controller 112-2 sends a snap sharing information reception request packet to the network (step S2). This snap sharing information reception request packet includes the storage number of the snap sharing information to be received.

  In the other station, the snap sharing information communication controller 212-2 receives the snap sharing information reception request packet, and the received snap sharing information reception request packet is notified to the snap sharing information system controller 212-3 (step S3). .

  The snap sharing information system controller 212-3 extracts the snap sharing information from the snap sharing information mailbox controller 212-1 based on the storage number included in the reception notification (steps S4 and S5).

  The snap shared information system controller 212-3 packetizes the extracted snap shared information, and sends the packetized snap shared information packet to the network via the snap shared information communication controller 212-2 (steps S6 and S6). Step S7).

  In the own station, the snap sharing information communication controller 112-2 receives the snap sharing information packet. The snap sharing information communication controller 112-2 issues a snap sharing information packet reception notification to the snap sharing information system controller 112-3 (step S8). In addition, the snap sharing information communication controller 112-2 instructs the snap sharing information mailbox controller 112-1 to store the snap sharing information in the snap sharing information mailbox 111 (step S9). . The snap share information mailbox controller 112-1 receives the snap share information storage instruction received from the snap share information communication controller 112-2 and stores the snap share information in the snap share information mailbox 111.

  On the other hand, the snap sharing information system controller 112-3 instructs the snap sharing information communication controller 112-2 to transmit a snap sharing information reception completion notification packet (step S10). In response to this instruction, the snap sharing information communication controller 112-2 sends a snap sharing information reception completion notification packet to the network (step S11).

  In the other station, the snap sharing information system controller 212-3 receives the snap sharing information reception completion notification packet via the snap sharing information communication controller 212-2 (step S12). As a result, the receiving operation 7-1 ends.

  The transmission operation 7-2 is an operation performed between the video conference apparatus of the local station and the partner station, and is an operation for transmitting the snap sharing information stored in the snap sharing mailbox 211 to the communication destination.

  The operation of the transmission operation 7-2 will be described on the assumption that the other station transmits snap shared information to the own station. The description will be given with reference to FIG. 9, which is a diagram showing the sequence.

  When the transmission operation 7-2 is performed at the partner station, the snap sharing information system controller 212-3 first enters a sequence for requesting the local station to transmit snap sharing information.

  The snap sharing information system controller 212-3 instructs the snap sharing information communication controller 212-2 to send a snap sharing information transmission request packet (step S21). In response to this instruction, the snap sharing information communication controller 212-2 sends a snap sharing information transmission request packet to the network (step S22). This snap sharing information transmission request packet includes the storage number of the snap sharing information to be transmitted.

  In the own station, the snap sharing information communication controller 112-2 receives the snap sharing information transmission request packet. Then, the snap shared information communication controller 112-2 notifies the received shared information transmission request packet to the snap shared information system controller 112-3 (step S23).

  The snap sharing information system controller 112-3 extracts the storage number of the snap sharing information included in the packet, and determines that the operation of the reception operation 7-1 for the storage number from the partner station is necessary.

  Then, the snap sharing information system controller 112-3 gives an instruction to send a snap sharing information transmission request response packet (step S24). In response to this instruction, the snap sharing information communication controller 112-2 sends a snap sharing information transmission request response packet to the network (step S25).

  In the other station, the snap shared information system controller 112-3 receives the snap shared information transmission request response packet via the snap shared information communication controller 112-2 (step S26).

  Thereafter, the local station executes the operation of receiving the snap shared information 7-1 corresponding to the storage number included in the shared information transmission request packet received in step S23 with respect to the partner station. That is, transmission from the own station is realized by making a reception request to the other station. Since the operation of the reception operation 7-1 has already been described above with reference to FIG. 8, illustration and description thereof are omitted here. This completes the transmission operation 7-2.

  The deletion operation 7-3 is an operation performed between the video conference apparatus of the local station and the partner station, and is an operation for deleting the snap sharing information stored in the snap sharing mailbox 211 of the communication destination.

  The operation of the deletion operation 7-3 will be described on the assumption that the local station makes a request to delete the snap shared information to the partner station. A description will be given with reference to FIG. 10 showing the sequence.

  When the deletion operation 7-3 is performed in the own station, the snap sharing information controller 112 first enters a sequence for requesting the other station to delete the snap sharing information.

  The snap sharing information system controller 112-3 instructs the snap sharing information communication controller 112-2 to transmit a snap sharing information deletion request packet (step S31). In response to this instruction, the snap sharing information communication controller 112-2 sends a snap sharing information deletion request packet to the network (step S32). This snap share information deletion request packet includes the storage number of the snap share information to be deleted.

  In the other station, the snap sharing information communication controller 212-2 receives the snap sharing information deletion request packet. Then, the snap shared information communication controller 212-2 notifies the received shared information deletion request packet to the snap shared information system controller 212-3 (step S33).

  The snap sharing information system controller 212-3 deletes the corresponding snap sharing information from the snap sharing information mailbox controller 212-1 based on the storage number included in the reception notification (step S34 and step S35). The snap sharing information system controller 212-3 instructs the snap sharing information communication controller 212-2 to transmit a snap sharing information deletion request response packet in order to notify that the deletion of the snap sharing information has been completed ( Step S36). In response to this instruction, the snap sharing information communication controller 212-2 sends a snap sharing information deletion request response packet to the network (step S37).

  In the local station, the snap sharing information system controller 112-3 receives the snap sharing information deletion request response packet via the snap sharing information communication controller 112-2. As a result, the deletion operation 7-3 ends.

  Synchronizing operation 7-4 is an operation performed between the own station and the teleconferencing station of the other station, and the snap sharing information stored in the snap sharing mail box 111 of the own station and the snap sharing mailbox 211 of the other station. This is an operation for matching.

  The synchronization operation 7-4 is prepared so that the control terminal of the local station and the partner station can browse the same snap shared information only by using the snap shared information mailbox on each side.

  The operation of the synchronization operation 7-4 will be described on the assumption that the own station synchronizes with the partner station. The description will be given with reference to FIG. 11, which is a diagram showing the sequence. FIG. 11 shows a sequence in which the own station synchronizes with the other station, and the own station transmits or receives excess and deficiency.

  When the synchronization operation 7-4 operates in the own station, first, the snap sharing information controller 112 enters a sequence for requesting the snap sharing information list from the other station. The snap sharing information system controller 112-3 instructs the snap sharing information communication controller 112-2 to transmit a snap sharing information list request packet (step S40). In response to this instruction, the snap sharing information communication controller 112-2 sends a snap sharing information list request packet to the network (step S41).

  In the other station, the snap sharing information communication controller 212-2 receives the snap sharing information list request packet, and the received snap sharing information list request packet is notified to the snap sharing information system controller 212-3 (step S42). .

  The snap sharing information system controller 212-3 takes out the snap sharing information list from the snap sharing information mailbox controller 212-1 based on the reception notification (step S43 and step S44).

  The snap shared information system controller 212-3 packetizes the extracted snap shared information list and sends a snap shared information list request response packet including the extracted extracted snap shared information list via the snap shared information communication controller 212-2. Then, it is transmitted on the network (step S45 and step S46).

  In the own station, the snap shared information system controller 112-3 receives the snap shared information list request response packet via the snap shared information communication controller 112-2 (step S47).

  The snap shared information system controller 112-3 instructs the snap shared information mailbox controller 112-1 to take out the snap shared information list in order to grasp the snap shared information list of its own station (step). S48). Upon receiving the instruction, the snap sharing information mailbox controller 112-1 takes out the snap sharing information list from the snap sharing information mailbox 111 and notifies the snap sharing information system controller 112-3.

  The snap sharing information system controller 112-3 compares the snap sharing information lists of the local station and the partner station, and checks whether there is excessive or insufficient snap sharing information. For the snap shared information that exists in the other station but not in the own station, the receiving operation 7-1 is performed on the storage number of the short amount of snap shared information from the other station. For the snap shared information that is in the local station but not in the partner station, the transmission operation 7-2 is performed on the storage number of the shortage of the shared snap information from the local station. This completes the synchronization operation 7-4. Since the reception operation 7-1 (see FIG. 8) and the transmission operation 7-2 (see FIG. 9) have already been described above, the description and illustration are omitted here.

  Next, the operation between the control terminal and the video conference device will be described. This time, the operation between the control terminal 120 and the video conference apparatus 110 will be described as an example. However, the control terminal 220 and the video conference apparatus 210 perform the same operations as the control terminal 120 and the video conference apparatus 110.

  The information list acquisition operation 7-5 is an operation performed between the control terminal and the video conference apparatus, and is an operation for the control terminal to acquire the storage list of the snap shared information mailbox.

  The information list acquisition operation 7-5 will be described. Description will be made with reference to FIG. 12, which is a diagram showing the sequence.

  In order to instruct the operation of the information list acquisition operation 7-5, the system controller 122 issues a snap sharing information list request to the snap sharing client system controller 121-1 (step S50). Upon receiving this request, the snap sharing client system controller 121-1 enters a sequence for requesting a snap sharing information list.

  The snap sharing client system controller 121-1 issues an instruction to send a snap sharing information list client request packet to the snap sharing client communication controller 121-2 (step S51).

  The snap sharing client communication controller 121-2 sends a snap sharing information list client request packet to the video conference device 110 (step S52).

  In the video conference apparatus 110, the snap sharing information communication controller 112-2 receives the snap sharing information list client request packet. Then, the snap sharing information communication controller 112-2 notifies the received snap sharing information list client request packet snap sharing information system controller 112-3 (step S53).

  Based on the reception notification, the snap sharing information system controller 112-3 issues a snap sharing information list extraction instruction to the snap sharing information mailbox controller 112-1 (step S54). In response to this instruction, the snap sharing information mailbox controller 112-1 takes out the snap sharing information list from the snap sharing information mailbox 111 and notifies the snap sharing information system controller 112-3 (step S55).

  The snap shared information system controller 112-3 packetizes the extracted snap shared information list and transmits the packetized snap shared information list client request response packet to the control terminal 120. -2 is instructed (step S56). In response to this, the snap sharing information communication controller 112-2 transmits a snap sharing information list client request response packet to the control terminal 120 (step S56).

  In the control terminal 120, the snap sharing client communication controller 121-2 receives the snap sharing information list client request response packet, and notifies the snap sharing client system controller 121-1 of the received snap sharing information list client request response packet. (Step S58).

  Upon receiving this notification, the snap sharing client system controller 121-1 notifies the system controller 122 of the snap sharing information list (step S59). This completes the information list acquisition operation 7-5.

  The information transmission operation 7-6 is an operation performed between the control terminal 120 and the video conference apparatus 110, and is an operation for transmitting the snap sharing information from the control terminal 120 to the snap sharing information mailbox of the local station and the partner station. .

  The information transmission operation 7-6 will be described. A description will be given with reference to FIG. 13 which shows the sequence.

  The system controller 122 issues a snap sharing information transmission request to the snap sharing client system controller 121-1 in order to instruct the operation of the information transmission operation 7-6 (step S60).

  In response to this request, the snap sharing client system controller 121-1 enters a sequence for requesting transmission of snap sharing information.

  The snap sharing client system controller 121-1 issues an instruction to the snap sharing client communication controller 121-2 to send a snap sharing information client transmission request packet (step S61). Receiving the instruction, the snap sharing client communication controller 121-2 sends a snap sharing information client transmission request packet to the video conference apparatus 110 (step S62).

  In the video conference apparatus 110, the snap sharing information communication controller 112-2 receives the snap sharing information client transmission request packet, and notifies the snap sharing information system controller 112-3 of the received snap sharing information client transmission request packet ( Step S63).

  The snap sharing information system controller 112-3 that has received the notification stores the snap sharing information included in the received snap sharing information client transmission request packet in the snap sharing information mailbox 111. A save instruction is issued for -1 (step S64).

  The snap shared information mailbox controller 112-1 performs storage according to the storage instruction, and then returns a storage completion notification to the snap shared information system controller 112-3 (step S65).

  Further, the snap shared information mailbox controller 112-1 executes the operation of the transmission operation 7-2 as the transmission operation from the own station, that is, each step shown in FIG.

  After executing the transmission operation 7-2, the snap sharing information system controller 112-3 instructs the snap sharing information communication controller 112-2 to transmit the snap sharing information client transmission request response packet (step S66). The snap sharing information communication controller 112-2 that has received the instruction transmits a snap sharing information client transmission request response packet to the control terminal 120 (step S67).

  In the control terminal 120, the snap shared client communication controller 121-2 receives the snap shared information client transmission request response packet, and notifies the received snap shared information client transmission request response packet to the snap shared information client system controller 121-1. (Step S68).

  The snap sharing information client system controller 121-1 that has received the notification thereafter notifies the system controller 122 of the completion of the transmission of the snap sharing information (step S69). This completes the information transmission operation 7-6.

  The information acquisition operation 7-7 is an operation performed between the control terminal 120 and the video conference device 110, and is an operation for transferring the snap sharing information from the snap sharing information mailbox to the control terminal 120.

  The information acquisition operation 7-7 will be described. A description will be given with reference to FIG. 14 showing the sequence.

  The system controller 122 requests the snap sharing client system controller 121-1 to retrieve the snap sharing information in order to instruct the operation of the information acquisition operation 7-7 (step S70).

  In response to this request, the snap sharing client system controller 121-1 enters a sequence for requesting extraction of snap sharing information.

  The snap sharing client system controller 121-1 issues an instruction to the snap sharing client communication controller 121-2 to send a snap sharing information client request packet (step S71). Upon receiving the instruction, the snap sharing client communication controller 121-2 sends a snap sharing information client request packet to the video conference device 110 (step S72).

  In the video conference apparatus 110, the snap sharing information communication controller 112-2 receives the snap sharing information client request packet, and notifies the received snap sharing information client request packet to the snap sharing information system controller 112-3 (step S73). ).

  Upon receipt of the notification, the snap sharing information system controller 112-3 extracts the snap sharing information from the snap sharing information mailbox 111 based on the received snap sharing information client request packet. (Step S74).

  The snap shared information mailbox controller 112-1 performs retrieval in accordance with the instruction, and then returns the retrieved snap shared information to the snap shared information system controller 112-3 (step S75).

  The snap sharing information system controller 112-3 issues an instruction to the snap sharing information communication controller 112-2 to transmit the snap sharing information packet (step S76). Receiving the instruction, the snap sharing information communication controller 112-2 transmits a snap sharing information packet to the control terminal 120 (step S77).

  In the control terminal 120, the snap sharing client communication controller 121-2 receives the snap sharing information packet, and notifies the snap sharing information client system controller 121-1 of the received snap sharing information packet (step S78).

  The snap sharing information client system controller 121-1 that has received the notification then notifies the system controller 122 of the snap sharing information included in the snap sharing information packet. This completes the information acquisition operation 7-7.

  The information deletion operation 7-8 is an operation performed between the control terminal 120 and the video conference apparatus 110, and is an operation for deleting the specified snap sharing information from the snap sharing information mailbox.

  The information deletion operation 7-8 will be described. Description will be made with reference to FIG. 15 which is a diagram showing the sequence.

  The system controller 122 issues a snap sharing information deletion request to the snap sharing client system controller 121-1 in order to instruct the operation of the information deleting operation 7-8 (step S80).

  In response to this request, the snap sharing client system controller 121-1 enters a sequence for deleting the snap sharing information.

  The snap sharing client system controller 121-1 issues an instruction to the snap sharing client communication controller 121-2 to send a snap sharing information client deletion request packet (step S81). Receiving the instruction, the snap sharing client communication controller 121-2 sends a snap sharing information client deletion request packet to the video conference apparatus 110 (step S82).

  In the video conference apparatus 110, the snap sharing information communication controller 112-2 receives the snap sharing information client deletion request packet, and notifies the snap sharing information system controller 112-3 of the received snap sharing information client deletion request packet ( Step S83).

  The snap sharing information system controller 112-3 that has received the notification deletes the snap sharing information specified by the received snap sharing information client deletion request packet from the snap sharing information mailbox 111. An instruction is issued to 112-1 (step S84).

  The snap shared information mailbox controller 112-1 performs deletion according to the instruction, and then returns a deletion completion notification to the snap shared information system controller 112-3 (step S85).

  Further, the snap shared information mailbox controller 112-1 executes the deletion operation 7-3, that is, each step shown in FIG. 10, as a deletion request to the other station.

  After execution of the delete operation 7-3, the snap shared information system controller 112-3 instructs the snap shared information communication controller 112-2 to transmit a snap shared information client delete request response packet (Step S3). S86). The snap sharing information communication controller 112-2 that has received the instruction transmits a snap sharing information client deletion request response packet to the control terminal 120 (step S87).

  In the control terminal 120, the snap sharing client communication controller 121-2 receives the snap sharing information client deletion request response packet, and notifies the snap sharing information client system controller 121-1 of the received snap sharing information client deletion request response packet. (Step S88).

  The snap sharing information client system controller 121-1 that has received the notification notifies the system controller 122 of the completion of deletion of the snap sharing information (step S89). Thereby, the information deletion operation 7-8 is completed.

  The information synchronization operation 7-9 is an operation performed between the control terminal 120 and the video conference device 110, and instructs an operation for matching the contents of the snap shared information mailbox between the local station and the partner station.

  The information synchronization operation 7-9 will be described. A description will be given with reference to FIG. 16, which is a diagram showing the sequence.

  In order to instruct the operation of the information synchronization operation 7-9, the system controller 122 issues a snap sharing information synchronization instruction to the snap sharing client system controller 121-1 (step S90).

  Upon receiving this instruction, the snap sharing client system controller 121-1 enters the snap sharing information synchronization sequence.

  The snap sharing client system controller 121-1 issues an instruction to the snap sharing client communication controller 121-2 to send a snap sharing information client synchronization request packet (step S91). Receiving the instruction, the snap sharing client communication controller 121-2 sends a snap sharing information client synchronization request packet to the video conference device 110 (step S92).

  In the video conference apparatus 110, the snap sharing information communication controller 112-2 receives the snap sharing information client synchronization request packet, and notifies the snap sharing information system controller 112-3 of the received snap sharing information client synchronization request packet. (Step S93).

  Upon receiving the notification, the snap sharing information system controller 112-3 performs the operation of the synchronization operation 7-4 in order to match the contents of the snap sharing information mailbox between the own station and the partner station, that is, each of the operations shown in FIG. Perform steps.

  After executing the synchronization operation 7-4, the snap shared information system controller 112-3 instructs the snap shared information communication controller 112-2 to transmit a snap shared information client synchronization request response packet. (Step S94). The snap sharing information communication controller 112-2 that has received the instruction transmits a snap sharing information client synchronization request response packet to the control terminal 120 (step S95).

  In the control terminal 120, the snap sharing client communication controller 121-2 receives the snap sharing information client synchronization request response packet, and sends the received snap sharing information client synchronization request response packet to the snap sharing information client system controller 121-1. (Step S96).

  The snap sharing information client system controller 121-1 that has received the notification then notifies the system controller 122 of the completion of the synchronization of the snap sharing information (step S97). This completes the information synchronization operation 7-9.

  The information notification operation 7-10 is an operation performed between the control terminal 120 and the video conference apparatus 110, and is an operation for notifying the control terminal 120 of information from the video conference apparatus 110 connected to the control terminal 120. The information notification is generated, for example, when notifying that the snap sharing information is received in response to a request from the other station.

  The information notification operation 7-10 will be described. Description will be made with reference to FIG. 17 which is a diagram showing the sequence.

  In the video conference apparatus 110, when the snap shared information system controller 112-3 needs to notify the control terminal 120 of information, the snap shared information system controller 112-3 transmits a snap shared information client information notification packet. Is instructed to the snap shared information communication controller 112-2 (step S101). The snap sharing information communication controller 112-2 that has received the instruction transmits a snap sharing information client information notification packet to the control terminal 120 (step S102).

  In the control terminal 120, the snap sharing client communication controller 121-2 receives the snap sharing information client information notification packet, and notifies the snap sharing information client system controller 121-1 of the received snap sharing information client information notification packet ( Step S103).

  The snap sharing information client system controller 121-1 that has received the notification then notifies the system controller 122 of a snap sharing information client information notification packet (step S104). This completes the information notification operation 7-10.

  Now, the operation of the present embodiment described above will be described based on specific cases. This time, an operation assuming a scene until the snap sharing information is transmitted from the control terminal 120 of the local station to the control terminal 220 of the partner station will be described. It is assumed that the video conference device 110 and the video conference device 210 are currently performing video conference communication. At the same time, it is assumed that the control terminal 120 and the control terminal 220 are accessing the online service server 330 from the control application 133 and the control application 230.

  Under such circumstances, a user operating the control terminal 120 at his / her own station (hereinafter referred to as an “operator”) also looks at the other party station on the online service screen 134 displayed on the control application 130. Suppose you want to tell the other station the link information of the online service.

  Then, in the control terminal 120, the snap sharing client controller 121 creates snap sharing information.

  This snap shared information is collected into one text message based on attributes such as link information of the online service opened by the control application 130.

  The operator presses the snap sharing button 133 of the control application 130 in order to transmit link information to the other station, and instructs transmission of the snap sharing information.

  Then, in the control terminal 120, the snap sharing client controller 121 creates snap sharing information.

  This snap shared information is collected into one text message based on attributes such as link information of the online service opened by the control application 130. Thereafter, the control terminal 121 performs the operation of information transmission operation 7-6. By this operation, the snap sharing information is stored in the snap request information mailbox 111 and then transmitted to the video conference device 210 of the partner station, and the snap sharing information is also stored in the snap sharing information mailbox 211 of the partner station.

  It is assumed that the operator who operates the control terminal 220 at the other station knows that the snap shared information has arrived from the operator's story through the video conference. When the snap sharing information is stored in the snap sharing information mail box 211 of the other station, the video conference device 210 may notify the control terminal 220 to that effect. In this case, the operator who operates the control terminal 220 at the other station knows that the snap shared information has arrived by the display on the control terminal 220.

  In any case, an operator who operates the control terminal 220 at the other station presses the snap shared information browsing button 232 in the control application 230 in order to take out the received snap shared information. Instruct removal.

  Then, the control terminal 220 executes the operation of information list acquisition operation 7-5. By this operation, the list of snap sharing information stored in the snap sharing information mailbox 211 is transmitted to the control terminal 220, and the control application 230 displays the list on the screen.

  The operator who operates the control terminal 220 at the partner station selects the item of the snap sharing information received this time according to the list displayed on the screen. Then, the control terminal 220 executes the operation of information acquisition operation 7-7 for the selected item. By this operation, the selected snap sharing information stored in the snap sharing information mailbox 320 is transmitted to the control terminal 220, and a message transmitted by the own station is displayed on the control application 230. In addition, the control application 230 accesses the online service server 330 based on the link information of the online service included in the snap sharing information transmitted to the control terminal 220, and information stored in the access destination is displayed on the control application 230. You may be made to do.

  Next, effects obtained by the embodiment of the present invention described above will be described. In the present embodiment, there are two types of communication destinations connected to the control terminal.

  One is a network for communicating with an online service, and the other is a network for communicating with a connected video conference device. Here, text messages can be exchanged via the latter network via a video conference device connected to the control terminal. For example, the link information of the online service opened on the control application running on the control terminal of the local station can be transmitted to the control terminal of the partner station via the video conference apparatus.

  With this configuration, the present embodiment further exhibits at least the following two effects.

  One effect is that a secure route that ensures privacy can be established. This is an effect that private communication between the parties can be realized. The video conference network is often a dedicated network, that is, a secure network, for securing a communication band. For this reason, a network independent from the network used for the online service can be prepared, so that a secure path can be constructed.

  Another effect is that by adding a process for exchanging text messages to the video conference device and the control terminal, it is not necessary to install another device in the communication network. Since video conferencing equipment and between video conferencing equipment and control terminals are connected to a network, if a process for bridging text messages is installed in the video conferencing equipment, text messages can be sent from the control terminal of the local station to the control terminal of the partner station. You can establish a route to communicate. Thus, by providing a control process for bridging the video conference apparatus and the control terminal, it is possible to eliminate the need for another apparatus in the communication network.

  Next, an example in which the IP network 310 used in the video conference is realized by an ISDN network will be described as a specific example of the present embodiment described above.

  Recently, video conferencing has used an IP network, but the ISDN network has been used about 10 years ago, and the ISDN network is still used overseas. Even in Japan, it is quite possible to use the ISDN network. Therefore, this time, a specific example using an ISDN network is taken as an example.

  Here, as one of the communication protocols used in the video conference using the ISDN network, ITU-T uses H.264. 320 is standardized. In this example, this H.264. A configuration using a video conference using 320 will be described.

  FIG. 17 shows the basic configuration shown in FIG. It is a figure showing the structure at the time of incorporating the video conference apparatus based on 320. FIG.

  Compared with the video conference device 110, the video conference device 510 is H.264. The difference is that a 320 controller 516 is added. Another difference is that the IP network interface 114 is an ISDN interface 514.

  H. 320 controller 516, using ISDN network 610. 320 is responsible for control for realizing video conference communication by H.320 and is capable of communicating through the ISDN network 610. 320 is a part for processing generation / separation of a communication stream conforming to 320.

  As described above, the IP network interface 114 in FIG. 6 is the ISDN network interface 514, and the IP network 310 is replaced with the ISDN network 610.

  The snap shared information communication controller 512-2 is connected to the partner station and H.264. H.320 to exchange snap sharing information through the communication protocol. A 320 controller 516 is also connected. By adopting such a configuration, it is possible to exchange snap shared information even in a video conference apparatus compatible with other than the IP network.

  As still another modification, it is conceivable to use the snap sharing information as a transmission means for transmitting control information to the control terminal of the counterpart station. That is, not only to convey a message such as link information to the snap sharing information, but also, for example, by transmitting the control information of the application running on the control terminal to the control terminal of the partner station, the control realized by the own station can be controlled. It can be reproduced by the other station. In this case, the system controller of the own station must convert the control information within a range that can be expressed by the snap shared information, and the system controller of the other station needs to perform the inverse conversion.

  In addition, in the above-described embodiment, the video conference, that is, both voice and video are exchanged via the video conference device. However, only either voice or video may be exchanged. For example, the present embodiment may be applied to a videophone system that exchanges only voice.

  Note that each of the video conference device and the control terminal can be realized by hardware, software, or a combination thereof. Further, the message communication control method performed by the video conference apparatus and the control terminal can be realized by hardware, software, or a combination thereof. Here, “realized by software” means realized by a computer reading and executing a program.

  The program may be stored using various types of non-transitory computer readable media and supplied to the computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD- R, CD-R / W, semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)). The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer HDD readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

  A part or all of the above-described embodiment can be described as in the following supplementary notes, but is not limited thereto.

(Appendix 1) A content sharing system for sharing content with a content sharing system existing on the other station side,
A first device and a second device;
The first device includes:
A first network for communicating with a first device on a partner station side provided in a partner-side content sharing system existing on the partner station side via the first network, and for communicating with the second device; Communication means;
For storing snap sharing information for the second device to access via the second network for content to be shared between the content sharing system and the content sharing system existing on the partner station side Storage means;
Storage control means for accessing the storage means with respect to the snap sharing information;
First control means for performing control including causing the first communication means to perform communication relating to the snap sharing information and causing the storage control means to perform the access relating to the snap sharing information; ,
With
The second device includes:
Communicating with the first communication means, and further, a second communication means for connecting to the second network;
Control of contents based on an instruction from a user is performed by the first control unit via the first communication unit and the second communication unit, and further communication regarding the snap sharing information is performed in the first communication unit. Second control means for performing communication between the communication means and the first control means via the second communication means;
Access means for accessing the content via the second communication means and the second network based on the snap sharing information obtained by the communication related to the snap sharing information by the second control means. When,
A content sharing system comprising:

(Supplementary note 2) The content sharing system according to supplementary note 1, wherein
The control performed by the first control means is
Transmission of the snap sharing information to the partner station side first device, reception of the snap sharing information from the partner station side first device, and the snap sharing information stored in the partner station content sharing system A request to delete, synchronization of the list of snap shared information stored in the storage means and the list of snap shared information stored in the storage means included in the first device on the other station side, and the first A content sharing system including at least one of transmission of snap sharing information from the device to the second device.

(Supplementary note 3) The content sharing system according to supplementary note 1 or 2,
The control that the second control unit causes the first control unit to perform is as follows:
Acquisition of a list of the snap shared information stored in the storage means, transmission of the snap shared information to the first device on the partner station side, reception of the snap shared information from the first device on the partner station side , Deletion of the snap sharing information stored in the storage means, a list of snap sharing information stored in the storage means, and snap sharing information stored in the storage means of the first apparatus on the counterpart station side A content sharing system including at least one of the list synchronizations.

(Supplementary note 4) The content sharing system according to any one of supplementary notes 1 to 3,
The content sharing system, wherein the content is content that can be accessed by the second device or the content sharing system on the other station side.

(Supplementary note 5) The content sharing system according to any one of supplementary notes 1 to 4,
A content sharing system that realizes a conference between a local station and a partner station.

(Supplementary note 6) The content sharing system according to supplementary note 5,
The content sharing system, wherein the first communication means communicates information necessary for the conference, and the second device outputs information necessary for the conference to participants of the conference.

  (Supplementary note 7) A content sharing expansion system comprising a plurality of content sharing systems according to any one of supplementary notes 1 to 6.

(Supplementary Note 8) A content sharing method performed by a local content sharing system for sharing content with a content sharing system existing on the partner station side,
The local station content sharing system includes a first device and a second device,
The first communication means of the first device communicates with the partner station side first device provided in the partner station side content sharing system existing on the partner station side via the first network, and Communicating with a second device;
For the content to be shared between the content sharing system on the local station side and the content sharing system existing on the other station side, the storage unit of the first device is configured to allow the second device to pass through the second network. Storing snap sharing information for accessing
The storage control means of the first device accessing the storage means with respect to the snap sharing information;
The first control unit of the first device causes the first communication unit to perform communication regarding the snap sharing information, and causes the storage control unit to perform the access regarding the snap sharing information. Steps for performing control including:
A second communication means of the second device communicates with the first communication means and further connects to the second network;
The second control means of the second device causes the first control means to control the content based on the instruction from the user via the first communication means and the second communication means, A step of performing communication related to the snap sharing information between the first communication unit and the first control unit via the second communication unit;
Based on the snap sharing information obtained by the communication related to the snap sharing information by the second control means, the access means of the second device is connected to the second communication means and the second network. Accessing the content;
A content sharing method comprising:

(Additional remark 9) It is provided with a first device and a second device for causing a computer to function as the first device in the content sharing system for sharing content with the content sharing system existing on the partner station side A content sharing program,
The computer,
A first network for communicating with a first device on a partner station side provided in a partner-side content sharing system existing on the partner station side via the first network, and for communicating with the second device; Communication means;
For storing snap sharing information for the second device to access via the second network for content to be shared between the content sharing system and the content sharing system existing on the partner station side Storage means;
Storage control means for accessing the storage means with respect to the snap sharing information;
First control means for performing control including causing the first communication means to perform communication relating to the snap sharing information and causing the storage control means to perform the access relating to the snap sharing information; ,
A content sharing program that causes the first apparatus to function as the first apparatus.

(Additional remark 10) For making a computer function as said 2nd apparatus in the content sharing system provided with a 1st apparatus and a 2nd apparatus, and sharing a content with the content sharing system which exists in the other party side A content sharing program,
The computer,
Communicating with a first communication means included in the first device, and further, a second communication means for connecting to a second network;
Control of contents based on an instruction from the user is performed by the first control means included in the first apparatus via the first communication means and the second communication means, and the content on the local station side Communication related to snap sharing information for the second device to access the content to be shared between the sharing system and the content sharing system existing on the partner station side via the second network Second control means for performing communication between the communication means and the first control means via the second communication means;
Access means for accessing the content via the second communication means and the second network based on the snap sharing information obtained by the communication related to the snap sharing information by the second control means. When,
A content sharing program that is caused to function as the second device.

(Appendix 11)
Provided in video conferencing equipment,
A snap sharing information mailbox which is a medium for storing snap sharing information;
A snap shared information mailbox controller that is a controller for reading and writing the snap shared information mailbox and the snap shared information;
In order to operate the snap shared information mailbox of the local station and the partner station, control is performed on the snap shared information mailbox controller of the local station and the snap shared information system controller of the partner station, and the snap shared information client system A snap shared information system controller that is a controller that controls the controller;
Snap shared information communication controller, which is a controller that performs information conversion for communicating with the other party's snap shared information system controller via the network,
Provided in the control terminal,
A snap shared information client system controller, which is a controller that performs control for operating the snap shared information system controller;
A message communication controller comprising a snap sharing client communication controller that is a controller that performs information conversion for communicating with a snap sharing information system controller via a network.

  The present invention is suitable for communication control of an arbitrary message in an arbitrary system such as a video conference system or a video phone system.

110, 210, 1001, 1006 Video conferencing apparatus 111, 211 Snap shared information mailbox 112, 212 Snap shared information controller 112-1, 212-1 Snap shared information mailbox controller 112-2, 212-2 Snap shared information Communication controller 112-3, 212-3 Snap shared information system controller 113, 213, 122, 222 System controller 114, 115, 214, 215, 123, 223 IP network interface 120, 220, 1013 Control terminal 121, 221 Snap sharing client controller 121-1, 212-1 Snap sharing client system controller 121-2, 221-2 Snap sharing client communication controller 130, 230 Control application 131, 231 Television conference Control screen 132, 232 Snap shared information browsing button 133, 233 Snap shared button 134, 234 Online service screen 310, 320 IP network 311, 312, 321, 322, 1002, 1005, 1008, 1010 Router 330, 1007 Online service server 516 H. 320 controller 514 ISDN network interface 610 ISDN network 1000 partner station 1003 WAN
1004 Own station 1009 Internet 1011 PC
1012 Hub 1014 NAT / Router

Claims (10)

A content sharing system for sharing content with a content sharing system on the other station side,
A first device and a second device;
The first device includes:
A first network for communicating with a first device on a partner station side provided in a partner-side content sharing system existing on the partner station side via the first network, and for communicating with the second device; Communication means;
For storing snap sharing information for the second device to access via the second network for content to be shared between the content sharing system and the content sharing system existing on the partner station side Storage means;
Storage control means for accessing the storage means with respect to the snap sharing information;
First control means for performing control including causing the first communication means to perform communication relating to the snap sharing information and causing the storage control means to perform the access relating to the snap sharing information; ,
With
The second device includes:
Communicating with the first communication means, and further, a second communication means for connecting to the second network;
Control of contents based on an instruction from a user is performed by the first control unit via the first communication unit and the second communication unit, and further communication regarding the snap sharing information is performed in the first communication unit. Second control means for performing communication between the communication means and the first control means via the second communication means;
Access means for accessing the content via the second communication means and the second network based on the snap sharing information obtained by the communication related to the snap sharing information by the second control means. When,
A content sharing system comprising: The content sharing system according to claim 1,
The control performed by the first control means is
Transmission of the snap sharing information to the partner station side first device, reception of the snap sharing information from the partner station side first device, and the snap sharing information stored in the partner station content sharing system A request to delete, synchronization of the list of snap shared information stored in the storage means and the list of snap shared information stored in the storage means included in the first device on the other station side, and the first A content sharing system including at least one of transmission of snap sharing information from the device to the second device. The content sharing system according to claim 1 or 2,
The control that the second control unit causes the first control unit to perform is as follows:
Acquisition of a list of the snap shared information stored in the storage means, transmission of the snap shared information to the first device on the partner station side, reception of the snap shared information from the first device on the partner station side , Deletion of the snap sharing information stored in the storage means, a list of snap sharing information stored in the storage means, and snap sharing information stored in the storage means of the first apparatus on the counterpart station side A content sharing system including at least one of the list synchronizations. The content sharing system according to any one of claims 1 to 3,
The content sharing system, wherein the content is content that can be accessed by the second device or the content sharing system on the other station side. The content sharing system according to any one of claims 1 to 4,
A content sharing system that realizes a conference between a local station and a partner station. The content sharing system according to claim 5,
The content sharing system, wherein the first communication means communicates information necessary for the conference, and the second device outputs information necessary for the conference to participants of the conference.   A content sharing expansion system comprising a plurality of the content sharing systems according to claim 1. A content sharing method performed by the local content sharing system for sharing content with a content sharing system existing on the partner station side,
The local station content sharing system includes a first device and a second device,
The first communication means of the first device communicates with the partner station side first device provided in the partner station side content sharing system existing on the partner station side via the first network, and Communicating with a second device;
For the content to be shared between the content sharing system on the local station side and the content sharing system existing on the other station side, the storage unit of the first device is configured to allow the second device to pass through the second network. Storing snap sharing information for accessing
The storage control means of the first device accessing the storage means with respect to the snap sharing information;
The first control unit of the first device causes the first communication unit to perform communication regarding the snap sharing information, and causes the storage control unit to perform the access regarding the snap sharing information. Steps for performing control including:
A second communication means of the second device communicates with the first communication means and further connects to the second network;
The second control means of the second device causes the first control means to control the content based on the instruction from the user via the first communication means and the second communication means, A step of performing communication related to the snap sharing information between the first communication unit and the first control unit via the second communication unit;
Based on the snap sharing information obtained by the communication related to the snap sharing information by the second control means, the access means of the second device is connected to the second communication means and the second network. Accessing the content;
A content sharing method comprising: A content sharing program for causing a computer to function as the first device in a content sharing system for sharing content with a content sharing system existing on a partner station side, comprising a first device and a second device There,
The computer,
A first network for communicating with a first device on a partner station side provided in a partner-side content sharing system existing on the partner station side via the first network, and for communicating with the second device; Communication means;
For storing snap sharing information for the second device to access via the second network for content to be shared between the content sharing system and the content sharing system existing on the partner station side Storage means;
Storage control means for accessing the storage means with respect to the snap sharing information;
First control means for performing control including causing the first communication means to perform communication relating to the snap sharing information and causing the storage control means to perform the access relating to the snap sharing information; ,
A content sharing program that causes the first apparatus to function as the first apparatus. A content sharing program for causing a computer to function as the second device in a content sharing system for sharing content with a content sharing system existing on a partner station side, comprising a first device and a second device There,
The computer,
Communicating with a first communication means included in the first device, and further, a second communication means for connecting to a second network;
Control of contents based on an instruction from the user is performed by the first control means included in the first apparatus via the first communication means and the second communication means, and the content on the local station side Communication related to snap sharing information for the second device to access the content to be shared between the sharing system and the content sharing system existing on the partner station side via the second network Second control means for performing communication between the communication means and the first control means via the second communication means;
Access means for accessing the content via the second communication means and the second network based on the snap sharing information obtained by the communication related to the snap sharing information by the second control means. When,
A content sharing program that is caused to function as the second device.

Images