JP5282701B2 - Remote conference system, remote conference terminal, and remote conference method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a remote conference system in which a called-side terminal which has received an originated call during absence of a user, allows the user returned to the called-side terminal to recognize a state of using a calling-side terminal. <P>SOLUTION: The called-side terminal 4 which has received a connection request from the calling-side terminal 3, transmits an absence notification to a conference management server 6 (T1-T6) if the user using the called-side terminal 4 is absent. The conference management server 6 which has received the absence notification, transmits an information request to the calling-side terminal 3 (T7, T8). The calling-side terminal 3 which has received the information request, transmits state information to the called-side terminal 4 via the conference management server 6 (T9-T12). On the basis of the state information received from the conference management server 6, the called-side terminal 4 reports a state of using the calling-side terminal 3 (T13). <P>COPYRIGHT: (C)2011,JPO&amp;INPIT

Description

  The present invention relates to a remote conference system, a remote conference terminal, and a remote conference method for executing a remote conference between conference terminals provided at a plurality of locations.

  Conventionally, a conference terminal is provided at a plurality of locations where a user exists, and a call-side conference terminal (hereinafter called a call-side terminal) and a call-side conference terminal (hereinafter called a call-side terminal) are connected via a network. Thus, there is a video conference system that performs a remote conference. In such a video conference system, when the user using the called terminal is absent, even if the called terminal receives a call from the calling terminal, the absent user immediately returns a reply. Can not do it. Therefore, a video conference system is known in which, when a callee terminal in the absence of a user receives a message from a partner who has already been registered in the list registration data, the other party who has received the message is registered at the head position of the list registration data. (For example, refer to Patent Document 1).

JP-A-8-317364

  In the video conference system described in Patent Literature 1, when the called terminal receives a message while the user is absent, the user who has returned to the called terminal refers to the name list registration data and receives the message. Can be identified and a reply to the message can be made. However, when the user replies to the message, it cannot be determined whether or not the other party using the calling terminal is present. When the calling terminal replies to a message despite the absence of the other party, there is a problem that the reply is wasted.

  The present invention has been made to solve the above-described problem, and when a call is made from a calling side terminal to a called side terminal in the absence of a user who uses the called side terminal, the called side It is an object of the present invention to provide a remote conference system, a remote conference terminal, and a remote conference method that allow a user who has returned to a terminal to grasp the usage state of a calling terminal.

  The remote conference system according to the first aspect of the present invention includes a plurality of remote conference terminals that are capable of acquiring at least one of image data and audio data from a predetermined range, and are connected to each other via a network. Each of which is a remote conference system for executing a remote conference by outputting conference data including at least one of the image data and the audio data acquired by each of the remote conference terminals. The terminal confirms that there is no call signal transmission means for transmitting a call signal for requesting connection to the one remote conference terminal to another remote conference terminal, and a user using the other remote conference terminal. When the absence information shown or the status request for requesting the usage status of the one remote conference terminal is received, the usage status of the one remote conference terminal is displayed. State determination means for refusing, and state information transmission means for transmitting state information indicating a use state of the one remote conference terminal to the other remote conference terminal based on a determination result of the state determination means, The other remote conference terminal is a user who uses the other remote conference terminal based on information acquired by the other remote conference terminal when the call signal is received from the one remote conference terminal. Absence determination means for determining whether or not the user is absent, and absence when transmitting the absence information or the status request to the one remote conference terminal when the absence determination means determines that the user is absent. A time signal transmission means, and a status notification means for notifying the usage status of the one remote conference terminal based on the status information when the status information is received from the one remote conference terminal. That.

  According to the first aspect, upon receiving a call signal from one remote conference terminal, the other remote conference terminal issues absence information or a status request if there is no user using the other remote conference terminal. When one remote conference terminal receives absence information or a status request from another remote conference terminal, the remote conference terminal issues status information regarding the usage status of the one remote conference terminal. The other remote conference terminal notifies the usage status of the one remote conference terminal based on the status information received from the one remote conference terminal. As a result, when a call is made from one remote conference terminal to another remote conference terminal in the absence of a user who uses another remote conference terminal, the user who has returned to the other remote conference terminal is The usage status of the conference terminal can be grasped.

  Further, in the first aspect, the state determining means is configured so that a user who uses the one remote conference terminal can use the one remote conference terminal as a usage state of the one remote conference terminal based on information acquired by the one remote conference terminal. You may determine whether you are absent. Thereby, the user who returned to the other remote conference terminal can grasp whether or not the user who uses one remote conference terminal is absent.

  Further, in the first aspect, the state determination means is configured to use the one remote conference terminal based on a connection state with the remote conference terminal different from the other remote conference terminal as a usage state of the one remote conference terminal. It may be determined whether or not the remote conference terminal is executing the remote conference. Thereby, the user who returned to the other remote conference terminal can grasp whether or not one remote conference terminal is executing the remote conference.

  Further, in the first aspect, the state informing means, when the usage state of the one remote conference terminal indicated in the state information is a usage state suitable for connection with the other remote conference terminal, The absence determination unit further performs notification to urge the connection with the one remote conference terminal when the state notification unit further notifies the connection with the one remote conference terminal. Based on information acquired by the terminal, it is determined whether or not there is a user who uses the other remote conference terminal, and the other remote conference terminal is determined by the absence determination means that the user exists. In this case, response signal transmission means for transmitting a response signal permitting connection with the other remote conference terminal to the one remote conference terminal may be provided. Thereby, when the user who uses another remote conference terminal returns, if the user who uses one remote conference terminal exists, both remote conference terminals can be connected automatically.

  A remote conference terminal according to a second aspect of the present invention is a remote conference terminal capable of performing a remote conference by connecting to each other via a network, and at least image data and audio data from a predetermined range in the remote conference terminal. At least one of the image data and the audio data acquired by the plurality of remote conference terminals when the terminal information acquisition means for acquiring one and a plurality of the remote conference terminals are connected to each other via the network A conference data output means for outputting conference data including one; a call signal transmission means for transmitting a call signal for requesting connection to the other remote conference terminal; and the other remote conference terminal as a response to the call signal. Absence information indicating that the user to be used is absent, or a status request for requesting the usage status of the remote conference terminal is received. And a status determination unit that determines a usage status of the remote conference terminal, and status information indicating a usage status of the remote conference terminal based on a determination result of the status determination unit, the status information indicating the usage status of the remote conference terminal. And status information transmitting means for transmitting to.

  According to the second aspect, after the remote conference terminal transmits a call signal for requesting connection to another remote conference terminal and receives absence information or a status request as a response, the remote conference terminal receives status information on the usage status of the remote conference terminal. To other remote conference terminals. As a result, when another remote conference terminal that has received a call from the remote conference terminal is in the absence of the user, the user who has returned to the other remote conference terminal changes the usage status of the remote conference terminal on the calling side. I can grasp it.

  A remote conference terminal according to a third aspect of the present invention is a remote conference terminal capable of performing a remote conference by connecting to each other via a network, and at least image data and audio data from a predetermined range in the remote conference terminal. At least one of the image data and the audio data acquired by the plurality of remote conference terminals when the terminal information acquisition means for acquiring one and a plurality of the remote conference terminals are connected to each other via the network The remote conference based on information obtained by the remote conference terminal when a call data requesting connection is received from another conference data output means for outputting conference data including one and the other remote conference terminal Absence determination means for determining whether or not the user using the terminal is absent, and the absence of the user by the absence determination means If it is determined, the absence information indicating that the user using the remote conference terminal is absent, or the status request for requesting the usage status of the other remote conference terminal is sent to the other remote conference terminal. When the status information indicating the use status of the other remote conference terminal is received as a response to the absence information or the status request, the other signal transmission means for transmitting to the other information based on the status information. A state notifying unit for notifying the usage state of the remote conference terminal.

  According to the third aspect, when the remote conference terminal receives a call signal from another remote conference terminal, if there is no user using the remote conference terminal, the remote conference terminal transmits absence information or a status request to the other remote conference terminal. To do. When the status information is received as a response to the absence information or the status request, the usage status of one remote conference terminal is notified based on the status information. As a result, when the remote conference terminal that has received a call from another remote conference terminal is in the absence of the user, the user who has returned to the called remote conference terminal can change the usage status of the other remote conference terminal. I can grasp it.

  A remote conference terminal according to a fourth aspect of the present invention is a remote conference terminal that can perform a remote conference by connecting to each other via a network, and at least image data and audio data from a predetermined range in the remote conference terminal. At least one of the image data and the audio data acquired by the plurality of remote conference terminals when the terminal information acquisition means for acquiring one and a plurality of the remote conference terminals are connected to each other via the network The conference data output means for outputting the conference data including one, the call signal transmitting means for transmitting one call signal for requesting connection to the one remote conference terminal, and the one call signal as a response to the one call signal, Requests one absence information indicating that the user using the remote conference terminal is absent, or the usage status of the remote conference terminal. When the status request is received, the status determination means for determining the usage status of the remote conference terminal, and one status information indicating the usage status of the remote conference terminal based on the determination result of the status determination means When a call signal requesting a connection is received from another remote conference terminal that is the same as or different from the one remote conference terminal, the status information transmitting means for transmitting to the one remote conference terminal and the remote conference terminal Based on the acquired information, the absence determination means for determining whether or not the user who uses the remote conference terminal is absent; and when the absence determination means determines that the user is absent, the remote Other absence information indicating that the user who uses the conference terminal is absent or another status request for requesting the usage status of the other remote conference terminal is transmitted to the other remote conference terminal. Based on the status information when other status information indicating the usage status of the other remote conference terminal is received as a response to the other absence information or the other status request. And status notification means for reporting the usage status of the other remote conference terminal.

  According to the fourth aspect, after the remote conference terminal transmits a call signal for requesting connection to another remote conference terminal and receives absence information or a status request as a response, the remote conference terminal receives status information regarding the usage status of the remote conference terminal. To other remote conference terminals. As a result, when one remote conference terminal that has received a call from the remote conference terminal is in the absence of the user, the user who has returned to the one remote conference terminal changes the usage status of the remote conference terminal on the calling side. I can grasp it.

  When the remote conference terminal receives a call signal from another remote conference terminal, if there is no user using the remote conference terminal, the remote conference terminal transmits absence information or a status request to the other remote conference terminal. When the status information is received as a response to the absence information or the status request, the usage status of one remote conference terminal is notified based on the status information. As a result, when the remote conference terminal that has received a call from another remote conference terminal is in the absence of the user, the user who has returned to the called remote conference terminal can change the usage status of the other remote conference terminal. I can grasp it.

  The remote conference method according to the fifth aspect of the present invention includes a plurality of remote conference terminals each capable of acquiring at least one of image data and audio data from a predetermined range, and connected to each other via a network. Is a remote conference method processed by a remote conference system that executes a remote conference by outputting conference data including at least one of the image data and the audio data acquired by each of the remote conference terminals. A call signal transmitting step of transmitting a call signal for requesting connection with the one remote conference terminal to the other remote conference terminal designated by the user at the one remote conference terminal; and When the call signal is received by the terminal, the other remote conference terminal is changed based on the information acquired by the other remote conference terminal. An absence determination step for determining whether or not a user to be used is absent, and a user who uses the other remote conference terminal is absent when the absence determination step determines that the user is absent. Or the absence request signal transmission step of transmitting to the one remote conference terminal a status request for requesting the usage status of the one remote conference terminal, and the absence information or A state determination step for determining a use state of the one remote conference terminal when the state request is received, and a state indicating the use state of the one remote conference terminal based on a determination result of the state determination step A status information transmission step for transmitting information to the other remote conference terminal; and when the status information is received by the other remote conference terminal, the status information And a state informing step for informing a use state of said one of the remote conference terminal based.

  According to the fifth aspect, when a call signal is received from one remote conference terminal in another remote conference terminal, absence information or a status request is issued if there is no user using the other remote conference terminal. . When one remote conference terminal receives absence information or a status request from another remote conference terminal, status information regarding the usage status of the one remote conference terminal is issued. In another remote conference terminal, the usage status of the one remote conference terminal is notified based on the status information received from the one remote conference terminal. As a result, when a call is made from one remote conference terminal to another remote conference terminal in the absence of a user who uses another remote conference terminal, the user who has returned to the other remote conference terminal is The usage status of the conference terminal can be grasped.

1 is a diagram illustrating an overall configuration of a video conference system 1. FIG. It is a block diagram which shows the electrical structure of the conference terminals 3, 4, and 5. FIG. 3 is a block diagram showing an electrical configuration of a conference management server 6. FIG. 3 is a timing chart showing the flow of various data among a calling terminal 3, a conference management server 6, and a called terminal 4. It is a flowchart of the continuous process performed by the conference terminals 3, 4, and 5. 4 is a flowchart of outgoing call processing executed by a calling terminal 3; 10 is a flowchart of relay processing executed by the conference management server 6. 4 is a flowchart of a reception process executed by a called terminal 4; It is a flowchart of a user standby process (S121). It is a figure which illustrates the video conference screen 280. It is a figure which illustrates the status alerting | reporting screen 290. FIG. It is another figure which illustrates the status alert | report screen 290. FIG. FIG. 6 is a diagram illustrating a stop notification screen 300. It is a flowchart of the process at the time of the transmission performed with the calling side terminal 3 which concerns on a modification. It is a flowchart of user waiting processing (S121) concerning a modification. It is a timing chart which shows the flow of various data among the calling side terminal 3, the conference management server 6, and the called side terminal 4 which concern on a modification.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, embodiments of the invention will be described with reference to the drawings. The drawings to be referred to are used for explaining the technical features that can be adopted by the present invention, and the configuration of the apparatus and the flowcharts of various processes described are not intended to be limited thereto. This is just an illustrative example.

  With reference to FIG. 1, the whole structure of the video conference system 1 which concerns on this embodiment is demonstrated. As shown in FIG. 1, in the video conference system 1 according to the present embodiment, a plurality of conference terminals respectively provided at a plurality of bases where users exist are connected to a network 2. In the video conference system 1 shown in FIG. 1, the conference terminal 3 is provided at the base A, the conference terminal 4 is provided at the base B, and the conference terminal 5 is provided at the base C. It is sufficient if a plurality of conference terminals are provided. Further, although the conference management server 6 is provided at the relay base, the conference management server 6 may be provided at any place connected to the network 2.

  In the video conference system 1 according to the present embodiment, the conference terminals 3, 4, 5 provided at each base are connected to each other by the conference management server 6. The video and audio acquired by the conference terminals 3, 4, and 5 are transmitted and received through the network 2. In each conference terminal 3, 4, 5, conference data obtained by synthesizing video and audio acquired at each base is created and output. Thereby, in each of the conference terminals 3, 4, and 5, the video and audio of the user existing at each base are synthesized and output in real time, and a remote conference (here, a video conference) is performed.

  With reference to FIG. 2, the electrical configuration of the conference terminals 3, 4, and 5 will be described. Since all the conference terminals 3, 4, 5 have the same configuration, only the configuration of the conference terminal 3 will be described here, and description of the other conference terminals 4, 5 will be omitted.

  The conference terminal 3 is provided with a CPU 20 as a controller that controls the conference terminal 3. Connected to the CPU 20 are a ROM 21 that stores BIOS, a RAM 22 that temporarily stores various data, and an I / O interface 30 that mediates data transfer. The I / O interface 30 is connected to a hard disk drive 31 (hereinafter referred to as HDD 31) having various storage areas. The I / O interface 30 includes a communication device 25 for communication connection to the network 2, a mouse 27, a video controller 23, a key controller 24, a camera 34 for photographing a user, and a user's voice. A microphone 35 for capturing, a speaker 36 for outputting sound, and a CD-ROM drive 26 are connected to each other. A display 28 is connected to the video controller 23. A keyboard 29 is connected to the key controller 24.

  The camera 34 has a shooting range, a focus, and the like set in advance so that a predetermined range in which a user using the conference terminal 3 is positioned can be suitably shot. In addition, the microphone 35 is set in advance with directivity, noise cut, and the like so as to appropriately capture an utterance within a predetermined range where a user using the conference terminal 3 is located. In addition, the output volume and output direction of the audio are also set so that the speaker 36 is suitable for listening within a predetermined range where the user using the conference terminal 3 is located.

  In the HDD 31, various data for executing a video conference (for example, video / audio acquired at each conference terminal 3, 4, 5 or conference data obtained by combining them) and a video conference are executed. The conference execution program is stored. The conference execution program stored in the HDD 31 includes a program for executing various processes (see FIGS. 5, 6, 8, and 9) related to interconnection between conference terminals 3, 4, and 5, which will be described later. The CD-ROM 114 inserted into the CD-ROM drive 26 stores the conference execution program. In the conference terminal 3, these programs and data can be set up in the HDD 31 by reading the CD-ROM 114 from the CD-ROM drive 26.

  The electrical configuration of the conference management server 6 will be described with reference to FIG. The conference management server 6 is a device that is connected to the conference terminals 3, 4, 5 provided at a plurality of bases via the network 2 and realizes interconnection between the conference terminals 3, 4, 5. The conference management server 6 includes a CPU 40, a ROM 41, a RAM 42, an I / O interface 50, and an HDD 51. The I / O interface 50 includes a communication device 45 for communicating with the network 2, a mouse 47, a key controller 44 that receives key inputs from the keyboard 49, and a video controller 43 that controls display of the display 48. Each is connected.

  The HDD 51 stores various data (for example, the IP address or telephone number of each conference terminal, connection information described later) for executing the interconnection between the conference terminals 3, 4, and 5, A relay control program for executing and managing the interconnection is stored. The relay control program stored in the HDD 51 includes a program for executing a relay process (see FIG. 7) described later.

  With reference to FIGS. 4-13, the process regarding the interconnection between each conference terminal 3,4,5 which performs a video conference is demonstrated in the video conference system 1 which concerns on this embodiment. In the video conference system 1, after the mutual connection is established between the conference terminals 3, 4, 5, the video conference proceeds by the mutual communication between the conference terminals 3, 4, 5. In the following, the conference terminal 3 at the site A is a calling terminal that requests connection to the conference terminal 4. The conference terminal 4 at the base B is a called terminal that is requested to connect from the conference terminal 3. A process flow until the mutual connection between the calling terminal 3 and the called terminal 4 is established will be described. Even if either one of the conference terminals 4 and 5 is a calling terminal and any one of the conference terminals 3 and 5 is a called terminal, the flow of processing until the mutual connection between the terminals is established is as follows. It is the same.

  First, the entire process of the video conference system 1 will be described with reference to the timing chart of FIG. When a user at site A issues a call instruction to site B (T1), a request to connect to site A is transmitted from the calling terminal 3 to the conference management server 6 (T2). When the conference management server 6 receives the connection request at the site A (T3), the connection request is transmitted to the called terminal 4 at the site B (T4). When the call request of the base A is received by the called terminal 4 (T5), the presence or absence of the user who uses the called terminal 4 is determined as will be described later. In the example of FIG. 4, it is assumed that there is no user using the called terminal 4. In this case, the absence notification of the base B is transmitted to the conference management server 6 according to the absence of the user who uses the called terminal 4 (T6). The absence notification of the base B is a signal indicating that the user who uses the called terminal 4 is absent.

  When the conference management server 6 receives the absence notification of the site B (T7), a status request for the site A is transmitted to the calling terminal 3 (T8). The status request for the base A is a signal requesting the usage status of the calling terminal 3. When the calling side terminal 3 receives a status request for the site A (T9), the usage state of the calling side terminal 3 is determined as described later. Then, a signal indicating the usage status of the calling terminal 3 (hereinafter referred to as the status information of the base A) is transmitted to the conference management server 6 (T10). In the example of FIG. 4, it is assumed that the calling terminal 3 is performing a video conference with another conference terminal 5 (that is, a video conference is being performed between the bases A and C). In this case, the status information of the base A indicating “in conference” is transmitted to the conference management server 6.

  When the conference management server 6 receives the status information of the site A (T11), the status information is transmitted to the called terminal 4 of the site B (T12). When the state information of the base A is received by the called terminal 4 (T13), notification is performed based on the state information of the base A (in the example of FIG. 4, “meeting”) as described later. Thereafter, the presence or absence of the user using the called terminal 4 (in other words, whether or not the user using the called terminal 4 has returned) is determined. In the example of FIG. 4, it is assumed that there is no user using the called terminal 4 when the state information is received at T13. In this case, the called terminal 4 waits for the next state information.

  After a predetermined time has elapsed since the previous transmission of the status information (T10), a status request for the site A is transmitted from the conference management server 6 to the calling terminal 3 as in T8 (T14). Similarly to T9 to T13, the state information of the base A is transmitted from the calling terminal 3 to the called terminal 4 via the conference management server 6 (T15, T16). The called terminal 4 performs notification based on the state information of the site A, and determines whether or not the user using the called terminal 4 has returned (T17). In the example of FIG. 4, it is assumed that the user who uses the called terminal 4 is present when the state information is received at T17. In this case, the called terminal 4 assumes that the user using the called terminal 4 has returned, and transmits a connection permission to the conference management server 6 (T18).

  When the conference management server 6 receives the connection permission for the site B (T19), the conference management server 6 transmits the connection permission to the calling terminal 3 (T20). When the connection permission of the base B is received by the calling terminal 3 (T21), the calling side is executed by the connection processing executed in each of the calling terminal 3, the conference management server 6, and the called terminal 4. An interconnection between the terminal 3 and the called terminal 4 is established. As a result, a video conference similar to the conventional one can be executed between the calling side terminal 3 and the called side terminal 4 (T22).

  In the following, referring to FIG. 5 to FIG. 8, processes executed in each of the calling side terminal 3, the conference management server 6, and the called side terminal 4 for realizing the overall processing of the video conference system 1. explain. In order to facilitate understanding, the timing chart shown in FIG. 4 and the screen examples shown in FIGS.

  With reference to FIG. 5, the continuous process performed by each conference terminal 3, 4, 5 will be described. The constant process (FIG. 5) is continuously executed by the CPU 20 until the conference terminals 3, 4, and 5 are turned off based on the conference execution program stored in the HDD 31, respectively. In the following, the constant process executed by the conference terminal 3 will be described, but the same process is executed by the other conference terminals 4 and 5.

  In the regular process shown in FIG. 5, a timer (not shown) is first reset (S1). When the timer is reset at S1, counting of elapsed time by the timer is started. Next, it is determined whether or not a user operation or voice is detected in the conference terminal 3 (S3). Specifically, when an input operation using the mouse 27 or the keyboard 29 is detected by a signal input to the CPU 20 via the I / O interface 30, it is determined that a user operation has been detected. (S3: YES). If a human voice (utterance) is detected from the voice acquired from the microphone 35 by known voice recognition, it is determined that the user voice has been detected (S3: YES). As described above, when the user's operation and voice are detected, it is considered that the user using the conference terminal 3 is present, so the process returns to S1, the timer is reset, and the elapsed time is counted from the beginning. The

  On the other hand, when neither a user operation nor voice is detected (S3: NO), it is determined whether no operation and no voice have continued for a predetermined time (S5). Here, if the elapsed time counted by the timer is equal to or longer than a predetermined time (for example, 10 minutes), it is determined that no operation and no sound have continued for a predetermined time (S5: YES). When no operation and no voice continues for a predetermined time, it is considered that the user who uses the conference terminal 3 is absent. Therefore, the still image α in the shooting range is acquired from the camera 34, and the still image α is stored in a predetermined storage area of the HDD 31 (S7). As a result, the predetermined storage area of the HDD 31 stores the still image α in the shooting range when the user using the conference terminal 3 is absent (that is, the background image when the user is absent). If the past still image α has been stored in the predetermined storage area of the HDD 31, the latest still image α acquired in S7 is overwritten and saved.

  When the elapsed time counted by the timer is less than a predetermined time (for example, 10 minutes) (S5: NO), no operation and no sound have not continued for the predetermined time, so that a fixed time (for example, 10 seconds) is waited. Is performed, and the process returns to S3. That is, when the user's operation and voice are not detected, S3 to S5 are repeatedly executed until no operation and no voice continues for a predetermined time (in other words, until the absence of the user is detected). After S7 is executed, the process returns to S1, the timer is reset, and the elapsed time is counted from the beginning.

  With reference to FIG. 6, the process at the time of the call origination terminal 3 is demonstrated. This process is continuously executed by the CPU 20 until the calling side terminal 3 is turned off based on the conference execution program stored in the HDD 31 of the calling side terminal 3. In the calling process shown in FIG. 6, for convenience, the flow for a call from one other site is shown, but a plurality of other sites can be called in parallel by executing this process a plurality of times.

  In the outgoing call process of the calling terminal 3 shown in FIG. 6, first, an input operation of the mouse 27 or the keyboard 29 is detected, and whether there is a call instruction for an arbitrary base (in this case, the base B) as a connection request destination. It is determined whether or not (S11). If there is no call instruction for site B (S11: NO), the process returns to S11 and waits for a call instruction. On the other hand, when there is a call instruction for the site B (S11: YES), a connection request for the site B is transmitted to the conference management server 6 (S13). In the example of the time chart shown in FIG. 4, T1 to T2 are executed by the processing of S11 to S13.

  After execution of S13, it is determined whether or not a status request for the site A has been received (S15). When the status request is received (S15: YES), the usage status of the calling terminal 3 is automatically determined by the following processing (S17 to S31), and information corresponding to the usage status is transmitted. First, it is determined whether or not the base A is executing a video conference with another base (S17). That is, when the calling side terminal 3 is performing a video conference with another conference terminal via the network 2 (S17: YES), the status information of the base A indicating “meeting” is the conference management server. 6 (S19).

  When the calling terminal 3 is not executing a video conference (S17: NO), the presence or absence of the user who uses the calling terminal 3 is automatically determined. First, a still image β in the shooting range is acquired from the camera 34 (S21), and it is determined whether or not a human face has been detected from the still image β (S23). Specifically, whether or not a human face is included in the still image β is analyzed by a known face recognition method. If a human face is detected from the still image β (S23: YES), it is considered that the user who uses the calling terminal 3 is present, so that the base indicating “standby” The state information of A is transmitted to the conference management server 6 (S29).

  When a human face is not detected from the still image β (S33: NO), the still image β and the still image α stored in the HDD 31 are compared. Then, it is determined whether or not the difference between the still images α and β (in other words, the ratio occupied by different parts comparing the still images α and β) is γ% or more (S35). That is, a change of a predetermined value or more (for example, 10% or more) occurs in the latest still image β in the calling terminal 3 on the basis of the still image α in the absence of the user acquired in the regular processing (see FIG. 5). It is determined whether or not. If the difference between the still images α and β is equal to or greater than γ% (S25: YES), the user is present because the change in the shooting range is large even when the human face is not reflected on the camera 34. In S29, the state information of the base A indicating “standby” is transmitted.

  If the difference between the still images α and β is less than γ% (S25: NO), it is determined whether or not the user's voice (utterance) is detected from the voice acquired from the microphone 35 (S27). . In S27, it is determined whether or not the voice acquired from the microphone 35 includes a human voice (utterance) by known voice recognition as in S3. If the user's voice (speech) is detected (S27: YES), it is considered that the user using the calling terminal 3 is present, so that it is “standby” in S29. The state information of the indicated base A is transmitted. On the other hand, when it is considered that the user who uses the calling terminal 3 is absent (S23, S25, and S27 are all NO), a request to cancel the site A is transmitted to the conference management server 6 (S31). The request for canceling the site A is a signal instructing to cancel the connection between the calling terminal 3 and the called terminal 4.

  In the example of the time chart shown in FIG. 4, T9 is executed by the process of S15, and T10 is executed by the processes of S17 to S29. In S19 and S23, it is preferable that the notification state of the state information in the calling terminal 3 is displayed on the display 28. For example, on the video conference screen 280 shown in FIG. 10, a notification display 281 is displayed together with the composite video of the video conference, and the calling side terminal 3 notifies the connection request destination base B of “meeting”. Is notified.

  When the status request for the site A has not been received (S15: NO), or after the execution of S19 and S29, it is determined whether or not the connection permission for the site B has been received (S33). When the connection permission of the site B has not been received (S33: NO), the process returns to S15 and waits for the next status request. In the example of the time chart shown in FIG. 4, T <b> 15 is executed by the processes of S <b> 15 to S <b> 29 in waiting for the next state request.

  When the connection permission of the site B is received (S33: YES), a connection process for the connection request destination site B is executed (S35). The connection process in S35 is a well-known connection process executed by the terminal on the calling side. Here, processing for establishing a connection to the calling side terminal 3 is performed in response to the called side terminal 4 receiving the connection permission of the calling side terminal 3. When S35 is executed, the process returns to S11 and waits for another call instruction. In the example of the time chart shown in FIG. 4, T21 is executed by the processing of S33 to S35. The calling terminal 3 and the called party are connected by connection processing (S35, S73 described later, S109 or S145 described later) executed in each of the calling terminal 3, the conference management server 6, and the called terminal 4. An interconnection with the terminal 4 is established. As a result, a video conference similar to the conventional one can be executed between the calling side terminal 3 and the called side terminal 4 (T22).

  The relay process of the conference management server 6 will be described with reference to FIG. This process is continuously executed by the CPU 40 based on the relay control program stored in the HDD 51 of the conference management server 6 until the conference management server 6 is powered off. In the relay processing shown in FIG. 7, for convenience, the flow of one set (two bases) of relay connection is shown, but by executing a plurality of this relay processing, a plurality of sets of relay connections can be executed in parallel. It is.

  In the relay process of the conference management server 6 shown in FIG. 7, it is determined whether or not a connection request for an arbitrary base (here, the base A) that is a connection request source has been received (S51). When the connection request for the site A has not been received (S51: NO), the process returns to S51 and waits for reception of the connection request. On the other hand, when the connection request for the site A is received (S51: YES), the connection request is transmitted to the called terminal 4 (S53). In the example of the time chart shown in FIG. 4, T3 to T4 are executed by the processing of S51 to S53.

  After the execution of S53, whether or not there is a response from the site B is determined by whether or not a response signal is received from the called terminal 4 (S55). When there is a response from the site B (S55: YES), it is determined whether or not the absence notification of the site B is received (S57). When there is no response from the site B (S55: NO), or when an absence notification is received from the site B (S57: YES), the connection information of the sites A and B is stored in a predetermined storage area of the HDD 51. (S59).

  When there is no response from the site B (S55: NO), for example, the response signal cannot be received due to power-off, failure or communication failure of the called terminal 4, and the mutual connection between the conference terminals 3 and 4 cannot be established. State. Further, when the absence notification of the base B is received (S55: NO), the user who uses the called terminal 4 is absent and the video conference cannot proceed between the conference terminals 3 and 4. is there. Therefore, in S59, when it is inappropriate to interconnect the calling side terminal 3 and the called side terminal 4, the combination of both conference terminals 3 and 4 and the IP address are transmitted to the conference management server 6 as connection information. Remembered.

  After the connection information is stored in the conference management server 6, a status request for the site A is transmitted to the calling terminal 3 (S61). In the example of the time chart shown in FIG. 4, T7 is executed by the processes of S55 to S57, and after the process of S59 is performed, T8 is executed by the process of S61.

  After the execution of S61, it is determined whether or not the status information of the base A has been received (S63). When the status information of the site A is received (S63: YES), the status information is transmitted to the called terminal 4 (S65). If the status information of the site A has not been received (S63: NO), it is determined whether or not a request to cancel the site A has been received (S67). When the cancellation request for the site A is received (S67: YES), the cancellation request is transmitted to the called terminal 4 (S69). After the request to cancel the site A is transmitted, the connection information of the sites A and B stored in the HDD 51 is deleted (S75), and the process returns to S51. That is, the connection between the calling side terminal 3 and the called side terminal 4 is stopped and another connection request is awaited. In the example of the time chart shown in FIG. 4, T11 to T12 are executed by the processing of S63 to S65.

  When the cancellation request for the site A has not been received (S67: NO), it is determined whether or not the connection permission for the site B has been received (S71). The connection permission for the site B is a signal transmitted to the conference management server 6 when connection processing (S109 and S145 described later) is executed at the called terminal 4. When the connection permission of the site B is not received (S71: NO), after waiting for a certain time (for example, 30 seconds), the process returns to S61. After the above-described S65 is executed, after waiting for a predetermined time (for example, 30 seconds), the process returns to S61. As a result, the conference management server 6 transmits a status request for the site A to the calling terminal 3 at regular intervals until a request for canceling the site A or a connection permission for the site B is received. In the example of the time chart shown in FIG. 4, T14 is executed by the process of S61 and T16 is executed by the processes of S63 to S65 after a predetermined time has elapsed since the previous transmission of the state information (T10).

  When the connection permission for the site B is received (S71: YES), a connection process between the sites A and B is executed (S73). The connection process of S73 is a known connection process executed by a relay device that mediates the connection between two terminals. Here, the connection permission of the called terminal 4 is transmitted to the calling terminal 3, and processing for mediating the mutual connection between the calling terminal 3 and the called terminal 4 is performed. When S73 is executed, the connection information of the base A and the base B is deleted (S75) in the same manner as after the execution of S69, and the process returns to S51 and waits for another connection request. In the example of the time chart shown in FIG. 4, after T19 to T20 are executed by the processes of S71 to S73, the process of S75 is performed.

  With reference to FIG. 8, the reception time process of the called terminal 4 will be described. This process is continuously executed by the CPU 20 based on the conference execution program stored in the HDD 31 of the called terminal 4 until the called terminal 4 is turned off. In the response process shown in FIG. 8, for convenience, the flow of a response to one other site is shown, but by executing this process a plurality of times, responses to a plurality of other sites can be executed in parallel.

  In the process at the time of reception of the called terminal 4 shown in FIG. 8, it is determined whether or not a connection request for an arbitrary base (here, the base A) that is a connection request source has been received (S101). When the connection request for the site A has not been received (S101: NO), the process returns to S101 and waits for reception of the connection request. On the other hand, when the connection request for the site A is received (S101: YES), it is determined whether or not an automatic response is set in the called terminal 4 (S103). The user of the called terminal 4 can arbitrarily set an automatic response or a manual response in advance. The automatic response or manual response set by the user is stored in a predetermined storage area of the RAM 22. The determination in S103 is made based on whether an automatic response or a manual response is stored in the RAM 22.

  When a manual response is set in the called terminal 4 (S103: NO), a connection request for the site A is displayed on the display 28 (S105). For example, the display 28 displays a notification screen including a comment “There was a call from the site A”. Then, it is determined whether or not there is a user operation within a certain period from the screen display of S105 (S107). Specifically, for example, it is determined whether or not an input operation using the mouse 27 or the keyboard 29 is detected within 30 seconds after the notification screen is displayed. If there is a user operation within a certain period from S105 (S107: YES), it is considered that the user using the called terminal 4 is present, and the connection to the connection requesting base A is made. Processing is executed (S109). The connection process in S109 is a known connection process executed by the called terminal. Here, as a connection permission for a call that is being executed by the calling side terminal 3, a signal that responds to the call is transmitted, and a process for establishing a connection to the calling side terminal 3 is performed.

  When an automatic response is set in the called terminal 4 (S103: YES), or when there is no user operation within a certain period from S105 (S107: NO), the called terminal 4 The presence or absence of the user who uses is automatically determined in the same manner as S21 to S27 in FIG. 6 (S111 to S117). When the user who uses the called terminal 4 is considered to be present (YES in any of S113, S115, and S117), the connection process of S109 is executed. On the other hand, when it is considered that the user who uses the called terminal 4 is absent (S113, S115, S117 are all NO), the absence notification of the site B is transmitted to the conference management server 6 (S119). In the example of the time chart shown in FIG. 4, T5 is executed by the process of S101, the processes of S103 to S117 are performed to detect the absence of the user, and T6 is executed by the process of S119.

  After the execution of S119, a user standby process for waiting for a return of the user who uses the called terminal 4 (that is, the usage state of the called terminal 4 changes from absence of the user to presence) is executed. (S121).

  As shown in FIG. 9, in the user standby process (S121), it is first determined whether or not the status information of the site A has been received (S131). When the status information of the site A is received (S131: YES), the status information is displayed on the screen of the display 28 (S133). Specifically, a status notification screen 290 as shown in FIGS. 11 and 12 is displayed on the display 28. The status notification screen 290 includes a connection request 291 indicating a call from the site A, a usage status 292 of the calling terminal 3 provided at the site A, and a call button 293 for connecting to the site A. Note that the usage state 292 in FIG. 11 indicates that the state information of the base A is “in meeting”. The use state 292 of FIG. 12 indicates that the state information of the base A is “standby”.

  After the execution of S133, it is determined whether or not the call button 293 has been pressed via the mouse 27 or the keyboard 29 on the state notification screen 290 (S135). When the call button 293 is pressed (S135: YES), a connection process for the connection request source site A is executed (S145). The connection process in S145 is a known connection process executed by the called terminal. Here, since the call from the calling side terminal 3 has already ended, a new connection request is transmitted to the calling side terminal 3 as connection permission for the call, and the connection to the calling side terminal 3 is established. Perform the process to establish.

  When the call button 293 is not pressed (S135: NO), the same processing as S111 to S117 in FIG. 8 is performed (S137 to 143). If it is assumed that the user who uses the called terminal 4 is present (any of S139, S141, and S143 is YES), the connection process of S145 is executed. That is, when the user returns to the base B, the presence of the user is detected by the called terminal 4 and the connection to the called terminal 4 is automatically performed. On the other hand, when the user who uses the called terminal 4 is regarded as absent (S139, S141, and S143 are all NO), the process returns to S131 and waits for the next state information.

  In the example of the time chart shown in FIG. 4, T13 is executed by the process of S131, and notification based on the state information of the base A is performed by the process of S133. At T10, since the status information of the base A indicating “meeting” is transmitted, the status notification screen 290 shown in FIG. 11 is displayed on the display 28 of the called terminal 4. When the state information is received at T13, the absence of the user is detected by the processing of S135 to S143, and the called terminal 4 waits for the next state information. And in waiting for the next state information, T17 is performed by the process of S131, and the notification based on the state information of the base A is performed by the process of S133. When the status information is received at T17, the presence of the user is detected by the processing of S135 to S143, and T18 is executed by the processing of S145.

  If the status information of the site A has not been received (S131: NO), it is determined whether or not a request to cancel the site A has been received (S147). When the cancellation request for the site A is received (S147: YES), the user standby process (FIG. 9) is terminated and the process returns to S101. That is, another connection request is awaited without executing the connection with the calling terminal 3. On the other hand, when the cancellation request for the site A has not been received (S147: NO), the process returns to S131 and waits for the next state information. Here, when the cancellation request for the site A is received (S147: YES), it is preferable that the display 28 displays on the display 28 that the processing is terminated without being connected to the calling terminal 3. . For example, on the cancellation notification screen 300 shown in FIG. 13, a connection request 301 indicating a call from the site A and a connection cancellation 302 based on the absence of the user at the site A are displayed.

  As described above, according to the video conference system 1 according to the present embodiment, the called terminal 4 that has received the connection request for the calling terminal 3 has no user who uses the called terminal 4. If there is, the absence notification is transmitted to the conference management server 6. Upon receiving the absence notification, the conference management server 6 transmits an information request to the calling terminal 3. The calling terminal 3 that has received the information request transmits state information to the called terminal 4 via the conference management server 6. The called terminal 4 notifies the usage state of the calling terminal 3 based on the state information received from the conference management server 6. As a result, when a call is made from the calling side terminal 3 to the called side terminal 4 while there is no user using the called side terminal 4, the user who has returned to the called side terminal 4 3 usage conditions can be grasped.

  By the way, in the said embodiment, the video conference system 1 corresponds to the "remote conference system" of this invention, and the conference terminals 3, 4, and 5 correspond to the "plural remote conference terminals" of this invention. In the calling terminal 3, the CPU 20 that executes S13 corresponds to the “calling signal transmitting means” of the present invention, and the CPU 20 that executes S17 and S21 to S27 corresponds to the “state determining means” of the present invention. The CPU 20 that executes S29 corresponds to the “status information transmitting unit” of the present invention. In the called terminal 4, the CPU 20 that executes S111 to S117 corresponds to the “absence determination means” of the present invention, and the CPU 20 that executes S119 corresponds to the “absence signal transmission means” of the present invention and executes S133. The CPU 20 that performs the processing corresponds to the “status notification unit” of the present invention, and the CPU 20 that executes S145 corresponds to the “response signal transmission unit” of the present invention.

  The camera 34 and the microphone 35 correspond to the “terminal information acquisition unit” of the present invention, and the CPU 20 that executes the video conference corresponds to the “conference data output unit” of the present invention. S13 corresponds to the “calling signal transmission step” of the present invention, S111 to S117 correspond to the “absence determination step” of the present invention, S119 corresponds to the “absence signal transmission step” of the present invention, and S17, S21. S27 corresponds to the “status determination step” of the present invention, S19 and S29 correspond to the “status information transmission step” of the present invention, and S133 corresponds to the “status notification step” of the present invention.

  In addition, this invention is not limited to the said embodiment, The change in the range which does not change the summary of invention is possible. In the above embodiment, the conference management server 6 controls the mutual connection of the conference terminals 3, 4, 5, and the video conference is executed between the conference terminals 3, 4, 5, but is not limited thereto. .

  For example, the conference management server 6 is connected to conference terminals 3, 4, and 5 provided at a plurality of bases via the network 2, and relays video, audio, data, etc., thereby performing a video conference between the multiple bases. It may be a multipoint control unit to be realized. In this case, the conference terminals 3, 4, and 5 have the same configuration as that of the above embodiment (FIG. 2), but at least functions as a client that participates in the video conference executed by the conference management server 6 (in detail, It is only necessary to have a function of transmitting video and audio to the conference management server 6 and a function of outputting conference data transmitted from the multi-site connection device.

  In the video conference system 1 having such a configuration, moving image data generated by the conference terminals 3, 4, and 5 provided at each base is transmitted to the conference management server 6 via the network 2. In the conference management server 6, conference data obtained by synthesizing the moving image data received from each base is created, and the conference data is transmitted to the conference terminals 3, 4, 5 via the network 2. In the conference terminals 3, 4, 5, the conference data received from the conference management server 6 is output. Thereby, the video and audio of the user existing at each base are synthesized in real time by the conference management server 6, and the synthesized conference data is output by each conference terminal 3, 4, 5 and a video conference is performed. .

  Further, if the conference terminals 3, 4, and 5 have a communication function for directly connecting to other conference terminals, it is not necessary to provide the conference management server 6. For example, the transmission time process of the calling terminal 3 shown in FIG. 14 is the same as the transmission time process shown in FIG. 6, except that a connection request to the base B, status information of the base A, and a stop request of the base A It is transmitted to the called terminal 4 (S13, S19, S29, S31), and is different in that it is directly connected to the called terminal 4 in S35. Further, after execution of S13, it is different in that it is determined whether or not the absence notification of the base B is received instead of S15 in the transmission processing shown in FIG. 6 (S201).

  On the other hand, the called terminal 4 performs the same process as the reception process shown in FIG. 8, but is different in that S119 is not executed. 15 is the same as the user standby process shown in FIG. 9, but the absence notification of the site B is sent to the calling terminal 3 before the execution of S131. It is transmitted (S203). And when not receiving the cancellation request | requirement of the base A (S147: NO) or when it is considered that the user who uses the called side terminal 4 is absent (S139, S141, S143 are all NO), a fixed time After waiting (for example, 30 seconds), the process returns to S203. In S109 and S145, the callee terminal 4 is directly connected to each other.

  With the above processing, in the example of the time chart shown in FIG. 16, when the user at the site A issues a call instruction for the site B (T51), a connection request for the site A is sent from the calling terminal 3 to the called terminal 4. It is transmitted (T52). T51 to T52 are executed by the processes of S11 to S13. In the called side terminal 4, if the user is absent at the time of receiving the connection request of the site A (T53), the absence notification of the site B is transmitted to the calling side terminal 3 (T54). T53 to T54 are executed by the processes of S101 to S119 and S203. When the calling terminal 3 receives the absence notification of the base B (T55), the state information of the base A is transmitted to the called terminal 4 (T56). T55 to T56 are executed by the processes of S201 and S17 to S29.

  Next, when the state information of the base A is received at the called terminal 4 (T57), notification based on the state information of the base A is performed. If the user of the called terminal 4 is absent at T57, an absence notice is transmitted at S203 after a certain period of time (T58). T57 to T58 are executed in the processes of S133 to S143 and S203. In response to the absence notification of the base B, the calling side terminal 3 transmits the state information of the base A to the called terminal 4 (T59). T59 is executed in the processes of S201 and S17 to S29. In the called terminal 4, notification based on the status information of the base A is performed, and if the user of the called terminal 4 is present, the connection permission of the base B is sent from the called terminal 4 to the calling side. It is transmitted to the terminal 3 (T60). T60 is executed in the processes of S133 to S143 and S145. Finally, the interconnection between the calling terminal 3 and the called terminal 4 is established, and a video conference is executed between the bases A and B (T61). T61 is executed in the processes of S33 to S35 and S145.

  Thus, even when the calling side terminal 3 and the called side terminal 4 are interconnected without going through the conference management server 6, as in the above embodiment, the absence of the user who uses the called side terminal 4 is absent. When a call is made from the calling terminal 3 to the called terminal 4, the user who returns to the called terminal 4 can grasp the usage state of the calling terminal 3.

  In the above modification (see FIGS. 14 and 15), the absence notification of the base B is transmitted to the calling terminal 3 in S203, but a status request for the base A may be transmitted instead. (See FIG. 16). Then, in S201, instead of determining whether or not the absence notification of the base B is received, it may be determined whether or not a status request for the base A is received. In the above modification, the CPU 20 that executes S203 corresponds to the “absence signal transmission unit” of the present invention, and S203 corresponds to the “absence signal transmission step” of the present invention.

1 Video Conference System 2 Network 3 Conference Terminal 4 Conference Terminal 5 Conference Terminal 6 Conference Management Server 20 CPU
21 ROM
22 RAM
27 Mouse 28 Display 29 Keyboard 31 Hard disk drive 34 Camera 35 Microphone

Claims (8)

Each of the remote conference terminals connected to each other via a network includes a plurality of remote conference terminals each capable of acquiring at least one of image data and audio data from a predetermined range. A remote conference system for executing a remote conference by outputting conference data including at least one of the image data and the audio data,
One of the remote conference terminals is
Call signal transmitting means for transmitting a call signal for requesting connection with the one remote conference terminal to the other remote conference terminal;
When the absence information indicating that the user who uses the other remote conference terminal is absent or the status request for requesting the usage status of the one remote conference terminal is received, the one of the remote conference terminals A state judging means for judging the use state;
Based on the determination result of the state determination means, comprising state information transmission means for transmitting state information indicating the use state of the one remote conference terminal to the other remote conference terminal,
The other remote conference terminal is:
When the call signal is received from the one remote conference terminal, based on information acquired by the other remote conference terminal, whether or not there is no user using the other remote conference terminal. Absence determination means to determine;
When the absence determination means determines that the user is absent, the absence signal transmission means for transmitting the absence information or the status request to the one remote conference terminal;
A state notifying unit for notifying the use state of the one remote conference terminal based on the state information when the state information is received from the one remote conference terminal; .   The state determination means determines whether or not there is a user using the one remote conference terminal based on information acquired by the one remote conference terminal as a usage state of the one remote conference terminal. The remote conference system according to claim 1, wherein the remote conference system is determined.   The state determination means determines whether the one remote conference terminal uses the remote conference terminal based on a connection state with the remote conference terminal different from the other remote conference terminal as a usage state of the one remote conference terminal. 3. The remote conference system according to claim 1, wherein it is determined whether or not the process is being executed. When the usage state of the one remote conference terminal indicated by the status information is a usage state suitable for connection with the other remote conference terminal, the status notification means is connected to the one remote conference terminal. To remind you,
The absence determination unit is further configured to, based on information acquired by the other remote conference terminal, when the notification notifying the connection with the one remote conference terminal is performed by the state notification unit, Determine if there is a user using the remote conference terminal,
The other remote conference terminal is:
Response signal transmitting means for transmitting a response signal permitting connection with the other remote conference terminal to the one remote conference terminal when the absence determination means determines that a user exists. The remote conference system according to claim 1. A teleconference terminal capable of performing a remote conference by connecting to each other via a network,
Terminal information acquisition means for acquiring at least one of image data and audio data from a predetermined range in the remote conference terminal;
Conference data that outputs conference data including at least one of the image data and the audio data acquired by the plurality of remote conference terminals when the plurality of remote conference terminals are connected to each other via the network. Output means;
Call signal transmitting means for transmitting a call signal for requesting connection to the other remote conference terminal;
In response to the call signal, when the absence information indicating that the user who uses the other remote conference terminal is absent or the status request for requesting the usage status of the remote conference terminal is received, the remote A state determination means for determining the usage state of the conference terminal;
A remote conference terminal comprising: status information transmission means for transmitting status information indicating a usage status of the remote conference terminal to the other remote conference terminal based on a determination result of the status determination means. A teleconference terminal capable of performing a remote conference by connecting to each other via a network,
Terminal information acquisition means for acquiring at least one of image data and audio data from a predetermined range in the remote conference terminal;
Conference data that outputs conference data including at least one of the image data and the audio data acquired by the plurality of remote conference terminals when the plurality of remote conference terminals are connected to each other via the network. Output means;
When a call signal requesting connection is received from another remote conference terminal, it is determined whether there is no user using the remote conference terminal based on information acquired by the remote conference terminal Absence determination means to
When it is determined that the user is absent by the absence determination means, the absence information indicating that the user who uses the remote conference terminal is absent, or the state of requesting the use status of the other remote conference terminal Out-of-office signal transmission means for transmitting a request to the other remote conference terminal;
A state of notifying the use state of the other remote conference terminal based on the state information when the state information indicating the use state of the other remote conference terminal is received as a response to the absence information or the state request A teleconference terminal comprising: a notification means. A teleconference terminal capable of performing a remote conference by connecting to each other via a network,
Terminal information acquisition means for acquiring at least one of image data and audio data from a predetermined range in the remote conference terminal;
Conference data that outputs conference data including at least one of the image data and the audio data acquired by the plurality of remote conference terminals when the plurality of remote conference terminals are connected to each other via the network. Output means;
Call signal transmitting means for transmitting a call signal for requesting connection to the remote conference terminal;
As a response to the one call signal, one absence information indicating that there is no user using the one remote conference terminal or one state request for requesting a use state of the remote conference terminal is received. State determination means for determining the usage state of the remote conference terminal,
Based on the determination result of the state determination means, state information transmission means for transmitting one state information indicating a use state of the remote conference terminal to the one remote conference terminal;
A user who uses the remote conference terminal based on information acquired by the remote conference terminal when a call signal requesting connection is received from another remote conference terminal that is the same as or different from the one remote conference terminal Absence determination means for determining whether is absent,
When it is determined that the user is absent by the absence determination means, other absence information indicating that the user who uses the remote conference terminal is absent or the use status of the other remote conference terminal is requested. Out-of-office signal transmission means for transmitting another status request to the other remote conference terminal;
When other status information indicating the usage status of the other remote conference terminal is received as a response to the other absence information or the other status request, the other remote conference terminal is configured based on the status information. A teleconference terminal comprising: a state informing means for informing a use state. Each of the remote conference terminals connected to each other via a network includes a plurality of remote conference terminals each capable of acquiring at least one of image data and audio data from a predetermined range. A remote conference method processed by a remote conference system for executing a remote conference by outputting conference data including at least one of the image data and the audio data,
A call signal transmission step of transmitting a call signal for requesting connection with the one remote conference terminal to the other remote conference terminal designated by the user at the one remote conference terminal;
When the call signal is received by the other remote conference terminal, based on information acquired by the other remote conference terminal, whether or not there is a user using the other remote conference terminal. The absence determination step to determine,
When it is determined that the user is absent in the absence determination step, the absence information indicating that the user who uses the other remote conference terminal is absent or the usage status of the one remote conference terminal is requested. An out-of-office signal transmission step of transmitting a status request to be transmitted to the one remote conference terminal;
A state determination step of determining a use state of the one remote conference terminal when the absence information or the state request is received by the one remote conference terminal;
Based on the determination result of the state determination step, a state information transmission step of transmitting state information indicating a use state of the one remote conference terminal to the other remote conference terminal;
A state notifying step of notifying the use state of the one remote conference terminal based on the state information when the state information is received by the other remote conference terminal; .

Images