JP4359968B2 - Communication apparatus and method, and recording medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a communication apparatus and method, and Record In particular, a communication apparatus and method for controlling image display and audio output in response to user biometric information, and Record It relates to the medium.
[0002]
[Prior art]
A remote conference that can hold a conference as if it were surrounding a single table by communicating the images and sounds of persons who are currently remote from each other via a network and reproducing the video and audio. There are systems and videophone systems that can talk as if the other party is in front of you.
[0003]
[Problems to be solved by the invention]
By the way, in actual meetings and conversations, you can adjust the distance from the conversation partner according to the feelings you have about the meeting partner and the conversation partner (hereinafter referred to as the conversation partner). Try to have a conversation. For example, if you are close to a conversation partner, you will be close to the conversation partner (sitting in a nearby seat), but if you are not very close, you will be a little away (sitting in a separate seat). In other words, when the conversation partner feels comfortable in the vicinity, the person approaches the person. On the other hand, when the conversation partner feels uncomfortable (for example, when nervous), the person is separated from the person.
[0004]
However, in the above-described conventional remote conference system and television telephone system, the conversation partner is imaged at a predetermined magnification, and the video is displayed at a certain size. In other words, in these systems, the video is not displayed as small as if the video is displayed close to the conversation partner, or as if the user is talking away. In the end, there was a problem that users could not comfortably hold meetings and conversations.
[0005]
The volume can also be adjusted by operating the volume dial, for example, but it has to be operated by oneself, and there is a problem that the user cannot comfortably hold a conference or conversation.
[0006]
The present invention has been made in view of such a situation, and makes it possible to optimally adjust a partner's image and sound.
[0007]
[Means for Solving the Problems]
The communication apparatus of the present invention is a communication apparatus that communicates image data and audio data with each other, and a first receiving unit that receives the audio data transmitted from the other communication apparatus; Output control means for controlling the output of the audio data received by the first receiving means, second receiving means for receiving the image data transmitted from the other communication device, and magnitude of line-of-sight fluctuations Detecting means for detecting at least one biological information of the diameter of the pupil, the amount of sweating, the heart rate, or the blood pressure, and a determination based on the biological information detected by the detecting means, and based on the determination result Z And Display of the image data received by the second receiving means Size of Display control means for controlling the display.
[0009]
The output control means makes a determination based on the biological information detected by the detection means, and based on the determination result. And Output of the audio data received by the first receiving means Amplification factor Can be controlled.
[0012]
Storage means for storing image data corresponding to the biological information is further provided, and the display control means makes a determination based on the biological information stored in the storage means corresponding to the image data, and the determination Based on results And Display of the image data Size of Can be controlled.
[0013]
The apparatus further comprises storage means for storing image data corresponding to the biological information, and the output control means includes: Stored in the storage unit corresponding to the image data Make a determination based on the biometric information, and And Output of the audio data Amplification factor Can be controlled.
[0014]
The communication method of the present invention is a communication method of a communication device that communicates image data and audio data with another communication device, and a first reception step of receiving the audio data transmitted from the other communication device. An output control step for controlling the output of the audio data received in the processing of the first reception step; a second reception step for receiving the image data transmitted from the other communication device; A detection step of detecting at least one biological information of gaze fluctuation size, pupil diameter size, perspiration amount, heart rate, or blood pressure, and determination based on the biological information detected in the processing of the detection step And based on the judgment results And Display of the image data received in the processing of the second receiving step Size of Display control step for controlling the display.
[0015]
The recording medium of the present invention is a communication program for communicating image data and audio data with another communication device, and inputs the audio data transmitted from the other communication device. An input step; an output control step for controlling the output of the audio data input in the processing of the first input step; and a second input step for inputting the image data transmitted from the other communication device. And a detection step of detecting at least one biological information of the size of gaze fluctuation, the size of the diameter of the pupil, the amount of sweat, the heart rate, or the blood pressure, and based on the biological information detected in the processing of the detection step Make a decision and based on the decision And Display of the image data input in the processing of the second input step Size of Display control step for controlling On the computer Execute for Recording a program Computer readable recoding media.
[0016]
In the communication apparatus and method and the recording medium of the present invention, the audio data transmitted from the other communication apparatus is received, the output of the received audio data is controlled, and the image transmitted from the other communication apparatus The data is received, and at least one biological information such as the size of the line-of-sight fluctuation, the size of the pupil diameter, the amount of sweat, the heart rate, or the blood pressure is detected, and the determination based on the detected biological information is performed. Based on results And Display of received image data Size of Is controlled.
[0025]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 shows a configuration example of a remote conference system to which the present invention is applied. In this remote conference system, two remote conference devices 1-1 and 1-2 (hereinafter referred to as remote conference device 1 when there is no need to individually distinguish the remote conference devices 1-1 and 1-2). The same applies to the other devices). The remote conference device 1-1 transmits the image data and audio data of the participant A participating in the conference to the remote conference device 1-2 via the network 2, or has been transmitted from the remote conference device 1-2. Play back image data and audio data.
[0026]
The remote conference apparatus 1-2 transmits the image data and audio data of the participant B participating in the conference to the remote conference apparatus 1-1 via the network 2, or has been transmitted from the remote conference apparatus 1-1. Play back image data and audio data.
[0027]
FIG. 2 shows an example of the external configuration of the remote conference apparatus 1-1. The teleconference device 1-1 includes a playback device 11, a video camera 12, a microphone 13, and a biological information detection device 14.
[0028]
The playback device 11 includes a display 21 and a speaker 22. The display 21 displays a video (for example, video of the participant B) corresponding to the image data transmitted from the remote conference device 1-2 based on the biological information from the biological information detection device 14 (see FIG. 2). In the example, the display scale B is displayed). The speaker 22 outputs a sound (for example, a speech of the participant B) corresponding to the sound data transmitted from the remote conference device 1-2.
[0029]
The video camera 12 images the face portion of the participant A. The microphone 13 collects the speech of the participant A. The video imaged by the video camera 12 and the voice collected by the microphone 13 are transmitted to the remote conference device 1-2.
[0030]
The biological information detection device 14 is a device that detects the biological information of the participant A. In this example, as shown in FIG. 3, the biological information detection device 14 has an optical unit 31 and is similar to glasses. The biometric information is information indicating whether the participant A has a pleasant emotion or an unpleasant feeling, and in this example, the size of the fluctuation in the line of sight of the participant A. When the human (participant A) has discomfort, the line of sight moves greatly (gaze fluctuation is large), and when he / she has a pleasant emotion, the line of sight does not move much (gaze fluctuation is small).
[0031]
Participant A wears biological information detection device 14 so that optical unit 31 covers both eyes. The optical unit 31 detects the magnitude of the line-of-sight fluctuation of the participant A and supplies it to the playback device 11.
[0032]
Next, the configuration of the playback apparatus 11 according to the first embodiment will be described. FIG. 4 shows a configuration example of a portion that performs the display scale adjustment processing of the playback apparatus 11 according to the first embodiment. The communication unit 41 receives the image data (image data of the video of the participant B) supplied from the remote conference device 1-2 and supplies it to the control unit 42. The communication unit 43 receives the biological information (the magnitude of the line-of-sight fluctuation) from the biological information detection device 14 and supplies it to the control unit 42. In addition, when biometric information is supplied to the reproducing | regenerating apparatus 11 with an analog signal, the communication part 43 has an A / D converter (not shown) etc., and converts an analog signal (biological information) into digital using it. It converts into a signal and supplies it to the control part 42.
[0033]
The control unit 42 supplies the image data supplied from the communication unit 41 to the display control unit 44, determines a display scale of a video corresponding to the image data based on the biological information from the communication unit 43, and displays the display scale. The control unit 44 is notified.
[0034]
The display control unit 44 causes the display 21 to display the image data supplied from the control unit 42 on the display scale notified from the control unit 42.
[0035]
Since the remote conference device 1-2 has the same configuration as the remote conference device 1-1, its illustration and description are omitted.
[0036]
Next, the processing procedure of the display scale adjustment process in the remote conference apparatus 1-1 will be described with reference to the flowchart of FIG. As shown in FIG. 2, when the participant A wears the biological information detecting device 14 and the video of the participant B is displayed on the display 21 on the display scale B (display scale in the initial state), the step is performed. In S <b> 1, the biological information detection device 14 detects the magnitude of the line-of-sight fluctuation of the participant A, and supplies the detection result to the playback device 11.
[0037]
In step S <b> 2, the control unit 42 of the playback device 11 receives the magnitude of the line-of-sight fluctuation supplied from the biological information detection device 14 via the communication unit 43 and determines the display scale of the video of the participant B. The details of the display scale determination process are shown in the flowchart of FIG.
[0038]
That is, in step S11, the control unit 42 determines whether or not the size of the line-of-sight fluctuation is larger than the size A. If it is determined that the size is larger, the control unit 42 proceeds to step S12 and determines the display scale as the display scale A. In this example, the display scale A is about 80% of the display scale B.
[0039]
If it is determined in step S11 that the magnitude of the line-of-sight fluctuation is not greater than (or less than) the magnitude A, the process proceeds to step S13, and the control unit 42 determines that the magnitude of the line-of-sight fluctuation is the magnitude B (size). It is determined whether or not it is larger than (A size smaller than A), and when it is determined that it is larger (when it is smaller than A and larger than B), the process proceeds to step S14, and the display scale is set to display scale B (initial Status display scale).
[0040]
When it is determined in step S13 that the magnitude of the line-of-sight fluctuation is not greater than (or less than) the magnitude B, the process proceeds to step S15, and the control unit 42 determines the display scale as the display scale C. In this example, the display scale C is about 120% of the display scale B.
[0041]
When the display scale is determined in step S12, step S14, or step S15, the display scale determination process is completed, and the process proceeds to step S3 in FIG.
[0042]
In step S3, the control unit 42 of the playback apparatus 11 notifies the display control unit 44 of the display scale determined in step S2. In step S <b> 4, the display control unit 44 causes the display 21 to display the video of the participant B received by the communication unit 41 based on the display scale notified from the control unit 42.
[0043]
For example, when the size of the detected line-of-sight fluctuation is larger than the size A and the display scale is determined to be the display scale A in step S2, the video of the participant B is displayed on the display scale B as shown in FIG. (FIG. 2) is displayed smaller than the case of being displayed. On the other hand, when the size of the detected line-of-sight fluctuation is B or less and the display scale is determined to be the display scale C, the video of the participant B is displayed on the display scale B as shown in FIG. It is displayed larger than the case.
[0044]
That is, if the biometric information indicates that the participant A feels uncomfortable (in this example, the magnitude of the line-of-sight fluctuation is large), is the participant A sitting slightly away from the participant B? As shown in FIG. 7, the video of participant B is displayed small (FIG. 7). Conversely, if the biometric information indicates that the participant A feels comfortable (in this example, the magnitude of the line-of-sight fluctuation is small), is the participant A sitting near the participant B? As shown in FIG. 8, the video of participant B is displayed in a large size (FIG. 8).
[0045]
The displayed video and the biometric information detected at that time (the magnitude of the line-of-sight fluctuation) are stored in association with each other. When the video is displayed next time, the stored biometric information is stored in correspondence with the stored video. It is also possible to determine the display scale based on this and display the video at the determined display scale.
[0046]
In the above example, the case where the display scale A is 80% of the display scale B and the display scale C is 120% has been described as an example. The relationship of gaze fluctuation (pleasant / uncomfortable) can be measured in advance and set based on the measurement result.
[0047]
Next, the configuration of the playback apparatus 11 according to the second embodiment will be described. FIG. 9 shows a configuration example of a portion for performing the display scale adjustment processing and the audio adjustment processing of the second embodiment of the playback device 11. The playback device 11 includes a communication unit 51 instead of the communication unit 41 of the playback device 11 of FIG. 4, a control unit 51 instead of the control unit 42, and an audio control unit 53.
[0048]
The communication unit 51 receives audio data in addition to the image data supplied from the remote conference device 1-2 and supplies the audio data to the control unit 52. The control unit 52 supplies the image data supplied from the communication unit 51 to the display control unit 44 and the audio data to the audio control unit 53. The control unit 52 receives the biological information from the biological information detection device 14 via the communication unit 43, determines the display scale as in the case of the control unit 42 of FIG. 4, and notifies the display control unit 44. The control unit 52 also determines the amplification factor of the audio data based on the biological information, and notifies the audio control unit 53 of the determination.
[0049]
The audio control unit 53 amplifies the audio data supplied from the control unit 52 with the amplification factor notified from the control unit 52 and outputs the amplified data from the speaker 22.
[0050]
Next, the processing procedure of the audio adjustment processing in the remote conference apparatus 1-1 will be described with reference to the flowchart of FIG. When the participant A wears the biological information detecting device 14 as shown in FIG. 2 and the video of the participant B is displayed on the display scale B on the display 21 (or the amplification factor from the speaker 22). When the voice of the participant B amplified by B (initial value) is output), in step S21, the biological information detecting device 14 detects the magnitude of the line-of-sight fluctuation of the participant A and the detection result is reproduced by the reproducing device 11. To supply.
[0051]
In step S <b> 22, the control unit 52 of the playback device 11 receives the magnitude of the line-of-sight fluctuation from the biological information detection device 14 via the communication unit 43, and determines the amplification factor based on the magnitude of the received line-of-sight fluctuation. To do. The details of the amplification factor determination process are shown in the flowchart of FIG.
[0052]
That is, in step S31, the control unit 52 determines whether or not the magnitude of the line-of-sight fluctuation is larger than the magnitude A. If it is determined that the magnitude is larger, the control section 52 proceeds to step S32 and determines the amplification factor as the amplification factor A. In this example, the amplification factor A is about 80% of the amplification factor B.
[0053]
If it is determined in step S31 that the magnitude of the line-of-sight fluctuation is not larger than (or less than) the magnitude A, the process proceeds to step S33, and the control unit 52 determines whether the magnitude of the line-of-sight fluctuation is larger than the magnitude B. If it is determined that it is greater than that (if it is smaller than size A and greater than size B), the process proceeds to step S34, and the gain is determined as gain B (initial value).
[0054]
If it is determined in step S33 that the magnitude of the line-of-sight fluctuation is not greater than (or less than) the magnitude B, the process proceeds to step S35, and the control unit 52 determines the amplification factor as the amplification factor C. In this example, the amplification factor C is about 120% of the amplification factor B.
[0055]
When the amplification factor is determined in step S32, step S34, or step S35, the amplification factor determination process is completed, and the process proceeds to step S23 in FIG.
[0056]
In step S23, the control unit 52 notifies the audio control unit 53 of the amplification factor determined in step S22. In step S <b> 24, the voice control unit 53 amplifies the voice data received by the communication unit 51 based on the amplification factor notified from the control unit 52, and outputs it from the speaker 22.
[0057]
For example, when the magnitude of the detected line-of-sight fluctuation is larger than the magnitude A and the amplification factor is determined as the amplification factor A in step S22, and the voice data is amplified by the amplification factor A, the voice of the participant B is Is output from the speaker 22 at a lower volume than when amplified by. On the other hand, when the magnitude of the detected line-of-sight fluctuation is smaller than the size B and the amplification factor is determined to be the amplification factor C, and the voice data is amplified by the amplification factor C, the voice of the participant B is amplified by the amplification factor B. Compared to the case, the sound is output from the speaker 22 at a large volume.
[0058]
That is, if the biometric information indicates that the participant A feels uncomfortable (in this example, the magnitude of the line-of-sight fluctuation is large), is the participant A talking with the participant B away? As described above, the voice of the participant B is output at a low volume. Conversely, when the biometric information indicates that the participant A feels comfortable (in this example, when the magnitude of the line-of-sight fluctuation is small), the participant A approaches the participant B and talks. As if, the voice of participant B is output at a high volume.
[0059]
In the above description, the case where the amplification factor is adjusted has been described as an example. However, the equalization of audio data may be adjusted.
[0060]
In addition, the displayed video (or audio) and the biometric information (line-of-sight fluctuation) detected at that time are stored in association with each other, and when the video (or audio) is displayed next time, it is stored correspondingly. It is also possible to amplify the sound at an amplification factor based on living body information.
[0061]
In the above description, for the sake of simplicity, only the audio adjustment process has been described. However, the display scale process and the audio adjustment process can be executed in parallel.
[0062]
FIG. 12 shows a configuration example of another remote conference apparatus 1-1 to which the present invention is applied. The remote conference device 1-1 is provided with a playback device 61 in place of the playback device 11 of the remote conference device 1-1 of FIG. 2, and further provided with a position control device 62.
[0063]
In the playback device 61, the image data transmitted from the remote conference device 1-2 is displayed on the display 11 with a constant display scale, and the transmitted audio data is amplified with a constant amplification factor, and the speaker 22 is displayed. Is output from. In other words, the display scale and amplification factor are not changed based on the biological information from the biological information detection device 14 as in the playback device 11. The magnitude of the line-of-sight fluctuation detected by the biological information detection device 14 (biological information) is transmitted to the remote conference device 1-2 in this example.
[0064]
The position control device 62 moves the video camera 12 along the line A and the microphone 13 along the line B based on the biological information (participant B's biological information) transmitted from the remote conference device 1-2. Move.
[0065]
FIG. 13 shows a configuration example of the position control device 62. The communication unit 71 receives the biological information of the participant B detected by the biological information detection device 84 (FIG. 14) of the remote conference device 1-2 and supplies it to the control unit 72. The control unit 72 determines the position on the line A of the video camera 12 based on the magnitude of the line-of-sight fluctuation supplied from the communication unit 71 and notifies the video camera moving unit 73 of the position. The control unit 72 determines the position of the microphone 13 on the line B based on the magnitude of the line-of-sight fluctuation supplied from the communication unit 71 and notifies the microphone moving unit 74 of the position.
[0066]
The video camera moving unit 73 moves the video camera 12 to a position on the line A notified from the control unit 72. The microphone moving unit 74 moves the microphone 13 to a position on the line B notified from the control unit 72.
[0067]
FIG. 14 shows a configuration example of the remote conference apparatus 1-2 in this example. The playback device 81 to the biological information detection device 84 of the remote conference device 1-2 are the playback device 61 of the remote conference device 1-1, the video camera 12 to the biological information detection device 14, and the position control device of the remote conference device 1-2. Since 101 has the same function as the position control device 62 of the remote conference device 1-1, its description is omitted.
[0068]
Next, operation | movement of the position control apparatus 62 of the remote conference apparatus 1-1 is demonstrated.
[0069]
When the control unit 72 of the position control unit 62 receives the magnitude of the line-of-sight fluctuation of the participant B detected by the biological information detection device 84 transmitted from the remote conference device 1-2 from the communication unit 71, the control unit 72 receives The position on the line A of the video camera 12 and the position on the line B of the microphone 13 corresponding to the magnitude of the line-of-sight fluctuation are determined. For example, if the size of the line-of-sight fluctuation of the participant B is larger than a predetermined size X, the end A2 (line A2) from the current position by a distance corresponding to the difference between the size of the line-of-sight fluctuation and the size X. ) Or an edge B2 (line B) direction (a direction away from the participant A) is detected. Further, when the size of the line-of-sight fluctuation of the participant B is smaller than the size X, the end A1 (line A) or the distance corresponding to the difference between the magnitude of the line-of-sight fluctuation and the size X from the current position. A position separated in the end B2 (line B) direction (direction approaching the participant A) is detected.
[0070]
The control unit 72 notifies the video camera moving unit 73 of the position on the line A of the video camera 12 detected as described above, and notifies the microphone moving unit 74 of the position of the microphone 13 on the line B.
[0071]
The video camera moving unit 73 moves the video camera 12 to a position on the line A notified from the control unit 72. The microphone moving unit 74 moves the microphone 13 to a position on the line B notified from the control unit 72. For example, when the video camera 12 is moved in the direction of the end A2 on the line A, the distance between the video camera 12 and the participant A increases, so that the participant A is captured small, and as a result, the video of the participant A Is displayed small on the display 91 of the playback device 81 of the remote conference device 1-2. Conversely, when the video camera 12 is moved in the direction of the end A1 on the line A, the distance between the video camera 12 and the participant A becomes smaller, so that the participant A is imaged more greatly. As a result, the participant A Is displayed largely on the display 91 of the playback device 81 of the remote conference device 1-2.
[0072]
Further, when the microphone 13 is moved in the direction of the end B2 on the line B, the distance between the microphone 13 and the participant A is increased, so that the voice of the participant A is collected, and as a result, the participant A's voice is collected. Audio is output at a low volume from the speaker 92 of the remote conference device 1-2. On the contrary, when the microphone 13 is moved in the direction of the end B1 on the line B, the distance between the microphone 13 and the participant A is shortened, and the voice of the participant A is collected more. As a result, the participant A Is output from the speaker 92 of the playback device 81 of the remote conference device 1-2.
[0073]
That is, in the case of the teleconference device 1-1 in FIG. 2, the reproduction of the transmitted image data and audio data is adjusted based on the biometric information of the participant A. In this example, the participant Based on the biological information of B (the other party), the image data and audio data transmitted to the remote conference device 1-2 are adjusted.
[0074]
In the above description, the case where the distance between the video camera 12 and the participant A is adjusted has been described as an example. However, the imaging state can be optically adjusted, for example, by adjusting the zoom magnification of the video camera 12. . In the above description, the case where the distance between the microphone 13 and the participant A is adjusted has been described as an example. However, the directivity of the microphone 13 can be adjusted.
[0075]
In the above description, the case where the magnitude of the line-of-sight fluctuation is taken as the biometric information has been described as an example of the biometric information. (The amount increases when uncomfortable), Heart rate (The number increases when uncomfortable), Blood pressure (The size increases when uncomfortable), etc. You can also. Note that the configuration of the biological information detection device 14 differs depending on the type of biological information. For example, when the biological information is the pupil diameter, the biological information detection device 14 has a configuration capable of detecting the pupil diameter. Similarly, the biological information detection device 14 detects the amount of sweat when the constituent biological information is the amount of sweat, the heart rate when the biological information is the heart rate, and the blood pressure when the biological information is the blood pressure. It has a configuration that can.
[0076]
The series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a computer constituting the software is installed in the remote conference device 1 as dedicated hardware or by installing various programs. It is installed in, for example, a general-purpose personal computer that can execute various functions.
[0077]
Next, referring to FIG. 15, when the computer is a general-purpose personal computer for the medium used for installing the program for executing the above-described series of processes in the computer and making it executable by the computer. Will be described as an example.
[0078]
As shown in FIG. 15A, the program can be provided to the user in a state where it is preinstalled in a hard disk 102 or a semiconductor memory 103 as a recording medium built in the personal computer 101.
[0079]
Alternatively, as shown in FIG. 15B, the program includes a floppy disk 111, a CD-ROM (Compact Disk-Read Only Memory) 112, an MO (Magneto-Optical) disk 113, a DVD (Digital Versatile Disk) 114, It can be temporarily or permanently stored in a recording medium such as the magnetic disk 115 and the semiconductor memory 116 and provided as package software.
[0080]
Further, as shown in FIG. 15C, the program is wirelessly transferred from the download site 121 to the personal computer 101 via the digital satellite broadcasting artificial satellite 122, or a network 131 such as a local area network or the Internet. The data can be transferred to the personal computer 101 via a wire and stored in the built-in hard disk 102 or the like in the personal computer 101.
[0081]
The medium in this specification means a broad concept including all these media.
[0082]
The personal computer 101 includes a CPU (Central Processing Unit) 142, for example, as shown in FIG. An input / output interface 145 is connected to the CPU 142 via the bus 141, and the CPU 142 receives an instruction from the input unit 147 such as a keyboard and a mouse via the input / output interface 145. Correspondingly, a program stored in a ROM (Read Only Memory) 143 corresponding to the semiconductor memory 103 in FIG. Alternatively, the CPU 142 is a program stored in advance in the hard disk 102, a program transferred from the satellite 122 or the network 131, received by the communication unit 148, and further installed in the hard disk 102, or a floppy disk attached to the drive 149. 111, the CD-ROM 112, the MO disk 113, the DVD 114, or the magnetic disk 115, and the program installed in the hard disk 102 is loaded into a RAM (Random Access Memory) 144 and executed. Further, the CPU 142 outputs the processing result to the display unit 146 formed of an LCD (Liquid Crystal Display) or the like as necessary via the input / output interface 145, for example.
[0083]
In the present specification, the steps for describing the program provided by the medium are not limited to the processes performed in time series according to the described order, but are not necessarily performed in time series, either in parallel or individually. This includes the processing to be executed.
[0084]
Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.
[0085]
【The invention's effect】
The present invention According to this, it is possible to display the video corresponding to the image data with the optimum size.
[0086]
The present invention According to the above, the captured image data and the collected sound data are optimally reproduced in, for example, another communication device.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration example of a remote conference system to which the present invention is applied.
FIG. 2 is a block diagram illustrating a configuration example of the remote conference apparatus 1-1 in FIG.
FIG. 3 is a diagram illustrating a configuration example of a biological information detection device 14;
FIG. 4 is a block diagram illustrating a configuration example of a portion that performs display scale adjustment processing of the first embodiment of the playback apparatus 11;
FIG. 5 is a flowchart for explaining display scale adjustment processing;
FIG. 6 is a flowchart illustrating details of processing in step S2.
7 is a diagram showing a display example of the display 21. FIG.
8 is a diagram showing another display example of the display 21. FIG.
FIG. 9 is a block diagram illustrating a configuration example of a part that performs display scale adjustment processing and audio adjustment processing according to the second embodiment of the playback apparatus;
FIG. 10 is a flowchart illustrating audio adjustment processing.
FIG. 11 is a flowchart illustrating details of a process in step S22.
FIG. 12 is a diagram illustrating another configuration example of the remote conference apparatus 1-1.
13 is a block diagram illustrating a configuration example of the position control device 62 in FIG. 12. FIG.
FIG. 14 is a diagram illustrating a configuration example of a remote conference device 1-2.
FIG. 15 is a diagram illustrating a medium.
16 is a block diagram illustrating a configuration example of the personal computer 101 in FIG.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Remote conference apparatus, 2 Network, 11 Playback apparatus, 12 Video camera, 13 Microphone, 14 Living body information detection apparatus, 21 Display, 22 Speaker, 31 Optical part, 41 Communication part, 42 Control part, 43 Communication part, 44 Display control Unit, 51 communication unit, 52 control unit, 53 audio control unit, 61 playback device, 62 position control device, 71 communication unit, 72 control unit, 73 video camera moving unit, 74 microphone moving unit, 81 playback device, 82 video camera , 83 microphone, 84 biological information detecting device, 91 display, 92 speaker,

Claims (6)

In a communication device that communicates image data and audio data with other communication devices,
First receiving means for receiving the audio data transmitted from the other communication device;
Output control means for controlling the output of the audio data received by the first receiving means;
Second receiving means for receiving the image data transmitted from the other communication device;
Detection means for detecting at least one biological information of the size of the line of sight fluctuation, the size of the pupil diameter, the amount of sweat, the heart rate, or the blood pressure;
Make decisions based on the biological information detected by the detecting means, and display control means for controlling the display size of said received image data by said second reception means based on the result of the determination Communication device. The output control means performs determination based on the biological information detected by the detecting means, for controlling the amplification factor of the output of the audio data received by said first receiving means based on the result of the determination The communication apparatus according to claim 1. Storage means for storing image data corresponding to the biological information,
Claims wherein the display control unit performs a determination based on the biological information stored in correspondence with the image data in the storage means, and based on the determination result to control the size of the display of said image data The communication apparatus according to 1. Storage means for storing image data corresponding to the biological information,
Claims wherein the output control means performs determination based on the biological information stored in correspondence with the image data in the storage means, and based on the determination result to control the amplification factor of the output of said audio data The communication apparatus according to 1 . In a communication method of a communication device that communicates image data and audio data with each other,
A first reception step of receiving the audio data transmitted from the other communication device;
An output control step of controlling output of the audio data received in the processing of the first reception step;
A second receiving step of receiving the image data transmitted from the other communication device;
A detection step of detecting at least one biological information of the size of gaze fluctuation, the size of the diameter of the pupil, the amount of sweat, the heart rate, or the blood pressure;
The detected by the processing of the detection step was performed determination based on the biological information, the display control for controlling the size of the display of the image data received by the processing of said based on the result of the judgment second receiving step A communication method including steps. A communication program for communicating image data and audio data with other communication devices,
A first input step of inputting the audio data transmitted from the other communication device;
An output control step of controlling the output of the audio data input in the processing of the first input step;
A second input step of inputting the image data transmitted from the other communication device;
A detection step of detecting at least one biological information of the size of gaze fluctuation, the size of the diameter of the pupil, the amount of sweat, the heart rate, or the blood pressure;
The detected by the processing of the detection step was performed determination based on the biological information, the display control for controlling the size of the display of the image data input by the processing of the second input steps based on the result of the determination A computer-readable recording medium in which a program for causing a computer to execute processing including steps is recorded.

Images