JP5296754B2 - Information processing apparatus, communication method thereof, and computer-executable program - Google Patents

Description

  The present invention relates to an information processing apparatus, a communication method thereof, and a computer-executable program.

  Recently, in personal computers (hereinafter referred to as “PC”), with the increase in camera mounting rate and the increase in speed and capacity of communication lines, two or more points are connected. Videophone systems (for example, Skype) that exchange image data and audio data are widespread.

  In such a videophone system, a user of a PC is photographed with a camera, and the photographed image is sent to the partner PC. The captured image is displayed on the display of the partner's PC. Here, when a user uses a videophone application, the user may open a window of another application to perform work.

  FIG. 7 is a diagram illustrating a display example of the display screen of each of the notebook PCs 100 and 200 when the notebook PC 100 and the notebook PC 200 are communicating via a videophone. The notebook PC 100 and the notebook PC 200 are equipped with a video phone application program such as a multi-window OS and Skype. As shown in FIG. 7A, in the notebook PC 100 and the notebook PC 200, the videophone application program is activated, and the windows WA1 and WB1 are displayed on the screens 102 and 202, respectively. Mr. A is the owner of the PC 100, and the image of Mr. A taken by the camera 101 is transmitted to the PC 200 of Mr. B and displayed in the window WB1. On the other hand, Mr. B is the owner of the PC 200, and the image of Mr. B taken by the camera 201 is transmitted to the PC 100 of Mr. A and displayed on the window WA1.

  In this case, for example, when the videophone application program is mainly used (the user is aware that the videophone application is being used), there is no particular problem. However, when using a videophone application, even if another application program is mainly used, the photographed image continues to be sent to the partner PC, so that the photographed image is sent. You may forget to send an inadvertent image. For example, as shown in FIG. 7B, when Mr. A displays a window WA2 of another application program, the window WA1 of the videophone application program is hidden, so that Mr. A is photographed himself. You may forget that you are inadvertently sending a shot image.

JP 2007-13893 A JP 2008-227919 A

  The present invention has been made in view of the above, and automatically prevents an inadvertent transmission of an image when a videophone application program is executed on an OS having a multi-window function. It is an object of the present invention to provide an information processing apparatus capable of performing communication, a communication method thereof, and a program executable by a computer.

  In order to solve the above-described problems and achieve the object, the present invention provides an OS having a multi-window function and a videophone function for transmitting an image captured by a camera to a partner terminal and performing bidirectional communication. In the information processing apparatus provided, when the videophone application program for realizing the videophone function is used to communicate with the counterpart terminal, the videophone application program window is not displayed. And when the detection means detects that the window of the videophone application program is in a non-display state, a mute image is used instead of the image captured by the camera. Image mute setting means to be displayed on the terminal.

  According to a preferred aspect of the present invention, the image mute setting means is picked up by the camera when the detection means detects that the window of the videophone application program is in a non-display state. It is desirable to transmit a mute image instead of the displayed image and display it on the counterpart terminal.

  Also, according to a preferred aspect of the present invention, the non-display state of the window of the video phone application program is in a state where it is hidden below another window, and the window of the video phone application program is minimized. It is desirable that the state is at least one of a state where the screen saver is activated, and a state where the system lock is activated.

  According to a preferred aspect of the present invention, the image mute setting means further transmits an audio signal to the counterpart terminal when the mute image is displayed on the counterpart terminal instead of the image captured by the camera. It is desirable to provide sound mute setting means for setting mute to mute.

  Further, according to a preferred aspect of the present invention, when the image mute setting means displays a mute image on the counterpart terminal instead of the image captured by the camera, the audio signal transmitted to the counterpart terminal is muted. The audio mute setting means is configured to display the mute image on the counterpart terminal instead of the image captured by the camera. It is desirable that the audio signal transmitted to the counterpart terminal is set to mute or not set according to the user setting.

  Further, according to a preferred aspect of the present invention, communication of an information processing apparatus including an OS having a multi-window function and a videophone function that transmits an image captured by a camera to a partner terminal and performs bidirectional communication. In the method, when the detecting means is communicating with the counterpart terminal using the videophone application program for realizing the videophone function, the window of the videophone application program is not displayed. And when the image mute setting means detects that the window of the videophone application program is not displayed by the detection means, the image mute is muted instead of the image captured by the camera. And displaying the image on the counterpart terminal.

  Further, according to a preferred aspect of the present invention, the information processing apparatus includes an OS having a multi-window function and a videophone function that transmits an image captured by a camera to a partner terminal and performs two-way communication. A window for the videophone application program is not displayed when the detecting means is communicating with the counterpart terminal using the videophone application program for realizing the videophone function. A step of detecting a display state; and an image mute setting unit, when the detection unit detects that the window of the videophone application program is in a non-display state, the image captured by the camera And causing the computer to execute a step of displaying a mute image on the counterpart terminal instead of And wherein the door.

  As described above, according to the present invention, it is possible to automatically prevent an inadvertent image from being transmitted when a videophone application program is executed on an OS having a multi-window function. There is an effect that an information processing apparatus can be provided.

FIG. 1 is a schematic external view of a notebook PC to which an information processing apparatus used in a videophone system is applied. FIG. 2 is a diagram illustrating a schematic hardware configuration example of the notebook PC of FIG. FIG. 3 is a schematic functional configuration diagram relating to the videophone of the notebook PC of FIG. FIG. 4 is a diagram illustrating an example of the audio MUTE setting screen. FIG. 5 is a flowchart for explaining processing in which a videophone application displays a mute image on a communication partner. FIG. 6 is a diagram illustrating a display example of the display screen of each of the notebook PCs 1A and 1B when communication is being performed via videophone between the notebook PC 1A and the notebook PC 1B. FIG. 7 is a diagram illustrating a display example of the display screen of each of the notebook PCs 100 and 200 when the notebook PC 100 and the notebook PC 200 are communicating via a videophone.

  Hereinafter, an information processing apparatus according to the present embodiment, a communication method thereof, and an embodiment of a computer system to which a computer-executable program is applied will be described. Although the components of the present invention are generally illustrated in the drawings herein, it can be readily understood that they may be arranged and designed in a wide variety of configurations with various configurations. Accordingly, the following more detailed description of the apparatus, method and program embodiments of the present invention is not intended to limit the scope of the invention as set forth in the appended claims, but merely to implement selected embodiments of the invention. It is intended as an example only, and is merely illustrative of selected embodiments of an apparatus, system and method consistent with the present invention as set forth in the claims herein. Those skilled in the art will appreciate that the present invention may be practiced without one or more of the specific details or with other methods, components, or materials.

(Embodiment)
FIG. 1 is a schematic external view of a notebook PC 1 to which an information processing apparatus used in a videophone system is applied. As shown in the figure, the notebook PC 1 includes a main body side housing 2 and a display side housing 3 which are substantially rectangular parallelepipeds. The main body side housing 2 includes an input unit 4 having a keyboard, a touch pad, and the like, a microphone 5, and speakers 6a and 6b. The display-side housing 3 includes an LCD (Liquid Crystal Display) 7 and a camera 8 that is disposed on the display surface side of the LCD 7 at a substantially central position above the LCD 7 and can image a subject in front.

  The main body side housing 2 and the display side housing 3 are connected to each other by a pair of left and right connecting portions (hinge portions) 9a and 9b at the respective ends, and the connecting portions 9a and 9b open and close these housings. Supports freely.

  FIG. 2 is a diagram illustrating a schematic hardware configuration example of the notebook PC 1 of FIG. As shown in the figure, the notebook PC 1 includes a CPU 11, ROM 12, memory 13, HDD (hard disk) 14, LCD 7, input unit 4, camera device 15, audio device 17, communication device 19, battery 21, DC-DC converter 22. , An AC adapter 23, and each part is connected directly or indirectly via a bus.

  The CPU 11 controls the entire notebook PC 1 by the OS 30 stored in the HDD 14 connected via the bus, and manages the function of executing processing based on various programs stored in the HDD 14. The ROM 12 stores a BIOS (Basic Input / Output System: basic input / output system) 12a, data, and the like.

  The memory 13 is composed of a cache memory and a RAM, and is a writable memory used as a work area for writing processing data of the execution program as a read area for the execution program of the CPU 11.

  The HDD (hard disk) 14 includes, for example, an OS 30 for controlling the entire notebook PC 1 such as Windows (registered trademark) XP, Vista, 7 and the like, and various drivers 31 such as various driver drivers for hardware operation of peripheral devices. In addition, it has a function of storing a video phone application program 32 for performing a video conference or chat, another application program 33 directed to a specific business, and the like.

  The LCD 7 converts display information into a video signal under the control of the CPU 11 and displays various information corresponding to the converted video signal on the display screen.

  In this embodiment, an LCD is used as a display. However, the present invention is not limited to this, and another display such as an organic EL display or a CRT may be used.

  The input unit 4 is a user interface for a user to perform an input operation, and includes a keyboard composed of various keys for inputting characters, commands, etc., a touch pad for moving a cursor on the screen, and selecting various menus. Etc.

  The camera device 15 includes a camera 8 and a camera processing circuit 16. The camera 8 includes a lens and an imaging unit (CCD or CMOS). The lens forms subject light, and the imaging unit outputs the imaged subject light as R, G, and B image signals. The camera processing circuit 16 includes an A / D converter, an image processing LSI, a memory, and the like. The camera processing circuit 16 performs drive timing and exposure control of the imaging unit, and performs data processing (A / D conversion, etc.) and output to the CPU 11.

  The audio device 17 includes a microphone 5, speakers 6 a and 6 b, and an audio processing circuit 18. The microphone 5 collects sound and outputs the sound data to the sound data processing unit 18. The speakers 6 a and 6 b output sound corresponding to the sound data output from the sound processing circuit 18. The audio processing circuit 18 includes an A / D converter, a D / A converter, an audio processing LSI, a memory, and the like, and processes audio data input from the microphone 5 (A / D conversion, etc.) Audio data (digital data) after data processing is output to the CPU 11 or audio data (digital) input from the CPU 11 is D / A converted and emitted from the speakers 6a and 6b.

  The communication device 19 is for transmitting and receiving data via a network, and transmits image data and audio data to the network, and receives image data and audio data transmitted via the network. Note that the communication device 19 may encode and transmit the image data and audio data, and may decode the encoded image data and audio data when received.

  The AC adapter 23 is connected to a commercial power supply, converts an AC voltage into a DC voltage, and outputs the DC voltage to the DC-DC converter 22. The DC-DC converter 22 converts the DC voltage supplied from the AC adapter 23 into a predetermined voltage, supplies power to each unit, and charges the battery 21. The battery 21 is charged by the DC-DC converter 22 and supplies the charged voltage to each unit. The battery 21 is used when the AC adapter 23 is not connected to a commercial power source.

  FIG. 3 is a schematic functional configuration diagram relating to the videophone of the notebook PC 1 of FIG. FIG. 4 is a diagram illustrating an example of the audio MUTE setting screen. In FIG. 3, an OS 30, an application program for videophone 32, another application program 33, a display driver 31a, a camera driver 31b, an audio driver 31c, and a communication driver 31d installed in the HDD 14 are read into the main memory 24 and the CPU 21 Executed by.

  The videophone application program 32 is an application program executed on the OS 30, and is used for making a call with an opponent terminal using an image and voice. The OS 30 intervenes in transmission / reception of data or commands between the videophone application program 32 and each device driver.

  The video phone application program 32 has a detection function for detecting that the video phone application program window is not displayed in the conventional video phone application such as Skype, and the video phone application program window is not displayed. An image mute setting function for transmitting a mute image to the partner terminal instead of an image captured by the camera 8 and displaying the mute image instead of an image captured by the camera 8 when a state is detected. Is added to an audio mute setting function for setting the audio signal to be transmitted to the counterpart terminal to mute.

  The videophone application program 32 causes the communication device 19 to establish a link with the partner terminal via the OS 30 and transmit an image captured by the camera 8 or a sound collected by the microphone 5 or transmitted from the partner terminal. Displaying images and sounds on the LCD 7 and emitting sounds from the speakers 6a and 6b. The videophone application program 32 acquires window display information of the LCD 7 from the OS 30. Here, the window display information of the LCD 7 includes information such as the size, coordinates, hierarchy, and non-display of the operation screen of the OS 30 (for example, activation of a screen saver, system lock, etc.). Based on the acquired window display information, the video phone application program 32 determines whether the video phone application program 32 is in a non-display state (hidden) or not. The MUTE image is transmitted to the counterpart terminal and displayed. Here, the MUTE image is transmitted to the counterpart terminal, but the MUTE image may be displayed when the MUTE command is transmitted to the counterpart terminal and the counterpart terminal receives the MUTE command.

  Here, the non-display state of the window of the videophone application program 32 means that when the window is hidden under the other application program 33 window, the window of the videophone application program 32 is minimized and displayed on the task bar. In this case, the case where the operation screen of the OS 30 is not displayed (screen saver activation, system lock, etc.) is included.

  Further, when outputting a MUTE image, the user can set on the screen whether or not the audio output is set to MUTE. FIG. 4 is a diagram illustrating an example of the audio MUTE setting screen. When the audio output MUTE is set when outputting the MUTE image, the videophone application program 32 instructs the audio driver 31c to output the audio, and the audio driver 31c does not output the audio. As a result, the voice output becomes MUTE at the counterpart terminal.

  The OS 30 controls basic operations of the notebook PC 1, manages various resources, and transmits, for example, instructions generated by the application program to the driver 31 and the BIOS 102a. The OS 30 has a multi-task function and a multi-window function, and also manages software resources such as an application program execution context (register set, main memory image, file handle, etc. used by a certain application program) and GUI parts. Has been made to do. In addition, the OS 30 causes the videophone application program 32 to output the above-described window display information of the LCD 7 in response to a request from the OS 30.

  The display driver 31a controls the LCD 7 according to an instruction from the OS 30. The camera driver 31b controls the camera device 15 according to an instruction from the OS 30. The audio driver 31b controls the audio device 17 in accordance with an instruction from the OS 30. The communication driver 31d controls the communication device 19 in accordance with an instruction from the OS 30.

  In the above configuration, an image captured by the camera 8 of the camera device 15 is transmitted from the communication device 19 to the counterpart terminal via the camera driver 31b, the OS 30, and the communication driver 31d. Further, the sound collected by the microphone 5 of the audio device 17 is transmitted from the communication device 19 to the counterpart terminal via the audio driver 31c, the OS 30, and the communication driver 31d. On the other hand, the image transmitted from the counterpart terminal is displayed on the LCD 7 via the communication device 19, the communication driver 31d, the OS 30, and the display driver 31a. On the other hand, the sound transmitted from the counterpart terminal is output from the speakers 6a and 6b of the audio device 17 via the communication device 19, the communication driver 31d, the OS 30, and the audio driver 31c.

  FIG. 5 is a flowchart for explaining processing in which the videophone application 32 displays a MUTE image on the communication partner. In FIG. 5, the videophone application program 32 acquires window display information of the LCD 7 from the OS 30 (step S1). The videophone application program 32 determines whether or not the window of the videophone application program 32 is hidden based on the acquired window display information (step S2).

  When the window of the videophone application program 32 is hidden (“Yes” in step S2), the videophone application program 32 sets a MUTE image (step S5) and returns to step S1. Specifically, the videophone application program 32 instructs the camera driver 31a to transmit a MUTE image, and the camera driver 31a outputs a MUTE image instead of the captured image in response to this instruction. As a result, the MUTE image is transmitted to the counterpart terminal, and the MUTE image is displayed on the display screen of the counterpart terminal. Note that, when the audio MUTE is set on the audio MUTE setting screen, the videophone application program 32 sets the audio signal to MUTE and does not output the audio signal to the counterpart terminal.

  On the other hand, if the window of the videophone application program 32 is not hidden (“No” in step S2), it is determined whether or not a MUTE image is set (step S3), and no MUTE image is set. In the case (“No” in step S3), the process returns to step S1. On the other hand, when the MUTE image is set (“Yes” in step S3), the MUTE image is canceled (step S4), and the process returns to step S1. Specifically, the videophone application program 32 instructs the camera driver 31b to transmit a captured image, and the camera driver 31b stops outputting the MUTE image and outputs the captured image in response to this instruction. . Thereby, the captured image is transmitted to the counterpart terminal, and the captured image is displayed on the display screen of the counterpart terminal.

  FIG. 6 shows a display example of the display screen of each of the notebook PCs 1A and 1B that is configured as shown in FIGS. 1 to 5 and is communicating with a video phone between the notebook PC 1A and the notebook PC 1B. Yes.

  As shown in FIG. 6A, the videophone application program 32 is activated on the notebook PC 1A and the notebook PC 1B, and the windows WA1 and WB1 are displayed on the LCDs 7A and 7B. Mr. A is the owner of PC1A, and the image of Mr. A taken by the camera 8A is transmitted to Mr. B's PC1B and displayed in the window WB1. On the other hand, Mr. B is the owner of PC1B, and the image of Mr. B taken by the camera 8B is transmitted to Mr. A's PC1A and displayed in the window WA1.

  Here, for example, as shown in FIG. 6B, when Mr. A displays the window WA2 of another application program 33, the window WA1 of the videophone application program 32 is not displayed. When the window WA1 of the videophone application program 32 is not displayed (“Yes” in step S2 in FIG. 5), the videophone application program 32 transmits the MUTE image to the notebook PC 1B of Mr. B (FIG. 5). In step S5), the MUTE image is displayed in the window WB1 of Mr. B's PC1B. In this way, Mr. A transmits a MUTE image even if the window WA1 of the videophone application program 32 is hidden under another window and forgets that he / she has taken a picture. It is possible to prevent sending a prepared photographed image.

  As described above, according to the present embodiment, the videophone application program 32 detects that the window of the videophone application program is not displayed when communicating with the counterpart terminal. In this case, since the mute image is displayed on the other party's terminal instead of the image captured by the camera 8, an inadvertent image is generated when the TV phone application program is executed on the OS having the multi-window function. Can be automatically prevented from being transmitted.

  In addition, when the video phone application program 32 detects that the window of the video phone application program 32 is in a non-display state, the video phone application program 32 transmits a mute image instead of the image picked up by the camera 8, and the counterpart terminal Since it is only necessary to display a mute image sent from the transmission side on the reception side, the processing on the reception side is simplified.

  Further, the non-display state of the window of the video phone application program 32 is a state in which it is hidden under another window, the state of the video phone application program window being minimized, the state of starting the screen saver, Since the system lock is at least one of the activated states, it is possible to automatically transmit an inadvertent image in various cases where the window of the videophone application program 32 is not displayed. It becomes possible to prevent.

  Further, when transmitting a MUTE image, the user can set whether or not to mute the audio signal transmitted to the counterpart terminal, and the videophone application program 32 can be used to transmit a mute image. Depending on the user's settings, the audio signal to be transmitted to the counterpart terminal is set to mute or not set, so that not only inadvertent images but also inadvertent audio is automatically prevented. It becomes possible.

  In the above embodiment, the case where the present invention is applied to a notebook PC has been described. However, the present invention is not limited to this, and other information processing apparatuses such as a desktop PC, a PDA, and a mobile phone are also described. Applicable.

  The information processing apparatus, its communication method, and computer-executable program of the present invention can be used when a videophone application program is executed on an OS equipped with a multi-window function.

1 Notebook PC
2 Main Body Side Housing 3 Display Side Housing 4 Input Unit 5 Microphone 6a, 6b Speaker 7 LCD (Liquid Crystal Display)
8 Camera 9a, 9b Connecting part (hinge part)
11 CPU
12 ROM
13 Memory 14 HDD
DESCRIPTION OF SYMBOLS 15 Camera device 16 Camera processing circuit 17 Audio device 18 Audio processing circuit 19 Communication device 21 Battery 22 DC-DC converter 23 AC adapter 30 OS
31 Driver 32 Video phone application program 33 Other application programs

Claims (7)

In an information processing apparatus including an OS having a multi-window function and a videophone function for transmitting an image captured by a camera to a partner terminal and performing bidirectional communication,
Using an application program for videophone that realizes the videophone function,
Detecting means for detecting that a window of the application program for videophone is in a non-display state by acquiring window display information from the OS when communicating with the counterpart terminal;
Image mute setting means for displaying a mute image on the counterpart terminal instead of the image captured by the camera when the detection means detects that the window of the videophone application program is in a non-display state. When,
An information processing apparatus comprising:   The image mute setting unit transmits a mute image instead of the image captured by the camera when the detection unit detects that the window of the videophone application program is in a non-display state. The information processing apparatus according to claim 1, wherein the information processing apparatus is displayed on the counterpart terminal.   The non-display state of the video phone application program window is in a state where it is hidden under another window, the video phone application program window is minimized, the screen saver is activated, and the system The information processing apparatus according to claim 1, wherein the information processing apparatus is at least one of states in which the lock is activated.   Furthermore, the image mute setting means includes audio mute setting means for setting the audio signal to be transmitted to the counterpart terminal when the mute image is displayed on the counterpart terminal instead of the image captured by the camera. The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. When the image mute setting means displays a mute image on the counterpart terminal instead of the image captured by the camera, the user can set whether to mute the audio signal transmitted to the counterpart terminal. And
The audio mute setting means, when the image mute setting means displays a mute image on the counterpart terminal instead of the image captured by the camera, transmits to the counterpart terminal according to the setting of the user. 5. The information processing apparatus according to claim 4, wherein the audio signal is set to mute or not set. In a communication method of an information processing apparatus provided with an OS having a multi-window function and a videophone function for performing bidirectional communication by transmitting an image captured by a camera to a partner terminal,
When the detection means communicates with the counterpart terminal using the videophone application program that realizes the videophone function, the display means acquires the window display information from the OS, thereby Detecting that the window of the application program is hidden;
The image mute setting means displays a mute image on the counterpart terminal instead of the image captured by the camera when the detecting means detects that the window of the videophone application program is in a non-display state. A process of
A communication method for an information processing apparatus, comprising: A program installed in an information processing apparatus including an OS having a multi-window function and a videophone function for transmitting an image captured by a camera to a partner terminal to perform bidirectional communication,
When the detection means communicates with the counterpart terminal using the videophone application program that realizes the videophone function, the display means acquires the window display information from the OS, thereby Detecting that the window of the application program is hidden;
The image mute setting means displays a mute image on the counterpart terminal instead of the image captured by the camera when the detecting means detects that the window of the videophone application program is in a non-display state. A process of
A computer-executable program characterized by causing a computer to execute.

Images