JP4223930B2 - Device system, device control program, and program recording medium - Google Patents

Description

  The present invention relates to a device system in which a plurality of devices are connected to each other, a device control program for controlling the devices connected to each other, and a program recording medium in which the device control program is recorded.

  Conventionally, home appliances and personal computers have been clearly separated. However, along with recent improvements in computer technology and home appliance technology, personal computers can function as conventional home appliances or operate in conjunction with home appliances. Yes.

  Specifically, there is an example in which a personal computer is connected to a home appliance such as a digital camera or a video camera, and a captured image or moving image is edited with the personal computer. In addition, not only AV (Audio Video) equipment but also a microwave oven that can be used to acquire cooking recipe information by connecting to the Internet has appeared. is doing.

  In this way, home appliances in the home are connected to each other to form a network, and by connecting them, a so-called information home appliance housing has been created that allows residents to live comfortably. In such information appliance homes, a TV set in the living room is used as a monitor, and lighting and air conditioner control of each room is controlled by a remote control or voice recognition device, or device control information including information from devices is monitored. It has functions such as obtaining from synthesized speech as well as from. As an example for realizing such an information home appliance, a voice input microphone, a speaker, or the like is used as in a “household equipment control system” disclosed in Patent Document 1 (Japanese Patent Laid-Open No. 2001-285969). There are systems that control TVs and air conditioners.

  However, the conventional information home appliances have the following problems. In other words, when device control information is displayed on a television, it is difficult to operate the device in a room where the television is not installed, and it is necessary to install some kind of monitor in each room to avoid it. There is a method of mounting a display device on the remote control, but in the case of a room where a television is installed, the operability of device control is improved by displaying on the television.

  Such a problem occurs not only in the display of the device control information as described above, but also in the feedback from the device by sound such as synthesized speech. In other words, it is difficult to install a speaker in each room, but the performance of the speaker installed in the remote control is not so high, so if there is a room where the speaker is installed, it is better to use the speaker in that room Easy to hear information.

  There is a similar problem with respect to input. For example, in the “household equipment control system” disclosed in Patent Document 1, the operator can control each device with a voice input microphone arranged in the room. However, when there is a remote controller equipped with another microphone, there may be a situation where the distance between the operator and the voice input microphone is long even though there is a remote controller equipped with the microphone. Therefore, it may not always be optimal to use a voice input microphone arranged in a room.

Thus, there is a problem that the operability of device control may be reduced depending on the device that inputs and outputs information.
JP 2001-285969 A

  Accordingly, an object of the present invention is to provide a device system, a device control program, and a program recording medium that can determine an appropriate input / output destination in accordance with an operation state of an operator.

In order to solve the above problems, the device system of the present invention provides:
Multiple devices are connected to each other and configured to exchange data with each other.
At least one of the plurality of devices is configured to have the input section including a voice input unit, a first device for sending input information input from the input unit,
At least one of the plurality of devices has an input device determination unit that determines an input device to function as an input device of the device system among the first devices, and transmits information on the determined input device Second device to
At least one of the plurality of devices, which has an output comprising a voice output unit and an image output unit, a third device for outputting the output information received from the output unit,
At least one of the plurality of devices, which has the output device determination unit that determines the output device to function as the output device of the instrument system of the third device, determined for the output device A fourth device that sends out information,
At least one of the plurality of devices receives and decodes the input information from the input device based on the information on the input device transmitted from the second device, and responds to the decoding result of the input information. The operation instruction information corresponding to the decoding result is transmitted to the selected device, while receiving the operation information from the device to which the operation instruction information is transmitted, based on the output device information transmitted from the fourth device. And a fifth device that sends the operation information to the output device .

According to the above configuration, the output device of the device system is determined by the output device determination unit provided in the fourth device that is at least one device among the plurality of devices connected to each other. In this way, it is possible to determine an appropriate output destination according to the operation status of the plurality of devices by the user. Furthermore, the input device of the device system is determined by the input device determination unit provided in the second device that is at least one device. In this way, it is possible to determine an appropriate input destination according to the operation status of the plurality of devices by the user. In other words, a device that is not operated by the user is designated as an input / output device, a device far from the user is designated as an input / output device, or a device with low output performance or input performance is designated as an input / output device. The trouble that is done will be solved.

Furthermore, the fifth device, which is at least one device, receives and decodes the input information from the input device based on the information on the input device sent from the second device, and decodes the input information. The operation instruction information according to the decoding result is transmitted to the device according to the result, while the output transmitted from the fourth device upon receiving the operation information from the destination device of the operation instruction information. Based on the device information, the operation information is sent to the output device.

In the device system of one embodiment,
The third device having the output unit includes an output performance information storage unit that stores the output performance of the output unit,
The output device determination unit is configured to determine, as the output device, a device having the highest output performance stored in the output performance information storage unit among the third devices.

According to this embodiment, the third device having the output unit with the highest output performance among the plurality of devices connected to each other is determined as the output device. Therefore, the problem that the third device having the output unit with low output performance is designated as the output device is solved.

In the device system of one embodiment,
The first device having the input unit includes an input performance information storage unit that stores the input performance of the input unit,
The input device determination unit is configured to determine, as the input device, a device having the highest input performance stored in the input performance information storage unit among the first devices.

According to this embodiment, the first device having the input unit with the highest input performance among the plurality of devices connected to each other is determined as the input device. Therefore, the problem that the first device having the input unit with low input performance is designated as the input device is solved.

In the device system of one embodiment,
The output device determination unit determines the output device when outputting information from the device system.

  According to this embodiment, the output device is determined when information is output from the device system. Therefore, even when the operation status (operating device and operation location) of the plurality of devices by the user changes with time, an appropriate output destination is determined at the time of information output.

In the device system of one embodiment,
The input device determination unit determines the input device when information is input to the device system by a user.

  According to this embodiment, the input device is determined when information is input to the device system. Therefore, even when the operation status (operating device and operation location) of the plurality of devices by the user changes with time, an appropriate input destination is determined when inputting information.

In the device system of one embodiment,
The output device determination unit is configured to determine, as the output device, a device that is last operated by a user among the third devices having the output unit.

According to this embodiment, the problem that the third device that is not operated by the user is designated as the output device is solved.

In the device system of one embodiment,
The input device determination unit is configured to determine a device operated by a user as the input device among the first devices having the input unit.

According to this embodiment, the problem that the first device that is not operated by the user is designated as the input device is solved.

In the device system of one embodiment,
At least one of the plurality of devices has a sensor including an infrared sensor and a camera for acquiring position information of the user,
The output device determination unit sets, as the output device, a device located closest to the user among the third devices having the output unit based on the position information of the user acquired by the sensor. It comes to decide.

According to this embodiment, among the plurality of devices connected to each other, the third device having the output unit and located closest to the user is determined as the output device. Therefore, the problem that the third device located far from the user is designated as the output device is solved.

In the device system of one embodiment,
At least one of the plurality of devices has a sensor including an infrared sensor and a camera for acquiring position information of the user,
The input device determination unit, based on the position information of the user acquired by the sensor, the device located closest to the user among the first devices having the input unit as the input device It comes to decide.

According to this embodiment, among the plurality of devices connected to each other, the first device which is located closest to the and users have the input unit is determined as the input device. Therefore, the problem that the first device located far from the user is designated as the input device is solved.

The device control program of the present invention is
Computer
It functions as at least one of the output device determination unit , the input device determination unit, and the fifth device in the device system of the present invention.

  According to the above configuration, it is possible to determine an appropriate input destination or output destination in accordance with the operation status of the plurality of devices by the user. Therefore, a device that is not operated by the user is specified as an input / output device, a device far from the user is specified as an input / output device, or a device with low output performance or input performance is specified as an input / output device. The problem that is done is solved.

Further, the input information from the determined input device is received and decoded, and the operation instruction information according to the decoding result is transmitted to the device according to the decoding result of the input information, while the operation instruction information is transmitted. In response to the operation information from the previous device, the operation information can be sent to the output device based on the determined output device information.

The program recording medium of the present invention is
A device control program of the present invention is recorded.

  According to the above configuration, it is possible to determine an appropriate input destination or output destination according to the operation status of the plurality of devices by the user. Therefore, a device that is not operated by the user is specified as an input / output device, a device far from the user is specified as an input / output device, or a device with low output performance or input performance is specified as an input / output device. The problem that is done is solved.

Further, the input information from the determined input device is received and decoded, and the operation instruction information according to the decoding result is transmitted to the device according to the decoding result of the input information, while the operation instruction information is transmitted. In response to the operation information from the previous device, the operation information can be sent to the output device based on the determined output device information.

As is clear from the above, according to the present invention, the output device determination unit provided in the fourth device, which is at least one device, among the plurality of devices connected to each other to configure the device system. Since the output device of the device system is determined, it is possible to determine an appropriate output destination according to the operation status of the plurality of devices by the user. In addition, since the input device of the device system is determined by the input device determination unit provided in the second device, which is at least one device , an appropriate input destination according to the operation status of the plurality of devices by the user. Can be determined.

  Therefore, a device that is not operated by the user is specified as an input / output device, a device far from the user is specified as an input / output device, or a device with low output performance or input performance is specified as an input / output device. This makes it possible to eliminate the problems that occur, and to provide a device system that is easy for the user to use.

Furthermore, the fifth device, which is at least one device, receives and decodes the input information from the input device based on the information on the input device sent from the second device, and decodes the input information. The operation instruction information according to the decoding result is transmitted to the device according to the result, while the output transmitted from the fourth device upon receiving the operation information from the destination device of the operation instruction information. Based on the device information, the operation information is sent to the output device.

  Hereinafter, the present invention will be described in detail with reference to the illustrated embodiments.

First Embodiment FIG. 1 is a block diagram showing a schematic configuration in a device system of the present embodiment. The device system 1 is configured by connecting a television receiver 2, a personal computer (hereinafter abbreviated as a personal computer) 3, a remote controller 4 and an air conditioner 5.

  Here, in the device system 1, it is assumed that the devices 2 to 5 are connected by a network called Ethernet conforming to IEEE (Eye Triple E) 802.3. Each of the devices 2 to 5 transmits and receives data for each transmission unit called a packet obtained by dividing a digital data into a predetermined length by a protocol called TCP (Transmission Control Protocol) / IP (Internet Protocol). It is assumed that information is transmitted and acquired by

  In the device system of this embodiment, the IP address of the television receiver 2 is set to 192.168.1.1.101, the IP address of the personal computer 3 is set to 192.168.1.102, and the IP address of the remote controller 4 is set to 192. .168.1.103, and the IP address of the air conditioner 5 is 192.1688.1.104.

  In this embodiment, the devices 2 to 5 are connected by Ethernet and TCP / IP. However, if the individual devices 2 to 5 are connected to each other and can exchange information, the connection method is used. Can be anything. In addition, the operation command transmitted to each of the devices 2 to 5 is represented by information indicating an operation command and information indicating a corresponding operation.

  Further, in the device system 1 according to the present embodiment, when there is any input such as a button on the remote controller 4 being pressed by the user, the device system 1 is connected from the input device (for example, the remote controller 4). Assume that a packet indicating that the input has started is transmitted to all the devices (for example, the television receiver 2, the personal computer 3, and the air conditioner 5). In the above example, the packet is sent to all devices, but the device having the input unit stores the device having the input device determining unit and the output device determining unit, which will be described later, It does not matter if the packet is sent only to the device. In the present embodiment, the output information of the device system 1 handles only video information. However, the audio information is also simultaneously output, for example, by outputting the result of changing the set temperature of the air conditioner 5 together with the video by voice synthesis. You may make it handle.

  Regarding the details of the device system 1 having the above-described configuration, the output device determination unit and the input device determination unit are mounted on the personal computer 3, and the output device determination unit determines the device operated by the user as the output destination, The input device determination unit determines a device operated by the user as an input destination. Then, a case where the user performs an operation for raising the temperature of the air conditioner 5 on the remote controller 4 constituting the device system 1 will be described as an example.

  First, each of the devices 2 to 5 constituting the device system 1 will be described. FIG. 2 is a block diagram showing a configuration of the television receiver 2, and includes a broadcast receiving unit 11, a control unit 12, a video output unit 13, an audio output unit 14, a video output performance information storage unit 15, a packet receiving unit 16, and The packet transmission unit 17 is configured.

  The broadcast receiving unit 11 receives the received broadcast radio wave, converts it into video and audio of the broadcast content, and outputs it to the control unit 12. For this function, the function of a conventional television receiver is used as it is. The control unit 12 performs control of output information and network communication.

  FIG. 3 is a flowchart showing the processing operation of the control unit 12. Hereinafter, the operation of the control unit 12 will be described with reference to FIG. When the power of the television receiver 2 is turned on, the processing operation by the control unit 12 is started.

  In step S 1, the video and audio transmitted from the broadcast receiving unit 11 are output to the video output unit 13 and the audio output unit 14. The processing by this step is the same as the processing by the conventional television receiver. In step S2, it is determined whether or not data has been sent from the packet receiver 16. As a result, if data is sent, the process proceeds to step S3. Otherwise, the process returns to step S1 to continue outputting the broadcast contents.

  In step S3, it is determined whether or not the data sent from the packet receiver 16 is an inquiry about the video output performance of the television receiver 2. As a result, if it is an inquiry about the video output performance, the process proceeds to step S4, and if not, the process proceeds to step S5. In step S4, the video output performance information of the television receiver is read from the video output performance information storage unit 15 and sent to the packet transmission unit 17 with the source of the inquiry as the destination. After that, the process returns to step S1 and shifts to the output of broadcast contents.

  In step S5, it is determined whether or not the data sent from the packet receiver 16 is an operation command for the television receiver 2. As a result, if it is an operation command, the process proceeds to step S6, and if not, the process proceeds to step S8. In step S6, an operation corresponding to the operation command such as “change channel” is performed. In step S7, information indicating the completion of the operation is sent to the packet transmitter 17 with the personal computer 3 as the destination. After that, the process returns to step S1 and shifts to the output of the broadcast contents.

  In step S8, it is determined whether or not the data sent from the packet receiver 16 is output information of the device system 1. As a result, if it is output information, the process proceeds to step S9, and if not, the process returns to step S1 and shifts to output of broadcast contents. In step S9, the output information of the device system 1 is sent to the video output unit 13. After that, the process returns to step S1 and shifts to the output of the broadcast contents. The output information of the device system 1 is various video information of the device system 1 including, for example, a change result of the set temperature for the air conditioner 5.

  The video output unit 13 includes video output means capable of video output including a liquid crystal display panel and the like. The video output unit 13 receives output information from the control unit 12 and displays video based on the input output information. The audio output unit 14 includes audio output means that can output audio including a speaker or the like. The audio output unit 14 receives output information from the control unit 12 and outputs audio based on the input output information. The video output performance information storage unit 15 stores numerical values such as the number of pixels and the number of colors representing the output performance of the video output unit 13. In the present embodiment, it is assumed that the number of pixels of the video output unit 13 is stored.

  The packet receiving unit 16 receives a packet flowing on the network, and restores data transmitted based on the received packet. The packet transmission unit 17 receives the data output from the control unit 12, packetizes the data according to TCP / IP, and outputs the obtained packet to the network.

  FIG. 4 is a flowchart of the processing operation by the packet receiver 16. Hereinafter, the operation of the packet receiving unit 16 will be described with reference to FIG. When the power of the television receiver 2 is turned on, the processing operation by the packet receiver 16 is started.

  In step S11, it is determined whether or not a packet is flowing on the network. As a result, if it is flowing, the process proceeds to step S12. On the other hand, if it is not flowing, it waits for a packet to flow on the network. In step S12, a flowing packet is received and its contents are read. In step S13, it is determined whether or not the received packet is addressed to the television receiver 2. As a result, if it is addressed to the television receiver 2, the process proceeds to step S14. On the other hand, if not, the process returns to step S11, and shifts to a determination of whether or not a packet is flowing on the network.

  In step S14, data is restored from the transmitted packet. The packet is obtained by subdividing data to be transmitted. Therefore, data is restored from the received packet according to TCP / IP. In step S15, it is determined whether or not the data restoration is completed. As a result, if completed, the process proceeds to step S16. On the other hand, if not completed, the process returns to step S11, and the process proceeds to a determination as to whether or not a packet is flowing on the network. In step S16, the restored data is sent to the control unit 12. After that, the process returns to step S11 and shifts to determination of whether or not a packet is flowing on the network.

  In this way, the television receiver 2 outputs the received broadcast video and audio, and when receiving an inquiry packet regarding the video output performance, transmits the video output performance information to the inquiry destination as a packet, When the operation instruction packet is received, the corresponding operation is performed and the operation completion information is transmitted to the personal computer 3. When the output information packet is received, the output information of the device system 1 is output as a video. is there.

  FIG. 5 is a block diagram showing the configuration of the personal computer 3. The personal computer 3 includes a voice recognition unit 21, an output device determination unit 22, an input device determination unit 23, a control unit 24, a video output unit 25, a voice output unit 26, a video output performance information storage unit 27, an output device storage unit 28, An input device storage unit 29, a packet receiving unit 30, and a packet transmitting unit 31 are included. In the present embodiment, the output device determination unit 22 and the input device determination unit 23 are mounted on the personal computer 3 to determine the device that functions as the output device of the device system 1 and the device that functions as the input device. 3 is done. However, in the present invention, this is not always necessary, and the output device determination unit and the input device determination unit are included in each device (the television receiver 2, the personal computer 3, the remote controller 4, and the air conditioner 5) constituting the device system 1. It can be installed in either. Further, although the voice recognition unit 21 is mounted on the personal computer 3, the user input does not necessarily have to be a voice, and may be a keyboard input or a button input. Further, the interpretation of the input may be performed by any device constituting the device system 1.

  The voice recognition unit 21 performs voice recognition processing using the voice output from the control unit 24 as an input. The voice recognition process is performed using existing technology. In this example, the vocabulary that is accepted during speech recognition is “turn on air conditioner”, “turn off air conditioner”, “increase temperature”, “lower temperature”, “turn on TV”, “turn off TV”, “two channels” ”And the like are provided for the operation of each device constituting the device system 1. As recognition units, discrete words may be recognized using the vocabulary listed above as one vocabulary, or continuous speech recognition may be performed as sentences by separating each word.

  In addition, as a result of the voice recognition process, information indicating which of the devices 2 to 5 is an operation and information indicating what operation is performed are output to the control unit 24. The information representing the device to be operated may be anything as long as each device can be uniquely represented. In this example, since each device is connected by TCP / IP, the IP address is used. The information indicating what operation is performed may be anything as long as the operation is uniquely determined for each device 2 to 5. In this example, each operation name is set corresponding to a number. And FIG. 6 shows a correspondence example between the “recognition result”, “information representing the operation target device”, and “information representing the operation” by the voice recognition unit 21.

  The output device determination unit 22 determines which device to output information from. FIG. 7 is a flowchart of processing operations when an output destination is determined for a device operated by a user, as an example of an output device determination method by the output device determination unit 22. Hereinafter, an example of the processing operation of the output device determination unit 22 will be described with reference to FIG.

  In step S21, it is determined whether or not information on the device last operated by the user has been received from the control unit 24. As a result, if information on the operating device has been received, the process proceeds to step S22. In step S22, it is determined whether or not the operating device has an output unit. As a result, if it does, it proceeds to step S23, and if it does not, it proceeds to step S24. In step S23, the stored information in the output device storage unit 28 is rewritten with the received information on the operating device. In step S24, a notification of output unit determination is sent to the control unit 24. After that, the process returns to step S21 to wait for receiving information on the device operated last by the user.

  In the present embodiment, an example is described in which video information is output using only the television receiver 2 as an output unit. However, the output of the device system 1 may be output using a plurality of output units. In the case of a device system capable of outputting video information and audio information, the video information and audio information may be output by one device, or may be output from output units of different devices.

  The input device determination unit 23 determines which device the information is input from. FIG. 8 is a flowchart of processing operations when determining an input destination for a device operated by a user, as an example of an input device determination method by the input device determination unit 23. Hereinafter, an example of the processing operation of the input device determination unit 23 will be described with reference to FIG.

  In step S31, it is determined whether or not information on the operated device is received from the control unit 24. As a result, if the information on the operating device has been received, the process proceeds to step S32. If not received, the process waits for reception. In step S32, the information stored in the input device storage unit 29 is rewritten with the received information on the operating device. In step S33, a notification of input unit determination is sent to the control unit 24. After that, the process returns to step S31 and waits to receive information on the device operated by the user.

  The control unit 24 receives data from the packet receiving unit 30 and performs control for performing processing corresponding to the contents. FIG. 9 shows a control process performed by the control unit 24 when data indicating that an input has started is received from the packet receiving unit 30 when the input device determining unit 23 determines an input destination for the device operated by the user. It is a flowchart of operation | movement. Hereinafter, the input control processing operation by the control unit 24 will be described with reference to FIG.

  In step S41, information indicating which device the input operation has started is output to the input device determination unit 23. As information for identifying the device in that case, since the devices 2 to 5 are connected by TCP / IP, an IP address is output. In step S42, it is determined whether or not the input device determination unit 23 has notified the determination input unit. As a result, if there is a notification, the process proceeds to step S43. In step S43, it is determined whether or not the input information from the determined input unit (the input unit notified in step S42) is received from the packet receiving unit 30. As a result, if it has been received, the process proceeds to step S44, and if it has not been received, it waits to receive information.

  In step S44, the received input information is output to the voice recognition unit 21. In step S45, it is determined whether or not a recognition result is output from the voice recognition unit 21. As a result, if it is output, the process proceeds to step S46, and if it is not output, it waits for the recognition result to be output. The series of processes from step S43 to step S45 realizes a repetitive operation of waiting until input information is received, sending the input information to the voice recognition unit 21 and further waiting until a recognition result is received.

  In step S46, the operation target device information and the operation information, which are the output recognition results, are received and output to the packet transmitter 31. Thus, the input control processing operation is completed.

  FIG. 10 is a flowchart of the control processing operation by the control unit 24 when outputting information from the device system 1 to the user when the output device is determined by the output device determination unit 22 to the device operated by the user. It is. Hereinafter, the output control processing operation by the control unit 24 will be described with reference to FIG.

  In step S51, the storage information in the input device storage unit 29 is output to the output device determination unit 22. In this way, information on the device that was last directly operated by the user is sent to the output device determination unit 22. In step S52, it is determined whether or not the output device determination unit 22 has notified the determination output unit. As a result, if there is a notification, the process proceeds to step S53. In step S53, it is determined whether or not the output data of the device system 1 is received from the packet receiver 30. As a result, if it has been received, the process proceeds to step S54, and if it has not been received, it waits to receive information. In step S 54, the received output data of the device system 1 and the stored contents of the output device storage unit 28 are output to the packet transmission unit 31. After that, the output processing operation ends.

  The video output unit 25 includes a liquid crystal display and is configured to display a video, and displays video information. Moreover, the audio | voice output part 26 is comprised so that an audio | voice can be output including a speaker, and outputs audio | voice information. The video output performance information storage unit 27 stores a numerical value representing the output performance of the video output unit 25, and in this embodiment, the number of pixels of the video output unit 25 is stored.

  The output device storage unit 28 stores information on devices having an output unit determined by the output device determination unit 22. In the present embodiment, the determined IP address of the device is stored. Further, it is assumed that the IP address of the television receiver 2 is stored as an initial value. Further, the input device storage unit 29 stores information on devices having an input unit determined by the input device determination unit 23. In the present embodiment, the determined IP address of the device is stored. It is assumed that the IP address of the remote controller 4 is stored as an initial value.

  The packet receiver 30 receives a packet flowing on the network and restores data sent from the received packet. The packet transmission unit 31 receives the data output from the control unit 24, packetizes the data according to TCP / IP, and outputs the obtained packet to the network.

  FIG. 11 is a flowchart of the processing operation performed by the packet receiver 30. Hereinafter, the operation of the packet receiving unit 30 will be described with reference to FIG. When the power of the personal computer 3 is turned on and the operation of the basic software (OS: operating system) is started, the processing operation by the packet receiving unit 30 is started.

  In step S61, it is determined whether a packet is flowing on the network. As a result, if it is flowing, the process proceeds to step S62, and if it is not flowing, it waits for a packet to flow on the network. In step S62, a flowing packet is received and its contents are read. In step S63, it is determined whether or not the received packet is destined for the personal computer 3. As a result, if it is addressed to the personal computer 3, the process proceeds to step S64. On the other hand, if not, the process returns to step S61, and shifts to a determination of whether or not a packet is flowing on the network.

  In step S64, data is restored from the transmitted packet. The packet is obtained by subdividing data to be transmitted. Therefore, data is restored from the received packet according to TCP / IP. In step S65, it is determined whether or not the data restoration is completed. As a result, if completed, the process proceeds to step S66. On the other hand, if not completed, the process returns to step S61, and the process proceeds to determination of whether a packet is flowing on the network. In step S66, the restored data is sent to the control unit 24. After that, the process returns to step S61, and the process proceeds to determination of whether or not a packet is flowing on the network.

  Thus, in the personal computer 3, the last operated device is determined and stored as an output unit, and the input device is determined and stored as an input unit. Then, the audio signal input from the determined input unit is recognized, and the image signal is output as a video. Furthermore, the voice recognition result is output as a voice, or the packet is transmitted as output information of the device system 1 to the determined output unit.

  FIG. 12 is a block diagram showing a specific configuration of the remote controller 4. The remote controller 4 includes a video output unit 41, an audio input unit 42, a talk switch 43, a control unit 44, a video output performance information storage unit 45, an input performance information storage unit 46, a packet reception unit 47, and a packet transmission unit 48. ing.

  The video output unit 41 includes a small liquid crystal display and is configured to be able to display video information on the remote controller, and displays the output information of the device system 1 received from the control unit 44. The voice input unit 42 includes a microphone or the like, converts voice input from the outside into a digital signal, and outputs the digital signal to the control unit 44. The talk switch 43 is operated by the user to indicate an input voice section. Further, when the talk switch 43 is pressed, input start information is output to the control unit 44. The control unit 44 performs processing corresponding to the output of the information input from the voice input unit 42 and the talk switch 43 to the packet transmission unit 48 and the data received from the packet reception unit 47.

  FIG. 13 is a flowchart of the processing operation by the control unit 44. Hereinafter, the processing operation performed by the control unit 44 will be described with reference to FIG.

  In step S71, it is determined whether or not input has been started. Specifically, it is performed by determining whether or not input start information from the talk switch 43 is received. As a result, if the input has started, the process proceeds to step S72, and if the input has not started, the process proceeds to step S75. In step S72, information notifying that the input has been started is output to the packet transmission unit 48 as data addressed to each device 2 to 5 constituting the device system 1. In step S73, it is determined whether or not the talk switch 43 is pressed. As a result, if the button is pressed, the process proceeds to step S74. If the button is not pressed, the process returns to step S71 to shift to the input start determination. In step S74, the digital audio signal from the audio input unit 42 is added to the digital audio signal stored so far and stored. After that, the process returns to step S73, and the process proceeds to the determination of pressing the talk switch 43. Thus, the digital audio signal input from the audio input unit 42 is continuously stored while the talk switch 43 is being pressed by the processing from step S72 to step S74.

  In step S75, it is determined whether or not data is received from the packet receiver 47. As a result, if received, the process proceeds to step S76, and if not received, the process returns to step S71 to shift to the input start determination. In step S76, it is determined whether the received data is an inquiry about the video output performance of the video output unit 41. As a result, if it is an inquiry about the video output performance, the process proceeds to step S77, and if not, the process proceeds to step S78. In step S77, the video output performance information of the video output unit 41 is read from the video output performance information storage unit 45, and is output to the packet transmission unit 48 with the transmission source of the inquiry as the destination. After that, the process returns to step S71 and shifts to input start determination.

  In step S78, it is determined whether the received data is an inquiry about the voice input performance of the voice input unit 42 or not. As a result, if it is an inquiry about input performance, the process proceeds to step S79, and if not, the process proceeds to step S80. In step S79, the input performance information is read from the input performance information storage unit 46, and is output to the packet transmission unit 48 with the transmission source of the inquiry as the destination. After that, the process returns to step S71 and shifts to input start determination.

  In step S80, it is determined whether or not the received data is output information of the device system 1. As a result, if it is the output information of the device system 1, the process proceeds to step S81, and if not, the process proceeds to step S82. In step S81, the output information of the device system 1 is output to the video output unit 41. After that, the process returns to step S71 and shifts to the input start determination.

  In step S82, it is determined whether or not the received data is a notification of input unit determination from the personal computer 3. As a result, if it is a notification of input unit determination, the process proceeds to step S83, and if not, the process returns to step S71 to shift to input start determination. In step S83, it is determined whether or not the determined input unit is the remote controller 4 based on the notification of the input unit determination. As a result, if it is the remote controller 4, the process proceeds to step S84, and if not, the process proceeds to step S85. In step S84, the digital audio signal stored in steps S72 to S74 is output to the packet transmitter 48 with the transmission source of the notification of the input unit determination as the destination. In step S85, the stored digital audio signal is erased. After that, the process returns to step S71 and shifts to the input start determination.

  The video output performance information storage unit 45 stores numerical values representing the output performance of the video output unit 41. In the present embodiment, it is assumed that the number of pixels of the video output unit 41 is stored. The input performance information storage unit 46 stores a numerical value representing the input performance of the voice input unit 42. In the present embodiment, it is assumed that the sensitivity value of the microphone used in the voice input unit 42 is stored.

  The packet receiving unit 47 receives a packet flowing on the network and restores data transmitted based on the received packet. The packet transmission unit 48 receives the data output from the control unit 44, packetizes the data according to TCP / IP, and outputs the obtained packet to the network.

  FIG. 14 is a flowchart of the processing operation performed by the packet receiver 47. Hereinafter, the operation of the packet receiving unit 47 will be described with reference to FIG. When the power of the remote controller 4 is turned on, the processing operation by the packet receiver 47 is started.

  In step S91, it is determined whether or not a packet is flowing on the network. As a result, if it is flowing, the process proceeds to step S92. If it is not flowing, it waits for a packet to flow on the network. In step S92, a flowing packet is received and its contents are read. In step S93, it is determined whether or not the received packet is destined for the remote controller 4. As a result, if it is addressed to the remote controller 4, the process proceeds to step S94. On the other hand, if not, the process returns to step S91, and the process proceeds to determination of whether or not a packet is flowing on the network.

  In step S94, data is restored from the sent packet. The packet is obtained by subdividing data to be transmitted. Therefore, data is restored from the received packet according to TCP / IP. In step S95, it is determined whether or not the data restoration is completed. As a result, if completed, the process proceeds to step S96. On the other hand, if not completed, the process returns to step S91, and the process proceeds to determination of whether or not a packet is flowing on the network. In step S96, the restored data is sent to the control unit 44. After that, the process returns to step S91, and the process proceeds to determination of whether or not a packet is flowing on the network.

  As described above, when the voice input is started, the remote controller 4 transmits the input start information as a packet, digitizes and stores the input voice, and receives the inquiry packet regarding the video output performance. Sends a packet of video output performance information to the inquiry destination, receives a packet of inquiry about the audio input performance, sends a packet of input performance information to the inquiry destination, and receives a packet of output information of the device system 1 Outputs the above output information as a video, and when receiving an input unit determination notification packet indicating that the remote controller 4 is determined to be an input unit, transmits the stored digital input voice to the notification destination. .

  FIG. 15 is a block diagram showing a specific configuration of the air conditioner 5. The air conditioner 5 includes an air conditioner function unit 51, a control unit 52, a packet reception unit 53, and a packet transmission unit 54.

  The air conditioner function unit 51 has a function of adjusting the room temperature, and has the same function as a normal air conditioner. The control unit 52 controls the operation of the air conditioner function unit 51 based on information flowing through the network. FIG. 16 is a flowchart of the processing operation by the control unit 52. Hereinafter, the operation of the control unit 52 will be described with reference to FIG. When the power of the air conditioner 5 is turned on, the processing operation by the control unit 52 is started.

  In step S101, it is determined whether or not data has been received from the packet receiver 53. As a result, if received, the process proceeds to step S102. If not received, the process waits to receive data from the packet receiving unit 53. In step S102, it is determined whether or not the received data is an operation command for the air conditioner 5. As a result, if the operation command is for the air conditioner 5, the process proceeds to step S103. On the other hand, if not, the process returns to step S101 and waits to receive data from the packet receiver 53. In step S103, the received operation command is executed. Specifically, the air conditioner function unit 51 is controlled to perform operations such as changing the set temperature of the air conditioner 5 and turning off the power. In step S104, information representing the result of executing the operation command is output to the packet transmitter 54 with the personal computer 3 as the destination. After that, the process returns to step S101 and waits to receive data from the packet receiving unit 53.

  The packet receiving unit 53 receives a packet flowing on the network, and restores data transmitted based on the received packet. The packet transmitter 54 receives the data output from the controller 52, packetizes the data according to TCP / IP, and outputs the obtained packet to the network.

  FIG. 17 is a flowchart of the processing operation by the packet receiver 53. Hereinafter, the operation of the packet receiving unit 53 will be described with reference to FIG. When the power of the air conditioner 5 is turned on, the processing operation by the packet receiver 53 is started.

  In step S111, it is determined whether or not a packet is flowing on the network. As a result, if it is flowing, the process proceeds to step S112. On the other hand, if it is not flowing, it waits for a packet to flow on the network. In step S112, a flowing packet is received and its contents are read. In step S113, it is determined whether or not the received packet is destined for the air conditioner 5. As a result, if it is addressed to the air conditioner 5, the process proceeds to step S114. On the other hand, if not, the process returns to step S111 and shifts to determination of whether or not a packet is flowing on the network.

  In step S114, data is restored from the transmitted packet. The packet is obtained by subdividing data to be transmitted. Therefore, data is restored from the received packet according to TCP / IP. In step S115, it is determined whether or not the data restoration is completed. As a result, if completed, the process proceeds to step S116. On the other hand, if not completed, the process returns to step S111 and shifts to determination of whether or not a packet is flowing on the network. In step S116, the restored data is sent to the control unit 52. After that, the process returns to step S111, and the process proceeds to determination of whether or not a packet is flowing on the network.

  As described above, in the air conditioner 5, when the operation command packet of the air conditioner 5 is received, the operation according to the operation command is executed, and the operation result information is packet-transmitted to the personal computer 4.

  Hereinafter, when the device operated last by the user is determined as the output destination, and the device operated by the user is determined as the input destination, the user raises the room temperature from the remote controller 4 constituting the device system 1 In the case where the operation is performed, the operation relating to each of the devices 2 to 5 will be specifically described.

  The user utters “Raise the temperature” while pressing the talk switch 43 of the remote controller 4, and then releases the talk switch 43. Then, according to the flowchart shown in FIG. 13, the control unit 44 in the remote controller 4 first outputs information indicating the start of input to the packet transmission unit 48. Further, the digital voice signal of the input voice “Raise temperature” from the voice input unit 42 is output to the packet transmission unit 48 as addressed to the personal computer 3. Then, the packet transmission unit 48 divides the voice data into packets addressed to the personal computer 3 and outputs them to the network.

  When the control unit 24 in the personal computer 3 receives the input start information transmitted from the remote controller 4, it inputs the IP address of the device (in other words, the remote controller 4) that has started input according to the flowchart shown in FIG. 9. The data is output to the device determination unit 23. Then, the input device determination unit 23 rewrites the storage information in the input device storage unit 29 according to the flowchart shown in FIG. 8 and outputs a notification determined by the input device to the control unit 24. The control unit 24 that has received the notification outputs the voice data from the remote controller 4 to the voice recognition unit 21. Then, based on the recognition result “increase temperature” received from the voice recognition unit 21, information indicating an operation corresponding to the recognition result addressed to the device related to the recognition result according to the correspondence table shown in FIG. To 31. In this case, information “3” indicating the operation “increase temperature” is output to the air conditioner 5.

  Then, the control unit 52 in the air conditioner 5 receives the information output from the personal computer 3 via the packet receiving unit 53. Then, according to the flowchart shown in FIG. 16, an operation of controlling the air conditioner function unit 51 to raise the set temperature is performed, and information indicating the execution result “operation completed” is sent to the personal computer 3 as output information of the device system 1 Output.

  The control unit 24 in the personal computer 3 outputs the IP address of the last operated device (that is, the remote controller 4 on which the input operation is first performed) to the output device determining unit 22 according to the flowchart shown in FIG. . Then, according to the flowchart shown in FIG. 7, the output device determination unit 22 determines the output device as the remote controller 4 and rewrites the storage information in the output device storage unit 28, and outputs the notification determined by the output device to the control unit 24. . The control unit 24 that has received the notification outputs the output information of the device system 1 output from the air conditioner 5 to the packet transmission unit 31 as addressed to the remote controller 4.

  Then, according to the flowchart shown in FIG. 13, the control unit 44 in the remote controller 4 displays information indicating that the operation of “increasing the set temperature” of the air conditioner has been completed as information on the device system output from the personal computer 3. The video is output to the output unit 41. In this way, a series of processing operations are completed.

-2nd Embodiment The whole structure of the apparatus system in this Embodiment is the same as the structure shown in FIG. 1 in the said 1st Embodiment. The internal configurations of the television receiver 2, the personal computer 3 and the remote controller 4 are the same as those in the first embodiment. However, the internal configuration of the air conditioner 5 is different from that in the first embodiment, and has a voice input unit as will be described in detail later. Hereinafter, the same numbers as those in the first embodiment are used for the components constituting the television receiver 2, the personal computer 3, and the remote controller 4.

  The output device determination unit 22 in the present embodiment determines, as an output device, a device having an output unit that exhibits the highest output performance among devices having an output unit. The input device determination unit 23 determines, as an input device, a device having an input unit that exhibits the highest input performance among devices having an input unit. Furthermore, in the present embodiment, it is assumed that the output performance of the video output unit 13 of the television receiver 2 is the highest and the input performance of the audio input unit of the air conditioner 5 is the highest.

  Hereinafter, the details of the device system 1 having the above configuration will be described by taking as an example a case where the user performs an operation of raising the set temperature of the air conditioner 5 constituting the device system 1 from the remote controller 4.

  FIG. 18 is a flowchart of the processing operation by the output device determination unit 22 in the personal computer 3. In the present embodiment, as described above, the output device determination unit 22 determines, as an output device, a device having an output unit that exhibits the highest output performance among devices having an output unit. Hereinafter, the processing operation of the output device determination unit 22 will be described with reference to FIG.

  In step S121, initialization is performed. Specifically, for example, an initial value such as “0” is substituted into a storage area for output performance that is temporarily used for comparison. In step S122, it is determined whether or not output performance information is received from the control unit 24. As a result, if it has been received, the process proceeds to step S123, and if it has not been received, it waits for reception. In step S123, the received output performance information is compared with the output performance value stored in the storage area, and it is determined whether or not the received output performance information is the maximum value. As a result, if it is the maximum value, the process proceeds to step S124, and if not, the process proceeds to step S125. In step S124, the contents of the storage area are rewritten with the received output performance information. Further, the storage contents of the output device storage unit 28 are rewritten with the received information of the device having the output performance.

  In step S125, it is determined whether or not output performance information of all devices has been received. As a result, if it has been received, the process proceeds to step S126. On the other hand, if it has not been received, the process returns to step S122 and waits for the reception of output performance information from the control unit 24. Here, in the series of processes from step S122 to step S125, the output performance information of all the devices is compared, and the device having the maximum output performance is stored in the output device storage unit 28. Yes. In step S126, an output unit determination notification is output to the control unit 24. After that, the process returns to step S121, and the process proceeds to initialization of the storage area for the output performance.

  In the present embodiment, the processing by the output device determination unit 22 is not completed until the output performance of all devices is received. However, in consideration of a case where there is a device that cannot output the output performance information due to some trouble or the like, the output unit determination notification may be output when a predetermined time has elapsed.

  FIG. 19 is a flowchart of the processing operation by the input device determination unit 23 in the personal computer 3. In the present embodiment, as described above, the input device determination unit 23 determines, as an input device, a device having an input unit that exhibits the highest input performance among devices having an input unit. Hereinafter, the processing operation of the input device determination unit 23 will be described with reference to FIG.

  In step S131, initialization is performed. Specifically, for example, an initial value such as “0” is substituted into a storage area for input performance that is temporarily used for comparison. In step S132, it is determined whether or not input performance information is received from the control unit 24. As a result, if it has been received, the process proceeds to step S133, and if it has not been received, it waits for reception. In step S133, the received input performance information is compared with the input performance value stored in the storage area, and it is determined whether or not the received input performance information is the maximum value. As a result, if it is the maximum value, the process proceeds to step S134, and if not, the process proceeds to step S135. In step S134, the contents of the storage area are rewritten with the received input performance information. Further, the stored content of the input device storage unit 29 is rewritten with the information of the device having the received input performance.

  In step S135, it is determined whether input performance information of all devices has been received. As a result, if it has been received, the process proceeds to step S136. On the other hand, if it has not been received, the process returns to step S132 and waits for input performance information from the control unit 24 to be received. Here, in the series of processing from step S132 to step S135, processing is performed in which the input performance information of all devices is compared and the device having the maximum input performance is stored in the input device storage unit 29. Yes. In step S136, a notification of input unit determination is output to the control unit 24. After that, the process returns to step S131 and the process proceeds to initialization of the storage area for the input performance.

  In the present embodiment, the processing by the input device determination unit 23 is not completed until the input performance of all devices is received. However, in consideration of the case where there is a device that cannot output the input performance information due to some trouble or the like, the input unit determination notification may be output when a predetermined time has elapsed.

  FIG. 20 shows the control in the case where data indicating that the input has started is received from the packet receiving unit 30 when the input destination is determined by the input device determining unit 23 to the device having the input unit exhibiting the highest input performance. 4 is a flowchart of a control processing operation by a unit 24. Hereinafter, the input control processing operation by the control unit 24 will be described with reference to FIG. When the data indicating that the input is started is received, the input control processing operation by the control unit 24 is started.

  In step S141, data for inquiring about input performance is output to the packet transmission unit 31 with all the devices 2 to 5 connected to the device system 1 as destinations. In step S142, it is determined whether or not there is a notification of input unit determination from the input device determination unit 23. As a result, if there is a notification, the process proceeds to step S145, and if not, the process proceeds to step S143. In step S143, it is determined whether or not data including input performance information, which is an answer to the input performance inquiry output in step S141, is received from the packet receiver 30. As a result, if it has been received, the process proceeds to step S144. On the other hand, if not received, the process returns to step S142, and the process proceeds to a determination process for determining whether or not the input device determination unit 23 has notified the input unit determination. In step S144, the received answer (that is, input performance information) is output to the input device determination unit 23. After that, the process returns to step S142, and the process proceeds to a determination process for determining whether or not the input device determination unit 23 has notified the input unit determination. Here, in the series of processes from step S142 to step S144, until the input device is determined, an answer regarding the input performance information inquired to each device 2-5 in step S141 is received and the input device determination unit 23 receives it. Processing to continue output.

  In step S145, since the notification of the input unit determination is received, information indicating the input unit determination destined for the device having the determined input unit is output to the packet transmission unit 31.

  In step S146, it is determined whether or not there is an input from the device having the determined input unit (the device notified in step S142). As a result, if there is an input, the process proceeds to step S147, and if not, the process waits until there is an input. In step S147, the received input information is output to the voice recognition unit 21. In step S148, it is determined whether or not a recognition result is output from the voice recognition unit 21. As a result, if it is output, the process proceeds to step S149. On the other hand, if it is not output, the process returns to step S146, and the process proceeds to a determination process for determining whether there is an input from the determined device. Here, the input information from the device determined by the input device determination unit 23 is output to the speech recognition unit 21 until the recognition result is received from the speech recognition unit 21 by the series of processes from step S146 to step S148. Processing to continue. In step S149, operation information corresponding to the recognition result destined for the device related to the output recognition result is output to the packet transmission unit 31 according to the correspondence table shown in FIG. Thus, the input control processing operation is completed.

  FIG. 21 shows the control processing operation performed by the control unit 24 when outputting the information of the device system 1 when the output device determining unit 22 determines the output destination for the device having the output unit exhibiting the highest output performance. It is a flowchart. Hereinafter, the output control processing operation by the control unit 24 will be described with reference to FIG.

  In step S151, data for inquiring about output performance is output to the packet transmission unit 31 with all the devices 2 to 5 connected to the device system 1 as destinations. In step S152, it is determined whether or not the output device determination unit 22 has notified the output unit determination. As a result, if there is a notification, the process proceeds to step S155, and if not, the process proceeds to step S153. In step S153, it is determined whether or not data including output performance information, which is an answer to the output performance inquiry output in step S151, has been received from the packet receiver 30. As a result, if it has been received, the process proceeds to step S154. On the other hand, if it has not been received, the process returns to step S152, and the process proceeds to a determination process for determining whether or not the output device determination unit 22 has notified the output unit determination. In step S154, the received answer (that is, output performance information) is output to the output device determination unit 22. After that, the process returns to step S152, and the process proceeds to a determination process for determining whether or not the output device determination unit 22 has notified the output unit determination. Here, in the series of processing from step S152 to step S154, until the output device is determined, an answer regarding the output performance information inquired to each device 2-5 in step S151 is received and the output device determination unit 22 receives the answer. Processing to continue output.

  In step S155, since the notification of the output unit determination is received, information indicating the output unit determination addressed to the device having the determined output unit is output to the packet transmission unit 31. In step S156, information on the device system 1 destined for the device having the determined output unit (the device notified in step S152) is output to the packet transmission unit 31. Thus, the input control processing operation is completed.

  FIG. 22 is a block diagram showing a specific configuration of the air conditioner 5 in the present embodiment. The air conditioner 5 includes an air conditioner function unit 61, a voice input unit 62, a control unit 63, a packet reception unit 64, a packet transmission unit 65, and an input performance information storage unit 66. Here, the air conditioner function unit 61, the packet receiver unit 64, and the packet transmitter unit 65 are the same as the air conditioner function unit 51, the packet receiver unit 53, and the packet transmitter unit 54 in the first embodiment. Omitted.

  The voice input unit 62 is constituted by a microphone or the like, converts voice input from the outside into a digital signal, and outputs the digital signal to the control unit 63. The control unit 63 receives information flowing through the network via the packet reception unit 64 and performs corresponding processing.

  FIG. 23 is a flowchart of the processing operation by the control unit 63. Hereinafter, the processing operation by the control unit 63 will be described with reference to FIG.

  In step S161, it is determined whether or not data is received from the packet receiver 64. As a result, if received, the process proceeds to step S162. If not received, the process waits until data from the packet receiving unit 64 is received. In step S162, it is determined whether the received data is an inquiry about the voice input performance of the voice input unit 62. As a result, if it is an inquiry about the input performance, the process proceeds to step S163; otherwise, the process proceeds to step S170. In step S163, the input performance information is read from the input performance information storage unit 66, and is output to the packet transmission unit 65 with the transmission source of the inquiry as the destination.

  In step S164, the digital audio signal from the audio input unit 62 is stored in addition to the digital audio signal stored so far. In step S165, it is determined whether or not a predetermined time (for example, 3 seconds) has elapsed since the output of the input performance information in step S163. As a result, if it has elapsed, the process proceeds to step S166. On the other hand, if it has not elapsed, the process returns to step S164, and the storage of the digital audio signal is continued. Thus, the voice input is accepted only for the predetermined time.

  In the present embodiment, in the series of processing from step S162 to step S165, the input performance inquiry is regarded as input start, and voice input is accepted for the predetermined time from the input start. However, the present invention is not limited to this. For example, the voice input is accepted only while the talk switch is being pressed by using a means capable of detecting the start / end of the voice input such as the talk switch 43 in the remote controller 4. There is no problem. Also, voice input is always accepted, the start and end of user utterance is automatically detected from the difference in input sound pressure, etc., and the digital voice signal of only the section estimated as the voice section is stored. There is no problem.

  In step S166, it is determined whether an input unit determination notification has been received. As a result, if it is received, the process proceeds to S167, and if not, waits until it is received. In step S167, based on the notification of the input unit determination, it is determined whether or not the determined input unit is the air conditioner 5. As a result, if the air conditioner 5 is used, the process proceeds to step S168; otherwise, the process proceeds to step S169. In step S168, the digital audio signal stored in step S164 and step S165 is output to the packet transmitter 65 with the input performance inquiry source as the destination. In step S169, the stored digital audio signal is erased. After that, the process returns to step S161 to shift to data reception determination.

  In step S170, it is determined whether the received data is an operation command for the air conditioner 5. As a result, if so, the process proceeds to step S171. If not, the process returns to step S161 to shift to data reception determination. In step S171, the air conditioner function unit 61 is controlled to perform an operation corresponding to the received operation command. After that, the process returns to step S161 to shift to data reception determination.

  The input performance information storage unit 66 stores a numerical value representing the input performance of the voice input unit 62. In the present embodiment, it is assumed that the sensitivity value of the microphone used in the voice input unit 62 is stored.

  Hereinafter, when the device having the output unit exhibiting the highest output performance is determined as the output destination, and the device having the input unit exhibiting the highest input performance is determined as the input destination, it is used from the remote controller 4 constituting the device system 1 When a person performs an operation of raising the room temperature, an operation relating to each of the devices 2 to 5 will be specifically described.

  The user utters “Raise the temperature” while pressing the talk switch 43 of the remote controller 4 in front of the air conditioner 5, and then releases the talk switch 43. Then, the control unit 63 in the air conditioner 5 stores the digital voice signal of the input voice “Raise the temperature” from the voice input unit 62 according to the flowchart shown in FIG. Further, the control unit 44 in the remote controller 4 first outputs information indicating the start of input to the packet transmission unit 48 in accordance with the flowchart shown in FIG. Further, the digital voice signal of the input voice “increase temperature” from the voice input unit 42 is stored and output to the packet transmission unit 48 addressed to the personal computer 3. Then, the packet transmission unit 48 divides the voice data into packets addressed to the personal computer 3 and outputs them to the network.

  When receiving the input start information transmitted from the remote controller 4, the control unit 24 in the personal computer 3 outputs input performance inquiry information to each device according to the flowchart shown in FIG. 20. Then, each control unit 44 and 63 of each device having the input unit (in this embodiment, the remote control 4 and the air conditioner 5) outputs an answer as input performance information of the corresponding input unit to the personal computer 3. Then, the control unit 24 in the personal computer 3 receives the response of the input performance information and outputs it to the input device determination unit 23. The input device determination unit 23 determines an input unit according to the flowchart shown in FIG. 19, and outputs an input device determination notification and information indicating the determined device to the control unit 24. Upon receiving the notification, the control unit 24 outputs an input unit determination notification to each device. In the present embodiment, since the input performance of the voice input unit 62 of the air conditioner 5 is the highest, the air conditioner 5 is determined as the input device. Therefore, the remote controller 4 and the air conditioner 5 each store a digital audio signal. However, according to the notification, the control unit 44 in the remote controller 4 does not output an audio signal, and only the control unit 63 in the air conditioner 5 displays “temperature. The audio signal “raise” is output to the personal computer 3.

  The control unit 24 in the personal computer 3 outputs the voice data from the air conditioner 5 to the voice recognition unit 21. Then, based on the recognition result “increase temperature” received from the voice recognition unit 21, information indicating an operation corresponding to the recognition result addressed to the device related to the recognition result according to the correspondence table shown in FIG. To 31. In this case, information “3” indicating the operation “increase temperature” is output to the air conditioner 5.

  Then, the control part 63 in the said air conditioner 5 receives the information output from the personal computer 3 via the packet receiving part 64 according to the flowchart shown in FIG. Then, an operation of raising the set temperature by controlling the air conditioner function unit 61 is performed, and information indicating the execution result “operation completed” is output to the personal computer 3 as output information of the device system 1.

  The control unit 24 in the personal computer 3 outputs inquiry information about output performance to each device according to the flowchart shown in FIG. Then, output performance information is output as an answer to the inquiry from each device having the output unit. Then, the control unit 24 in the personal computer 3 sequentially outputs inquiries to the output device determination unit 22. The output device determination unit 22 determines an output unit according to the flowchart shown in FIG. In the present embodiment, since the output performance of the video output unit 13 of the television receiver 2 is the highest, the output unit is determined for the television receiver 2. Then, an output unit determination notification is output to the control unit 24. The control unit 24 outputs the output information of the device system 1 output from the air conditioner 5 to the packet transmission unit 31 as addressed to the television receiver 2.

  In accordance with the flowchart shown in FIG. 3, the control unit 12 in the television receiver 2 outputs the information “the change in the set temperature of the air conditioner 5 has been completed”, which is the output information of the device system 1 output from the personal computer 3. To the video output unit 13. In this way, a series of processing operations are completed.

Third Embodiment In this embodiment, the device closest to the user among the devices having the output unit is determined as the output device by the output device determination unit, and the device closest to the user among the devices having the input unit. This is related to a device system in which an input device determination unit determines an input device. Hereinafter, the apparatus system will be described by taking as an example a case where a user performs an operation for raising the room temperature at a position closest to the television receiver.

  FIG. 24 is a block diagram of a device system according to the present embodiment. The device system 71 is configured by connecting a television receiver 72, a personal computer 73, an air conditioner 74, and a position sensor 75 to each other. The personal computer 73 is the same as the personal computer 3 in the second embodiment, and the television receiver 72 is different from the television receiver 2 in the second embodiment in that it has an audio input unit. Is different from the air conditioner 5 in the second embodiment in that it has a video output unit. Further, the operations of the control units of the television receiver 72, the personal computer 73 and the air conditioner 74 are different from the operations of the control units of the television receiver 2, the personal computer 3 and the air conditioner 5 in the second embodiment. In the following, the configuration and operation of each device that is different from the second embodiment will be described.

  FIG. 25 is a block diagram showing the configuration of the television receiver 72. The broadcast receiving unit 81, the control unit 82, the video output unit 83, the audio output unit 84, the audio input unit 85, the packet receiving unit 86, and the packet transmission. The unit 87 is configured. Among these, the control part 82 and the audio | voice input part 85 differ from the case of the said 2nd Embodiment. Hereinafter, the control unit 82 and the voice input unit 85 will be described.

  FIG. 26 is a flowchart showing the processing operation of the control unit 82. Hereinafter, the operation of the control unit 82 will be described with reference to FIG. When the power of the television receiver 72 is turned on, the processing operation by the control unit 82 is started.

  In step S181, the video and audio transmitted from the broadcast receiving unit 81 are output to the video output unit 83 and the audio output unit 84. The processing by this step is the same as the processing by the conventional television receiver. In step S182, it is determined whether voice input has been started. As a result, if started, the process proceeds to step S183, and if not, the process proceeds to step S186. The determination uses a method of automatically extracting a speech section such as word spotting. In that case, the sound from the television receiver 72 itself may have some adverse effects on the recognition. However, since the sound produced by the television receiver 72 itself can be grasped in advance, it can be dealt with by a method such as spectral subtraction.

  In step S183, information indicating that input has been started by the user is output to the packet transmitter 87 as addressed to each device 73-75. In step S184, the digital audio signal from the audio input unit 85 is added to the digital audio signal stored so far and stored. In step S185, it is determined whether or not voice input is in progress. As a result, if the voice is being input, the process returns to step S184 and the storage of the digital voice signal is continued. On the other hand, if the audio input has been completed, the process returns to step S181 to continue outputting the broadcast contents.

  In step S186, it is determined whether or not data is sent from the packet receiver 86. As a result, if data has been sent, the process proceeds to step S187; otherwise, the process returns to step S181 to continue outputting broadcast contents. In step S187, it is determined whether or not the received data is a notification of input unit determination. As a result, if the notification is an input unit decision, the process proceeds to step S188, and if not, the process proceeds to step S191. In step S188, it is determined whether or not the determined input unit is the television receiver 72. As a result, if it is the television receiver 72, the process proceeds to step S189, and if not, the process proceeds to step S190. In step S189, the digital audio signal stored in steps S184 and S185 is output to the packet transmission unit 87 with the transmission source of the notification of the input unit determination as a destination. In step S190, the stored digital audio signal is erased. After that, the process returns to step S181 to continue outputting the broadcast contents.

  In step S191, it is determined whether or not the data sent from the packet receiver 86 is an operation command for the television receiver 72. As a result, if it is an operation command, the process proceeds to step S192; otherwise, the process proceeds to step S194. In step S192, for example, an operation corresponding to the operation command such as “change channel” is performed. In step S193, the output information of the device system 71 indicating the completion of the operation is sent to the packet transmitter 87 with the personal computer 73 as the destination. After that, the process returns to step S181 to continue outputting the broadcast contents.

  In step S194, it is determined whether or not the data sent from the packet receiver 86 is output information of the device system 71. As a result, if it is output information, the process proceeds to step S195; otherwise, the process returns to step S181 to continue outputting the broadcast contents. In step S195, the output information of the device system 71 is sent to the video output unit 83. After that, the process returns to step S181 to continue outputting the broadcast contents.

  FIG. 27 is a block diagram of the position sensor 75. The position sensor 75 includes a sensor 91, an analysis unit 92, a control unit 93, a packet reception unit 94 and a packet transmission unit 95.

  The sensor 91 is composed of an infrared sensor, a CCD (Charge Coupled Device) camera, etc., and acquires a video signal by acquiring a video of a room where the device system 71 is installed in order to measure the location of the user. The data is output to the analysis unit 92. In the present embodiment, video information is handled, but the present invention is not limited to this as long as user position information can be obtained. The analysis unit 92 analyzes the video signal sent from the sensor 91, analyzes the positions of the user, the television receiver 72, the personal computer 73 and the air conditioner 74, and outputs position information representing the analysis result to the control unit 93. To do.

  The video information analysis method is not particularly limited as long as the positional relationship between the user and each of the devices 72 to 74 can be grasped. In the present embodiment, the distance between the user's head and each of the devices 72 to 74 is acquired and compared, and information obtained by arranging device information representing each device in the order of the closest distance to the user. The position information is output to the control unit 93. The device information may be anything as long as it can uniquely determine which device in the device system 71, but in the present embodiment, the device information is an IP address assigned to each device 72-74. Further, the position information obtained in this way is output to the control unit 93 periodically (for example, every 0.5 seconds) so that the control unit 93 can use it whenever necessary.

  Based on the position information from the analysis unit 92, the control unit 93 responds to an inquiry regarding “apparatus closest to the user”. FIG. 28 is a flowchart of the processing operation by the control unit 93. In step S201, it is determined whether there is an inquiry about a device closest to the user. As a result, if there is an inquiry, the process proceeds to step S202, and if not, the processing operation is terminated. In step S 202, information representing a device closest to the user with the inquiry source as a destination is output to the packet transmission unit 95. After that, the processing operation is terminated.

  The packet receiving unit 94 receives a packet flowing on the network, and restores data transmitted based on the received packet. The packet transmission unit 95 receives the data output from the control unit 93, packetizes the data according to TCP / IP, and outputs the obtained packet to the network.

  FIG. 29 is a flowchart of the processing operation by the packet receiving unit 94. Hereinafter, the operation of the packet receiving unit 94 will be described with reference to FIG. When the power of the position sensor 75 is turned on, the processing operation by the packet receiver 94 is started.

  In step S211, it is determined whether a packet is flowing on the network. As a result, if it is flowing, the process proceeds to step S212. On the other hand, if it is not flowing, it waits for a packet to flow on the network. In step S212, a flowing packet is received and its contents are read. In step S213, it is determined whether or not the received packet is addressed to the position sensor 75. As a result, if it is addressed to the position sensor 75, the process proceeds to step S214. On the other hand, if not, the process returns to step S211 to shift to the determination of whether or not a packet is flowing on the network.

  In step S214, data is restored from the transmitted packet. The packet is obtained by subdividing data to be transmitted. Therefore, data is restored from the received packet according to TCP / IP. In step S215, it is determined whether or not the data restoration is completed. As a result, if completed, the process proceeds to step S216. On the other hand, if not completed, the process returns to step S211 and the process proceeds to determination as to whether or not a packet is flowing on the network. In step S216, the restored data is sent to the control unit 93. After that, the process returns to step S211 and shifts to determination of whether or not a packet is flowing on the network.

  FIG. 30 is a block diagram of the air conditioner 74. The air conditioner 74 includes an air conditioner function unit 101, a voice input unit 102, a control unit 103, a packet reception unit 104, a packet transmission unit 105, and a video output unit 106. Here, the air conditioner function unit 101, the voice input unit 102, the packet transmission unit 104, and the packet transmission unit 105 are the air conditioner function unit 61, the voice input unit 62, the packet transmission unit 64, and the packet of the air conditioner 5 in the second embodiment. Since it is the same as the transmission part 65, detailed description is abbreviate | omitted. Hereinafter, the control unit 103 and the video output unit 106 different from the air conditioner 5 in the second embodiment will be described.

  FIG. 31 is a flowchart showing the processing operation of the control unit 103. Hereinafter, the operation of the control unit 103 will be described with reference to FIG. When the power supply of the air conditioner 74 is turned on, the processing operation by the control unit 103 is started.

  In step S221, it is determined whether or not data has been sent from the packet receiving unit 104. As a result, if data has been sent, the process proceeds to step S222; otherwise, the process waits for data to be sent. In step S222, it is determined whether or not the data sent from the packet receiving unit 104 is an input start notification. As a result, if it is an input start notification, the process proceeds to step S223; otherwise, the process proceeds to step S225. In step S223, the digital audio signal from the audio input unit 102 is added to the digital audio signal stored so far and stored. In step S224, it is determined whether or not a predetermined time (for example, 5 seconds) has elapsed. As a result, if it has elapsed, the process returns to step S221, and shifts to data reception determination. On the other hand, if it has not elapsed, the process returns to step S223 and the storage of the digital audio signal is continued.

  In step S225, it is determined whether or not the data sent from the packet receiving unit 104 is an input unit determination notification. As a result, if it is a notification of input unit determination, the process proceeds to step S226, and if not, the process proceeds to step S229. In step S226, it is determined whether the determined input unit is the air conditioner 74 or not. As a result, if it is the air conditioner 74, the process proceeds to step S227, and if not, the process proceeds to step S228. In step S227, the digital audio signal stored in step S223 and step S224 is output to the packet transmission unit 105 with the transmission source of the notification of the input unit determination as the destination. In step S228, the stored digital audio signal is erased. After that, the process returns to step S221 to shift to data reception determination.

  In step S229, it is determined whether or not the data sent from the packet receiving unit 104 is an operation command for the air conditioner 74. As a result, if it is an operation command, the process proceeds to step S230, and if not, the process proceeds to step S232. In step S230, an operation corresponding to the operation command such as “change the set temperature” is performed. In step S231, the output information of the device system 71 indicating the completion of the operation is sent to the packet transmission unit 105 with the personal computer 73 as the destination. After that, the process returns to step S221 to shift to data reception determination.

  In step S232, it is determined whether or not the data transmitted from the packet receiving unit 104 is output information of the device system 71. As a result, if it is output information, the process proceeds to step S233. If not, the process returns to step S221 to shift to data reception determination. In step S233, the output information of the device system 71 is sent to the video output unit 106. After that, the process returns to step S221 to shift to data reception determination.

  The video output unit 106 includes a liquid crystal display and is configured to display video information on the air conditioner 74, and displays the output information of the device system 71 received from the control unit 103.

  The components of the personal computer 73 are the same as those in FIG. 5 in the first and second embodiments, but the operations of the output device determination unit, input device determination unit, and control unit are the same as those in the first and second embodiments. It is different from the form. Hereinafter, operations different from those of the first and second embodiments will be described. In the following description, the numbers of the components of the personal computer 3 shown in FIG. 5 are used.

  The output device determination unit 22 of the personal computer 73 in the present embodiment determines a device closest to the user among the devices having the output unit as the output device. FIG. 32 is a flowchart of the processing operation of the output device determination unit 22. The processing operation of the output device determination unit 22 will be described below with reference to FIG.

  In step S241, it is determined whether information representing a device closest to the user from the position sensor 75 is received via the control unit 24. As a result, if it has been received, the process proceeds to step S242, and if it has not been received, it waits for receiving the above information. In step S242, a device closest to the user is selected from the devices having the output unit based on the received information. In step S243, the storage information in the output device storage unit 28 is rewritten with the IP address of the device selected in step S242. In step S244, a notification of output unit determination is output to the control unit 24. After that, the process returns to step S241 to wait for receiving information from the position sensor 75.

  The input device determination unit 23 of the personal computer 73 in the present embodiment determines a device closest to the user among the devices having the input unit as the input device. FIG. 33 is a flowchart of the processing operation of the input device determination unit 23. Hereinafter, the processing operation of the input device determination unit 23 will be described with reference to FIG.

  In step S251, it is determined whether information representing the device closest to the user from the position sensor 75 is received via the control unit 24. As a result, if it has been received, the process proceeds to step S252, and if it has not been received, it waits for receiving the above information. In step S252, based on the received information, a device closest to the user is selected from devices having an input unit. In step S253, the information stored in the input device storage unit 29 is rewritten with the IP address of the device selected in step S252. In step S254, notification of input unit determination is output to the control unit 24. After that, the process returns to step S251 to wait for receiving information from the position sensor 75.

  FIG. 34 shows a case where data indicating that the input has started is received from the packet receiving unit 30 when the input device is determined by the input device determining unit 23 of the personal computer 73 to the device having the input unit closest to the user. It is a flowchart of the control processing operation | movement by the control part 24 in FIG. The input control processing operation by the control unit 24 will be described below with reference to FIG.

  In step S 261, data for inquiring information representing a device closest to the user with the position sensor 75 as a destination is output to the packet transmission unit 31. In step S262, it is determined whether or not the information is received from the packet receiver 30 as an answer from the position sensor 75. As a result, if it has been received, the process proceeds to step S263, and if it has not been received, it waits to receive the above information. In step S263, the information from the position sensor 75 is output to the input device determination unit 23.

  In step S264, it is determined whether or not the input device determination unit 23 has notified the input unit determination. As a result, if there is a notification, the process proceeds to step S265. If not, the process waits until there is a notification. In step S265, it is determined whether or not there is an input from the device having the determined input unit (the device notified in step S264). As a result, if there is an input, the process proceeds to step S266. If not, the process waits until there is an input. In step S266, the received input information is output to the voice recognition unit 21. In step S267, it is determined whether or not a recognition result is output from the voice recognition unit 21. As a result, if it is output, the process proceeds to step S268. On the other hand, when it is not output, it waits for a recognition result to be output. Here, a series of processes from step S265 to step S267 realizes a repetitive operation of waiting until input information is received, sending the input information to the voice recognition unit 21 when receiving input information, and further waiting until a recognition result is received. ing. In step S268, according to the correspondence table shown in FIG. 6, the operation information corresponding to the recognition result destined for the device (operation target device) related to the output recognition result is output to the packet transmission unit 31. Thus, the input control processing operation is completed.

  FIG. 35 shows a control process performed by the control unit 24 when outputting the information of the device system 71 when the output device is determined as the device having the output unit closest to the user by the output device determination unit 22 of the personal computer 73. It is a flowchart of operation | movement. The output control processing operation by the control unit 24 will be described below with reference to FIG.

  In step S271, data for inquiring information representing a device closest to the user with the position sensor 75 as a destination is output to the packet transmission unit 31. In step S272, it is determined whether or not the information is received from the packet receiving unit 30 as an answer from the position sensor 75. As a result, if it has been received, the process proceeds to step S273, and if it has not been received, it waits to receive the above information. In step S273, information from the position sensor 75 is output to the output device determination unit 22.

  In step S274, it is determined whether or not the output device determination unit 22 has notified the output unit determination. As a result, if there is a notification, the process proceeds to step S275. In step S275, it is determined whether or not the output information of the device system 71 is via the packet receiver 30. As a result, if the output information is present, the process proceeds to step S276, and if not, the process waits until the output information is present. In step S276, the storage information in the output device storage unit 28 is read, and the output information of the device system 71 is output to the packet transmission unit 31 for the device stored in the output device storage unit 28. After that, the output control processing operation is terminated.

  Hereinafter, when the device having the output unit closest to the user is determined as the output destination and the device having the input unit closest to the user is determined as the input destination, the television receiver 72 constituting the device system 71 An operation related to each of the devices 72 to 75 will be specifically described when a user utters a command to raise the room temperature nearby.

  The user says “Raise the temperature” near the television receiver 72. Then, according to the flowchart shown in FIG. 26, the control unit 82 in the television receiver 72 first outputs an input start notification to each of the devices 73 to 75, and the input audio “temperature” is input from the audio input unit 85. The digital voice signal "raise" is stored. Further, the control unit 103 in the air conditioner 74 stores a digital voice signal of the input voice “increase temperature” from the voice input unit 102 according to the flowchart shown in FIG.

  In accordance with the flowchart shown in FIG. 34, the control unit 24 in the personal computer 73 inquires the position sensor 75 for information representing the device closest to the user, and outputs the information to the input device determination unit 23 when receiving the answer. The input device determination unit 23 determines the television receiver 72, which is the device closest to the user, as an input unit according to the flowchart shown in FIG. Upon receiving the notification, the control unit 24 outputs an input unit determination notification to each device. As a result, the television receiver 72 and the air conditioner 74 each store a digital audio signal, but only the television receiver 72 outputs an audio signal “increase temperature” to the personal computer 73 in accordance with the notification.

  The control unit 24 in the personal computer 73 outputs the voice data from the television receiver 72 to the voice recognition unit 21. Based on the recognition result “increase temperature” received from the voice recognition unit 21, information “2” representing the operation “increase temperature” is output to the air conditioner 74 according to the correspondence table shown in FIG. 6.

  Then, the control unit 103 in the air conditioner 74 performs an operation of increasing the set temperature by controlling the air conditioner function unit 101 according to the flowchart shown in FIG. Output to the personal computer 73 as output information of the system 71.

  The control unit 24 in the personal computer 73 inquires of the position sensor 75 for information representing the device closest to the user according to the flowchart shown in FIG. The output device determination unit 22 determines the television receiver 72 that is the device closest to the user as an output unit in accordance with the flowchart shown in FIG. Receiving the notification of output unit determination, the control unit 24 transmits the output information of the device system 71 output from the air conditioner 74 to the television receiver 72.

  Then, in accordance with the flowchart shown in FIG. 26, the control unit 82 in the television receiver 72 “the change of the set temperature of the air conditioner has been completed” which is the output information of the device system 71 transmitted from the personal computer 73. Is output to the video output unit 83. In this way, a series of processing operations are completed.

  As described above, in each of the above-described embodiments, among the devices constituting the device systems 1 and 71, at least one device is provided with an output unit including a speaker, a liquid crystal display, and the like, and at least one device is provided. An input unit including a microphone or the like is provided. Further, any one of the devices 3 and 73 is provided with an output device determination unit 22 that determines an output device of the device systems 1 and 71 and an input device determination unit 23 that determines an input device. All devices are connected via a network, and data generated or input is transmitted / acquired by packet communication.

  At that time, in the case of the first embodiment, the input device determination unit 23 determines the device operated by the user among the devices having the input unit as the input device. On the other hand, the output device determination unit 22 determines the device last operated by the user among the devices having the output unit as the output device. In the case of the second embodiment, the input device determining unit 23 determines a device that exhibits the highest input performance among the devices having the input unit as an input device. On the other hand, the output device determination unit 22 determines a device exhibiting the highest output performance among the devices having the output unit as an output device. In the case of the third embodiment, the input device determination unit 23 determines the device closest to the user among the devices having the input unit as the input device. On the other hand, the output device determination unit 22 determines the device closest to the user among the devices having the output unit as the output device.

  Therefore, in any of the embodiments, it is possible to determine an appropriate input / output destination device in accordance with the operation status of the user and perform input / output. Therefore, it is possible to prevent the device control operability from being lowered due to the mismatch.

  Here, the specific hardware configuration of the personal computers 3 and 73 having the above functional configuration includes a program memory for storing various programs including programs for executing the above-described various processes, a data memory for storing various information, and the Internet. Communication I / F connected to a communication network such as Ethernet, Ethernet, input device, output device, display device, external auxiliary storage device in which an external recording medium is set and accesses this external recording medium, the above program memory, data memory, communication It consists of a CPU (Central Processing Unit) that controls the I / F, input device, output device, display device, external auxiliary storage device, etc., and executes calculation of interest space and determination of presentation information.

  That is, the voice recognition unit 21, the output device determination unit 22, the input device determination unit 23, and the control unit 24 are configured by the CPU, the video output unit 25 is configured by the display device, and the voice output unit 26 is configured by the output device. The video output performance information storage unit 27, the output device storage unit 28, and the input device storage unit 29 are configured by the data memory and the external auxiliary storage device, and the packet reception unit 30 and the packet transmission unit 31 are the communication I / I. It is composed of F. Further, the CPU performs various processing operations such as calculation / judgment processing, timing processing, and input / output processing in addition to the processing operations according to the present embodiment by the respective units 21 to 24 described above. .

  By the way, the functions of the CPU as the voice recognition unit 21, the output device determination unit 22, the input device determination unit 23, and the control unit 24 are realized by a device control program recorded on a program recording medium. The program recording medium in the above embodiment is a program medium made of ROM (Read Only Memory). Alternatively, it may be a program medium that is loaded into the external auxiliary storage device and read out. In any case, the program reading means for reading the device control program from the program medium may have a configuration for directly accessing and reading the program medium, or provided in a RAM (Random Access Memory). A program storage area (not shown) may be downloaded, and the program storage area may be accessed and read. It is assumed that a download program for downloading from the program medium to the program storage area of the RAM is stored in the main unit in advance.

  Here, the program medium is configured to be separable from the main body side, and is a tape system such as a magnetic tape or a cassette tape, a magnetic disk such as a floppy disk or a hard disk, a CD (compact disk) -ROM, or MO (magneto-optical). Optical discs such as discs, MD (mini discs) and DVDs (digital versatile discs), card systems such as IC (integrated circuit) cards and optical cards, mask ROM, EPROM (ultraviolet erasable ROM), EEPROM (electrical This is a medium that carries a fixed program, including a semiconductor memory system such as a general erasing ROM) and a flash ROM.

  In addition, when the microcomputers 3 and 31 in the above embodiment have a configuration that can be connected to an external communication network such as the Internet via a communication I / F, the program media is transmitted from the communication network. It may be a medium that fluidly supports the program by downloading or the like. In this case, it is assumed that a download program for downloading from the communication network is stored in the main device in advance. Or it shall be installed from another recording medium.

  It should be noted that what is recorded on the recording medium is not limited to a program, and data can also be recorded.

It is a block diagram in the apparatus system of this invention. FIG. 2 is a block diagram showing a specific configuration of the television receiver in FIG. 1. It is a flowchart which shows the processing operation of the control part in FIG. It is a flowchart which shows the processing operation of the packet receiver in FIG. It is a block diagram which shows the specific structure of the personal computer in FIG. It is a figure which shows the example of a response | compatibility with the "recognition result" by the speech recognition part in FIG. It is a flowchart of the processing operation by the output device determination part in FIG. It is a flowchart of the processing operation by the input device determination part in FIG. It is a flowchart of the input control processing operation by the control part in FIG. It is a flowchart of the output control processing operation | movement by the control part in FIG. It is a flowchart of the processing operation by the packet receiver in FIG. It is a block diagram which shows the specific structure of the remote control in FIG. It is a flowchart which shows the processing operation by the control part in FIG. It is a flowchart of the processing operation by the packet receiver in FIG. It is a block diagram which shows the specific structure of the air conditioner in FIG. It is a flowchart which shows the processing operation by the control part in FIG. It is a flowchart of the processing operation by the packet receiver in FIG. It is a flowchart of the processing operation by the output device determination part different from FIG. It is a flowchart of the processing operation by the input device determination part different from FIG. 10 is a flowchart of an input control processing operation by a control unit different from FIG. 9. It is a flowchart of the output control processing operation by the control part different from FIG. It is a block diagram which shows the specific structure of the air conditioner different from FIG. It is a flowchart which shows the processing operation by the control part in FIG. It is a block diagram in an apparatus system different from FIG. FIG. 25 is a diagram illustrating a specific configuration of the television receiver in FIG. 24. It is a flowchart of the processing operation of the control part in FIG. It is a figure which shows the specific structure of the position sensor in FIG. It is a flowchart of the processing operation of the control part in FIG. It is a flowchart of the processing operation of the packet receiver in FIG. It is a figure which shows the specific structure of the air conditioner in FIG. It is a flowchart of the processing operation of the control part in FIG. It is a flowchart of the processing operation by the output device determination part of the personal computer in FIG. It is a flowchart of the processing operation by the input device determination part of the personal computer in FIG. It is a flowchart of the input control processing operation by the control part of the personal computer in FIG. It is a flowchart of the output control processing operation by the control part of the personal computer in FIG.

Explanation of symbols

1,71 ... device system,
2,72 ... TV receiver,
3,73 ... PC
4 ... Remote control,
5,74 ... air conditioner,
11, 81 ... broadcast receiver,
12, 24, 44, 52, 63, 82, 93, 103 ... control unit,
13, 25, 41, 83, 106 ... video output unit,
14, 26, 84 ... audio output unit,
15, 27, 45 ... Video output performance information storage unit,
16, 30, 47, 53, 64, 86, 94, 104 ... packet receiving unit,
17, 31, 48, 54, 65, 87, 95, 105 ... packet transmission unit,
21 ... voice recognition unit,
22 ... output device determination unit,
23: Input device determination unit,
28: Output device storage unit,
29: Input device storage unit,
42, 62, 85, 102 ... voice input unit,
43 ... Talk switch,
46, 66 ... input performance information storage unit,
51, 61, 101 ... air conditioner function part,
75: Position sensor,
91 ... sensor,
92: Analysis unit.

Claims (11)

A device system configured such that a plurality of devices are connected to each other and can exchange data with each other.
At least one of the plurality of devices is configured to have the input section including a voice input unit, a first device for transmitting input information input from the input unit,
At least one of the plurality of devices has an input device determination unit that determines an input device to function as an input device of the device system among the first devices, and transmits information on the determined input device Second device to
At least one of the plurality of devices, which has an output comprising a voice output unit and an image output unit, a third device for outputting the output information received from the output unit,
At least one of the plurality of devices, which has the output device determination unit that determines the output device to function as the output device of the instrument system of the third device, determined for the output device A fourth device that sends out information,
At least one of the plurality of devices receives and decodes the input information from the input device based on the information on the input device transmitted from the second device, and responds to the decoding result of the input information. The operation instruction information corresponding to the decoding result is transmitted to the selected device, while receiving the operation information from the device to which the operation instruction information is transmitted, based on the output device information transmitted from the fourth device. A device system that is a fifth device that sends the operation information to the output device . The device system according to claim 1,
The third device having the output unit includes an output performance information storage unit that stores the output performance of the output unit,
The output device determination unit is configured to determine, as the output device, a device having the highest output performance stored in the output performance information storage unit among the third devices. . The device system according to claim 1,
The first device having the input unit includes an input performance information storage unit that stores the input performance of the input unit,
The input device determination unit is configured to determine, as the input device, a device having the highest input performance stored in the input performance information storage unit among the first devices. . The device system according to claim 1,
The device system according to claim 1, wherein the output device determining unit determines the output device when outputting information from the device system. The device system according to claim 1,
The input device determination unit determines the input device when information is input to the device system by a user. The device system according to claim 1,
The device system according to claim 1, wherein the output device determination unit determines, as the output device, a device last operated by a user among the third devices having the output unit. The device system according to claim 1,
The apparatus system according to claim 1 , wherein the input device determination unit determines a device operated by a user as the input device among the first devices having the input unit. The device system according to claim 1,
At least one of the plurality of devices has a sensor including an infrared sensor and a camera for acquiring position information of the user,
The output device determination unit sets, as the output device, a device located closest to the user among the third devices having the output unit based on the position information of the user acquired by the sensor. An equipment system characterized by being determined. The device system according to claim 1,
At least one of the plurality of devices has a sensor including an infrared sensor and a camera for acquiring position information of the user,
The input device determination unit, based on the position information of the user acquired by the sensor, the device located closest to the user among the first devices having the input unit as the input device An equipment system characterized by being determined. Computer
Output device determination unit in the claim 1, the device control program for causing to function as at least any one <br/> of the input device determination unit and the fifth device. A computer-readable program recording medium on which the device control program according to claim 10 is recorded.

Images