JP7821076B2 - Language setting device and language setting program - Google Patents

Description

This disclosure relates to a language setting device and a language setting program.

Language setting devices have been developed in recent years. When a language setting device recognizes the type of detected language identified by voice detection information received from a microphone, it sets the type of output language to the recognized type of detected language. If the language setting device is, for example, a display device equipped with a display unit as an output unit, the display device displays on the display unit a display language of the same type as the recognized type of detected language. For example, when English voice information is received via a microphone, the display device displays English on the display unit.

JP 2014-66791 A

Generally, there may be situations where multiple language setting devices exist. In such situations, for example, a first language setting device may receive voice detection information from a second language setting device. In this case, the first language setting device receives first voice language information from a microphone and second voice language information from the second language setting device. At this time, the first language setting device is unable to appropriately determine whether to set the output language type to the first detected language type identified by the first voice language information, or to the second detected language type identified by the second voice language information.

The present disclosure has been made in consideration of the above-mentioned problems. The purpose of the present disclosure is to provide a language setting device and a language setting program that can appropriately determine the type of output language even when the language setting device receives multiple types of speech language information.

The language setting device of the present disclosure is configured to receive first voice detection information from a microphone and second voice detection information from a communication terminal via a communication unit, and includes a control unit that controls an output unit that outputs output information. When the control unit receives the first voice detection information from the microphone and the second voice detection information from the communication terminal via the communication unit, if the type of first detected language identified by the first voice detection information and the type of second detected language identified by the second voice detection information differ, the control unit sets the type of output language of the output information to be output by the output unit to either the type of first detected language or the type of second detected language.

The language setting program disclosed herein is a language setting program for causing a computer to operate as a control unit configured to receive first voice detection information from a microphone and second voice detection information from a communication terminal via a communication unit, and to control an output unit that outputs output information. When the control unit receives the first voice detection information from the microphone and the second voice detection information from the communication terminal via the communication unit, if the type of first detected language identified by the first voice detection information and the type of second detected language identified by the second voice detection information differ, the control unit sets the type of output language of the output information to be output by the output unit to either the type of first detected language or the type of second detected language.

1 is a functional block diagram showing a configuration of a language setting system according to a first embodiment. 1 is a schematic diagram showing a usage status of a language setting system according to a first embodiment. FIG. 4 is a flowchart illustrating processing executed by a control unit of the language setting device and a control unit of the communication terminal according to the first embodiment; FIG. 10 is a schematic diagram showing the usage status of the language setting system according to the second embodiment. FIG. 10 is a diagram showing an example of selection information for requesting selection of a setting language displayed on the output unit of the language setting device of the second embodiment, in which the currently set language is Japanese. FIG. 11 is a diagram showing another example of selection information for requesting selection of a setting language displayed on the output unit of the language setting device of the second embodiment, in which the currently set language is English. 10 is a flowchart illustrating processing executed by a control unit of a language setting device and a control unit of a communication terminal according to a second embodiment; FIG. 11 is a schematic diagram showing the usage status of the language setting system of the third embodiment. 11 is a flowchart illustrating processing executed by a control unit of a language setting device and a control unit of a communication terminal according to a third embodiment.

The language setting system and language setting program according to the embodiments of the present disclosure will be described below with reference to the drawings. Note that in the drawings, identical or equivalent elements are designated by the same reference numerals, and redundant descriptions will not be repeated.

(Embodiment 1)
The language setting device DP and the language setting program according to the first embodiment will be described with reference to FIGS.

Figure 1 is a functional block diagram showing the configuration of the language setting system 100 of embodiment 1.

As shown in FIG. 1, the language setting system 100 includes a communication terminal CM, a language setting device DP, and a linking device PR. The communication terminal CM and the language setting device DP are configured to be communicatively connected. The language setting device DP and the linking device PR are also configured to be communicatively connected. The communication method may be either wired or wireless. In this embodiment, the communication terminal CM is a smartphone, an example of a mobile terminal. The language setting device DP is a television set (sometimes simply referred to as "TV" in the drawings). The linking device PR is a printer that prints text or images on paper media.

The communication terminal CM includes a control unit CM1, a memory unit CM2, an output unit CM3, a communication unit CM4, a microphone CM5, and an input unit CM6.

Control units CM1, CM2, CM3, CM4, CM5, and CM6 have the same configuration and functions as control units DP1, DP2, DP3, DP4, DP5, and DP6 of the language setting device DP, which will be described next. In other words, the communication terminal CM has the same configuration and functions as the language setting device DP, in addition to the configuration and functions of a smartphone. Therefore, descriptions of the configurations and functions of control unit CM1, memory unit CM2, output unit CM3, communication unit CM4, microphone CM5, and input unit CM6 will be omitted.

The language setting device DP includes a control unit DP1, a memory unit DP2, an output unit DP3, a communication unit DP4, a microphone DP5, and an input unit DP6.

The control unit DP1 is a computer called a processor or controller. The control unit DP1 is configured to receive voice detection information from the microphone DP5 based on a language setting program stored in the memory unit DP2. The control unit DP1 controls the output unit DP3 and communication unit DP4 based on user operations on the input unit DP6.

The storage unit DP2 is a device called a memory that stores a language setting program and other information. The storage unit DP2 may be provided inside the language setting device DP. However, the storage unit DP2 may also be provided outside the language setting device DP and be called a database that can communicate with the control device DP1. The language setting program is used to cause the control unit DP1 to perform the various operations described below.

The output unit DP3 includes a display unit (e.g., a liquid crystal display) that displays images and a sound generation unit (e.g., a speaker) that emits sound, and is controlled by the control unit DP1. The communication unit DP4 is a device that, under the control of the control unit DP1, can send and receive electrical signals or radio waves for communicating with the linked device PR.

In the case of wireless communication, the communication unit DP4 is a wireless communication unit including an antenna that emits radio waves, and in the case of wired communication, it is a wired communication unit such as a USB (Universal Serial Bus) port that can transmit electrical signals. The communication unit DP4 may be any unit that functions as an interface for communicating with devices external to the language setting device DP. In this embodiment, the communication unit DP4 uses communication means such as Bluetooth®, PRI-Fi®, and HDMI® terminals.

Microphone DP5 converts sound waves propagating through the air into electrical signals with corresponding waveforms, thereby receiving voice detection information corresponding to the detected language and transmitting that voice detection information to control unit DP1.

When operated by a user, input unit DP6 sends input information from input unit DP6 to control unit DP1, causing control unit DP1 to perform specified processing. Input unit DP6 can be any input interface that can input information to control unit DP1, such as a remote controller, touch panel, touchpad, mouse, keyboard, or microphone. Input unit DP6 sends information to control unit DP1 via either wireless or wired communication instructing it to use the automatic language setting change function.

The language setting device DP itself only needs to include the control unit DP1. In other words, the language setting device DP does not need to include at least one of the memory unit DP2, output unit DP3, communication unit DP4, microphone DP5, and input unit DP6. In that case, however, the control unit DP1 can be communicatively connected to at least one of the memory unit DP2, output unit DP3, communication unit DP4, microphone DP5, and input unit DP6.

In this embodiment, the control unit DP1 of the language setting device DP recognizes the type of the first detected language identified by the first voice detection information received by the microphone DP5. Thereafter, the control unit DP1 continues to not receive second voice detection information from the communication terminal CM, which is another language setting device. In this state, the type of output language to be output by the output unit DP3 is set to the type of the first detected language. In this case, the control unit DP1 also causes the communication unit DP4 to send automatic language setting information (the same as the first voice detection information) to the linked device PR, instructing the linked device PR to set the set language type to the type of detected language received by the microphone DP1. Note that the output unit DP3 has both a display unit that displays the display language and a sound generation unit that emits the detected language, but it may also have only one of the display unit and the sound generation unit.

The linking device PR comprises a control unit PR1, a memory unit PR2, an output unit PR3, and a communication unit PR4. The control unit PR1 controls the output unit PR3 and the communication unit PR4 based on a linking program stored in the memory unit PR2. The memory unit PR2 is a device called a memory that stores the linking program and other information. The output unit PR3 includes both a display unit that displays images and a sound generating unit that emits sounds, and is controlled by the control unit PR1. The communication unit PR4 is controlled by the control unit PR1 and is a device that sends and receives radio waves, such as an antenna, for communicating with an external device of the linking device PR, for example, a language setting device DP, and may be any device called a communications interface.

In this embodiment, when the control unit PR1 of the linked device PR receives automatic language setting information from the language setting device DP, it sets the set language type of the linked device PR to the language type indicated by the automatic language setting information.

As described above, not only the output language of the language setting device DP but also the setting language of the linked device PR can be automatically set without the need for the user to operate the input unit DP6. As a result, the user does not need to set the output language type individually for each of multiple devices. This eliminates the problem of the user having to operate the input unit DP6 to set the language for multiple devices. In other words, the usability of the language setting system 100 is improved.

Figure 2 is an overview diagram showing the usage status of the language setting system 100 in embodiment 1.

As shown in FIG. 2, around the language setting device DP, which is a television set as an example of a display device, three members of a host family are watching a video on the television set and conversing in Japanese. Therefore, the control unit DP1 of the language setting device DP receives first voice detection information from the microphone DP6 that can identify the first detected language type Det_LangA, which is Japanese. As a result, the control unit DP1 sets the set language Set_LangA of the language setting device DP to Japanese. As a result, the output language output from the output unit DP3 of the language setting device DP is Japanese.

Meanwhile, a conversation in English is taking place near the communication terminal CM between the international student on homestay and the host family's son. Therefore, the control unit CM1 of the communication terminal CM, which serves as a language setting device, recognizes the conversation in English and receives second voice detection information from the microphone CM6 that can identify the second detected language type Det_LangB, which is English. As a result, the control unit CM1 sets the set language Set_LangB of the communication terminal CM to English. As a result, the output language output from the output unit CM3 of the communication terminal CM becomes English. Furthermore, the control unit CM1 transmits the second voice detection information that can identify the second detected language type Det_LangB, which is English, to the language setting device DP via the communication unit CM4.

In this embodiment, for example, the language setting device DP may receive the first voice detection information it recognizes after receiving the second voice detection information from the communication terminal CM. In this case, the control unit DP1 sets the type of output language output by the output unit DP3 to Japanese, which is the first detected language type Det_LangA identified by the first detection information received from the microphone DP5. The control unit DP1 also sends automatic language setting information (same as the first voice detection information) capable of identifying the first detected language type Det_LangA, which is Japanese, via the communication unit DP4 to the linked device PR as a printer. As a result, the control unit PR1 of the linked device PR sets its setting language Set_LangC to Japanese, the same as the first detected language Det_LangA (see FIG. 2).

On the other hand, the language setting device DP may receive second voice detection information from the communication terminal CM after it recognizes the first voice detection information. In this case, the control unit DP1 sets the type of output language output by the output unit DP3 to English, which is the second detected language Det_LangB identified by the second voice detection information. The control unit DP1 then sends automatic language setting information (same as the second voice detection information) capable of identifying the second detected language Det_LangB, which is English, via the communication unit DP4 to the linked device PR as a printer. This causes the control unit PR1 of the linked device PR to set its setting language Set_LangC to English, the same as the second detected language Det_LangB (not shown).

Figure 3 is a flowchart illustrating the processing executed by the control unit DP1 of the language setting device DP and the control unit CM1 of the communication terminal CM in embodiment 1.

First, we will explain the processing of steps S101 to S105 executed by the control unit DP1 of the language setting device DP.

In step S101, the control unit DP1 determines whether or not there has been voice input, i.e., whether or not first voice detection information has been received from the microphone DP5. In step S102, the control unit DP1 calculates the recognition result of the voice language type, i.e., the first detected language type Language_1. In other words, the control unit DP1 identifies the type of the first detected language Language_1 (for example, Japanese) based on the first voice language information received from the microphone DP5. In step S103, it determines whether the newly detected first detected language type Language_1 (for example, Japanese) is the same as the first detected language type Det_LangA that was previously detected and stored in the memory unit DP2.

In step S103, it may be determined that the newly detected first detected language type Language_1 (e.g., Japanese) is the same as the previously detected first detected language type Det_LangA (e.g., Japanese). In this case, the control unit DP1 repeats steps S101 to S103. On the other hand, in step S103, it may be determined that the newly detected first detected language type Language_1 (e.g., Japanese) is not the same as the previously detected first detected language type Det_LangA (e.g., English). In this case, in step S104, the control unit DP1 stores the newly detected first detected language type Language_1 (e.g., Japanese) in the memory unit DP2 as the previously detected first detected language type Det_LangA (e.g., Japanese).

In step S105, the control unit DP1 transmits the first detected language type Det_LangA (e.g., Japanese) stored in the memory unit DP2 to its internal automatic language setting processing unit. The automatic language setting processing unit of the control unit DP1 uses the first detected language type Det_LangA to execute the processing of steps S301 to S305, which will be described later.

Next, we will explain the processing of steps S201 to S208 executed by the control unit CM1 of the communication terminal CM.

In step S201, the control unit CM1 determines whether or not there has been voice input, that is, whether or not second voice detection information has been received from the microphone CM5. If it is determined in step S201 that second voice detection information has not been received from the microphone CM5, the control unit CM1 executes the processing of step S201 again.

On the other hand, if it is determined in step S201 that second voice detection information has been received from microphone CM5, then in step S202, the control unit CM1 calculates the recognition result of the second voice language type, the second detected language type Language_2. That is, the control unit CM1 identifies the second detected language type Language_2 (e.g., English) based on the second voice language information received from microphone CM5. In step S203, the control unit CM1 determines whether the newly detected second detected language type Language_2 (e.g., English) is the same as the second detected language type Det_LangB that was previously detected and stored in the memory unit CM2.

In step S203, it may be determined that the newly detected second detected language type Language_2 (e.g., English) is the same as the previously detected second detected language type Det_LangB (e.g., English). In this case, the control unit CM1 repeats steps S201 to S203.

On the other hand, in step S203, it may be determined that the newly detected second detected language type Language_2 (e.g., English) is not the same as the previously detected second detected language type Det_LangB (e.g., Japanese). In this case, in step S204, the control unit CM1 stores the newly detected second detected language type Language_2 (e.g., English) in the memory unit CM2 as the previously detected second detected language type Det_LangB (e.g., English). In step S205, the second detected language type Det_LangB is stored in the memory unit CM2 as the set language type SetLangB (e.g., English). In step S206, the control unit CM1 changes the set language of the communication terminal CM to SetLangB (e.g., English). As a result, the output language output by the output unit CM3 of the communication terminal CM is changed to the set language SetLangB (e.g., English).

In step S207, the control unit CM1 determines whether there is a controllable device, i.e., whether the communication terminal CM can communicate with the language setting device DP. If it is determined in step S207 that the communication terminal CM cannot communicate with the language setting device DP, the control unit CM1 executes step S201.

On the other hand, in step S207, it may be determined that the communication terminal CM is capable of communicating with the language setting device DP. In this case, in step S208, the control unit CM1 transmits second voice detection information capable of identifying the type of the second detected language, Det_LangB (for example, English), to the language setting device DP.

Finally, we will explain the processing of steps S301 to S305 executed by the control unit DP1 of the language setting device DP.

In step S301, the control unit DP1 determines whether the first detected language type Det_LangA (e.g., Japanese) of the language setting device DP or the second detected language type Det_LangB (e.g., English) of the communication terminal CM is the same as the set language type SetLang_A. The first detected language type Det_LangA (e.g., Japanese) is identified by the first voice detection information received from the microphone DP5. The second detected language type Det_LangB (e.g., English) is identified by the second voice detection information received from the communication terminal CM. The set language type SetLang_A is stored in the memory unit DP2 and is either the first detected language type or the second detected language type.

In step S301, it may be determined that the first detected language type Det_LangA (e.g., Japanese) of the language setting device DP or the second detected language type Det_LangB (e.g., English) of the communication terminal CM is the same as the set language SetLang_A of the language setting device DP. In this case, the control unit DP1 executes the process of step S304.

On the other hand, in step S301, it may be determined that the first detected language type Det_LangA (e.g., Japanese) of the language setting device DP or the second detected language type Det_LangB of the communication terminal CM is not the same as the set language SetLang_A (e.g., English). In this case, in step S302, the control unit DP1 stores the first detected language type Det_LangA (e.g., Japanese) of the language setting device DP or the second detected language type Det_LangB (e.g., English) of the communication terminal CM as the set language type SetLangA in the memory unit DP2. In step S303, the control unit DP1 changes the language setting to SetLangA; specifically, it changes the type of output language output from the output unit DP3 to the set language type SetLangA stored in the memory unit DP2.

In step S304, it is determined whether there is a controllable device, i.e., whether the language setting device DP can communicate with the linked device PR. If it is determined in step S304 that the language setting device DP cannot communicate with the linked device PR, the control unit DP1 executes step S301.

On the other hand, in step S304, it may be determined that the language setting device DP is capable of communicating with the linked device PR. In this case, in step S305, the control unit DP1 transmits automatic language setting information (first voice detection information or second voice detection information) capable of identifying the set language type SetLangA to the linked device PR. As a result, the linked device PR is configured to output from the output unit PR3 the set language type that is the same as the set language type SetLangA of the language setting device DP.

In this embodiment, as described above, the type of first detected language recognized by the language setting device DP (e.g., Japanese) may differ from the type of second detected language recognized by the communication terminal CM (e.g., English). In this case, the language setting device DP sets the type of output language of the output information to be output by the output unit DP to either the type of first detected language (e.g., Japanese) or the type of second detected language (e.g., English). Therefore, even when the control unit DP1 receives two types of speech language information corresponding to two types of speech languages, it can appropriately determine the type of output language to be output from the output unit DP3.

Here, when the first detected language type and the second detected language type are different, the control unit DP1 sets the output language type to be output by the output unit DP to the detected language type identified by the most recently received voice detection information, either the first voice detection information or the second voice detection information. Therefore, the output language type output by the output unit DP of the language setting device DP is always updated to the most recent language type recognized by either the language setting device DP or the communication terminal CM.

In addition, when the first detected language type and the second detected language type are different, the control unit DP1 may set the output language type of the output information to be output by the output unit DP to either the predetermined first detected language type or the predetermined second detected language type (the language of the priority device). In other words, when the first detected language type and the second detected language type are different, the control unit DP1 may set the output language type of the output information to be output by the output unit DP to either the first detected language type or the second detected language type by any method.

(Embodiment 2)
The language setting device and language setting program of the second embodiment will be described with reference to Figures 4 to 7. Note that the following description will not be repeated for the same aspects as those of the language setting device and language setting program of the first embodiment. The language setting device and language setting program of the present embodiment differ from those of the first embodiment in the following respects.

Figure 4 is an overview diagram showing the usage status of the language setting system 100 in embodiment 2.

As shown in FIG. 4, around the language setting device DP, which is a television set as an example of a display device, three members of a host family are watching a video on the television set and conversing in English. Therefore, the control unit DP1 of the language setting device DP receives first voice detection information from the microphone DP6 that can identify the type of the first detected language, English. As a result, the control unit DP1 sets the setting language of the language setting device DP to English. As a result, the output language output from the output unit DP3 of the language setting device DP is English.

Meanwhile, a conversation in Japanese is taking place near the communication terminal CM between the host family's daughter and the international student staying with the host family. Therefore, the control unit CM1 of the communication terminal CM, which serves as a language setting device, recognizes the conversation in Japanese and receives second voice detection information from the microphone CM6 that can identify the type of the second detected language, Japanese. As a result, the control unit CM1 sets the setting language of the communication terminal CM to Japanese. As a result, the output language output from the output unit CM3 of the communication terminal CM becomes Japanese. The control unit CM1 also sends the second voice detection information (automatic language setting information) that can identify the type of the second detected language, Japanese, to the language setting device DP via the communication unit CM4.

Figure 5 shows an example of selection information displayed on the output unit DP3 of the language setting device DP of embodiment 2, requesting selection of a set language, where the current set language is Japanese. Figure 6 shows another example of selection information displayed on the output unit DP3 of the language setting device DP of embodiment 2, requesting selection of a set language, where the current set language is English.

The type of first detected language (e.g., English) identified by the first voice detection information received from the microphone DP6 may differ from the type of second detected language (e.g., Japanese) identified by the second voice detection information received from the communication terminal CM. In this case, the control unit P1 of the language setting device DP displays selection information on the output unit DP, as shown in FIGS. 5 and 6, prompting the user to select either the first detected language (e.g., English) or the second detected language (e.g., Japanese). In this embodiment, specifically, the selection information asks whether the language setting device DP should change the currently set language to the newly detected first detected language (e.g., English) or the newly detected second detected language (e.g., Japanese). In this case, the user of the language setting device DP selects "change" or "do not change." The control unit DP1 then sets the type of output language to be output by the output unit DP3 to either the first detected language or the second detected language selected by the user using the input unit DP6.

Figure 7 is a flowchart illustrating the processing executed by the control unit DP1 of the language setting device DP and the control unit CM1 of the communication terminal CM in embodiment 2. Note that the control unit DP1 of the language setting device DP in embodiment 2 executes exactly the same processing as the control unit DP1 of the language setting device DP in embodiment 1 with respect to steps S101 to S105. Therefore, the processing of steps S101 to S105 is omitted from Figure 7.

First, we will explain the processing of steps S211 to S217 executed by the control unit CM1 of the communication terminal CM.

In step S211, the control unit CM1 determines whether or not there has been voice input, that is, whether or not second voice detection information has been received from the microphone CM5. If it is determined in step S211 that second voice detection information has not been received from the microphone CM5, the control unit CM1 executes the processing of step S211 again.

On the other hand, if it is determined in step S211 that second voice detection information has been received from microphone CM5, then in step S212, the control unit CM1 calculates the recognition result of the type of voice language (for example, Japanese). That is, the control unit CM1 identifies the type of second detected language (for example, Japanese) based on the second voice language information received from microphone CM5. In step S213, it is determined whether the newly detected type of second detected language (for example, Japanese) is the same as the type of second detected language previously detected and stored in memory unit CM2.

If it is determined in step S213 that the newly detected type of second detected language (e.g., Japanese) is the same as the previously detected type of second detected language, the control unit CM1 repeats steps S211 to S213.

On the other hand, in step S213, it may be determined that the newly detected type of second detected language (for example, Japanese) is not the same as the previously detected type of second detected language (for example, Japanese). In this case, in step S214, the control unit CM1 stores the newly detected type of second detected language (for example, Japanese) in the memory unit CM2 as speech language information. In step S215, the set language type of the communication terminal CM is changed to the second detected language type (for example, Japanese), and the changed set language type is stored in the memory unit CM2.

In step S216, the control unit CM1 determines whether there is a controllable device, i.e., whether the communication terminal CM can communicate with the language setting device DP. If it is determined in step S216 that the communication terminal CM cannot communicate with the language setting device DP, the control unit CM1 executes the processing of step S211. On the other hand, if it is determined in step S216 that the communication terminal CM can communicate with the language setting device DP, in step S217 the control unit CM1 transmits second voice detection information (hereinafter also referred to as "automatic language setting information") that can identify the type of second detected language (for example, Japanese) to the language setting device DP.

Next, we will explain the processing of steps S311 to S316 executed by the control unit DP1 of the language setting device DP.

In step S311, the control unit DP1 determines whether the type of second detected language (e.g., Japanese) identified by the second voice detection information received from the communication terminal CM is the same as the type of set language of the language setting device DP. The type of second detected language (e.g., Japanese) is identified by the second voice detection information received from the communication terminal CM. The type of set language of the language setting device DP is stored in the memory unit DP2. The set language of the language setting device DP is assumed to be the first detected language (e.g., English) recognized by the language setting device DP. However, the set language of the language setting device DP may also be the second detected language (e.g., Japanese) recognized by the communication terminal CM.

In step S311, it may be determined that the type of second detected language of the communication terminal CM (for example, Japanese) is the same as the type of set language of the language setting device DP. In this case, the control unit DP1 executes the process of step S315. On the other hand, in step S311, it may be determined that the type of second detected language of the communication terminal CM (for example, Japanese) is not the same as the type of set language of the language setting device DP. In this case, in step S312, the control unit DP1 causes the output unit DP3 to output question information inquiring whether the type of set language of the language setting device DP should be changed to the type of second detected language of the communication terminal CM. That is, in step S312, the control unit DP1 causes the output unit DP to output selection information inquiring whether to select either the type of first detected language or the type of second detected language (see Figures 5 and 6). Note that in this embodiment, the selection information inquires whether the set language of the language setting device DP should be changed to the detected language of the communication terminal CM.

In step S313, the control unit DP1 determines whether to change the set language type to the second detected language type of the communication terminal CM (for example, Japanese). That is, the control unit DP1 determines whether it has received information that can identify whether to change the set language input by the user using the input unit DP6. That is, the control unit DP1 determines whether it has received language type change information from the input unit DP6 that indicates either the first detected language type (for example, English) or the second detected language type (for example, Japanese). In this embodiment, the language type change information is either information indicating "change" or information indicating "do not change." In step S313, if the control unit DP1 has not received language type change information from the input unit DP6, it executes the processing of step S315.

Meanwhile, in step S313, the control unit DP1 may have received language type change information from the input unit DP6. In this case, in step S314, based on the language type change information, the control unit DP1 changes the set language (e.g., English) of the language setting device DP to the second detected language type (e.g., Japanese) of the communication terminal CM. That is, the control unit DP1 sets the output language type to be output by the output unit DP3 to either the first detected language type (e.g., English) or the second detected language type (e.g., Japanese) selected by the input unit DP6. More specifically, the control unit DP1 stores the second detected language type (e.g., Japanese) of the communication terminal CM in the memory unit DP2 as the set language type. The control unit DP1 also changes the output language type output from the output unit DP3 to the set language (e.g., Japanese) stored in the memory unit DP2.

In step S315, it is determined whether there is a controllable device, i.e., whether the language setting device DP can communicate with the linked device PR. If it is determined in step S315 that the language setting device DP cannot communicate with the linked device PR, the control unit DP1 executes step S311.

On the other hand, if it is determined in step S315 that the language setting device DP is capable of communicating with the linked device PR, then in step S316 the control unit DP1 transmits automatic language setting information capable of identifying the type of set language (for example, Japanese) to the linked device PR. As a result, the linked device PR is configured to output from the output unit PR3 the same type of set language (for example, Japanese) as the type of set language of the language setting device DP.

As described above, the control unit DP1 causes the output unit DP to output selection information requesting the selection of either the first detected language type or the second detected language type. The control unit DP1 also sets the output language type to be output by the output unit DP3 to either the first detected language type or the second detected language type selected by the input unit DP6. This prevents the occurrence of an inconvenient situation in which the output language of the language setting device DP is changed to the detected language type of the communication terminal CM even though the user of the language setting device DP does not want to change the output language.

(Embodiment 3)
The language setting device and language setting program of the third embodiment will be described with reference to Figures 8 and 9. Note that the following description will not be repeated regarding the same points as those of the language setting device and language setting program of the first embodiment. The language setting device and language setting program of the present embodiment differ from those of the first embodiment in the following points.

Figure 8 is an overview diagram showing the usage status of the language setting system 100 in embodiment 3.

In FIG. 8, the language setting device DP further includes an imaging unit CA in addition to the configuration of embodiments 1 and 2. The imaging unit CA acquires image data of the periphery of the language setting device DP, specifically, the area in front of the screen of the television receiver. Therefore, the imaging unit CA can acquire image data of the viewer of the television receiver.

As shown in FIG. 8, around the language setting device DP, which is a television set as an example of a display device, two members of a host family are watching a video on the television set and conversing in Japanese. Therefore, the language setting device DP receives first voice detection information of a first detected language type, Japanese, from the microphone DP6. As a result, the control unit DP1 sets the setting language of the language setting device DP to Japanese. As a result, the output language output from the output unit DP3 of the language setting device DP is Japanese.

Meanwhile, a conversation in English is taking place near the communication terminal CM between the host family's son and the international student staying with the host family. Therefore, the control unit CM1 of the communication terminal CM, which serves as a language setting device, recognizes the conversation in English and receives second voice detection information for the detected language type, English, from the microphone CM6. As a result, the control unit CM1 sets the set language of the communication terminal CM to English. As a result, the output language output from the output unit CM3 of the communication terminal CM becomes English. The control unit CM1 also sends second voice detection information (automatic language setting information) that can identify the second detected language type, English, to the language setting device DP via the communication unit CM4.

In this embodiment, the type of the first detected language (e.g., Japanese) may differ from the type of the second detected language (e.g., English). In this case, the control unit DP1 causes the imaging unit CA to receive peripheral images of the language setting device DP and reads an image of the user of the communication terminal CM that has been pre-stored in the memory unit DP2. Furthermore, if the control unit DP1 determines that the user's image is not included in the peripheral images, it does not change the type of output language to be output by the output unit DP3 to the type of second detected language (e.g., English). In other words, the control unit DP1 maintains the type of output language to be output by the output unit DP3 as the type of first detected language (e.g., Japanese).

Figure 9 is a flowchart illustrating the processing executed by the control unit DP1 of the language setting device DP and the control unit CM1 of the communication terminal CM in embodiment 3. Note that the control unit DP1 of the language setting device DP in embodiment 3 executes exactly the same processing as the control unit DP1 of the language setting device DP in embodiment 1 with respect to steps S101 to S105. Therefore, the processing of steps S101 to S105 is omitted from Figure 9.

First, we will explain the processing of steps S221 to S227 executed by the control unit CM1 of the communication terminal CM.

In step S221, the control unit CM1 determines whether or not there has been voice input, that is, whether or not second voice detection information has been received from the microphone CM5. If it is determined in step S221 that second voice detection information has not been received from the microphone CM5, the control unit CM1 executes the processing of step S221.

On the other hand, if it is determined in step S211 that second voice detection information has been received from microphone CM5, then in step S222, the control unit CM1 calculates the recognition result of the type of voice language. That is, the control unit CM1 identifies the type of second detected language (e.g., English) based on the second voice language information received from microphone CM5. In step S223, it determines whether the newly detected type of second detected language (e.g., English) is the same as the type of second detected language previously detected and stored in memory unit CM2.

If it is determined in step S223 that the newly detected type of second detected language (e.g., English) is the same as the previously detected type of second detected language, the control unit CM1 repeats steps S221 to S223.

On the other hand, in step S213, it may be determined that the newly detected second detected language type Language_2 (e.g., English) is not the same as the previously detected second detected language type (e.g., Japanese). In this case, in step S224, the control unit CM1 stores the newly detected second detected language type (e.g., English) in the memory unit CM2 as speech language information. In step S225, the set language of the communication terminal CM is changed to the second detected language type (e.g., English), and the changed set language is stored in the memory unit CM2.

In step S226, the control unit CM1 determines whether there is a controllable device, i.e., whether the communication terminal CM can communicate with the language setting device DP. If it is determined in step S226 that the communication terminal CM cannot communicate with the language setting device DP, the control unit CM1 executes the process of step S221. On the other hand, in step S226, it may be determined that the communication terminal CM can communicate with the language setting device DP. In this case, in step S227, the control unit CM1 transmits second voice detection information (i.e., automatic language setting information) that can identify the type of detected language to the language setting device DP.

Next, we will explain the processing of steps S321 to S326 executed by the control unit DP1 of the language setting device DP.

In step S321, the control unit DP1 determines whether the type of the second detected language of the communication terminal CM (e.g., English) is the same as the set language of the language setting device DP (e.g., Japanese). The type of the second detected language is identified by the second voice detection information received from the communication terminal CM. The set language type of the language setting device DP is stored in the memory unit DP2. The set language of the language setting device DP is assumed to be the first detected language (e.g., Japanese) recognized by the language setting device DP. However, the set language of the language setting device DP may also be the second detected language (e.g., English) recognized by the communication terminal CM.

If, in step S321, the control unit DP1 determines that the type of the second detected language of the communication terminal CM is the same as the type of the set language, it executes the processing of step S326.

On the other hand, in step S321, it may be determined that the type of the second detected language of the communication terminal CM (for example, English) is not the same as the type of the set language (for example, Japanese). In this case, in step S322, the control unit DP1 causes the imaging unit CA to receive a peripheral image and reads out an image of the user (son) of the communication terminal CM that was previously stored in the memory unit DP2. In step S323, the control unit DP1 causes the camera CA to acquire a peripheral image of the language setting device DP, specifically, an image of the front side of the screen of the language setting device DP.

In step S324, it is determined whether the user of the communication terminal CM (the son of the foster family) is present in front of the screen of the language setting device DP. Specifically, the control unit DP1 determines whether an image of the user of the communication terminal CM is included in the peripheral image. If it is determined in step S325 that the image of the user is not included in the peripheral image, the control unit DP executes the processing of step S326. In other words, if it is determined that the image of the user of the communication terminal CM is not included in the peripheral image of the language setting device DP acquired by the imaging unit CA, the control unit DP1 determines that the user of the communication terminal CM is not present in front of the screen of the language setting device DP. As a result, the control unit DP1 does not change the setting of the type of output language (for example, Japanese) to be output by the output unit DP3.

On the other hand, if it is determined in step S325 that the user's image is included in the peripheral images, then in step S325 the control unit DP1 determines that the user of the communication terminal CM is in front of the screen of the language setting device DP. As a result, the control unit DP1 sets the type of output language to be output by the output unit DP3 to the type of second detected language (for example, English). In other words, the control unit DP1 changes the type of output language to be output by the output unit DP3 to the second detected language (for example, English) detected by the communication terminal CM.

In step S326, it is determined whether there is a controllable device, i.e., whether the language setting device DP can communicate with the linked device PR. If it is determined in step S326 that the language setting device DP cannot communicate with the linked device PR, the control unit DP1 executes step S321.

On the other hand, in step S326, it may be determined that the language setting device DP is able to communicate with the linked device PR. In this case, in step S326, the control unit DP1 transmits automatic language setting information (first voice detection information or second voice detection information) capable of identifying the type of set language to the linked device PR. As a result, the linked device PR is configured to output from the output unit PR3 the type of set language that is the same as the type of set language of the language setting device DP.

According to the language setting device DP of the present embodiment described above, if it is determined that the image of the user of the communication terminal CM is not included in the peripheral image of the language setting device DP acquired by the imaging unit CA, the setting of the type of output language to be output by the output unit DP3 is not changed. This prevents the occurrence of an inconvenient situation in which the output language of the language setting device DP is set to the type of language detected by the communication terminal CM even when the user of the communication terminal CM is not present in the vicinity of the language setting device DP (for example, in front of the screen).

DP Language setting device DP1 Control unit DP5 Microphone DP3 Output unit DP4 Communication unit DP6 Input unit PR Linked device PR1 Control unit

Claims (6)

a control unit configured to receive first voice detection information from the microphone and second voice detection information from the communication terminal via the communication unit, and to control an output unit that outputs output information;
The control unit
When the first voice detection information is received from the microphone and the second voice detection information is received from the communication terminal via the communication unit,
If the type of the first detected language specified by the first voice detection information is different from the type of the second detected language specified by the second voice detection information,
setting the type of output language of the output information to be output by the output unit to either the type of the first detected language or the type of the second detected language;
Language setting device. When the control unit is communicably connected to the linked device, the control unit transmits automatic language setting information from the communication unit to the linked device, the automatic language setting information instructing the linked device to set the type of the set language of the linked device as the type of the output language.
The language setting device according to claim 1 . If the type of the first detected language and the type of the second detected language are different, the control unit sets the type of output language to be output by the output unit to the type of detected language identified by the voice detection information received later, of the first voice detection information and the second voice detection information.
The language setting device according to claim 1 . The control unit
if the first detected language type and the second detected language type are different, outputting selection information to the output unit to request selection of either the first detected language type or the second detected language type;
setting the type of output language to be output by the output unit to either the type of the first detected language or the type of the second detected language selected by the input unit;
The language setting device according to claim 1 . The control unit
If the type of the first detected language and the type of the second detected language are different, causing an imaging unit to receive a surrounding image and reading out an image of the user of the communication terminal that has been stored in advance in a storage unit;
When it is determined that the image of the user is not included in the peripheral image, the setting of the type of output language to be output by the output unit is not changed.
The language setting device according to claim 1 . A language setting program for causing a computer to operate as a control unit configured to receive first voice detection information from a microphone and to receive second voice detection information from a communication terminal via a communication unit, and to control an output unit that outputs output information,
The control unit
When the first voice detection information is received from the microphone and the second voice detection information is received from the communication terminal via the communication unit,
If the type of the first detected language specified by the first voice detection information is different from the type of the second detected language specified by the second voice detection information,
setting the type of output language of the output information to be output by the output unit to either the type of the first detected language or the type of the second detected language;
Language setting program.