JP7664793B2 - Information processing system, communication method, and information processing terminal - Google Patents

Description

This disclosure relates to an information processing system, a communication method, and an information processing terminal.

Conventionally, in cooperative play games in which users play cooperatively, users have used chat to exchange information and communicate with other users (see, for example, Patent Document 1). Chat functions that allow multiple users to exchange information include a text chat function that exchanges chat content by text, and a voice chat function that exchanges chat content by voice.

JP 2020-22668 A

For example, in an information processing system that provides a chat function to multiple players, such as in a worldwide online game, players who speak different languages may use the chat function to exchange information. Even if players speak different languages, they can still communicate with each other by translating the chat content using a translation device, for example.

In an information processing system that provides a chat function to multiple players, it would be convenient if other players could easily identify the player who made the translated chat content. However, Patent Document 1 does not describe translating chat content using a translator to facilitate communication.

The objective of this disclosure is to enable other players to easily recognize the player who made the translated chat content.

According to the present disclosure, there is provided an information processing system in which a plurality of information processing terminals operated by a plurality of players respectively provide a chat function to the plurality of players, the information processing system having a translation processing unit that translates chat content generated by the chat function, and a chat processing unit that plays back the chat content translated by the translation processing unit in a voice associated with the player who uttered the chat content.

According to the present disclosure, it is possible for other players to easily recognize the player who spoke the translated chat content.

1 is a configuration diagram of an example of an information processing system according to an embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer according to the present embodiment. 2 is a diagram illustrating an example of a functional configuration of the information processing terminal and the translation device according to the embodiment; 2 is a diagram illustrating an example of a functional configuration of the information processing terminal and the translation device according to the embodiment; FIG. 13 is a diagram illustrating an example of a voice table. 10 is a flowchart of an example of processing of the information processing system according to the present embodiment. 10 is a flowchart of an example of processing of the information processing system according to the present embodiment. 10 is a flowchart of an example of processing of the information processing system according to the present embodiment. 10 is a flowchart of an example of processing of the information processing system according to the present embodiment. 10 is a flowchart of an example of processing of the information processing system according to the present embodiment.

Below, the form for implementing this disclosure will be described with reference to the drawings.

[System configuration]
First, an example of a game system will be described as an example of an information processing system that realizes a communication method according to an embodiment. Note that the information processing system that realizes a communication method according to an embodiment may be a system other than a game system, and may be, for example, a social networking service (SNS) system.

Figure 1 is a configuration diagram of an example of an information processing system according to this embodiment. The information processing system 1 according to this embodiment shown in Figure 1 has a server device 10, information processing terminals 12a to 12c, translators 14a to 14b, and a network 18 for data communication. The network 18 is a LAN (Local Area Network), the Internet, a communication network, or the like.

The translator 14a is communicatively connected to the information processing terminal 12a. The translator 14b is communicatively connected to the information processing terminal 12b. In the following, the translators 14a and 14b may be collectively referred to as the translator 14. The translator 14 is communicatively connected to the information processing terminal 12a or 12b by wire or wirelessly. For example, the translator 14 communicates with the information processing terminal 12a or 12b using short-range wireless communication such as Bluetooth (registered trademark) or Wifi (registered trademark).

The information processing terminal 12a in FIG. 1 is operated by player A. The information processing terminal 12b is operated by player B. The information processing terminal 12c is operated by player C. The information processing system 1 in FIG. 1 provides a chat function to players A to C by having the information processing terminals 12a to 12c transmit and receive chat contents uttered by players A to C. The transmission and reception of chat contents may be performed via the server device 10, or may be performed without the server device 10.

The information processing terminal 12a works in conjunction with the translator 14a and translates the chat content using the translation function of the translator 14a. The information processing terminal 12b works in conjunction with the translator 14b and translates the chat content using the translation function of the translator 14b. Furthermore, the information processing terminal 12c translates the chat content using a translation function realized by executing a translation program installed in the information processing terminal 12c. Note that the information processing terminals 12a to 12c may also translate the chat content using a translation function realized by a translation program installed in the server device 10.

The translator 14 may be, for example, a handheld dedicated terminal with a translation function, or a general-purpose terminal with a translation program installed. The translator 14 may be one that is placed near the player, or one that is attached to a headset or the like and used as a clip. The translation function can be realized using existing technology, for example, the technology described in International Publication No. "WO2019/111346."

The information processing terminals 12a to 12c are computers operated by the players A to C. The information processing terminals 12a to 12c are PCs, tablet terminals, smartphone terminals, game devices, etc. The information processing terminals 12a to 12c accept operations from the players A to C, for example, via a touch panel, controller, mouse, or keyboard, execute information processing according to the operations, and display the results of the execution.

The server device 10 can be realized by a computer. The server device 10 transmits and receives data between the information processing terminals 12a to 12c, executes information processing in response to the operations of the players A to C received by the information processing terminals 12a to 12c, and provides the results of the execution to the information processing terminals 12a to 12c.

The server device 10 may be realized by a cloud computer. Note that the number of server devices 10 in FIG. 1 is not limited to one, and two or more may be used for distributed processing. For example, the server device 10 may be used for downloading programs (applications) to the information processing terminals 12a to 12c, for logging in players A to C, and for managing various databases.

Note that the system configuration in FIG. 1 is an example. In the following description, the information processing terminals 12a to 12c may be collectively referred to as information processing terminal 12. At least some of the functions of the server device 10 may be realized as functions of the information processing terminal 12. Some of the functions of the information processing terminal 12 may be realized as functions of the server device 10. Furthermore, the number of information processing terminals 12 in FIG. 1 is not limited to three, and may be two, four or more.

[Hardware configuration]
The information processing terminal 12 according to this embodiment is realized, for example, by a computer 500 having the configuration shown in Fig. 2. Similarly, the server device 10 is realized, for example, by a computer 500 having the configuration shown in Fig. 2. Fig. 2 is a diagram showing an example of the hardware configuration of a computer according to this embodiment.

The computer 500 in FIG. 2 has, for example, a CPU (Central Processing Unit) 100, a storage device 102, a communication device 104, an input device 106, and an output device 108. The CPU 100 controls the computer 500 in accordance with a program. The storage device 102 is, for example, a memory such as a ROM (Read Only Memory) or a RAM (Random Access Memory), or a storage such as a HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage device 102 stores the programs and data executed by the CPU 100.

The communication device 104 is a communication device such as a network circuit that controls communication. The input device 106 is an input device such as a touchpad, a controller, a mouse, a keyboard, a camera, or a microphone. The output device 108 is an output device such as a display or a speaker. A touch panel is realized by combining a touchpad, which is an example of the input device 106, with a display, which is an example of the output device 108. The hardware configuration in FIG. 2 is an example.

[Function block]
Below, we will explain separately the functional blocks when working in conjunction with the translation device 14 to translate chat content using the translation function of the translation device 14, and the functional blocks when translating chat content using a translation function realized by executing a built-in translation program.

For example, the functional blocks in the case where chat content is translated using the translation function of the translation device 14 in cooperation with the translation device 14 are as shown in FIG. 3. FIG. 3 is a diagram showing an example of the functional configuration of the information processing terminal and translation device according to this embodiment. Note that the functional configuration in FIG. 3 is only an example, and for example, at least a part of the functional configuration of the information processing terminal 12 shown in FIG. 3 may be provided in the translation device 14 or the server device 10, and processing may be performed in cooperation with each other.

The information processing terminal 12 in FIG. 3 has a control unit 200, an operation reception unit 202, an output control unit 204, a communication unit 206, and a memory unit 210.

The memory unit 210 stores a game program 212, a sound table 214, an image change table 216, a bonus table 218, and a national character table 220. The memory unit 210 may be realized by the memory device 102, or may be realized by a memory device connected via the network 18, etc.

The game program 212 is an example of a game processing and chat processing program executed by the CPU 100. The sound table 214 stores information about the sound that is reproduced in the chat content, as described below. The image change table 216 stores information about visual changes that are made to the image of the player or character while sound is being reproduced, as described below.

The bonus table 218 also stores information about bonuses to be given to players who communicate with each other via the chat function, for example when they cooperate in a game, as described below. The national character table 220 stores information about visual changes that are given to the image of a player or character whose audio is being played, according to the national character, as described below.

In this embodiment, when a player uses the chat function to communicate with other players while playing a game, the chat contents can be translated by the translator 14, making it possible for players who speak different languages to communicate with each other. Therefore, this embodiment makes it easier for players who speak different languages, such as their native language, to communicate with each other, and reduces barriers to cooperative play between players who speak different languages, promoting cooperative play and revitalizing cooperative play games.

The control unit 200 performs overall control of the information processing terminal 12. The overall control of the information processing terminal 12 includes a process for accepting operations from the player for the game being played, and generating and displaying game images in response to the operations. The overall control of the information processing terminal 12 also includes a process for providing a chat function to multiple players. Furthermore, the overall control of the information processing terminal 12 includes a process for selecting the audio to be played back in chat content, a change process for giving a visual change to the image of the player or character for which audio is being played back, a change process for giving a visual change to the image of the player or character for which audio is being played back in response to the nationality of the player for which audio is being played back, and other processes.

The control unit 200 is realized by the CPU 100 executing the processes described in a program such as the game program 212. The control unit 200 in FIG. 3 is configured to have a game control unit 230 and an information processing terminal side cooperation processing unit 232. The game control unit 230 performs processes related to the game, such as game processing and chat processing. In addition, the information processing terminal side cooperation processing unit 232 performs processes related to cooperation with the translator 14.

For example, the game control unit 230 executes game processing, generates game images according to the game processing being executed, and displays them on the output device 108 as a game screen. The game control unit 230 also executes chat processing to provide a chat function to the player. If translation of chat content uttered by the player is required, the game control unit 230 can cause the translation device 14 to translate the chat content via the information processing terminal side collaboration processing unit 232 that collaborates with the translation device 14.

The game control unit 230 is configured to have a chat processing unit 240, an image generation unit 242, an image change processing unit 244, an emotion recognition unit 246, and a bonus granting unit 248. The chat processing unit 240 accepts chat content spoken by a player and transmits the chat content to the information processing terminals 12 of the other players. The chat processing unit 240 also receives chat content spoken by other players. The chat processing unit 240 causes the translator 14 to translate the chat content as necessary.

The chat processing unit 240 plays back the translated chat content as audio. The audio used to play back the chat content is, for example, audio associated with the player who spoke the chat content. Information on the audio used to play back the chat content is stored in the audio table 214. The audio used to play back the chat content may also be, for example, audio associated with the character used by the player who spoke the chat content. For example, information on the audio associated with the character used by the player is stored in the audio table 214.

The image generation unit 242 generates game and chat images in accordance with the game processing and chat processing. The image change processing unit 244 imparts visual changes to the game and chat images so that the player or character for whom sound is being played by the chat processing unit 240 can be identified. For example, the image change processing unit 244 imparts visual changes by changing the appearance of the player or character for whom sound is being played by the chat processing unit 240 to be different from the appearance of players or characters other than those for whom sound is being played by adding a frame, effect, or icon, etc.

The emotion recognition unit 246 recognizes the emotion (anger, sadness, joy, etc.) of the player who made the chat content statement from the voice of the player who made the chat content statement. The technology for recognizing the emotion of the player who made the chat content statement from the voice of the player who made the chat content statement is an existing technology, and for example, the technology described in JP 2002-91482 A can be used.

The recognized emotion of the player is used by the chat processing unit 240 to select the audio to be played back in the chat content. Audio information based on the recognized emotion of the player is stored, for example, in the audio table 214. The chat processing unit 240 refers to the audio table 214 and plays back the chat content in audio based on the recognized emotion of the player.

The image change processing unit 244 also uses the recognized player's emotion to select a visual change to identify the image of the player or character for which audio is being played. Information on the visual change based on the recognized player's emotion is stored, for example, in the audio table 214. The image change processing unit 244 refers to the audio table 214 and applies a visual change based on the recognized player's emotion to the image of the player or character for which audio is being played.

The bonus granting unit 248 performs a process of granting bonuses when players cooperate in a game whose relationship can be recognized from the results of the translation process, such as players who use the same language or players who belong to the same region, as described below.

For example, the benefit granted by the benefit granting unit 248 is an image of an action of recovering by eating food that is commonly eaten in the same area, which can be used in place of an image of a recovery action when a certain number or more players belonging to the same area are registered in the same guild.

The bonus granted by the bonus granting unit 248 is an image of clothing commonly worn in the area that can be used as a costume for the player's character when a predetermined number or more of players, etc., belonging to the same area are registered in the same guild. The bonus granted by the bonus granting unit 248 is an image of a greeting action commonly performed in the area that can be used in place of an image of a greeting action when a predetermined number or more of players, etc., belonging to the same area are registered in the same guild.

The image change processing unit 244 also identifies information relating to the national character of each player based on the language used by the player, which can be recognized from the results of the translation process, etc. Language-based national character-related information is stored, for example, in the national character table 220. The image change processing unit 244 refers to the national character table 220 and applies a visual change to the image of the player's character for which audio is being played, in accordance with the identified player's national character.

For example, the image change processing unit 244 visually changes the image of the player's character while audio is being played, using an image of an action that corresponds to the national characteristics (religion, ethnicity, etiquette, etc.) of the identified player. Examples of actions that correspond to national characteristics include bowing, raising hands, and joining hands in prayer, which are actions that show respect.

The operation reception unit 202 receives various operations by the player on the input device 106. The output control unit 204 displays various screens on the output device 108 according to the control of the control unit 200. The operation reception unit 202 is realized by the CPU 100 controlling the input device 106 according to a program. The output control unit 204 is realized by the CPU 100 controlling the output device 108 according to a program.

The various operations performed by the player on the input device 106 refer to operations performed by the player operating the operation reception unit 202 to cause the CPU 100 to execute processing. The output control unit 204 displays various screens and outputs sounds according to the control of the control unit 200. The communication unit 206 performs processing related to communication. The communication unit 206 is realized when the CPU 100 executes a program and controls the communication device 104 according to the program.

The translator 14 in FIG. 3 has a translation processing unit 250, a translation result output unit 252, and a translator-side cooperation processing unit 254. The translation processing unit 250 executes a process of translating chat contents using the chat function. The translation result output unit 252 outputs the translated chat contents to the information processing terminal 12. The translator-side cooperation processing unit 254 executes a process related to cooperation with the information processing terminal 12. For example, the translator 14 translates the chat contents via the translator-side cooperation processing unit 254, which cooperates with the information processing terminal 12.

Next, functional blocks for translating chat content using a translation function realized by executing a built-in translation program will be described. The functional blocks for translating chat content using a translation function realized by executing a built-in translation program are as shown in FIG. 4. FIG. 4 is a diagram showing an example of the functional configuration of an information processing terminal according to this embodiment. Note that the functional configuration in FIG. 4 is only an example, and for example, at least a part of the functional configuration of the information processing terminal 12 shown in FIG. 4 may be provided in the server device 10 and processing may be performed in cooperation with each other.

The information processing terminal 12 in FIG. 4 has a control unit 200, an operation reception unit 202, an output control unit 204, a communication unit 206, and a memory unit 210. Note that the functional configuration of the information processing terminal 12 in FIG. 4 is similar to the functional configuration of the information processing terminal 12 in FIG. 3 except for some parts, and therefore a description of the same parts will be omitted as appropriate. The information processing terminal 12 in FIG. 4 has a configuration in which the information processing terminal side cooperation processing unit 232 of the information processing terminal 12 in FIG. 3 has been replaced with a translation processing unit 234.

For example, the game control unit 230 executes chat processing to provide a chat function to the player. If translation of chat content uttered by the player is required, the game control unit 230 can cause the translation processing unit 234 to translate the chat content. The chat processing unit 240 causes the translation processing unit 234 to translate the chat content as necessary. Other functional configurations are similar to those in FIG. 3, and therefore description thereof will be omitted.

Figure 5 is a diagram showing an example of a sound table. The sound table 214 stores information such as that shown in Figure 5 (A) or Figure 5 (B) as information related to the sound used to play back chat content. Figure 5 (A) stores a player name and a sound in association with each other as information related to the sound used to play back chat content. Figure 5 (B) stores a player name, a used character, and a character sound in association with each other as information related to the sound used to play back chat content.

The player name is an example of information that identifies a player. The voice is an example of information that identifies the voice used to play back chat content. The voice table in FIG. 5(A) is an example in which voice information used to play back chat content is associated with each player. By referring to the voice table in FIG. 5(A), the information processing terminal 12 can play back the translated chat content in the voice associated with the player who made the comment.

The character used is an example of information that identifies a character that the player is using in the game. The character voice is an example of information that identifies the voice used to play back the chat content. The voice table in FIG. 5(B) is an example in which voice information used to play back the chat content is associated with each character used by the player. By referring to the voice table in FIG. 5(B), the information processing terminal 12 can play back the translated chat content in the voice associated with the character used by the player who made the comment.

[process]
In the following, an example will be described in which a player communicates with other players by using a chat function while playing a game in the information processing system 1 according to this embodiment. Here, an example of the information processing system 1 in FIG. 1 will be described. Note that players A to C use different languages.

Figure 6 is a flowchart of an example of the processing of the information processing system according to this embodiment. For example, players A to C start chatting in step S10 in order to communicate with each other while playing the game. The information processing terminals 12a to 12c repeat the processing of steps S12 to S18 until the chat ends in step S20.

When players A to C wish to communicate with other players, they vocally state the content (chat content) from an input device 106 such as a microphone. Here, the explanation will continue assuming that player A has stated the chat content. The chat content stated by player A is transmitted from information processing terminal 12a to information processing terminals 12b and 12c.

In step S12, the information processing terminals 12b and 12c determine that player A has made a statement based on the chat content received from the information processing terminal 12a, and perform the processing of steps S14 to S18. If the information processing terminals 12a to 12c do not receive chat content from the other information processing terminals 12, they determine that no other players have made a statement, and skip the processing of steps S14 to S18.

In step S14, the information processing terminal 12b cooperates with the translator 14b to translate the chat content uttered by player A using the translation function of the translator 14b. Also in step S14, the information processing terminal 12c translates the chat content uttered by player A using a translation function realized by executing a translation program installed in the information processing terminal 12c.

Note that, although an example in which players A to C use different languages has been described here, if the languages used are the same, translation of the chat content in step S14 may be omitted. The languages used by players A to C may be determined by a translation function, or may be determined based on information manually set by the players.

In step S16, the information processing terminals 12b and 12c refer to the audio table 214 and identify the audio associated with player A who spoke the chat content as the audio to be used in playing back the chat content spoken by player A. In step S16, the information processing terminals 12b and 12c may also refer to the audio table 214 and identify the audio associated with character α used by player A who spoke the chat content as the audio to be used in playing back the chat content spoken by player A. In step S18, the information processing terminals 12b and 12c play back the chat content translated in step S14 using the audio identified in step S16.

For example, if player A is male, storing male voice information in association with player A in the voice table 214 allows the chat content spoken by player A to be played back in a male voice. Also, if player A is female, storing female voice information in association with player A in the voice table 214 allows the chat content spoken by player A to be played back in a female voice. In this way, by increasing the number of voice types that can be associated with player A in the voice table 214 and associating them with appropriate voices, players B and C can easily recognize player A who spoke the chat content being played back.

Figure 7 is a flowchart of an example of processing of the information processing system according to this embodiment. The processing of the flowchart in Figure 7 is similar to that in Figure 6 except for some parts, so a description of the same parts will be omitted as appropriate.

The processing of steps S30 to S34 is similar to the processing of steps S10 to S14 in FIG. 6, and therefore a description thereof will be omitted. In step S36, the information processing terminals 12b and 12c refer to the image change table 216 to identify the visual change to be applied to the image of player A or character α who has spoken the chat content. In step S38, the information processing terminals 12b and 12c play back the chat content translated in step S34 as audio, and perform image change processing to apply the visual change identified in step S36 to the image of player A or character α used by player A who is speaking.

For example, players B and C can easily recognize player A who made the replayed chat content by applying visual changes through image modification processing in which a frame, effect, icon, or the like is added to the image showing player A or character α displayed on the screens of information processing terminals 12b and 12c.

In addition, for example, players B and C can easily recognize player A who made a comment in the chat content being played back by applying a visual change through image change processing in which the character α displayed on the screens of information processing terminals 12b and 12c moves its mouth as if it is speaking.

Figure 8 is a flowchart of an example of processing of the information processing system according to this embodiment. The processing of the flowchart in Figure 8 is similar to that in Figure 6 except for some parts, so a description of the same parts will be omitted as appropriate.

The processing of steps S50 to S54 is similar to the processing of steps S10 to S14 in FIG. 6, and therefore a description thereof will be omitted. In step S56, the information processing terminals 12b and 12c recognize the emotion of the player A who made the statement from the voice of the player A who made the statement.

In step S58, the information processing terminals 12b and 12c refer to the voice table 214 and identify the voice associated with the emotion of player A who uttered the chat content as the voice to be used for playing back the chat content uttered by player A. In step S60, the information processing terminals 12b and 12c play back the chat content translated in step S54 using the voice identified in step S58.

For example, if player A's emotion is "joy", then by storing information on the "joy" voice (voice that player A feels happy) in association with the emotion of "joy" in the voice table 214, the chat content uttered by player A can be played back in the "joy" voice. Also, if player A's emotion is "anger", then by storing information on the "anger" voice (voice that player A feels angry) in association with the emotion of "anger" in the voice table 214, the chat content uttered by player A can be played back in the "anger" voice.

In this way, by increasing the number of voice types that can be associated with the emotions of player A in the voice table 214 and associating them with appropriate voices, players B and C can more easily recognize the emotions of player A who made the replayed chat content.

The voice table 214 may also record voice information in association with the game situation in addition to the emotions of player A. For example, if player A speaks a chat message when the hit points (HP) of the character α used by player A are low, the chat message spoken by player A may be reproduced on the information processing terminals 12b and 12c in a distressed voice.

Figure 9 is a flowchart of an example of processing of the information processing system according to this embodiment. The processing of the flowchart in Figure 9 is similar to that of Figure 8 with some exceptions, so a description of the same parts will be omitted as appropriate.

The processing of steps S70 to S76 is similar to the processing of steps S50 to S56 in FIG. 8, and therefore a description thereof will be omitted. In step S78, the information processing terminals 12b and 12c refer to the image change table 216 and specify the visual change to be applied to the image of player A or character α who has spoken the chat content, based on the emotion of player A recognized in step S76. In step S80, the information processing terminals 12b and 12c play back the chat content translated in step S74 as audio, and perform image change processing to apply the visual change specified in step S78 to the image of player A who is speaking, or character α used by player A.

For example, if player A's emotion is "joy", then by storing facial expression information of "joy" in association with the emotion of "joy" in the image change table 216, the facial expression of player A or character α displayed on the screens of the information processing terminals 12b and 12c can be changed to a "joy" facial expression. Furthermore, the image change table 216 may record facial expression information in association with the emotion of player A, taking into account the game situation as well.

For example, if player A makes a chat comment when the hit points (HP) of the character α used by player A are low, the facial expression of player A or character α displayed on the screens of information processing terminals 12b and 12c may be visually changed to look distressed.

In this way, by increasing the variety of visual changes that can be associated with the emotions of player A in the image change table 216 and associating them with appropriate visual changes, it becomes easier for players B and C to recognize the emotions of player A who made the comments in the chat content being played back.

Figure 10 is a flowchart of an example of processing of the information processing system according to this embodiment. The processing of the flowchart in Figure 10 is similar to that in Figure 6 except for some parts, so a description of the same parts will be omitted as appropriate.

The processing of steps S90 to S94 is similar to the processing of steps S10 to S14 in FIG. 6, and therefore a description thereof will be omitted. In step S94, the information processing terminals 12b and 12c determine the language used by the player A who made the statement. The language used by player A may be determined by a translation function or based on the language information set by the player. Based on the language used by player A, the information processing terminals 12b and 12c identify the nationality of player A.

In step S98, the information processing terminals 12b and 12c refer to the national character table 220 to determine the visual change to be made to the image of the player A who made the statement, or to the image of the character α used by the player A, based on the national character of the player A who made the statement.

In step S100, the information processing terminals 12b and 12c play back the chat content translated in step S94 as audio, and perform an image change process to give a visual change to the image of the speaking player A or the character α used by player A according to the national character identified in step S98.

For example, players B and C can see actions that correspond to player A's national character as the actions of player A's character α displayed on the screens of information processing terminals 12b and 12c.

The processing of the flowcharts shown in Figures 6 to 10 can be combined in part or in whole. For example, by adding the processing contents of steps S16 and S18 of Figure 6 to the processing of the flowchart of Figure 7, the information processing terminals 12b and 12c can play back the chat content translated in step S34 in the voice specified in step S16, and perform image change processing that gives the image of the speaking player A or the character α used by player A the visual change specified in step S36.

For example, by adding the processing contents of steps S58 and S60 in FIG. 8 to the processing of the flowchart in FIG. 9, the information processing terminals 12b and 12c can play back the chat content translated in step S74 in the voice specified in step S58, and can also perform image change processing that imparts the visual change specified in step S78 to the image of the currently speaking player A or character α used by player A.

In the above, an example has been described in which the chat contents uttered by player A are transmitted from information processing terminal 12a to information processing terminals 12b and 12c, and then translated at information processing terminals 12b and 12c, but the chat contents may also be translated at information processing terminal 12a or at server device 10. Furthermore, although an example of application to voice chat has been described in this embodiment, application to a text chat read-aloud function is also possible.

In this way, in this embodiment, the player who made the translated chat content can be easily recognized by other players. For example, in a game system, unlike a conference where you can concentrate on listening to what others are saying and reading the subtitles, it is necessary to listen to the chat content in parallel with playing the game and understanding the situation. According to this embodiment, it becomes easier for other players to recognize the player who made the comment in the chat content being played back.

The disclosed embodiment of the information processing system 1 should be considered as an example and not a limitation. The above embodiment can be modified and improved in various forms without departing from the scope and spirit of the appended claims. Furthermore, the matters described in the above-mentioned embodiments can have other configurations as long as they are not inconsistent, and can be combined as long as they are not inconsistent.

1 Information processing system 10 Server device 12a to 12c Information processing terminal 14a to 14b Translation machine 232 Information processing terminal side cooperation processing unit 240 Chat processing unit 244 Image change processing unit 246 Emotion recognition unit 248 Benefit giving unit 250 Translation processing unit 254 Translation machine side cooperation processing unit

Claims (13)

An information processing system in which a plurality of information processing terminals operated by a plurality of players respectively provide a chat function to the plurality of players,
a translation processing unit that translates chat contents using the chat function;
a chat processing unit that reproduces the chat content translated by the translation processing unit in a voice associated with the player who spoke the chat content;
an image change processing unit that gives a visual change to the player or character who has spoken the chat content;
having
The translation processing unit determines the region to which the player belongs or identifies information related to the national character of the player based on a result of translating the chat content,
the image change processing unit applies a visual change to the image of the character in accordance with the region or the national character;
Information processing system. 2. The information processing system according to claim 1, wherein the chat processing unit reproduces the chat content translated by the translation processing unit in a voice associated with a character used by the player who made the comment. the image change processing unit applies a visual change to an image of the player or the character so that the player or the character can be identified while the sound is being reproduced ;
3. The information processing system according to claim 2. an emotion recognition unit that recognizes the emotion of the player who made the chat content from the voice of the player who made the chat content;
and
4. The information processing system according to claim 1, wherein the chat processing unit reproduces the chat contents in a voice based on the recognized emotion of the player. an emotion recognition unit that recognizes the emotion of the player who made the chat content from the voice of the player who made the chat content;
and
4. The information processing system according to claim 3, wherein the image change processing section applies a visual change based on the recognized emotion of the player to the image of the character during playback of the sound. An information processing system in which a plurality of information processing terminals operated by a plurality of players respectively provide a chat function to the plurality of players,
a translation processing unit that translates chat contents using the chat function;
a chat processing unit that reproduces the chat content translated by the translation processing unit in a voice associated with the player who spoke the chat content;
having
The translation processing unit determines the language or region of each of the players who made a comment based on a result of translating the chat content,
a reward providing unit that provides a reward when the players who use the same language or who belong to the same region cooperate with each other;
The information processing system further comprises: An information processing system in which a plurality of information processing terminals operated by a plurality of players respectively provide a chat function to the plurality of players,
a translation processing unit that translates chat contents using the chat function;
a chat processing unit that reproduces the chat content translated by the translation processing unit in a voice associated with the player who said the chat content;
having
the chat processing unit reproduces the chat content translated by the translation processing unit in a voice associated with a character used by the player who made the comment,
an image change processing unit that applies a visual change to an image of the player or the character so that the player or the character can be identified while the sound is being reproduced;
having
The translation processing unit determines the language of each of the players who made a comment based on a result of translating the chat content,
The image change processing unit specifies information about the national character of the player based on the determined language of each of the players, and applies a visual change corresponding to the national character to the image of the character.
Information processing system. 8. The information processing system according to claim 1, wherein the translation processing unit is realized by a translation machine capable of communicating with the information processing terminal. 8. The information processing system according to claim 1, wherein the translation processing unit is realized by a translation program installed in the information processing terminal. 10. The information processing system according to claim 1, wherein the chat function is a chat function used by the plurality of players during a game. A communication method for an information processing system in which a plurality of information processing terminals operated by a plurality of players respectively provide a chat function to the plurality of players, comprising:
a translation step of translating chat content by the chat function;
a chat processing step of playing back the chat content translated by the translation step in a voice associated with the player who said the chat content;
an image change processing step for giving a visual change to the player or character who has spoken the chat content;
having
The translation step includes a step of determining a region to which the player belongs or identifying information related to the national character of the player based on a result of translating the chat content,
The image change processing step includes a step of giving a visual change to the image of the character according to the region or the national character.
How to communicate. an information processing terminal to which information processing terminals operated by other players are communicably connected and capable of communicating with the other players through a chat function,
a translation processing unit that translates chat contents using the chat function;
a chat processing unit that reproduces the chat content translated by the translation processing unit in a voice associated with the player who spoke the chat content;
an image change processing unit that gives a visual change to the player or character who has spoken the chat content;
having
The translation processing unit determines the region to which the player belongs or identifies information related to the national character of the player based on a result of translating the chat content,
the image change processing unit applies a visual change to the image of the character in accordance with the region or the national character;
Information processing terminal. an information processing terminal to which information processing terminals operated by other players are communicably connected and capable of communicating with the other players through a chat function,
a linking processing unit that links with a translation device that translates chat content using the chat function;
a chat processing unit that reproduces the chat content translated by the translator in a voice associated with the other player who said the chat content;
an image change processing unit that gives a visual change to the player or character who has spoken the chat content;
having
The cooperation processing unit determines the region to which the player belongs or identifies information related to the national character of the player based on a result of translating the chat content,
the image change processing unit applies a visual change to the image of the character in accordance with the region or the national character;
Information processing terminal.

Images