JP7484285B2 - Information processing device, output sound determination method, and output sound determination program - Google Patents

Description

The present invention relates to an information processing device, an output sound determination method, and an output sound determination program.

There is known technology for controlling the emission of sound from a sound source set based on the position of a character in response to the character's actions in a virtual space (for example, Patent Document 1). By using the technology disclosed in Patent Document 1, a sense of realism is created in the sounds emitted by the character, increasing the enjoyment of the game.

JP 2018-201790 A

In recent years, the number of players in so-called "e-sports," which use games such as FPS (First Person Shooter) and TPS (Third Person Shooter), has been increasing. As the number of e-sports players increases, more users are seeking to improve their gaming skills in addition to enjoying the games. Since there is no set scenario in multiplayer e-sports, each user cannot memorize the scenario and predict it in advance to improve their gaming skills. However, as with regular sports, it is possible to improve by receiving coaching from others.

However, it is assumed that users with high game skills, such as advanced players, perform operations after appropriately determining whether each of the multiple sounds output is an important sound or not. Therefore, understanding which output sounds each user reacted to when performing operations may lead to improved user operation skills. Patent Document 1 does not disclose any technology for improving user operation skills.

The object of the present invention is to solve the above-mentioned problems, and to provide an information processing device, an output sound determination method, and an output sound determination program that can improve a user's operation skills.

The information processing device of the present invention comprises a detection unit that detects a specified event in a first virtual space based on an operation of a first user, and a determination unit that determines a first output sound that causes the first user to perform an operation corresponding to the specified event based on output sound information including identification information of an output sound output from a first communication terminal displaying the first virtual space during a specified period before the time when the specified event is detected, and the detection unit further comprises a processing unit that detects the specified event in a second virtual space based on an operation of a second user, and when the specified event in the second virtual space is detected after the specified event in the first virtual space is detected, notifies the second communication terminal displaying the second virtual space of the content of the specified event in the first virtual space .

The output sound determination method of the present invention is an output sound determination method in which a computer detects a specified event in a first virtual space based on an operation of a first user, and when the specified event in the first virtual space is detected followed by the detection of the specified event in a second virtual space based on an operation of a second user, the computer notifies a second communication terminal displaying the second virtual space of the content of the specified event in the first virtual space, and determines a first output sound that has the first user perform an operation corresponding to the specified event based on output sound information including identification information of an output sound output from the first communication terminal displaying the first virtual space during a specified period before the time the specified event was detected.

The output sound determination program of the present invention is an output sound determination program that causes a computer to execute a process to detect a specified event in a first virtual space based on an operation of a first user, and when the specified event in the first virtual space is detected followed by the detection of the specified event in a second virtual space based on an operation of a second user, notify a second communication terminal displaying the second virtual space of the content of the specified event in the first virtual space, and determine a first output sound that causes the first user to perform an operation corresponding to the specified event based on output sound information including identification information of an output sound output from the first communication terminal displaying the first virtual space during a specified period before the time the specified event was detected.

The present invention provides an information processing device, an output sound determination method, and an output sound determination program that can improve a user's operation skills.

FIG. 1 illustrates an example of a configuration of an information processing system according to a first embodiment; FIG. 13 is a diagram illustrating an example of an event determination table. FIG. 11 is a diagram for explaining a determination process. 4 is a flowchart showing an example of operation of the information processing device according to the first embodiment; FIG. 13 illustrates an example of a priority management table. FIG. 13 is a diagram illustrating a configuration example of an information processing system according to a second embodiment. FIG. 11 is a diagram for explaining an example of the operation of the information processing device according to the second embodiment; FIG. 11 is a diagram for explaining an example of the operation of the information processing device according to the second embodiment;

Specific embodiments to which the present invention is applied will be described in detail below with reference to the drawings. However, the present invention is not limited to the following embodiments. In addition, the following descriptions and drawings have been simplified as appropriate for clarity of explanation.

(Embodiment 1)
<Example of information processing system configuration>
A configuration example of an information processing system 100 according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing a configuration example of the information processing system according to the first embodiment. The information processing system 100 includes an information processing device 10 and a communication terminal 20. The information processing system 100 is a system that provides a game that a user U1 plays on the communication terminal 20, and therefore may be referred to as a game system.

The information processing device 10 may be, for example, a personal computer device or a server device. The information processing device 10 connects to and communicates with the communication terminal 20 via a network. The network may be a wireless network, a wired network, or a combination of a wireless and wired network. The information processing device 10 has a game program 151 stored in the storage unit 15, and uses the game program 151 to provide a game to the communication terminal 20. The information processing device 10 may be referred to as a game server. The game provided by the information processing device 10 may be, for example, an FPS or TPS game.

The information processing device 10 transmits a game scenario to the communication terminal 20. The information processing device 10 receives operation information input to the communication terminal 20 and other communication terminals (not shown). The information processing device 10 determines position information and behavior information in the game space of at least one object placed in the game space, which is a virtual space, based on the operation information received from the communication terminal 20 and the operation information received from the other communication terminals (not shown). The information processing device 10 transmits the determined position information and behavior information to the communication terminal 20. The objects include, for example, a player character, an enemy character, an ally character, and various objects in the game. The player character is a character that acts in response to the operation of a user U1 who plays a game using the communication terminal 20. The game scenario means information required for each communication terminal to execute the game, such as information on the player's settings, the character's status, etc.

The communication terminal 20 may be, for example, a personal computer device, a smartphone, a tablet terminal, a mobile phone, or a dedicated game device. The communication terminal 20 is a terminal that provides a game to the user U1. The communication terminal 20 may be referred to as a game terminal. The communication terminal 20 connects to and communicates with the information processing device 10 via a network. The communication terminal 20 receives a game scenario from the information processing device 10, displays a game space on a display based on the game scenario, and executes a game. The communication terminal 20 acquires an operation performed by the user U1, and generates operation information. The communication terminal 20 transmits the operation information to the information processing device 10. The communication terminal 20 receives position information and action information in the game space of each object in the game from the information processing device 10, and determines a display position and a display operation of each object in the game on the display. The communication terminal 20 displays a game space in which each object in the game is arranged on a display provided in the communication terminal 20 based on the determined display position and display operation.

<Configuration example of information processing device>
Next, a configuration example of the information processing device 10 will be described. The information processing device 10 includes a processing unit 11, an acquisition unit 12, a detection unit 13, a determination unit 14, and a storage unit 15. The processing unit 11, the acquisition unit 12, the detection unit 13, the determination unit 14, and the storage unit 15 may be software or modules in which processing is performed by a processor executing a program stored in a memory. In addition, the processing unit 11, the acquisition unit 12, the detection unit 13, the determination unit 14, and the storage unit 15 may be hardware such as a circuit or a chip.

The processing unit 11 executes processing related to the game based on the game program 151 stored in the memory unit 15. The processing unit 11 generates a game scenario at predetermined time intervals based on the game program 151 and transmits the game scenario to the communication terminal 20. The processing unit 11 determines position information and action information of at least one object in the game space executed by the communication terminal 20 based on operation information received from the communication terminal 20 by the acquisition unit 12 described below and operation information received from another communication terminal (not shown). The processing unit 11 transmits the determined position information and action information to the communication terminal 20.

The processing unit 11 generates output sound information including identification information of the output sound output from the communication terminal 20 based on position information and action information of each object in the game space executed on the communication terminal 20. The processing unit 11 stores the generated output sound information in the storage unit 15.

The output sound information includes, as identification information for the output sound to be output, object identification information for each object in the game, and identification information for identifying output sound data related to each object. The output sound information also includes the output start time at which the output sound of the output sound data corresponding to the output sound identification information is output, and the output end time at which the output sound of the output sound data is output. Furthermore, the output sound information includes the volume of the output sound output from the communication terminal 20, the relative distance between a reference position in the game space and the position of each object in the game space, and the direction of each object in the game space relative to the reference position. The reference position is, for example, the position of the player character in the game space, but may be an arbitrarily set position.

The processing unit 11 determines the output sound to be output from the communication terminal 20 at each time based on the position information and action information of each object in the game space, and generates output sound information. The processing unit 11 calculates the relative distance and direction contained in the output sound information based on the position information and action information of each object. The processing unit 11 also calculates the volume contained in the output sound information based on the position information, action information, and multiple parameters related to the output sound of each object.

The processing unit 11 may obtain the volume of the output sound output from the communication terminal 20 from the communication terminal 20. Alternatively, sound data recording each output sound output by the communication terminal 20 may be generated, and the processing unit 11 may obtain the sound data from the communication terminal 20 and analyze it to calculate the volume of the output sound output from the communication terminal 20. Alternatively, the communication terminal 20 may generate output sound information, and the processing unit 11 or the obtaining unit 12 may obtain the output sound information from the communication terminal 20.

The acquisition unit 12 receives operation information input to the communication terminal 20 from the communication terminal 20 and acquires the operation information.
The detection unit 13 detects a predetermined operation event in the game space displayed by the communication terminal 20 based on the operation of the user U1. An operation event refers to a change in the state of the display showing the game space displayed on the communication terminal 20, including the action of the player character in the game space, based on the operation of the user U1, and is, for example, a state change set in an event determination table. The detection unit 13 detects an operation event based on the acquired operation information and the event determination table, and detects the predetermined operation event based on a determination of whether the detected operation event is a predetermined operation event. The predetermined operation event is an operation event that leads to improvement of game skills, and is called an evaluation target event.

The event determination table will now be described with reference to FIG. 2. FIG. 2 is a diagram showing an example of an event determination table. The event determination table is a table for managing multiple operation events and for determining whether each operation event is an event to be evaluated. The event determination table is stored in the memory unit 15.

As shown in FIG. 2, the event determination table associates operation events with evaluation target events.
An event that occurs within the game space due to an operation by the user U1 is set as the operation event.
The evaluation target event is set with information for determining whether or not the operation event is an evaluation target event. When an evaluation target event is set with "○", it indicates that it is an evaluation target event, and when an evaluation target event is set with "×", it indicates that it is not an evaluation target event.

The detection unit 13 identifies, for example, the action content taken by the player character in the game space of the communication terminal 20 based on the operation information. The detection unit 13 determines whether the action content of the player character is the action content set as an operation event in the event determination table. When the action content of the player character is set as an operation event in the event determination table, the detection unit 13 checks the evaluation target event in the event determination table and determines whether the action content of the player character is an evaluation target event. When the detection unit 13 determines that the action content of the player character is an evaluation target event, it detects that the evaluation target event has occurred.

When the detection unit 13 detects an event to be evaluated, it generates event information including the event occurrence time of the event to be evaluated, the event end time, the operation event, and the state of the player character before and after the event to be evaluated. For example, if the operation event is "change weapon," the state of the player character before and after the event to be evaluated is set to "holding a knife" as the state before the event, and set to "holding a firearm" as the state after the event. The detection unit 13 stores the event information in the memory unit 15.

The communication terminal 20 may hold operation events set in the event determination table, detect operation events based on operation information input to the communication terminal 20, and generate event information. The detection unit 13 may acquire event information from the communication terminal 20 as data in JSON (JavaScript Object Notation) format, for example, and detect an event to be evaluated based on the acquired event information and the event determination table. The detection unit 13 may store the event information of the event to be evaluated in the storage unit 15.

Returning to FIG. 1, the determination unit 14 will be described. The determination unit 14 extracts, from the output sound information, output sound information of an output sound output from the communication terminal 20 during a detection period before the event occurrence time. The determination unit 14 extracts output sound information in which the detection period is included between the output start time and the output end time of the output sound information. The determination unit 14 determines an output sound that has caused the user U1 to perform an operation corresponding to the event to be evaluated based on the extracted output sound information. The output sound that has caused the user U1 to perform an operation corresponding to the event to be evaluated is an output sound to which the user U1 reacts, and may therefore be referred to as a reaction sound. The output sound that has caused the user U1 to perform an operation corresponding to the event to be evaluated may also be referred to as an output sound that has a causal relationship between the operation of the user U1 and the event to be evaluated.

The detection period is the period from the event occurrence time to a specified time. The detection period is not limited to the event occurrence time, but may be the period from the time before or after the event occurrence time to the specified time. The length of the detection period may be, for example, the period during which one game scenario is executed. Alternatively, the length of the detection period may be the average time it takes for each of multiple users to react to a certain sound and perform an operation. Alternatively, the length of the detection period may be the average time it takes for the user UI to react to a certain sound and perform an operation over the last several times (e.g., five times) so that the length of the detection period changes according to the user UI's proficiency. Alternatively, the length of the detection period may be a fixed time (e.g., 3 seconds).

The determination unit 14 determines an output sound that causes the user U1 to perform an operation corresponding to the event to be evaluated, based on the identification information of the output sound related to the object displayed by the communication terminal 20 and the volume of the output sound output from the communication terminal 20. Specifically, the determination unit 14 determines a reaction sound based on the volume included in the extracted output sound information.

The determination process of the determination unit 14 will now be described with reference to FIG. 3. FIG. 3 is a diagram for explaining the determination process. The horizontal axis indicates time, with more time passing to the right. The vertical axis indicates the volume of the output sound output from the communication terminal 20, with the volume increasing downwards. The blocks in FIG. 3 illustrate the relationship between the time at which the output sound is output and the volume of the output sound.

The output sounds S(A) to S(E) are output sounds that are output to the communication terminal 20. The output sound S(A) is, for example, the breathing sound of an enemy character, the output sound S(B) is, for example, the moving sound of an ally character, and the output sound S(C) is, for example, the moving sound of an ally character. In addition, the output sound S(D) is, for example, the moving sound of an enemy character, and the output sound S(E) is, for example, the moving sound of an enemy character.

When the detection unit 13 detects an event to be evaluated, the determination unit 14 extracts, from the output sound information, output sound information output from the communication terminal 20 during a detection period TF from the time T (EA), which is the event occurrence time, to a predetermined time before that. Based on the extracted output sound information, the determination unit 14 obtains the output start time, output end time, and volume. Figure 3 illustrates output sounds S (A) to S (E) based on the obtained output start time, output end time, and volume.

The determination unit 14 identifies the output sound that has the loudest volume at the output start time of each output sound during the detection period TF, and determines the identified output sound as the reaction sound. In FIG. 3, the output sound that has the loudest volume at the output start time of each output sound during the detection period TF is S (A). Therefore, the determination unit 14 determines the breathing sound of the enemy character as the reaction sound.

It is also assumed that there are multiple output sounds that are the loudest at the output start time of the output sound output within the detection period TF. Therefore, when there are multiple output sounds that are the loudest at the output start time of the output sound output within the detection period TF, the determination unit 14 determines the reaction sound based on the direction relative to the reference position contained in the extracted output sound information. Specifically, the determination unit 14 determines the output sound whose direction is a predetermined direction among the multiple identified output sounds as the reaction sound. When the reference position is, for example, the position of the player character in the game space, the predetermined direction may be the opposite direction to the face direction or moving direction of the player character, the same direction, or an arbitrarily set direction. Alternatively, the predetermined direction may be a direction in which the player character is more likely to be exposed to danger, such as a blind spot.

In FIG. 3, the volume of each output sound is illustrated as being constant regardless of time, but it is also assumed that the volume may vary depending on time. Therefore, the determination unit 14 may determine a reaction sound for each output sound based on the volume when it is the loudest between the output start time and the output end time. Alternatively, the determination unit 14 may determine a reaction sound for each output sound based on the average or median volume between the output start time and the output end time. Alternatively, the determination unit 14 may determine a reaction sound for each output sound based on the amount of variation in volume between the output start time and the output end time. Alternatively, the determination unit 14 may determine a reaction sound based on the volume at the output start time or the volume at the output end time.

Returning to FIG. 1, the storage unit 15 will be described. The storage unit 15 stores various information necessary for game processing, including a game program 151. The storage unit 15 stores an event determination table. The storage unit 15 stores event information and output sound information.

<Example of operation of information processing device>
Next, an operation example of the information processing device 10 will be described with reference to Fig. 4. Fig. 4 is a flowchart showing an operation example of the information processing device according to the first embodiment.

The acquisition unit 12 acquires operation information from the communication terminal 20 (step S1). The acquisition unit 12 receives operation information input to the communication terminal 20 from the communication terminal 20 and acquires the operation information.

The processing unit 11 generates output sound information (step S2). The processing unit 11 generates output sound information for the output sound output from the communication terminal 20 based on the position information and action information of each object in the game space executed on the communication terminal 20.

The detection unit 13 detects an operation event (step S3). The detection unit 13 detects a predetermined operation event in the game being executed on the communication terminal 20 based on the acquired operation information and the event determination table.

The detection unit 13 determines whether the detected operation event is an event to be evaluated (step S4). The detection unit 13 uses the event determination table to determine whether the detected operation event is an event to be evaluated.

If the operation event is an event to be evaluated (YES in step S4), the determination unit 14 extracts output sound information for the detection period from the output sound information (step S5). When the detection unit 13 detects an event to be evaluated, it generates event information. The determination unit 14 extracts output sound information in which the detection period is included between the output start time and output end time of the output sound information.

On the other hand, if the operation event is not an event to be evaluated (NO in step S4), the process returns to step S1, and the information processing device 10 executes the processes from step S1 onwards.

In step S6, the determination unit 14 determines a reaction sound based on the volume of the extracted output sound information (step S6). The determination unit 14 identifies the output sound that has the highest volume at the output start time of each output sound during the detection period, and determines the identified output sound as the reaction sound.

It is determined whether there are multiple determined reaction sounds (step S7), and if there are multiple determined reaction sounds (YES in step S7), the determination unit 14 determines a reaction sound based on the direction included in the output sound information (step S8). If there are multiple output sounds that are the loudest at the output start time of the output sound output within the detection period, the determination unit 14 obtains a direction relative to a reference position that is associated with the identified output sound from the extracted output sound information. The determination unit 14 determines the output sound whose obtained direction is a specified direction as the reaction sound.

On the other hand, if there are not multiple determined reaction sounds (NO in step S7), the information processing device 10 does not execute step S8 and ends the process.

As described above, the detection unit 13 detects an event to be evaluated from among operation events in the game space, which is a virtual space. The determination unit 14 determines an output sound that caused the user U1 to perform an operation related to the event to be evaluated, based on output sound information of an output sound output from the communication terminal 20 that displays the game during a detection period before the event occurrence time.

In this way, by using the information processing device 10, it is possible to know what output sounds a user is reacting to when performing operations. By checking the output sounds to which users with high game skills reacted, each user can train themselves to be conscious of the output sounds to which they should react, and improve their operation skills. Furthermore, by knowing the output sounds determined by the information processing device 10, each user can train themselves to be conscious of the output sounds to which they should pay attention, and thus improve their operation skills. Therefore, the information processing device 10 according to the first embodiment can improve the user's operation skills.

(Variation 1)
In the above-described first embodiment, the determination unit 14 determines the reaction sound based on the volume included in the output sound information, but the determination unit 14 may determine the reaction sound based on the relative distance included in the output sound information. The determination unit 14 extracts output sound information of the output sound output from the communication terminal 20 during the detection period from the output sound information. The determination unit 14 determines the output sound output by the communication terminal 20 as the sound of the object with the shortest relative distance included in the extracted output sound information as the reaction sound. When there are multiple reaction sounds determined based on the relative distance, the determination unit 14 determines the reaction sound based on the direction included in the output sound information. Even in this manner, the same effect as that of the first embodiment can be obtained. Here, the first modification may be combined with the first embodiment. For example, when there are multiple reaction sounds determined based on the relative distance, the determination unit 14 may determine the reaction sound based on the volume included in the output sound information. Alternatively, when there are multiple reaction sounds determined based on the volume, the determination unit 14 may determine the reaction sound based on the relative distance included in the output sound information.

(Variation 2)
In the above-described embodiment 1, the determination unit 14 determined the reaction sound based on the volume included in the output sound information, but the determination unit 14 may determine the reaction sound based on the output sound information and a priority management table that manages the priority set for each output sound.

Here, the priority management table will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of a priority management table. The priority management table is a table that manages the priority of each output sound output from the communication terminal 20 in relation to each object in the game that is placed in the game space. The output sound, sound source attribute, and priority are set in the priority management table.

The output sounds are set to each output sound that is arranged in the game space, is associated with each object in the game, and is output from the communication terminal 20. The output sounds are set, for example, by output sound identification information that identifies the output sound data.
The sound source attribute is set to an object located in the game space that is related to each output sound set in the output sound of the priority management table. The object may be called a virtual sound source because it is considered to be a sound source in the game space that virtually outputs the output sound of the priority management table.
The priority is set to the priority of each output sound set in the output sound in the priority management table. The priority is determined, for example, based on the play content of a player with high game skills. The priority may be determined, for example, based on history information such as the number of times a reaction sound is determined by the determination unit 14 when a player with high game skills plays the game.

The determination unit 14 extracts output sound information of the output sound output from the communication terminal 20 during the detection period from the output sound information. The determination unit 14 acquires output sound identification information included in the extracted output sound information. The determination unit 14 searches the priority management table using the acquired output sound identification information as a condition (key) and acquires the priority associated with the acquired output sound identification information. The determination unit 14 determines the output sound with the highest acquired priority as the reaction sound. When there are multiple reaction sounds determined based on the priority of the output sound, the determination unit 14 determines the reaction sound based on the direction included in the output sound information. Even in this manner, the same effect as in the first embodiment can be obtained. In addition, when the priority is determined based on the play of a player with high game skills, a more appropriate reaction sound can be grasped, and therefore, skill can be further improved. Here, the second modification and the first embodiment and/or the first modification may be combined by determining the judgment order for each.

(Variation 3)
In the above-mentioned first embodiment, the information processing device 10 has been described as determining the reaction sound, but the present invention may be modified so that the communication terminal 20 has the functional units of the information processing device 10. The communication terminal 20 may then execute each process performed by the information processing device 10. Even in this way, the same effect as in the first embodiment can be obtained.

(Embodiment 2)
Next, a description will be given of embodiment 2. Embodiment 2 is an improved example of embodiment 1.
<Example of information processing system configuration>
A configuration example of the information processing system 200 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing a configuration example of the information processing system according to the second embodiment. The information processing system 200 includes an information processing device 30 and communication terminals 20_1 and 20_2. The communication terminals 20_1 and 20_2 are communication terminals having the same configuration and operation as the communication terminal 20 of the first embodiment. Compared to the first embodiment, the information processing system 200 has a configuration in which the information processing device 10 is replaced with the information processing device 30, and has a configuration including two communication terminals 20.

The information processing device 30 has a configuration basically similar to that of the information processing device 10 according to the first embodiment. Therefore, the description common to the first embodiment will be omitted as appropriate. The information processing device 30 connects to and communicates with the communication terminals 20_1 and 20_2 via a network. The information processing device 30 provides a game to the communication terminals 20_1 and 20_2 using a game program 151.

The information processing device 30 provides the communication terminals 20_1 and 20_2 with play in a possession mode, which is a mode that allows a comparison of events to be evaluated on the communication terminals 20_1 and 20_2. In the possession mode, one of the communication terminals 20_1 and 20_2 is designated as a student player terminal and the other is designated as a teacher player terminal, and the game play content of the teacher player is compared with the game play content of the student player. In the following explanation, it is assumed that the communication terminals 20_1 and 20_2 run the game in the possession mode, that the communication terminal 20_1 is the student player terminal, and that the communication terminal 20_2 is the teacher player terminal.

In the possession mode, the information processing device 30 transmits the same game scenario to the communication terminals 20_1 and 20_2 at predetermined time intervals. The communication terminals 20_1 and 20_2 are configured to be able to play independently within one game scenario. The information processing device 30 transmits the next game scenario to the communication terminals 20_1 and 20_2, and when the game scenario starts, the status of the player characters, etc. of the teacher player terminal are adjusted to match that of the student player terminal. In other words, the possession mode is a mode in which the game space including the player characters and each object in the game of the teacher player terminal is replaced with the game space of the student player terminal every time the game scenario is changed. In this way, the information processing device 30 introduces the possession mode and compares the game play content of the teacher player with the game play content of the student player for each game scenario.

The information processing device 30 acquires from the communication terminal 20_1 position information, behavior information, and information regarding the game space of each object in the game space of the communication terminal 20_1 so that play in the possession mode can be executed in the communication terminals 20_1 and 20_2. The information processing device 30 then transmits a game scenario to the communication terminal 20_2 designated as the teacher player terminal, and transmits information regarding the game space of the communication terminal 20_1 to the communication terminal 20_2. Note that the communication terminal 20_2 may acquire information regarding the game space of the communication terminal 20_1 from the communication terminal 20_1 and replace it with the game space of its own device.

The communication terminals 20_1 and 20_2 are basically configured in the same manner as the communication terminal 20 according to the first embodiment. Therefore, the explanation common to the first embodiment will be omitted as appropriate. The communication terminal 20_1 is a communication terminal owned by a user U1 who is a student player. The communication terminal 20_2 is a communication terminal owned by a user U2 who is a teacher player. The communication terminals 20_1 and 20_2 are equipped with a vibrator.

The communication terminals 20_1 and 20_2 are configured to be able to execute game play in the possession mode. The communication terminals 20_1 and 20_2 receive a game scenario from the information processing device 30. The communication terminals 20_1 and 20_2 display a game space, which is a virtual space, on the display of their own devices based on the game scenario. The communication terminal 20_2 receives information about the game space of the communication terminal 20_1 before receiving the game scenario from the information processing device 30. The communication terminal 20_2 replaces the game space displayed by its own device with the game space of the communication terminal 20_1, and executes a game based on the received game scenario. For ease of explanation, the game space displayed by the communication terminal 20_2 is described as the first game space, and the game space displayed by the communication terminal 20_1 is described as the second game space.

<Configuration example of information processing device>
Next, a configuration example of the information processing device 30 will be described. The information processing device 30 includes a processing unit 31, an acquisition unit 12, a detection unit 33, a determination unit 14, and a storage unit 15. The information processing device 30 has a configuration in which the processing unit 11 and the detection unit 13 of the information processing device 10 of the first embodiment are replaced with the processing unit 31 and the detection unit 33, respectively. The acquisition unit 12, the determination unit 14, and the storage unit 15 are basically the same as those of the first embodiment, so the configuration different from that of the first embodiment will be described while omitting the contents common to the first embodiment as appropriate.

The acquiring unit 12 receives operation information input to the communication terminals 20_1 and 20_2 from the communication terminals 20_1 and 20_2, and acquires the operation information.
The determination unit 14 extracts, from the output sound information, output sound information of the output sound output from the communication terminals 20_1 and 20_2 displaying the game during a detection period before the event occurrence time. The determination unit 14 determines reaction sounds, which are output sounds that cause the users U1 and U2 to perform operations corresponding to the event to be evaluated, based on the output sound information extracted respectively.

The processing unit 31 corresponds to the processing unit 11 in the first embodiment. The processing unit 31 has a configuration basically similar to that of the processing unit 11, and therefore a description of the configuration similar to that of the first embodiment will be omitted as appropriate. The processing unit 31 may be software or a module in which processing is performed by a processor executing a program stored in a memory. The processing unit 31 may also be hardware such as a circuit or a chip.

The processing unit 31 transmits a game scenario to the communication terminals 20_1 and 20_2. Before transmitting the game scenario, the processing unit 31 acquires information about the second game space from the communication terminal 20_1. The processing unit 31 transmits the game scenario to the communication terminal 20_2 designated as the teacher player terminal, and transmits information about the second game space to the communication terminal 20_2.

When an evaluated event is detected in the second game space after an evaluated event is detected in the first game space, the processing unit 31 notifies the communication terminal 20_1 of the content of the evaluated event of the communication terminal 20_2. The processing unit 31 notifies the communication terminal 20_1 of the content of the evaluated event of the communication terminal 20_2 by sending an event content notification including the content of the evaluated event of the communication terminal 20_2 to the communication terminal 20_1.

When the detection unit 33 detects an event to be evaluated in the first game space, the processing unit 31 acquires the event occurrence time in the first game space from the detection unit 33. When the detection unit 33 detects the event to be evaluated in the second game space, the processing unit 31 acquires the event occurrence time in the second game space from the detection unit 33. When the event occurrence time in the first game space is later than the event occurrence time in the second game space, the processing unit 31 transmits an event content notification including the content of the event to be evaluated of the communication terminal 20_2 to the communication terminal 20_1.

The processing unit 31 may notify the content of the event to be evaluated for the communication terminal 20_2 by displaying the event information of the event to be evaluated for the communication terminal 20_2 in text on a display provided in the communication terminal 20_1. Alternatively, the processing unit 31 may notify the content of the event to be evaluated for the communication terminal 20_2 by recording the play content of the event to be evaluated for the communication terminal 20_2 as video data and transmitting the video data to the communication terminal 20_2. Alternatively, the processing unit 31 may notify the content of the event to be evaluated for the communication terminal 20_2 by outputting the event information of the event to be evaluated for the communication terminal 20_2 as audio from a speaker provided in the communication terminal 20_1.

When an evaluation target event is detected in the second game space after the evaluation target event is detected in the first game space, the processing unit 31 causes the communication terminal 20_1 to adjust the volume of the reaction sound of the evaluation target event. The processing unit 31 causes the communication terminal 20_1 to execute control to increase the volume of the reaction sound of the evaluation target event by transmitting a volume adjustment instruction to the communication terminal 20_1 instructing the communication terminal 20_1 to increase the volume of the reaction sound of the evaluation target event. When the event occurrence time in the first game space is later than the event occurrence time in the second game space, the processing unit 31 transmits the volume adjustment instruction to the communication terminal 20_1.

When the number of delays counted by the detection unit 33 is equal to or greater than a predetermined number, the processing unit 31 notifies the communication terminal 20_1 that the evaluation target event, whose number of delays is equal to or greater than the predetermined number, was delayed in the second game space more than in the first game space. The number of delays is the number of times that the evaluation target event was detected in the second game space after it was detected in the first game space.

When the number of delays counted by the detection unit 33 reaches or exceeds a predetermined number, the processing unit 31 causes the communication terminal 20_1 to highlight the event to be evaluated in the second game space and to vibrate a vibrator provided in the communication terminal 20_1. The processing unit 31 causes the communication terminal 20_1 to execute the control content by transmitting a delay notification including control content indicating at least one of highlighting and vibrating the vibrator to the communication terminal 20_1. The processing unit 31 notifies the communication terminal 20_1 that the event to be evaluated is delayed in the second game space compared to the first game space by causing the communication terminal 20_1 to execute at least one of highlighting and vibrating the vibrator.

The processing unit 31 highlights the content of the event to be evaluated so that it can be understood. For example, if the event to be evaluated is related to a "weapon," the processing unit 31 may display the weapon with a thicker outline or may change the color of the weapon. Alternatively, the content of the event to be evaluated may be displayed in text on a display provided on the communication terminal 20_1.

The detection unit 33 corresponds to the detection unit 13 according to the first embodiment. The detection unit 33 may be software or a module in which processing is performed by a processor executing a program stored in a memory. The detection unit 33 may also be hardware such as a circuit or a chip.

The detection unit 33 has a configuration basically similar to that of the detection unit 13, and therefore a description of the configuration similar to that of the first embodiment will be omitted as appropriate. The detection unit 33 detects events to be evaluated in the game spaces based on the operations of the users U1 and U2. The detection unit 33 detects events to be evaluated in the game spaces executed on the communication terminals 20_1 and 20_2 based on the operation information acquired by the acquisition unit 12. The detection unit 33 counts the number of delays for each event to be evaluated.

<Example of operation of information processing device>
Next, an operation example of the information processing device 30 will be described with reference to Fig. 7 and Fig. 8. Fig. 7 and Fig. 8 are diagrams for explaining an operation example of the information processing device according to the second embodiment.

First, FIG. 7 will be described. FIG. 7 is a sequence diagram showing an example of the operation between communication terminals 20_1 and 20_2 and information processing device 30, in which communication terminals 20_1 and 20_2 execute a game in possession mode, a certain game scenario is generated, and the next game scenario is generated. Note that since user U2 having communication terminal 20_2 is the teacher player, it will be described as performing an operation corresponding to the event to be evaluated before user U1 having communication terminal 20_1.

The processing unit 31 of the information processing device 30 generates a game scenario (step S11) and transmits it to the communication terminals 20_1 and 20_2 (step S12). The processing unit 31 acquires information about the second game space from the communication terminal 20_1 and transmits it to the communication terminal 20_2. The communication terminal 20_2 replaces the game space displayed by its own device with the second game space so that the game situations played by the users U1 and U2 match.

The acquisition unit 12 of the information processing device 30 acquires the operation information input to the communication terminals 20_1 and 20_2 from the communication terminals 20_1 and 20_2 (step S13). Note that step S13 is repeatedly executed periodically or non-periodically.

The information processing device 30 detects an event to be evaluated in the first game space and determines a reaction sound (step S14). The detection unit 33 detects the event to be evaluated using the operation information and the event determination table and generates event information. The determination unit 14 extracts output sound information for the detection period from the output sound information. The determination unit 14 determines a reaction sound based on the extracted output sound information. The processing unit 31 obtains the event occurrence time in the first game space from the detection unit 33.

The information processing device 30 detects the event to be evaluated in the second game space and determines a reaction sound (step S15). The information processing device 30 detects the event to be evaluated and determines a reaction sound in the same manner as in step S14. The processing unit 31 obtains the event occurrence time in the second game space from the detection unit 33.

The processing unit 31 compares the event occurrence times in the first game space and the second game space, and determines whether the event occurrence time in the first game space is earlier than that in the second game space (step S16). The processing unit 31 uses the event occurrence times in the first game space and the second game space to determine whether the event to be evaluated was detected in the second game space after the event to be evaluated was detected in the first game space.

If the event occurrence time in the first game space is earlier than that in the second game space (YES in step S16), the information processing device 30 executes step S17 and subsequent steps.
On the other hand, if the event occurrence time in the first game space is not earlier than that in the second game space (NO in step S16), the information processing device 30 skips steps S17 to S21 and terminates processing of the game scenario generated in step S11.

The processing unit 31 transmits a volume adjustment instruction to the communication terminal 20_1 (step S17). The processing unit 31 transmits a volume adjustment instruction to the communication terminal 20_1 to adjust the volume of the reaction sound corresponding to the evaluation target event detected in steps S14 and S15. By transmitting the volume adjustment instruction to the communication terminal 20_1, the processing unit 31 causes the communication terminal 20_1 to adjust the volume of the reaction sound. Upon receiving the volume adjustment instruction, the communication terminal 20_1 controls the volume of the reaction sound determined in steps S14 and S15 to be increased.

The processing unit 31 transmits an event content notification to the communication terminal 20_1 (step S18). The processing unit 31 transmits the event content notification including the content of the event to be evaluated of the communication terminal 20_2 to the communication terminal 20_1. Note that step S18 may be executed after step S17 or before step S17.

The detection unit 33 counts the number of delays (step S19). The detection unit 33 increments the number of delays of the evaluation target event detected in steps S14 and S15 by 1. Note that steps S19 to S21 may be performed before step S17 or step S18, or may be performed in parallel with steps S17 and S18.

The processing unit 31 determines whether the number of delays is equal to or greater than a predetermined number (step S20). The processing unit 31 obtains the number of delays from the detection unit 33, and determines whether the number of delays of the event to be evaluated detected in steps S14 and S15 is equal to or greater than a predetermined number.

If the number of delays is equal to or greater than the predetermined number (YES in step S20), the processing unit 31 transmits a delay notification to the communication terminal 20_1 (step S21). The processing unit 31 transmits a delay notification to the communication terminal 20_1 indicating that the evaluation target event that has reached the predetermined number or more has been delayed in the second game space more than in the first game space. The processing unit 31 transmits the delay notification to the communication terminal 20_1 including at least one of highlighting the evaluation target event in the second game space and vibrating a vibrator provided in the communication terminal 20_1. In response to the delay notification, the communication terminal 20_1 executes the control included in the delay notification.

On the other hand, if the number of delays is not equal to or greater than the predetermined number (NO in step S20), the information processing device 30 skips step S21 and ends the processing for the game scenario generated in step S11 described above.
When the information processing device 30 has executed the process up to step S21, it generates a new game scenario and repeatedly executes steps S11 to S21 until the game ends.

Next, we will explain Figure 8. Figure 8 is a diagram showing a time chart of events to be evaluated detected in the first game space and the second game space. The horizontal axis represents time. The lower side of the time axis in Figure 8 shows the event occurrence time of the event to be evaluated detected in the first game space. The upper side of the time axis in Figure 8 shows the event occurrence time of the event to be evaluated detected in the second game space.

The example shown in FIG. 8 indicates that evaluation target event 1 was detected in the second game space at time T (EA1). It indicates that evaluation target event 1 was detected in the first game space at time T (EB1). It indicates that evaluation target event 2 was detected in the first game space at time T (EB2).

As shown in FIG. 8, before evaluation target event 1 is detected in the second game space, evaluation target events 1 and 2 have been detected in the first game space. In this way, it is expected that the number of evaluation target events for the teacher player is greater than the number of evaluation target events for the student player.

Based on the sequence diagram of FIG. 7, in steps S17 and S18, the processing unit 31 transmits a volume adjustment instruction and an event content notification for the evaluated event 1 to the communication terminal 20_1. However, as shown in FIG. 8, it is expected that the teacher player will perform operations corresponding to multiple evaluated events before the student player performs an operation corresponding to the evaluated event 1. Therefore, in steps S17 and S18 of FIG. 7, the processing unit 31 may transmit a volume adjustment instruction and an event content notification for other evaluated events detected in the first game space up to step S15, in addition to the evaluated events detected in steps S14 and S15.

The information processing device 30 determines reaction sounds corresponding to events to be evaluated in the first game space and the second game space, as in the first embodiment. User U1 can train based on the determined reaction sounds, and can therefore improve his/her operation skills. Furthermore, by using the reaction sounds determined for user U2, user U1 can further train while understanding the difference between his/her own operation skill and the reaction sounds determined for user U2. Thus, according to the information processing device 30 in the second embodiment, the user's operation skill can be improved.

In addition, in this embodiment, a possession mode is introduced to compare the play of the teacher player with the play of the student player. If the event to be evaluated occurs later for the student player than for the teacher player, the information processing device 30 notifies the student player of the content of the event to be evaluated by the teacher player. This allows the student player to clearly understand the difference between them and the teacher player, and to imitate the play of the teacher player.

Furthermore, if the event to be evaluated occurs later for the student player than for the teacher player, the information processing device 30 increases the volume of the reaction sound corresponding to the event to be evaluated in the second game space. This allows the student player to understand the reaction sound based on the volume and instantly perform appropriate operations.

Furthermore, the information processing device 30 notifies the communication terminal 20_1 that an event to be evaluated that has been delayed a predetermined number of times or more has been delayed. This allows the student player to understand the difference in the operation content of the teacher player and the operation skills that need to be improved. Therefore, the information processing device 30 according to the second embodiment allows the user's operation skills to be improved.

The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the invention. For example, in the above-described embodiment, the present invention is described as being configured as hardware, but the present invention is not limited to this. The present invention can also be realized by having a CPU (Central Processing Unit) execute a computer program to perform any process.

The program can be stored and supplied to the computer using various types of non-transitory computer readable media. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R/Ws, and semiconductor memories (e.g., mask ROMs, PROMs (Programmable ROMs), EPROMs (Erasable PROMs), flash ROMs, and RAMs (random access memories)). The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The transitory computer readable media can supply the program to the computer via wired communication paths such as electric wires and optical fibers, or wireless communication paths.

10, 30 Information processing device 11, 31 Processing unit 12 Acquisition unit 13, 33 Detection unit 14 Determination unit 15 Storage unit 20, 20_1, 20_2 Communication terminal 100, 200 Information processing system 151 Game program U1, U2 User

Claims (6)

a detection unit that detects a predetermined event in the first virtual space based on an operation of the first user;
a determination unit that determines a first output sound that causes the first user to perform an operation corresponding to the predetermined event, based on output sound information including identification information of an output sound output from a first communication terminal that displays the first virtual space before the predetermined event is detected ,
The detection unit detects the predetermined event in the second virtual space based on an operation of a second user;
The information processing device further includes a processing unit that, when the specified event in the second virtual space is detected after the specified event in the first virtual space is detected, notifies a second communication terminal displaying the second virtual space of the content of the specified event in the first virtual space . the output sound information includes identification information of an output sound associated with an object in the first virtual space and a volume of the output sound output from the first communication terminal;
The information processing device according to claim 1 , wherein the determination unit determines the first output sound based on the volume. the output sound information includes a relative distance between a reference position in the first virtual space and a position of an object in the first virtual space,
The information processing device according to claim 1 , wherein the determination unit determines the first output sound based on the relative distance. the output sound information includes a direction of the object relative to a reference position in the first virtual space;
The information processing device according to claim 2 , wherein the determination unit determines the first output sound by further using the direction. The computer
Detecting a predetermined event in a first virtual space based on an operation of a first user;
when the predetermined event in the second virtual space based on an operation of a second user is detected after the predetermined event in the first virtual space is detected, notifying a second communication terminal displaying the second virtual space of the content of the predetermined event in the first virtual space;
An output sound determination method for determining a first output sound that causes the first user to perform an operation corresponding to the specified event based on output sound information including identification information of an output sound output from a first communication terminal displaying the first virtual space before the time the specified event is detected. Detecting a predetermined event in a first virtual space based on an operation of a first user;
when the predetermined event in the second virtual space based on an operation of a second user is detected after the predetermined event in the first virtual space is detected, notifying a second communication terminal displaying the second virtual space of the content of the predetermined event in the first virtual space;
An output sound determination program that causes a computer to execute a process to determine a first output sound that causes the first user to perform an operation corresponding to the specified event based on output sound information including identification information of an output sound output from a first communication terminal that displays the first virtual space before the time when the specified event was detected.

Images