JP7655497B2 - Information processing system, information processing method, and computer program - Google Patents

Description

The present invention relates to an information processing system, an information processing method, and a computer program.

There is known an information processing system that generates animation of a character object based on the movement of an actor and distributes a video including the animation of the character object (see, for example, Patent Document 1).

JP 2015-184689 A

In this technical field, an important issue is how to increase distribution users' willingness to distribute, viewing users' willingness to watch, and/or users' willingness to interact with each other.

The purpose of this disclosure is to provide technical improvements that solve or mitigate at least some of the problems with the prior art described above.

One of the more specific objectives of the present disclosure is to provide an information processing system, information processing method, and computer program that can increase distribution users' motivation to distribute, viewing users' motivation to watch, and/or users' motivation to interact with each other.

The information processing system of the present disclosure is an information processing system having one or more computer processors, the one or more computer processors being characterized in having a receiving unit that receives audio information related to at least the audio of the first user transmitted from a first user terminal of a first user, a transmitting unit that transmits information to the first user terminal and/or the second user terminal for displaying a video related to the first user on the first user terminal and/or the second user terminal of a second user, an analyzing unit that analyzes whether the audio contains a specific word based on the audio information, and a display control unit that controls the display of the video based on display control information associated with the specific word contained in the audio according to the result of the analysis by the analyzing unit.

The specific word is a word related to an action that requires an operation on the first user terminal, and the display control information can be information for causing an operation object associated with the action to appear on the video or the screen of the first user terminal, for highlighting an operation object associated with the action displayed on the video or the screen of the first user terminal, and/or for displaying an operation screen associated with the action.

The specific word is a word related to an action that requires an operation on the second user terminal, and the display control information can be information for causing an operation object associated with the action to appear on the video or the screen of the second user terminal, for highlighting an operation object associated with the action displayed on the video or the screen of the second user terminal, and/or for displaying an operation screen associated with the action.

The display control unit controls the display of the video in the video displayed on the first user terminal and the second user terminal when the specific word is a word related to an action requiring an operation on the first user terminal, and controls the display of the video only in the video displayed on the second user terminal when the specific word is a word related to an action requiring an operation on the second user terminal.

The one or more computer processors may further include an effect generating unit that generates a particular effect on the first user terminal and/or the second user terminal when an action is performed by selecting an operational object that appears or is highlighted in the video.

The specific word is a word related to the request, and the display control information can be information for making an object associated with the request appear in the video and/or information for highlighting an object displayed in the video.

The object associated with the request may be a lottery object that allows real products and/or product objects to be acquired by lottery, a shop object that represents a shop where real products and/or product objects can be purchased, or an advertising object that represents an advertisement for a real product and/or product object.

The one or more computer processors may include an order unit that, when a win of a real product is determined by an operation on a lottery object on the first user terminal, or when a real product is ordered on the first user terminal via a shop object and/or an advertisement object, transmits information related to the win or information related to the order and at least the address information of the first user contained in the user information of the first user to an information processing device of a physical store associated with the lottery object, the shop object, and/or the advertisement object.

When a real product is ordered on the first user terminal via a shop object and/or an advertisement object, the display control unit can display a product object corresponding to the real product in the video.

The specific word is a word related to a specific item, and the one or more computer processors further include a determination unit that determines whether the specific item is associated with the first user terminal, and when the determination unit determines that the specific item is associated with the first user terminal, the display control unit can control the display of the video based on display control information that is information for making a specific object corresponding to the specific item appear in the video, information for highlighting a specific object displayed in the video, and/or information for displaying a list screen of items associated with the first user terminal, including the specific item.

When the determination unit determines that the specific item is not associated with the first user terminal, the display control unit can control the display of the video based on display control information, which is information for making a lottery object that can acquire the specific item by lottery, a shop object that represents a shop where the specific item can be purchased, or an advertisement object that represents an advertisement related to the specific item appear in the video, and/or information for highlighting and displaying the lottery object, shop object, and/or advertisement object displayed in the video.

When the determination unit determines that a specific item is not associated with the first user terminal, the display control unit can control the video based on display control information, which is information for making a line to a screen associated with a user terminal of another user who has the specific item appear in the video.

The specific word can be a word related to an event in real space, and the display control information can be information for making a real object associated with the event in real space appear in the video.

The specific word is a word contained in specific text displayed in the video, and the display control unit can highlight the specific text.

The particular text may be a comment posted from the first user terminal or the second user terminal, or a system comment.

Highlighting may include displaying objects related to the character object of the user who posted the comment.

The video may display the first user's character object and a virtual space in which the character object can move.

When the second user terminal is associated with the first user terminal, at least a portion of the virtual space is shared with the second user terminal, and the effect of controlling the display of the video by the display control unit can extend to both the first user terminal and the second user terminal.

When the second user terminal is not associated with the first user terminal, at least a portion of the virtual space is shared with the second user terminal, but the effect of the control of the video display by the display control unit can extend to only one of the first user terminal and the second user terminal.

The one or more computer processors may include a setting unit that can set whether or not to control the display of the video according to the results of the analysis by the analysis unit.

The first user may be a broadcasting user and the second user may be one or more viewing users.

The receiving unit receives multiple pieces of audio information related to the audio of multiple users transmitted from multiple user terminals including the first user terminal, the analyzing unit analyzes whether each of the multiple pieces of audio contains a specific word, and the display control unit controls the display of the video based on display control information associated with the specific word contained in the audio and the number of pieces of audio containing the specific word.

The specific word may be set based on the operation of the first user terminal.

The receiving unit receives motion information regarding the motion of the first user transmitted from the first user terminal, and the video can display a character object of the first user that moves based on the motion information.

The information processing method of the present disclosure is characterized in that one or more computer processors execute a receiving step of receiving audio information related to at least the audio of the first user transmitted from a first user terminal of a first user, a transmitting step of transmitting information for displaying a video related to the first user on the first user terminal and/or the second user terminal of a second user to the first user terminal and/or the second user terminal, an analyzing step of analyzing whether the audio includes a specific word based on the audio information, and a display control step of controlling the display of the video based on display control information associated with the specific word included in the audio according to the analysis result obtained in the analyzing step.

The information processing method disclosed herein is characterized in that one or more computer processors execute a transmitting step of transmitting audio information related to at least the audio of a first user to a server device, a receiving step of receiving information for displaying a video related to the first user from the server device, and a display control step of controlling the display of the video based on display control information associated with the specific word included in the audio, depending on the result of an analysis of whether the audio includes a specific word based on the audio information.

The computer program of the present disclosure is characterized in that it causes one or more computer processors to realize a transmission function for transmitting audio information related to at least the audio of a first user to a server device, a reception function for receiving information for displaying a video related to the first user from the server device, and a display control function for controlling the display of the video based on display control information associated with a specific word contained in the audio in response to a result of an analysis of whether the audio contains a specific word based on the audio information.

The information processing method disclosed herein is characterized in that one or more computer processors are caused to execute a receiving step of receiving information for displaying a video related to a first user from a server device, and a display control step of controlling the display of an image based on display control information associated with a specific word contained in the voice, depending on the result of an analysis of whether the voice contains a specific word based on voice information related to at least the voice of the first user.

The computer program of the present disclosure is characterized in that it causes one or more computer processors to realize a receiving function for receiving information for displaying a video related to a first user from a server device, and a display control function for controlling the display of the video based on display control information associated with a specific word contained in the audio, depending on the result of an analysis of whether the audio contains a specific word based on audio information related to at least the first user's audio.

According to the present disclosure, it is possible to provide technical improvements that solve or alleviate at least some of the problems of the conventional technology described above. Specifically, according to the configuration of the present disclosure, it is possible to improve the willingness of broadcasting users to broadcast, the willingness of viewing users to watch, and/or the willingness of users to interact with each other.

1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. 1 is a system configuration diagram illustrating an example of an information processing system according to the present disclosure. 2 is a configuration diagram showing an example of the hardware configuration of a server device, a broadcast user terminal, and a viewing user terminal in the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 1 is a conceptual diagram showing an image of a virtual space in the present disclosure. FIG. 2 is a configuration diagram illustrating an example of a functional configuration of a server device according to the present disclosure. FIG. 2 is a data configuration diagram showing an example of a data table stored in a storage device in the present disclosure. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing an image of a screen displayed on a user terminal. 11 is a conceptual diagram showing a first user and an image of a screen displayed on a user terminal. FIG. 11 is a conceptual diagram showing a first user and an image of a screen displayed on a user terminal. FIG. FIG. 13 is a configuration diagram showing another example of the functional configuration of the server device in the present disclosure. 11 is a conceptual diagram showing a first user and an image of a screen displayed on a user terminal. FIG. FIG. 1 is a flow diagram showing an example of the flow of an information processing method according to the present disclosure. FIG. 2 is a circuit configuration diagram showing an example of a circuit configuration for implementing a computer program according to the present disclosure. FIG. 2 is a configuration diagram showing an example of a functional configuration of a first user terminal in the present disclosure. 11 is a flow diagram showing an example of the flow of an information processing method in a first user terminal in the present disclosure. FIG. 2 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a first user terminal in the present disclosure. FIG. 2 is a configuration diagram showing an example of a functional configuration of a second user terminal in the present disclosure. 11 is a flow diagram showing an example of the flow of an information processing method in a second user terminal in the present disclosure. FIG. 11 is a circuit diagram showing an example of a circuit configuration for realizing a computer program executed in a second user terminal in the present disclosure. FIG. 1 is a block diagram of processing circuitry for performing computer-based operations in the present disclosure.

First, an overview of an information processing system according to an embodiment of the present disclosure will be described with reference to the drawings.

The information processing system in this disclosure is an information processing system that includes one or more client devices and a server device, and includes one or more computer processors.

The video displayed on each client device will be described as including animation of 3D or 2D character objects generated based on the movements of the broadcasting user, but is not limited to this and may include animation of character objects generated in response to the broadcasting user's operations, or may include an image of the broadcasting user himself. Also, these character objects and the broadcasting user may not be displayed, and only the voice of the broadcasting user may be included.

Here, a distribution user refers to a user who transmits information related to video and/or audio. For example, a distribution user may be a user who hosts or organizes a single video distribution, a collaborative distribution in which multiple people can participate, a video chat or voice chat in which multiple people can participate and/or watch, or an event (such as a party) in a virtual space in which multiple people can participate and/or watch, in other words, a user who mainly carries out these activities. Therefore, a distribution user in this disclosure can also be referred to as a host user, organizer user, or organizer user.

On the other hand, a viewing user refers to a user who receives information regarding video and/or audio. However, a viewing user can be a user who is not only able to receive the above information but also able to react to it. For example, a viewing user may be a user who watches a video broadcast or a collaborative broadcast, or a user who participates in and/or watches a video chat, voice chat, or event. Therefore, a viewing user in this disclosure can also be referred to as a guest user, participating user, listener, spectator user, supporter user, etc.

The information processing system in the embodiment of the present disclosure can also be used to provide a digital world in which many people can participate simultaneously and freely engage in activities such as interacting, working, and playing through character objects (avatars) at a level close to that of the real world, and in which social activities can take place beyond the gap between reality and virtuality, creating a next-generation Internet space (metaverse).

In such a space, users' avatars can roam freely within the world and communicate with each other.

Then, one of the multiple avatars (character object) in the virtual space may be configured to be able to distribute video as the character object of the distribution user. In other words, one-to-many video distribution may be possible in a many-to-many metaverse virtual space.

In such a space, there can be no particular distinction between broadcasting users and viewing users.

The space depicted in the video may be a virtual space, a real space, or an augmented reality space that combines these. The video may be something like a karaoke video or a game commentary video that plays back at least a specific image and the voice of the broadcasting user, or may display a character object or an actual image of the broadcasting user superimposed on these.

In addition, if the real space includes a broadcast user, a character object generated based on the broadcast user's movements may be displayed superimposed on an actual image of the broadcast user. Also, an animation of a gift object or the like may be displayed superimposed on an image captured in real space.

<System Configuration>
As shown as an example in FIG. 1, the information processing system 1000 of the present disclosure may include one or more viewing user terminals 1100, and an information processing device (support computer) 1300 located in a video distribution studio, etc., connected to these viewing user terminals 1100 via a network 1200.

The information processing device 1300 may be connected to a specific server device via the Internet, and some or all of the processing to be performed by the information processing device 1300 may be performed by the server device. Such a server device may be the information processing device 2400 shown in FIG. 2.

In this specification, such distribution by the information processing system 1000 is referred to as studio distribution.

In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.

The information processing system 1000 of the present invention can also be linked to another information processing system 2000, shown as an example in FIG. 2. The information processing system 2000 shown in FIG. 2 can include a broadcast user terminal 2100, one or more viewing user terminals 2200, and an information processing device (server device) 2400 connected to the broadcast user terminal 2100 and the viewing user terminal 2200 via a network 2300.

In the above example, the broadcast user terminal 2100 can be an information processing terminal such as a smartphone. In this specification, broadcasting by such an information processing system 2000 is referred to as mobile broadcasting.

In mobile distribution, the facial movements of the broadcast user are captured by a camera on the broadcast user terminal 2100, and are reflected on the character's face in real time using known face tracking technology.

Note that there is no particular distinction between broadcast users and viewing users in mobile distribution; viewing users can broadcast via mobile at any time, and broadcast users can become viewing users when viewing videos of other broadcast users.

The videos generated by the information processing system 1000 and the information processing system 2000 can be distributed to viewing users from a single video distribution platform, as an example.

In addition, in any broadcast, the process of generating animation by reflecting motion on a character and the process of displaying gifts (described below) may be shared among the broadcast user terminal, the viewing user terminal, an information processing device, and other devices.

In other words, "distribution" here refers to the transmission of information that enables the video to be viewed on the viewing user's terminal, and the rendering of the video may be performed on the information processing device 1300, 2400 side, or on the distribution user terminal 2100 or the viewing user terminal 1100, 2200 side.

Specifically, facial motion data and voice data of the broadcasting user are transmitted from the broadcasting user terminal or information processing device to a terminal or device that generates (renders) the animation of the character object. Body motion may also be transmitted in addition to facial motion.

In this disclosure, the process of generating animation is described as being performed on both the broadcasting user terminal and the viewing user terminal, but is not limited to this.

The information processing system of the present disclosure can be applied to either of the examples shown in FIG. 1 and FIG. 2. Therefore, the information processing system 3000 in the embodiment of the present disclosure will be described as including a first user terminal 100, a second user terminal 200, and a server device 400 that can be connected to the first user terminal 100 and the second user terminal 200 via a network 300, as shown in FIG. 3.

The first user terminal 100 and the second user terminal 200 are connected to the server device 400 via, for example, a base station, a mobile communication network, a gateway, and the Internet. Between the first user terminal 100 and the second user terminal 200 and the server device 400, communication is performed based on a communication protocol such as Hypertext Transfer Protocol (HTTP). In addition, between the first user terminal 100 and the second user terminal 200 and the server device 400, a connection is first established by HTTP communication, and thereafter, communication may be performed based on WebSocket, which performs two-way communication with lower cost (lower communication load and processing load) than HTTP communication. Note that the communication method between the first user terminal 100 and the second user terminal 200 and the server device 400 is not limited to the above-mentioned method, and any communication method technology may be used as long as it can realize this embodiment.

The first user terminal 100 functions at least as the information processing device 1300 or the broadcasting user terminal 2100 described above, the second user terminal 200 functions at least as one or more of the viewing user terminals 1100, 2200 described above, and the server device 400 functions at least as the specified server device or information processing device 2400 described above.

In the present disclosure, the first user terminal 100 and the second user terminal 200 can be a smartphone (multifunction phone terminal), a tablet terminal, a personal computer, a console game machine, a head mounted display (HMD), a wearable computer such as a glasses-type wearable terminal (AR glasses, etc.), and an information processing device capable of playing videos other than these devices. Furthermore, these terminals may be standalone devices that operate independently, or may be composed of multiple devices connected to each other so that they can send and receive various data.

<Hardware Configuration>
Here, the hardware configuration of the first user terminal 100 will be described with reference to Fig. 4. The first user terminal 100 includes a processor 101, a memory 102, a storage 103, an input/output interface (input/output I/F) 104, and a communication interface (communication I/F) 105. The components are connected to each other via a bus B.

The first user terminal 100 can realize the functions and methods described in this embodiment through cooperation between the processor 101, memory 102, storage 103, input/output I/F 104, and communication I/F 105.

The processor 101 executes functions and/or methods realized by codes or instructions included in a program stored in the storage 103. The processor 101 includes, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may realize each process disclosed in each embodiment by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large scale integration (LSI)), etc.). These circuits may be realized by one or more integrated circuits, and multiple processes shown in each embodiment may be realized by one integrated circuit. In addition, an LSI may be called a VLSI, a super LSI, an ultra LSI, etc. depending on the degree of integration.

The memory 102 temporarily stores the programs loaded from the storage 103 and provides a working area for the processor 101. The memory 102 also temporarily stores various data generated while the processor 101 is executing the programs. The memory 102 includes, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), etc.

Storage 103 stores programs. Storage 103 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), flash memory, etc.

The communication I/F 105 is implemented as hardware such as a network adapter, communication software, or a combination of these, and transmits and receives various data via the network 300. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication I/F 105 communicates with other information processing devices via the network 300. The communication I/F 105 transmits various data to other information processing devices according to instructions from the processor 101. The communication I/F 105 also receives various data transmitted from other information processing devices and transmits it to the processor 101.

The input/output I/F 104 includes an input device for inputting various operations to the first user terminal 100, and an output device for outputting the results of processing performed by the first user terminal 100. The input/output I/F 104 may be an integrated input device and output device, or may be separate input device and output device.

The input device is realized by any of all types of devices, or a combination of devices, that can receive input from a user and transmit information related to the input to the processor 101. Examples of input devices include hardware keys such as a touch panel, a touch display, and a keyboard, pointing devices such as a mouse, a camera (operation input via images), and a microphone (operation input via voice).

The input device may include a sensor unit. The sensor unit is one or more sensors that detect face motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body with respect to the sensor unit. Face motions include blinking, opening and closing of the mouth, and other movements. The sensor unit may be a publicly known one. An example of the sensor unit includes a ToF sensor that measures and detects the time of flight (Time of Flight) until light irradiated toward the user is reflected by the user's face and returns, a camera that photographs the user's face, and an image processing unit that processes the data photographed by the camera. The sensor unit may also include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. The RGB camera and the near-infrared camera may be, for example, True Depth of the "iPhoneX (registered trademark)", or "LiDAR" of the "iPad Pro (registered trademark)", or other ToF sensors installed in smartphones. Specifically, this camera uses a dot projector to project tens of thousands of invisible dots onto the user's face, etc. Then, it detects and analyzes the reflected light from the dot pattern to form a depth map of the face, and captures an infrared image of the face, etc., thereby capturing accurate facial data. The sensor unit's processing unit generates various information based on the depth map and the infrared image, and compares the information with registered reference data to calculate the depth of each point on the face (the distance between each point and the near-infrared camera) and positional deviations other than depth.

The sensor unit may also have a function of tracking not only the user's face but also their hands (hand tracking). The sensor unit may further include sensors other than the above-mentioned sensors, such as an acceleration sensor or a gyro sensor. The sensor unit may have a spatial mapping function of recognizing objects in the real space in which the user exists based on the detection results of the above-mentioned ToF sensor or other known sensors, and mapping the recognized objects on a spatial map. Hereinafter, when face motion detection data and body motion detection data are described without making a distinction between them, they will simply be referred to as "tracking data". Note that the image processing unit of the sensor unit may be provided in a control unit that can be provided in the information processing system of the present invention.

The operation unit as an input device can be one that corresponds to the type of the user terminal. Examples of the operation unit include a touch panel integrated with a display, operation buttons provided on the housing of the user terminal, a keyboard, a mouse, and a controller operated by the user's hand. The controller may have various known sensors built in, such as an acceleration sensor and an inertial measurement unit (IMU) such as a gyroscope. Another example of the operation unit may be a tracking device that identifies the user's hand movement, eye movement, head movement, line of sight, and the like. In this aspect, for example, the user's instructions can be determined based on the user's hand movement, and various operations can be performed, such as starting or ending the distribution of a video, rating a message or a video, and requesting the display of a specific object (for example, a gift, which will be described later). Note that if the sensor unit also has an input interface function such as a hand truck function, the operation unit can be omitted.

The output device outputs the processing results processed by the processor 101. The output device includes, for example, a touch panel, a speaker, etc.

It should be noted that the functions provided by the components described herein may be implemented in circuitry or processing circuitry, including general-purpose processors, application-specific processors, integrated circuits, ASICs (Application Specific Integrated Circuits), a CPU (a Central Processing Unit), conventional circuits, and/or combinations thereof, programmed to provide the functions described. Processors include transistors and other circuits and are considered to be circuitry or processing circuitry. A processor may be a programmed processor that executes a program stored in a memory.

In this specification, a circuitry, unit, or means is hardware that is programmed to realize or executes the described functions. The hardware may be any hardware disclosed in this specification or any hardware known to be programmed to realize or execute the described functions.

If the hardware is a processor that is considered to be a type of circuitry, the circuitry, means, or unit is the combination of the hardware and/or software used to configure the hardware and/or processor.

In addition, the second user terminal 200 and server device 400 in this disclosure can also be configured with the same hardware configuration as shown in FIG. 4, unless otherwise noted.

Next, various functions that can be executed on a user terminal that has launched an application realized by an information processing system in an embodiment of the present disclosure, and the transition of the displayed screens will be explained with reference to the drawings.

Figure 5 shows the top screen T10 that is displayed on a user terminal (it is not yet specified here whether the user will be viewing/distributing) when a video distribution/viewing application is launched.

As shown in FIG. 5, a user can select a distribution channel (also called a distribution slot, distribution program, distribution video, etc.) from thumbnail images of one or more recommended distribution channels T12 listed in the Recommendations tab T11 on the top screen T10, and watch a video being played on that one distribution channel.

Alternatively, a user can view a video being played on a specific distribution channel by accessing a fixed link for the specific distribution channel. Such a fixed link can be obtained through a notification from a first user the user is following, or a share notification sent by another user, etc.

In this way, the user watching the video becomes the viewing user, and the terminal watching the video becomes the second user terminal 200.

As shown in FIG. 5, the top screen T10 may also display a display area T13 for notifications such as campaigns and events. This notification display area T13 can be switched to display other notifications by sliding the display area.

The top screen T10 displays a follow tab T14, a game tab T15 for displaying game categories, a collaboration waiting tab T16 for displaying distribution channels waiting for collaboration, and a beginner tab T17 for displaying beginner distribution channels. By selecting these (by switching between tabs), the top screen T10 transitions to each of the different screens.

The service name display T18 and search button T19 in the upper frame of the top screen T10 may remain fixed and displayed on the destination screen.

Similarly, the home button T20, message button T21, delivery preparation button T22, gacha button T23, and profile button T24 in the lower frame of the top screen T10 may also be fixed and remain displayed on the transition destination screen.

On the top screen T10 shown in FIG. 5, a user who selects a displayed thumbnail image T12 becomes a viewing user (second user) who watches the video as described above, and a user who selects the distribution preparation button T22 becomes a distribution user (first user) who distributes the video.

As an example, when the distribution preparation button T22 is selected on the top screen T10 shown in FIG. 5, the screen transitions to the avatar setting screen D10 shown in FIG. 6. Then, when the distribution button D11 is selected on the avatar setting screen D10, the screen transitions to the distribution setting screen D20 shown in FIG. 7. Then, when the start distribution button D25 is selected on the distribution setting screen D20, the screen transitions to the avatar distribution screen D30 shown in FIG. 8.

Next, we will explain the details of the flow until video distribution begins.

The one or more computer processors in the present disclosure may include a distribution start request receiving unit, a distribution setting unit, and a distribution start unit.

The distribution start request receiving unit receives a request to start distribution of a first video including an animation of a character object from a first user terminal of a first user.

Here, the first video refers to a video that includes animation of a character object. Note that in this specification, a character object may also be called an "avatar."

The request to start distribution can be transmitted from the user terminal (which will later become the first user terminal) to the server device 400 by selecting a distribution button D11 located on an avatar setting screen D10 or the like, which is transitioned from the above-mentioned top screen displayed on the user terminal (which will later become the first user terminal) that has launched a dedicated application (video distribution/viewing application) for accessing the video distribution platform.

Figure 6 shows an example of an avatar setting screen D10. The avatar setting screen D10 can display a character object CO, a distribution button D11, a gacha button D12, a change of clothes button D13, a photo button D14, etc.

When the user selects the change clothes button D13, a closet screen appears for selecting various avatar parts for the character object CO, such as eyes, nose, mouth, hair, accessories, clothes, and background.

When the user selects the gacha button D12, a lottery screen for obtaining the avatar parts appears.

When the user selects the photo button D14, a shooting screen appears for taking a still image of the character object.

When the user selects the distribution button D11, a distribution start request is sent to the server device 400.

The distribution setting unit sets the distribution settings of the first video based on the specifications from the first user terminal 100 in response to a request to start distribution of the first video accepted by the distribution start request accepting unit.

As an example, when the distribution button D11 is selected, the screen displayed on the first user terminal 100 transitions from the avatar setting screen D10 shown in FIG. 6 to the distribution setting screen D20 shown in FIG. 7.

The distribution settings may include at least one of the following: a setting regarding the title of the first video, a setting regarding whether other users can appear in the first video, a setting regarding the number of people who can appear in the first video, and a setting regarding a password.

These distribution settings can be set in the title setting field D21, collaboration permission setting field D22, number of people setting field D23, and password setting field D24 in FIG. 7. In addition, FIG. 7 also displays a collaboration permission field D26 for anyone and a SNS posting permission field D27.

The title of the first video can be freely determined by the broadcasting user within the range of the maximum number of characters allowed. If there is no input from the broadcasting user, a pre-set title including the name of the character object (broadcasting user), such as "This is XXX's broadcast ♪", may be automatically determined.

The first user can freely decide whether or not other users can appear in the first video. If yes, other users can make an appearance request to the distributing user, and if no, other users cannot make an appearance request to the distributing user. In this specification, the state in which other users appear in the first user's video is sometimes referred to as "collaboration." More details on collaboration will be provided later.

The number of people who can appear in the first video can only be set if other users are allowed to appear in the first video as described above, and can be freely determined by the distributor user within the range of the maximum number of people allowed.

The password can be set arbitrarily only if other users are allowed to appear in the first video described above, and the distribution user can freely decide the number of digits specified. When other users apply to appear in the first video, they are required to enter the password. Note that the password setting field D24 may be configured to be active only if the collaboration permission setting field D26 is OFF.

The distribution start unit distributes information about the first video to the viewing user's second user terminal 200 based on the conditions set by the distribution setting unit.

Such a command to start distribution is sent by selecting the start distribution button D25 shown in FIG. 7.

As an example, the distribution initiation unit distributes (avatar distributes) information about a video (first video) including animation of a character object of a first user to a second user terminal 200 of a second user.

The information about the first video includes, for example, motion information indicating the movement of a character object, voice information of the first user, and gift object information indicating gifts sent by other viewing users. The gift object information includes at least gift object identification information that specifies the type of gift object, and position information that indicates the position where the gift object is displayed.

Then, the distribution start unit can live-stream the video via the video distribution platform described above.

Figure 8 shows the avatar distribution screen D30 displayed on the first user terminal 100.

The avatar distribution screen D30 displays the character object CO, as well as a comment input button D31 for the distribution user to input a comment, a photo button D32 for saving a still image of the screen, a start play button D33 for playing a game described below, an external service linkage button D34 for watching videos provided by an external service, and a gacha button D12 for obtaining avatar parts.

In addition, the top of the avatar distribution screen D30 can display a cumulative viewer count D35, a cumulative like count D36, a collaborator count D37, a share button for external SNS D38, a guest details button D39, a ranking display button D40, a settings button D41, and an audio switch button D42 for switching audio ON/OFF. Also displayed is an end button D43 for ending the distribution.

A detailed description of these displays and buttons will be omitted, but by selecting the settings button D41, it is possible to change the distribution settings set on the distribution settings screen D20.

Note that FIG. 8 shows an example in which distribution has been started with the distribution setting screen D20 allowing other users to appear in the first video and setting the number of people who can appear in the first video to three, so character object CO is displayed shifted to the bottom left. Up to three character objects of other users can appear in the empty space.

The above is an explanation of the screen transitions that occur when delivering an avatar according to the invention disclosed herein.

Next, we will explain the screen transitions that occur when a broadcaster plays a game while broadcasting.

The one or more computer processors in the present disclosure may include a game request receiving unit, a game video distribution unit, and a game display processing unit.

During avatar distribution as shown in FIG. 8, the broadcasting user can request to start playing the game by selecting the start play button D33.

The game displayed by selecting the play start button D33 is a dedicated game implemented in an application realized by the information processing system of the present disclosure, and may be different from a general-purpose game provided by an external service. Therefore, game distribution in the present disclosure may be distinguished from distribution of a gameplay video of a general-purpose game provided by an external service together with a live commentary by the distribution user.

Alternatively, the request to start playing can be transmitted from the first user terminal 100 to the server device 400 by selecting a start play button located on a specific screen displayed on the first user terminal 100 of the first user.

Figure 9 shows an example of a screen G10 on which a play start button G11 is arranged as the above-mentioned predetermined screen. The screen G10 shown in Figure 9 is a screen transitioned to by selecting the game tab T15 from the top screen T10 (Figure 5) displayed on a user terminal that has launched an application realized by the information processing system of the present disclosure.

The screen G10 displays at least a start play button G11 that can send a request to start playing a specific game.

Then, when the game request receiving unit receives a request to start playing a specific game, the game video distribution unit distributes information about the second video to the second user terminal 200.

Here, the second video is a gameplay video of a specific game. In this specification, the distribution of such a video so that it is displayed on the screen of the second user terminal 200 is referred to as "game distribution."

Furthermore, after launching the application realized by the invention of the present disclosure, the user can, as the first user, send a request to start distribution of the second video to the information processing device 2400 by selecting a play start object placed on the game list screen and the game details screen.

These game list screens and game details screens are the first screens, which will be explained in detail below.

In other words, the game display processing unit performs display processing of a first screen that includes a distribution start object capable of sending a request to start distribution, a play start object capable of sending a request to start playing a specific game, and a thumbnail image of a video of a gameplay video of a specific game being distributed.

The screen G10 shown in FIG. 9 corresponds to the game list screen among the first screens. The first screen, which is the game list screen, is a screen transitioned to by selecting the game tab T15 from the top screen T10.

This first screen includes a distribution preparation button T22 as a distribution start object, a play start button G11 as a play start object, and a thumbnail image indicating the video distribution channel.

The first screen displays, for each of the multiple playable games, a start play button G11, a game icon G12, the game name G13, the total number of viewers of the game's distribution channel G14, and a distribution list G15 including thumbnail images of the distribution channels currently distributing the game.

The order of thumbnail images displayed in the distribution list G15 displayed here can be different depending on the viewing user. As an example, the order is arranged in the following order of priority: the most number of views by the viewing user who is following the images, the most cumulative number of viewers, and the oldest distribution start date. The display range of the thumbnail images in this distribution list G15 can be changed by scrolling horizontally.

The games displayed on this game list screen are the top 10 titles with the following priorities: As an example, the priorities are determined within 48 hours of the game distribution start date and time, in descending order of the most recent date the viewing user last played within the last 30 days, in descending order of the period ID priority, and in descending order of the period ID.

This distribution list G15 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.

Figure 10 corresponds to the game details screen of the first screen. The first screen, which is the game details screen, is G20, which is the screen transitioned to by selecting the game icon G12 or game name G13 displayed on the game list screen shown in Figure 9.

This first screen includes a distribution preparation button T22, which is a distribution start object, a play start button G21, which is a play start object, and a thumbnail image indicating the distribution channel of the video.

The first screen also displays a game icon G22, a game name G23, the total number of viewers of the game's distribution channel G24, and a distribution list G25 that includes thumbnail images of the distribution channels currently distributing the game.

The order of thumbnail images displayed in the distribution list G25 displayed here can be different depending on the viewing user. As an example, the order is arranged in the following order of priority: the most number of views by the viewing user who is following the images, the most cumulative number of viewers, and the oldest distribution start date. The display range of the thumbnail images in this distribution list G25 can be changed by vertical scrolling.

This distribution list G25 is updated when you return from another tab screen or when you perform a pull-to-refresh operation.

As described above, a user who selects the distribution start object (distribution preparation button T22) or the play start object (play start button G11, 21) becomes the first user to make a distribution start request or a play start request.

In addition, the user who selects the thumbnail image becomes the second user who watches the second video.

The first screen also includes a first area in which scrolling is not possible and a second area in which scrolling is possible.

The first screen referred to here is the first screen shown in FIG. 10. The first screen includes a first area R1 and a second area R2. Specifically, the game title is displayed in the first area R1, and the above-mentioned play start button G21, game icon G22, game name G23, number of viewers G24, and distribution list G25 are displayed in the second area R2.

The first region R1 is a portion that is fixedly displayed on the display screen and cannot be scrolled, while the second region R2 is a portion that can be scrolled by the user. By scrolling the second region R2, the user can check thumbnail images that are hidden outside the screen.

However, since there is a risk that the play start button G21 may be hidden off-screen by scrolling the second area, the display processing unit in this disclosure can display the play start object (play start button G21) in the first area R1 depending on the display state of the play start object (play start button G21) displayed in the second area R2.

As an example, in FIG. 10, the play start button G21 is displayed in the second region R2, but in FIG. 11, it is displayed in the first region R1. In other words, when part or all of the play start button G21 is no longer displayed in the second region R2, the play start button G21 appears in the first region.

The game display processing unit may also cause the play start object to be displayed in stages in the first area R1 depending on the display state of the play start object displayed in the second area R2.

This representation can be achieved by changing the transparency of the play start object in accordance with the amount of scrolling of the second region R2.

As an example, a scroll amount (unit: pixels) of 0 to 50 can correspond to a button transparency of 0.0 (completely transparent) to 1.0 (completely opaque). In this way, in the initial display state, the object is completely transparent and therefore invisible, but when scrolled 50 pixels or more, the object becomes completely visible. It is preferable to change the object's transparency linearly in this range (0 to 50). Note that the unit of scroll amount is logical pixels, which may differ from the actual pixels on the display.

The game request receiving unit is also capable of receiving a request to end play of a specified game from the first user terminal 100 after the game video distribution unit has distributed information about the second video.

A request to end play can be sent by selecting the end button located on the game screen.

Then, when the game request receiving unit receives a request to end play of a specific game, the distribution starting unit can end the distribution of information about the second video and distribute information about the first video.

In other words, what is distributed here is not just a portion of the information in the first video, but all of the information in the first video.

Then, when the distribution starting unit ends the distribution of information about the second video and distributes information about the first video, it is the first video that is displayed on the second user terminal 200.

Next, we will explain the flow for starting to watch a video.

One or more processors in the present disclosure may further include a viewing reception unit.

The viewing reception unit accepts video viewing requests from users.

In response to a viewing request, the distribution start unit distributes video and audio information as video information to the user's information processing terminal.

Figure 12 shows an example of a viewing screen V10 of an avatar video displayed on the second user terminal 200.

A viewing user can post a comment by entering text in the comment input field V11 and pressing the send button V12.

In addition, by pressing the gift button V13, the viewing user can see a list of gifts (screen V30 in FIG. 13) and can send a display request for the specified gift by selecting it.

At this time, one or more processors in the present disclosure may include a determination unit. The determination unit determines whether or not a gift display request has been made from the second user terminal 200.

The display request may include gift object information. The gift object information includes at least gift object identification information that identifies the type of gift object, and location information that indicates the location where the gift object is to be displayed.

In addition, as shown in FIG. 13, gifts can be displayed by category (free (paid) gifts, accessories, cheering goods, appeals, variety, etc.).

Here, paid gifts are gifts (coin gifts) that can be purchased by the viewing user using their purchased My Coins, and free gifts are gifts (point gifts) that can be obtained by the viewing user with or without using their My Points that they obtained for free.

The term "gift" used in this application has the same concept as the term "token." Therefore, it is possible to understand the technology described in this application by replacing the term "gift" with the term "token."

In addition, the viewing user can post a rating showing a favorable opinion by pressing the like button V14. Note that in addition to or instead of the like button V14, it is also possible to display a button for posting a negative rating or other emotions.

In addition, if the first user has set the distribution settings to allow other users to appear, they can send a request to appear in the video by selecting the collaboration request button V15.

In addition, on the screen of a video distributed by a first user who is not yet being followed by a second user, a follow button V16 is displayed that allows the second user to follow the distribution user. This follow button functions as an unfollow button on the screen of a video distributed by a first user who is already being followed by the second user.

This "following" may be from a second user to another second user, from a first user to a second user, or from a first user to another first user. However, following is managed as a one-way association only, and associations in the reverse direction are managed separately as followers.

A photo button V25 for saving a still image of the screen may also be displayed.

The viewing screen V10 also displays a support ranking display button V17, a share button V18, and a ranking display button V19.

The support ranking displays the ranking of second users who are supporting the first user, and the ranking can be calculated based on the amount of the gift (points/coins), etc.

Furthermore, regarding sharing a video, the second user can press the share button V18 to check a list of SNS (social networking services) on which the video can be shared, and can send a fixed link to a specified location on a specified SNS by selecting it.

You can also request a collaboration broadcast from the first user by pressing the collaboration request button V15. A collaboration broadcast means having a character object of the second user appear in the video broadcast by the first user.

The upper part of the viewing screen V10 can display the broadcast user icon V21, the broadcast user name (character object name) V22, a cumulative number of viewers display V23, and a cumulative number of likes display V24.

In addition, when the End Viewing button V20 is selected, a screen for ending viewing appears, allowing the user to send a request to end viewing.

The screen for ending such viewing will be explained in detail below. This screen is called "small window audio distribution" and is used for viewing in a mode where only the audio is played without displaying the video image.

Selection of the above-mentioned viewing end button V20 is accepted by the viewing acceptance unit as a request to end viewing of the video.

At this time, the distribution starting unit ends the distribution of information about the video in response to the request to end viewing, but does not end the distribution of information about the audio.

When information about video and audio is distributed to the user terminal, the video is displayed on the main screen of the user terminal, and when information about audio only is distributed, the video is not displayed on the user terminal, but a sub-screen indicating that a video is being viewed is displayed.

Figure 14 shows an image of screen V50 on which the above-mentioned sub-screen V51 is displayed.

When this sub-screen V51 is displayed, the main screen displayed in the background transitions to the screen before watching the video. For example, if you move from the recommendation tab to the viewing frame, it will return to displaying the recommendation tab, and if you move from the follow tab to the viewing frame, it will transition to the follow tab.

When this sub-screen V51 is displayed, operations can be performed on the main screen, and transitions to other screens are possible.

The sub-screen V51 displays a profile picture, name, title, and an audio icon that visually indicates that audio is being played.

Then, viewing can be completely ended by selecting the end icon V52 displayed on the sub-screen V51.

When the video display is to be terminated, the server device may transmit information but not display it on the terminal, or the server device may stop transmitting information altogether.

With this configuration, you can search for other broadcasts or chat with other users while listening to only the audio.

Next, we will explain "collaboration," where other users appear in a video of a first user.

As described above, the second user can send a request to join the video by pressing the collaboration request button V15 shown in FIG. 12 and going through the collaboration broadcast participation request confirmation screen that is displayed.

In the present disclosure, a collaboration avatar display unit provided in one or more computer processors displays in a video a character object that is generated based on the movement of the viewing user who made the participation request in response to the received participation request.

Figure 15 shows, as an example, a viewing or distribution screen in which a second avatar CO4, a character object of a guest user, is participating in a video in which a first avatar CO3, a character object of a host user, is displayed. Note that the display of objects other than the avatars is omitted in Figure 15.

Furthermore, as shown in FIG. 16, a third avatar CO1, which is a character object generated based on the movement of another viewing user, may also participate in the video. Note that in FIG. 16, the third avatar CO1 is placed behind the first avatars CO3 and CO4's avatar A2, but the three may also be placed in a horizontal line. Also, the placement position of the avatars may be specified by the distribution user.

Figure 17 shows a list screen T30 of users who have mutual follow relationships, which is displayed by selecting the Follow tab T14 on the top screen shown in Figure 5. Mutual follow refers to a relationship in which two users follow each other.

This list screen T30 displays the profile images and names of users with whom you have a mutual follow relationship.

As shown in FIG. 17, the list screen T30 displays a first object T31 for each user who has a mutual follow relationship. In addition, a chat object T32 may be displayed together with the first object T31. By selecting this chat object, it is possible to transition to an individual chat screen with the second user.

The first object T31 sends a specified notification to the terminal of the user associated with the first object T31.

The specified notification may be, for example, a call notification.

Next, we will explain the details of the flow for performing a video chat in an embodiment of the present disclosure.

As an example, users can conduct video chats from individual chat screens or group chat screens.

These chat screens can be accessed, for example, from the chat list screen C10 (Figure 18) that is expanded by selecting the message button T21 on the top screen T10 (Figure 5).

The chat list screen C10 shown in FIG. 18 displays icons of users (character objects) or groups who have sent and/or received messages (chats) in the past, along with their names or titles. Note that the group icons may include icons of users (character objects) who will join the group.

Then, the user can select a user or group on the chat list screen C10, open the personal chat screen C20 (Figure 19) or the group chat screen, and start a video chat by selecting the video chat button C21.

In addition, by selecting the chat creation button C12 or group creation button C13, which is displayed by selecting the edit button C11 on the chat list screen C10 (Figure 20), a chat screen can be created for a user or group that is not displayed on the chat list screen C10.

Figure 21 shows the user selection screen C30 that opens when the chat creation button C12 is selected, and a chat screen with the displayed recommended users or with a user searched for using the search field C31 is displayed/generated. The configuration of the generated chat screen is the same as the chat screen C20 shown in Figure 19, and a video chat can be started by selecting the video chat button C21.

Similarly, FIG. 22 shows a group creation screen C40 that opens when the group creation button C13 is selected. The user can add users other than themselves as group members by selecting the user addition button C41. As an example, the number of group members that can be added is up to seven. The group name can also be set on this screen.

Once a group is created, the group chat screen C50 is displayed (Figure 23). On the group chat screen C50, you can also start a video chat by selecting the video chat button C51.

The chat screen C20 can also be accessed from the chat object T32 on the follow list screen T30 (Figure 17).

Chat icons can also be placed on other users' profile screens, allowing users to move to the chat screen from various pages and start video chats.

When a video chat starts, a notification is sent to the other party, who can join the video chat by responding to the notification. Users can set whether or not they want to receive such notifications.

Also, a configuration may be adopted in which video chats can only be conducted with users who are mutually followed. In this case, an icon indicating that a user who is mutually followed is currently video chatting with another user may be displayed on the follow list screen, and a user may be able to participate in the ongoing video chat by selecting the icon.

The video chat in this disclosure can be said to be a function that allows only specific users to view the above-mentioned collaborative distribution. The specific users here refer to the users who are participating in the video chat.

Next, we will explain the image of the expansion of virtual space in this disclosure with reference to Figure 24.

As shown as an example in FIG. 24, the virtual space in this embodiment is arranged so that a disk-shaped island (world) is floating in the air. This island is an object that resembles an upside-down tower-shaped cake, and various objects can be arranged on the disk-shaped ground. Note that this island and ground are shown as examples, and their display forms are not particularly limited.

The objects that can be displayed are at least the character object CO of the first user, a gift object G1 corresponding to a gift requested to be displayed by the second user, and an object S1 whose display position and display timing are controlled by the server device 400 (system side).

It is possible for a character object to move and jump within the world through user operation, and such functionality can be provided, as an example, as one of the games described above. In this disclosure, this is specifically referred to as "world distribution," and the above-mentioned game distribution start and end procedures are applied.

Specifically, switching from normal streaming (avatar streaming) to world streaming can be performed by selecting the play button D33 (Fig. 8) of the game displayed in the avatar streaming video, or the play button G11, G21 (Figs. 9, 10) of a game selected from a list of games displayed on the screen transitioned to by selecting the play button D33.

You can also switch from world streaming to avatar streaming by selecting the end play button displayed on the world streaming video.

Next, various functions that can be executed in the information processing system 3000 according to an embodiment of the present disclosure will be explained with reference to the drawings.

The one or more computer processors included in the information processing system 3000 according to an embodiment of the present disclosure include a receiving unit 410, a transmitting unit 420, an analyzing unit 430, and a display control unit 440, as shown in FIG. 25.

The receiving unit 410 receives at least audio information relating to the voice of the first user transmitted from the first user terminal 100 of the first user.

The above audio information may include, as an example, audio corresponding to an utterance by the first user picked up by a microphone provided in the first user terminal 100 or connected to the first user terminal 100, and/or information regarding other audio other than the utterance by the first user.

Examples of other sounds include environmental sounds and speech from other users. Whether a speech is from the user or another user can be identified using publicly known voice recognition technology. Environmental sounds also include television sounds, intercom sounds, telephone ringtones, animal cries, station announcements, the sounds of trains, cars, motorcycles, etc., and the sounds of multiple people talking.

The transmission unit 420 transmits information to the first user terminal 100 and/or the second user terminal 200 of the second user to display a video related to the first user on the first user terminal 100 and/or the second user terminal 200 of the second user.

As an example, a video related to a first user can be a video in which a character object of the first user or an actual image of the first user is displayed, or a video that includes only the voice of the first user without displaying any of the character objects or actual images of the first user.

In addition, the video displayed on the first user terminal 100 and the video displayed on the second user terminal 200 may be at least partially different.

As described above, the information for displaying the video includes information for displaying the video already rendered in the server device 400 on a client terminal (the first user terminal 100 and/or the second user terminal 200) and/or information for rendering the video on the client terminal. Also, part of the video may be rendered on the server device, and other parts of the video may be rendered on the client terminal.

The analysis unit 430 analyzes whether the voice contains specific words based on the voice information received by the receiving unit 410.

Information regarding a specific word may be stored in advance in a predetermined storage device provided in the one or more computer processors, or in a predetermined storage device connectable to the information processing system 3000.

Figure 26 shows an image of the data structure for a specific word stored in a specified storage device.

As shown in FIG. 26, a specific word is stored in association with display control information in a specific storage device.

The display control information includes, as an example, information about an operation object (control target) for performing an operation required for an action corresponding to a specific word, and information about control information (control content) for the operation object, but is not limited to these and may include other information.

For example, the specific word "gacha" is associated with an operation object called a "gacha button" for performing the operations required to execute a gacha, and with the control content of "making the gacha button appear" or "highlighted."

By way of example, specific words include words related to actions requiring operations on the first user terminal 100, words related to actions requiring operations on the second user terminal 200, words related to requests, words related to specific items, words related to events in real space, words contained in specific text displayed in a video, and/or words set on the first user terminal 100, but are not limited to these example words.

Words related to actions requiring operations on the first user terminal 100 can be, for example, words related to actions requiring operations on the first user terminal 100 by the first user, such as participating in a lottery such as gacha or participating in an event (for example, words indicating "gacha" or "event"). Details will be described later.

The words related to the action requiring operation on the second user terminal 200 may be, for example, words related to the action requiring operation by the second user on the second user terminal 200, such as gifting or posting a comment (for example, words indicating "gift", "comment", etc.). Details will be described later.

A word related to a request can be, for example, a word expressing the request (desire) of the first user (for example, a word indicating "hungry" or "sleepy"). Details will be described later.

A word related to a specific item may be, for example, a word indicating an electronic item that can be associated with the first user terminal 100 (for example, a word indicating "accessories," "clothes," etc.). Details will be described later.

Words related to events in the real world can be, for example, words that describe the weather, location, date and time (for example, words that indicate "good weather" or "Christmas"). Details will be given later.

The words contained in the specific text displayed in the video can be, for example, words contained in comments posted from the first user terminal 100 or the second user terminal 200, or in system comments posted by the system operator. Details will be provided later.

The word set in the first user terminal 100 may be, for example, a word selected or input in the first user terminal 100 (such as a password, theme, catchphrase, or answer to a quiz). Details will be described later.

Then, the analysis unit 430 analyzes whether the above-mentioned specific words are included in the voice based on the voice information.

As an analysis method, known or future voice recognition technology can be applied, but examples include a method of directly analyzing whether specific words are included in the voice information, and a method of converting the voice information into text information and then analyzing whether specific words are included.

In addition, instead of or in addition to analyzing whether the audio contains specific words as described above, the analysis unit 430 may analyze the content of the audio based on the audio information and analyze whether the audio contains content corresponding to the specific words as described above.

Even in this case, it is possible to apply known or future voice recognition technologies for analysis and interpretation methods.

The display control unit 440 then controls the display of the video based on the display control information associated with specific words contained in the audio, in accordance with the results of the analysis by the analysis unit 430.

As described above, the display control information is stored in a specific storage device in association with a specific word.

Controlling the display of the video includes changing the display of at least a portion of the video.

As an example, controlling the display of a video may include making a specific object appear in the video, highlighting a specific object displayed in the video, displaying another screen instead of or in addition to the screen displayed in the video, etc.

For example, as shown in FIG. 27, when a first user makes a statement such as "I think I'll try the gacha" in a video related to avatar distribution, the display is controlled so that the gacha button D12 displayed in the video lights up.

Alternatively, as shown in FIG. 28, when a first user makes a statement such as "I think I'll try the gacha" in a video related to avatar distribution, the display is controlled so that a gacha object D44 for trying the gacha appears in the video.

For example, in a video related to avatar distribution, when a first user makes a statement such as "I want a duck," as shown in FIG. 29, a gift list screen V30 is displayed on the screen of the second user terminal 200, and the display is controlled so that the frame of the corresponding gift is displayed in a different manner from the other frames.

Similarly, as shown in FIG. 30, when a first user makes a statement such as "I'm hungry" in a video related to world distribution, the display is controlled so that a shop object D45 appears in the video.

Alternatively, as shown in FIG. 31, when a first user makes a statement such as "I want to eat a hamburger" in a video related to world distribution, display control is performed so that an advertisement object D46 appears in the video.

Note that the above specific examples of video display control are merely examples and are not limited to these.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

In particular, the above configuration can increase a first user's willingness to distribute videos, a second user's willingness to watch videos, and/or users' willingness to interact with each other.

Specifically, by controlling the display of the video appropriately based on the first user's speech in the video, the quality of the video as content can be improved.

As the quality improves, the second user will be more willing to watch the video, which will in turn increase the first user's willingness to distribute the video.

In particular, control of the display based on speech in a video by a first user can, for example, support the operation of the first user and/or the operation of the second user, and support interaction between users.

For example, in the past, when a first user wanted to enter a lottery such as a gacha during video streaming, the first user would typically be required to tap an operational object such as a gacha button displayed on the screen, and then tap a lottery button on the lottery screen to which the user was redirected.

At this time, if the first user concentrates on finding and selecting a desired operation object from among the various operation objects displayed on the screen, there is a risk that the first user's talk in the video will be neglected. Talk contributes greatly to the quality of the video and the interaction between users, and neglecting this should be avoided. In particular, the above problem is more pronounced because information processing terminals such as smartphones that are expected to be used as the first user terminal tend to have small screens.

Technology for controlling a computer by voice has existed for some time. However, in this technical field, where basically all voice input from a first user terminal is played back on a second user terminal, having the first user speak words for voice control can degrade the quality of the content.

On the other hand, the invention disclosed herein automatically recognizes specific words from the natural talk of a first user, making it possible to support the operations of the first user and/or the second user, and to support interactions between users, without compromising the quality of the content.

Here, the video related to the first user can be a video related to avatar distribution or world distribution, as described above.

In world distribution, a video related to a first user displays the first user's character object and the virtual space (metaverse) in which the character object can move. In the case of a video related to world distribution, the first user and the second user may be users whose respective character objects are both in the world (distributor users), and the second user may be a viewing user who simply watches.

In the case of videos related to avatar distribution, the first user is the distribution user and the second user is the viewing user.

Here, the video relating to the first user may display a character object of the first user that moves based on movement information relating to the first user's movements transmitted from the first user terminal 100. At this time, the movement information (motion data) is received by the receiving unit 410 described above.

Next, we will explain the case where the specific word is related to an action that requires an operation on the first user terminal 100.

As described above, words related to actions requiring operations on the first user terminal 100 are words related to actions that require operations by the first user on the first user terminal 100, such as participating in a lottery such as gacha or participating in an event (for example, words indicating "gacha" or "event").

The specific word may be a single word or a sentence.

At this time, the display control information can be information for making an operation object associated with the action appear on the video or the screen of the first user terminal 100, for highlighting an operation object associated with the action displayed on the video or the screen of the first user terminal 100, and/or for displaying an operation screen associated with the action.

As an example, making an operation object associated with an action appear on the video or the screen of the first user terminal 100 is making a gacha object or an event participation object appear on the video or the screen of the first user terminal 100.

Here, with regard to the appearance of an operation object, there is no difference between making the operation object appear in the video and in the first user terminal 100 in the sense that the operation object is displayed on the screen of the first user terminal 100, but making the operation object appear in the first user terminal 100 includes making the operation object appear by superimposing it on the video or in a position separate from the video.

In addition, if these are already being displayed in the video or on the first user terminal 100, the above-mentioned operation object is displayed in an emphasized manner. "Displaying in an emphasized manner" means that a specified dramatic effect is generated for the operation object, for example, a sparkling effect is added, a blinking or rotating effect is added, or a mark or frame is added to serve as a landmark.

In addition, if there are multiple gacha categories, the corresponding gacha banner can be highlighted, for example by lighting it up.

An example of displaying an operation screen associated with an action is to display a gacha lottery screen or a pop-up image for transitioning to the gacha lottery screen.

Any of the display control information can be information for controlling the video in a manner that attracts the first user's attention.

Next, we will explain the case where the specific word is a word related to an action that requires an operation on the second user terminal 200.

As described above, words related to actions requiring operations on the second user terminal 200 are words related to actions that require operations by the second user on the second user terminal 200, such as gifting or posting a comment (for example, words indicating "gift" and "comment").

At this time, the display control information can be information for making an operation object associated with the action appear on the video or the screen of the second user terminal 200, for highlighting an operation object associated with the action displayed on the video or the screen of the second user terminal 200, and/or for displaying a screen associated with the action.

As an example of making an operation object associated with an action appear on the video or the screen of the second user terminal 200, it is to make a gift button or a comment input field appear on the video or the screen of the second user terminal 200.

A present button may also be displayed that corresponds to the action of sending a real product to the first user. If a real product has already been gifted to the first user by another user, the present button displayed on the screen of the second user terminal 200 may be hidden or grayed out.

Here, with regard to the appearance of an operation object, there is no difference between making the operation object appear in the video and in the second user terminal 200 in the sense that both result in the operation object being displayed on the screen of the second user terminal 200, but in the latter case, it is considered to include making the operation object appear by superimposing it on the video or in a position separate from the video.

In addition, if these are already being displayed in the video or on the second user terminal 200, the above-mentioned operation object is displayed in an emphasized manner. "Displaying in an emphasized manner" means that a specified dramatic effect is given to the operation object, for example, a sparkling effect is added, a blinking or rotating effect is added, or a mark or frame is added to serve as a landmark.

And, displaying an operation screen associated with an action means, for example, displaying a gift list screen or a pop-up image for transitioning to the gift list screen.

Any of the display control information can be used to control the video in a manner that attracts the second user's attention.

In addition, if the specific word is a word related to an action that requires an operation on the first user terminal 100, the display control unit 440 can control the display of the video on the first user terminal 100 and the second user terminal 200.

The reason why the video display is also controlled on the second user terminal 200 is that the first user's reaction to the results of the video display control can also be provided to the second user as part of the content.

On the other hand, if the specific word is a word related to an action that requires an operation on the second user terminal 200, the display control unit 440 can control the display of the video only in the video displayed on the second user terminal 200.

This is to prevent the second user's reaction to the results of controlling the video display from becoming part of the content, and also to reduce the discomfort felt by the first user having to request an operation from the second user.

In addition, one or more computer processors in the present disclosure may further include an effect generation unit 450, as shown in FIG. 32.

The effect generation unit 450 generates an effect that provides a benefit to the first user terminal 100 and/or the second user terminal 200 when the above action is performed by selecting an operation object that appears or is highlighted in the video or the first user terminal 100/second user terminal 200.

In other words, the effect generation unit 450 will not generate the above-mentioned special effect if the above-mentioned action is performed via a route different from the above-mentioned.

Examples of special effects include a discount on the fee (paid coins) paid when playing gacha or gifting, an increase in the number, size or value of items obtained through gacha, an increase in the number, size or value of objects displayed through gifting, the generation of special effects in videos, the awarding of points when participating in an event, etc.

Such benefits are given as a reward to the first user for carrying out or promoting an action such as gacha, gifts, or an event in the video.

Next, we will explain in detail the case where the specific words mentioned above are words related to the request.

Words related to requests can be, for example, words that indicate the first user's intention to express a desire. In addition, words related to requests include words that directly indicate requests, such as "I want to eat XX," "I want to sleep," "I want it to be cool," "I want it to be warm," "I want it to be bright," and "I want it to be dark," as well as words that indirectly indicate requests, such as "I'm hungry," "I'm sleepy," "hot," "cold," "dark," and "bright."

In this case, the display control information can be information for making an object associated with the request appear in the video and/or information for making an object displayed in the video appear in an emphasized manner.

The object associated with the request can be, for example, a lottery object.

The lottery object may be a lottery object D47 as shown in FIG. 33. The lottery object may also be the gacha button D12 described above.

The lottery object D47 allows the first user to obtain a real product and/or product object through a lottery.

The lottery may be conducted for a fee (by consuming paid tickets or paid coins) or free of charge (by consuming free tickets or free points). If the lottery is conducted for free, the lottery may be configured so that whether or not the lottery object is displayed is determined by the lottery itself.

Note that the real-world products and/or product objects that are the subject of the lottery do not have to be limited to one type, but may be of multiple types.

For example, if the specific word is a word that indicates hunger, a lottery can be held that does not limit the type of food as a prize. For example, when a first user says "I'm hungry," a lottery is held from among multiple prizes including pizza, hamburgers, sushi, etc., and one of these prizes is determined to be the winner or loser.

On the other hand, if the specific word is a word that requests a specific dish, a lottery can be held that limits the dish as a prize. For example, if a first user says, "I want to eat a hamburger," a lottery for a hamburger is held, and it is determined whether or not the user wins a hamburger.

In addition, if the specific word refers to the cold, a lottery can be held that does not limit the prizes to food or cold weather gear. For example, if a first user says "It's cold," a lottery is held from among multiple prizes including soup, hot drinks, gloves, scarves, and other cold weather gear, and one of these prizes is determined to be the winner or loser.

On the other hand, if the specific word is a word that requests a specific product, a lottery can be held that limits the food as the product. For example, if a first user says, "I want gloves," a lottery is held for gloves, and it is determined whether the user wins or loses the gloves.

The lottery object D47 may represent a lottery machine as shown in FIG. 33, may represent a product that is the subject of the lottery, or may represent a representative object related to the product that is the subject of the lottery.

When the lottery object D47 displayed on the screen is selected by the first user, the lottery result may be displayed on that screen, or the lottery result may be displayed on a transition destination lottery screen.

Then, depending on whether the lottery result is a win, a real product and/or a product object is awarded to the first user terminal 100.

The above-mentioned assignment may be performed automatically, or may be performed in response to an operation by the first user, as described below.

When a real product is granted, it means that the right to obtain the real product is granted to the first user, and when a product object is granted, it means that data related to the product object is associated with the first user terminal 100.

A product object is an object that represents a product, and can be an object that is attached to a character object associated with the first user, or a non-attached object that is temporarily or permanently displayed in a virtual space (world, room, etc.) associated with the first user terminal 100.

In addition, if the lottery object D47 is already displayed, the lottery object is highlighted. "Highlighting" means that a specified dramatic effect is applied to the lottery object, for example, a sparkling effect is added, a blinking or rotating effect is added, or a mark or frame is added to serve as a landmark.

Also, displaying a screen associated with an action means, for example, displaying a lottery screen or a pop-up image for transitioning to the lottery screen.

Any of the display control information can be used to control the video in a manner that attracts the first user's attention.

The object associated with the request can be, for example, a shop object.

The shop object can be the shop object D45 shown in FIG. 30.

Shop object D45 is an object that represents a shop where real products and/or product objects can be purchased.

The shop object D45 may be an operational object that transitions to a product selection and purchase screen when selected, or it may be placed in a virtual space displayed in a video, allowing a character object to enter and view, touch, and purchase products.

The object associated with the request can be, for example, an advertisement object.

The advertisement object can be advertisement object D46 shown in FIG. 31.

Advertisement object D46 is an object that represents an advertisement for a real product and/or product object.

The advertising object D46 can be displayed in the form of a flag, signage, billboard, or wrapping on a vehicle object such as a balloon, bus, or train displayed in the virtual space.

The advertising object D46 may be an operational object that transitions to an online sales site when selected, or it may be placed in a virtual space displayed in a video and move a character object to a virtual shop where the character object can enter and view, touch, and purchase products.

The lottery object D47, shop object D45, and advertisement object D46 may be displayed for a predetermined period of time, or may be displayed until selected by the first user. Also, the display may be terminated in response to a voice command from the first user.

When the video is from a first-person perspective in world distribution, the character object or the first user may be displayed as a pop-up on the edge of the screen, as if these objects were wearing AR glasses.

Furthermore, at least a portion of the virtual space can be shared with the second user terminal 200.

When the second user terminal 200 is associated with the first user terminal 100, the effect of the control of the video display by the display control unit 440 can extend to both the first user terminal 100 and the second user terminal 200.

On the other hand, if the second user terminal 200 is not associated with the first user terminal 100, the effect of the control of the video display by the display control unit 440 can be limited to only one of the first user terminal 100 and the second user terminal 200.

When the second user terminal 200 is associated with the first user terminal 100, this includes when they are in a mutual follow relationship and when the second user is unilaterally following the first user.

When the second user terminal 200 is not associated with the first user terminal 100, this includes cases where there is no mutual follow relationship and cases where the first user is unilaterally following the second user.

When virtual spaces are provided by multiple servers, users who follow each other are likely to coexist and communicate in the virtual space of the same server, so they can be displayed in the same way to avoid discrepancies in conversation. Similarly, the same space can be shared with a second user who is a follower of the first user.

On the other hand, you cannot share the same space with a second user who exists in the virtual space of a different server.

With the above configuration, the rendering load of objects can be reduced by limiting the range in which effects are shared.

In addition, one or more computer processors in the present disclosure may further include an ordering unit 460, as shown in FIG. 32.

When a win of a real product is determined by an operation on the lottery object D47 on the first user terminal 100, or when a real product is ordered on the first user terminal 100 via the shop object D45 and/or the advertisement object D46, the order unit 460 can transmit information regarding the win or information regarding the order and at least the address information of the first user contained in the user information of the first user to an information processing device of the physical store associated with the lottery object, the shop object and/or the advertisement object.

As a result, a first user can register an address such as their home address in the information processing system disclosed herein and have a physical product delivered to them without having to go through the trouble of inputting their address each time.

The real-world product may be a product that may satisfy the request. As an example, if the request is related to hunger, then food and drink such as hamburgers, pizza, soup, etc. may be included; if the request is related to sleep, then sleeping goods such as pillows and bedding may be included; if the request is related to temperature, such as hot or cold, then food and drink or cooling/heating goods may be included; if the request is related to darkness or brightness, then lighting fixtures may be included; however, the product is not limited to these and may be any product that may satisfy even a part of the request.

When a real product is ordered on the first user terminal 100 via the shop object D45 and/or the advertising object D46, the display control unit 440 can display a product object corresponding to the real product in the video.

In other words, in the present disclosure, a specific storage device is assumed to store product objects corresponding to real products that can be provided. This enhances the sense of connection between the first user and the character object, and also stimulates communication because the second user can see what the first user has ordered.

For example, when a first user says "I'm hungry," real food is delivered to the first user and a food object is attached to the first user's character object.

The product object can be displayed at the time of ordering, after ordering and before the actual product arrives, or after the actual product arrives. In this case, the timing of product arrival is obtained from the delivery side or input by the first user.

As mentioned above, for companies that provide real-world products, displaying product objects in a virtual space can have a promotional effect through product placement. It can also lead to increased brand awareness and the acquisition of new customers. This allows operators to earn advertising revenue, which can then be used to charge users free service or increase revenue for broadcasting users.

In addition, companies will be able to introduce new advertising methods not available in traditional advertising, such as targeting broadcasters (influencers) with a large number of viewers/followers to display advertisements.

Next, we will explain what happens when a specific word is related to a specific item.

In this case, one or more computer processors in the present disclosure may further include a determination unit 470, as shown in FIG. 32.

The determination unit 470 determines whether a specific item is associated with the first user terminal 100.

The database to be judged may be stored in a storage device provided in the server device 400, or may be stored in a storage device provided in the first user terminal 100.

A word related to a particular item may be, for example, a word indicating an electronic item that can be associated with the first user terminal 100 (for example, a word indicating "accessories," "clothes," etc.).

When the determination unit 470 determines that a specific item is associated with the first user terminal 100, the display control unit controls the video based on display control information, which is information for making a specific object corresponding to the specific item appear in the video, information for highlighting a specific object displayed in the video, and/or information for displaying a list screen of items associated with the first user terminal, including the specific item.

As an example, making a specific object corresponding to a specific item appear in the video is making the specific object appear in the video. If the specific object is an accessory or other wearable item, it will be displayed in association with a specific part of the character object.

In addition, if a specific object is already displayed in the video, the specific object is highlighted. "Highlighting" means creating a specific dramatic effect for the specific object, such as adding a sparkling effect, a blinking or rotating effect, or adding a mark or frame to serve as a landmark.

One example of displaying a list screen of items associated with the first user terminal, including a specific item, is to display the closet screen described above.

When the determination unit 470 determines that a specific item is not associated with the first user terminal 100, the display control unit can control the display of the video based on display control information, which is information for making a lottery object that can acquire a specific item by lottery, a shop object that represents a shop where the specific item can be purchased, or an advertisement object that represents an advertisement related to the specific item appear in the video, and/or information for highlighting and displaying the lottery object, shop object, and/or advertisement object displayed in the video.

In other words, if the first user makes a comment about a specific item that he or she does not have, the display of the video is controlled based on information for obtaining the specific item. Details of the lottery object, shop object, and advertisement object are as described above.

In addition, when the determination unit 470 determines that a specific item is not associated with the first user terminal 100, the display control unit can control the display of the video based on display control information, which is information for making a line to a screen associated with a user terminal of another user who has the specific item appear in the video.

The first user can exchange, transfer, or receive (hereinafter referred to as "exchange, etc.") items with other users. This can happen while the first user is streaming a video, or when the first user is not streaming a video.

And making the video display a path to a screen related to the user device of another user who has a particular item includes making a screen for exchanging items with another user, etc., and a pop-up image for transitioning to that screen appear.

The above screen can be used as a dedicated screen for other users' profile screens, exchanges, etc.

Item exchanges with other users may be freely negotiated via messages (chat), or a function may be implemented that allows users to express their desire to transfer or receive items in advance.

Next, we will explain what happens when a specific word is related to an event in the real world.

Words related to events in the real world can be, for example, words that describe the weather, location, date and time (for example, words that indicate "good weather" or "Christmas").

In this case, the display control information can be information for making a real object associated with an event in real space appear in the video.

One example of making a real-world object associated with an event in real space appear in a video is making a wallpaper object appear in the video. A wallpaper object is an object that is displayed behind a character object and functions as the background of the video.

For example, when the first user says something like "It's nice weather," a wallpaper object of a clear sky appears in the video, and the display is controlled so that a sun object also appears.

Similarly, when the first user says something like "It's starting to rain!", the display is controlled so that a wallpaper object showing rain appears in the video.

Next, we will explain the case where the specific word is a word contained in specific text displayed in the video.

The words contained in the specific text displayed in the video can be, for example, words contained in comments posted from the first user terminal 100 or the second user terminal 200, or words contained in system comments posted by the system operator.

System comments are comments that are automatically displayed on videos, and are usually textual notifications about when a second user enters or leaves the broadcast slot, or when a gift has been thrown.

Note that the specific text is not limited to any particular text as long as it is displayed on the screen, and may include the above-mentioned comments, text shown on a displayed object (such as a gift object, a whiteboard object, or a memo pad object), etc.

At this time, the display control unit 440 can highlight specific text.

Highlighting specific text means generating a specific dramatic effect on an object related to the specific text, such as adding a sparkling effect, a blinking or rotating effect, or adding a mark or frame to serve as a landmark. The display color of the specific text may also be changed.

Note that it is not necessary for all of the specific text to be read out to the first user, and text equivalent to a predetermined percentage of the specific text may be recognized as a specific word.

Highlighting may include displaying objects related to the character object of the user who posted the comment.

A related object can be a two-dimensional character object or a reduced-sized character object that does not move based on the broadcast user's movements.

Compared to drawing three-dimensional character objects, which entails a large processing load, the above configuration can reduce drawing costs.

Reducing the size of a character object also includes changing the head-to-body ratio of the character object. For example, this includes a miniature character with the same head-to-body ratio. Note that a miniature character may be in 2D or 3D.

When multiple people are collaborating, the receiving unit 410 receives multiple pieces of voice information related to the voices of multiple users transmitted from multiple user terminals including the first user terminal 100.

At this time, the analysis unit 430 analyzes whether the voice contains specific words. The analysis unit 430 also identifies the number of specific words contained in the voice.

The display control unit 440 can control the display of the video based on display control information associated with a specific word contained in the audio and the number of audios containing the specific word.

In this way, in the case of collaboration, the display of the video can be controlled differently depending on the number of people who say a particular word. For example, if a particular word is said by one person and if a particular word is said by multiple people, the display of the video can be controlled to be more colorful when multiple people say it.

In addition, in the case of videos of multiple people playing games, it is possible to create special effects or activate skills within the game.

In addition, if the specific word is a password set by the first user who is the host, as described below, it will increase the sense of unity among the participating users in the collaborative video, stimulate communication, and improve the quality of the video.

Also, if only the host knows a certain word and the guest does not, it will be possible to provide quiz show-like content.

Next, we will explain the case where the specific word is a configured word set by an operation on the first user terminal 100.

In this case, one or more computer processors in the present disclosure may further include a setting unit 480, as shown in FIG. 32.

The setting unit 480 sets a specific word based on the operation of the first user received by the receiving unit 410.

The first user may be able to operate the above settings on the above-mentioned distribution setting screen D20, or may be able to operate via a setting button D41 displayed during video distribution. In addition, the above settings may be operated on the first user's profile screen, etc., regardless of whether distribution is being performed or not.

The specific word may be set by selecting it from among presented candidate words, or by freely inputting text. The candidate words are assumed to be stored in advance in a predetermined storage device provided in or connectable to one or more computer processors of the present disclosure.

The words set on the first user terminal are stored in a storage device in association with display control information, as in the data table shown in FIG. 26. In the case of candidate words, this display control information is associated in advance, and in the case of words entered by free input, the user can freely set the actions, control targets, and/or control contents to be associated with a particular word.

Such set words may be effective only in a single avatar broadcast or world broadcast by the first user terminal, or may be effective in a collaborative broadcast or world broadcast involving multiple users.

In other words, in the latter collaborative broadcasts and worlds, the set words function as a password between users, helping to stimulate communication between multiple users.

In addition, if the specific word is set by the system, the specific word may be known to the user in advance, or may not be disclosed to the user. If the set specific word is not disclosed, it can be used as a secret keyword, creating fun in guessing the correct answer, or a sense of surprise when the answer is correct.

The setting unit 480 may also set whether or not to control the display of the video according to the results of the analysis performed by the analysis unit 430.

The setting unit 480 performs the above settings based on the operation of the first user received by the receiving unit 410, and the first user may perform the above settings on the above-mentioned distribution setting screen D20, or may perform the operation via a setting button D41 displayed during distribution of the video. In addition, the above settings may be performed on the first user's profile screen, etc., regardless of whether distribution is occurring or not.

With this configuration, the first user can choose at his/her own will whether or not to control the video display according to the results of the analysis by the analysis unit 430, and it becomes possible to prevent the video display from being controlled unintentionally by the first user.

In the above embodiment, an example has been described in which the display control unit 440 controls the display of the video based on the display control information associated with a specific word contained in the audio in accordance with the results of analysis by the analysis unit 430, but the analysis unit 430 may analyze whether a specific action is included in the action based on the action information received by the receiving unit 410.

At this time, the display control unit can control the display of the video based on the display control information associated with a specific action included in the action, in accordance with the results of the analysis by the analysis unit 430.

The information regarding the specific operation may be stored in advance in a predetermined storage device provided in the one or more computer processors, or in a predetermined storage device connectable to the information processing system 3000.

In addition, specific actions are stored in association with display control information in a specified storage device.

The display control information includes, as an example, information about an operation object (control target) for performing an operation required for an action corresponding to a specific motion, and information about control information (control content) for the operation object, but is not limited to these and may include other information.

For example, the specific action "yawning" is associated with a control content in which the gift list screen V30 is displayed on the second user terminal 200 and the display is controlled so that the corresponding eye mask gift is illuminated.

Furthermore, the specific action "pat the belly" is associated with a control content in which the gift list screen V30 opens on the second user terminal 200 and the display is controlled so that the corresponding meat gift is illuminated.

The above-mentioned embodiments relating to specific words can also be applied in appropriate combinations when the above-mentioned specific actions are adopted.

Next, we will explain the information processing method in an embodiment of the present disclosure.

The information processing method in the embodiment of the present disclosure can be executed in an information processing system 3000 that includes one or more user terminals 100, 200 and a server device 400.

As shown as an example in FIG. 34, the information processing method of the present disclosure can cause one or more computer processors provided in the information processing system 3000 to execute a receiving step S410, a transmitting step S420, an analyzing step S430, and a display control step S440.

In the receiving step S410, voice information relating to at least the voice of the first user is received, which is transmitted from the first user terminal of the first user.

Such receiving step S410 can be executed by the receiving unit 410 described above.

The receiving step S410 can be executed on the server side (server device 400).

In the transmission step S420, information for displaying the video related to the first user on the first user terminal and/or the second user terminal of the second user is transmitted to the first user terminal and/or the second user terminal.

Such transmission step S420 can be performed by the transmission unit 420 described above.

The sending step S420 can be executed on the server side (server device 400).

In analysis step S430, the audio information is used to analyze whether the audio contains specific words.

Such analysis step S430 can be performed by the above-mentioned analysis unit 430.

The analysis step S430 may be performed on the server side (server device 400) or on the client side (first user terminal 100).

The display control step S440 controls the display of the video based on the display control information associated with specific words contained in the audio, according to the results of the analysis performed in the analysis step S430.

Such display control step S440 can be executed by the display control unit 440 described above.

The display control step S440 may be executed on the server side (server device 400) or on the client side (first user terminal 100/second user terminal 200).

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, we will explain the computer program in an embodiment of the present disclosure.

The computer program in the embodiment of the present disclosure can be executed in an information processing system 3000 having one or more user terminals 100, 200 and a server device 400.

The computer program in this disclosure causes one or more computer processors provided in the information processing system 3000 to realize a receiving function, a transmitting function, an analyzing function, and a display control function.

The receiving function receives voice information regarding at least the voice of the first user, which is transmitted from the first user terminal of the first user.

The transmission function transmits information to the first user terminal and/or the second user terminal for displaying a video related to the first user on the first user terminal and/or the second user terminal of the second user.

The analysis function uses audio information to analyze whether the audio contains specific words.

The display control function controls the display of the video based on the display control information associated with specific words contained in the audio, according to the results of the analysis performed by the analysis function.

The above functions can be realized by the receiving circuit 1410, transmitting circuit 1420, analyzing circuit 1430, and display control circuit 1440 shown in FIG. 35. The receiving circuit 1410, transmitting circuit 1420, analyzing circuit 1430, and display control circuit 1440 are realized by the receiving unit 410, transmitting unit 420, analyzing unit 430, and display control unit 440 described above, respectively. Details of each unit are as described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, an information processing device in an embodiment of the present disclosure will be described. The information processing device corresponds to the first user terminal 100 in the information processing system 3000 described above.

The information processing device is an information processing device having one or more computer processors, and the one or more computer processors have a transmitting unit 110, a receiving unit 120, and a display control unit 130, as shown in FIG. 36.

The transmitting unit 110 transmits voice information relating to at least the voice of the first user to the server device.

The receiving unit 120 receives information from the server device for displaying a video related to the first user.

The display control unit 130 controls the display of the video based on the display control information associated with the specific word contained in the audio, depending on the result of the analysis of whether the audio contains a specific word based on the audio information. The display control unit 130 can be configured in the same manner as the display control unit 440 described above.

The one or more computer processors may also include an analysis unit that analyzes whether the voice contains a specific word based on the voice information. In this case, the analysis unit may have a configuration similar to that of the analysis unit 430 described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, an example of an information processing method according to an embodiment of the present disclosure will be described. This information processing method is executed in the information processing device (first user terminal 100) described above.

The information processing method disclosed herein is characterized in that, as shown as an example in FIG. 37, one or more computer processors provided in an information processing device execute a transmission step S110, a reception step S120, and a display control step S130.

The sending step S110 sends voice information related to at least the voice of the first user to the server device. Such a sending step S110 can be executed by the sending unit 110 described above.

The receiving step S120 receives information for displaying a video related to the first user from the server device. Such receiving step S120 can be executed by the receiving unit 120 described above.

The display control step S130 controls the display of the video based on the display control information associated with the specific word contained in the audio, depending on the result of the analysis of whether the audio contains a specific word based on the audio information. Such a display control step S130 can be executed by the display control unit 130 described above.

In addition, the information processing method according to the embodiment of the present disclosure may cause the one or more computer processors to execute an analysis step of analyzing whether the voice contains a specific word based on the voice information. In this case, the analysis step may have a configuration similar to that of the above-mentioned analysis step S430.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, a computer program according to an embodiment of the present disclosure will be described. Such a computer program is executed in the information processing device (first user terminal 100) described above.

The computer program disclosed herein is characterized in that it causes one or more processors included in an information processing device to realize a transmission function, a reception function, and a display control function.

The transmission function transmits voice information related to at least the first user's voice to the server device.

The receiving function receives information from the server device for displaying a video related to the first user.

The display control function controls the display of the video based on the display control information associated with the specific words contained in the audio, depending on the results of an analysis of whether the audio contains specific words based on the audio information.

The above functions can be realized by the transmission circuit 1110, the reception circuit 1120, and the display control circuit 1130 shown in FIG. 38. The transmission circuit 1110, the reception circuit 1120, and the display control circuit 1130 are realized by the transmission unit 110, the reception unit 120, and the display control unit 130 described above, respectively. Details of each unit are as described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, an information processing device in an embodiment of the present disclosure will be described. The information processing device corresponds to the second user terminal 200 in the information processing system 3000 described above.

The information processing device is an information processing device having one or more computer processors, and the one or more computer processors have a receiving unit 210 and a display control unit 220 as shown in FIG. 39.

The receiving unit 210 receives information from the server device for displaying a video related to the first user.

The display control unit 220 controls the display of the video based on the display control information associated with the specific word contained in the audio, depending on the result of the analysis of whether the audio contains a specific word based on the audio information. The display control unit 220 can be configured in the same manner as the display control unit 440 described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Next, an example of an information processing method according to an embodiment of the present disclosure will be described. This information processing method is executed in the information processing device (second user terminal 200) described above.

The information processing method disclosed herein is characterized in that one or more computer processors provided in an information processing device execute a receiving step S210 and a display control step S220, as shown as an example in FIG. 40.

The receiving step S210 receives information for displaying a video related to the first user from the server device. Such a receiving step S210 can be executed by the receiving unit 210 described above.

The display control step S220 controls the display of the video based on display control information associated with the specific words included in the voice, depending on the result of analysis of whether the voice contains specific words based on voice information related to at least the voice of the first user. Such a display control step S220 can be executed by the display control unit 220 described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

Finally, we will explain the computer program in an embodiment of the present disclosure. Such a computer program is a computer program executed in the above-mentioned information processing device (second user terminal 200).

The computer program disclosed herein is characterized in that it causes one or more processors included in an information processing device to realize a receiving function and a display control function.

The receiving function receives information from the server device for displaying a video related to the first user.

The display control function controls the display of the video based on display control information associated with specific words contained in the audio, depending on the results of an analysis of whether the audio contains specific words based on audio information about at least the first user's audio.

The above functions can be realized by the receiving circuit 1210 and the display control circuit 1220 shown in FIG. 41. The receiving circuit 1210 and the display control circuit 1220 are realized by the receiving unit 210 and the display control unit 220 described above, respectively. Details of each unit are as described above.

The above configuration provides a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above.

In addition, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-mentioned embodiment. Such an information processing device can be realized by storing a program describing the processing contents for realizing each function of the server device or terminal device according to the embodiment in a memory unit of the information processing device, and reading and executing the program by the CPU of the information processing device.

FIG. 42 is a block diagram of a processing circuit for performing computer-based operations in accordance with the present disclosure. FIG. 42 shows a processing circuit 600, which corresponds to the CPU of the terminals and devices in the present disclosure.

The processing circuit 600 can be used to control any computer-based and cloud-based control process, and the flowchart descriptions or blocks can be understood as representing modules, segments, or portions of code that include one or more executable instructions for implementing a particular logical function or step in a process, and alternative implementations are included within the scope of the exemplary embodiments of the present advancement in which the functions may be performed. The order from that shown or discussed includes substantially simultaneous or reverse order depending on the functionality involved, as will be understood by those skilled in the art. The functionality of the elements disclosed herein can be implemented using circuits or processing circuits that may include general purpose processors, special purpose processors, integrated circuits, ASICs ("application specific integrated circuits"), conventional circuits configured or programmed to perform the disclosed functions, and/or combinations thereof. A processor processes circuits or circuits to include transistors and other circuits therein. A processor may be a programmed processor that executes a program stored in a memory. In this disclosure, a processing circuit, unit, or means is hardware that performs or is programmed to perform the recited functions. The hardware can be any hardware disclosed herein or any other known hardware that is programmed or configured to perform the recited functions.

In FIG. 42, the processing circuit 600 includes a CPU 601 that executes one or more control processes discussed in this disclosure. Process data and instructions may be stored in memory 602. These processes and instructions may also be stored on a storage medium disk 604, such as a hard drive (HDD) or a portable storage medium, or may be stored remotely. Furthermore, the claimed advancement is not limited by the form of the computer-readable medium on which the instructions of the processes of the invention are stored. For example, the instructions may be stored on a CD, DVD, flash memory, RAM, ROM, PROM, EPROM, EEPROM, hard disk, or any other non-transitory computer-readable medium of an information processing device with which the processing circuit 600 communicates, such as a server or computer. The processes may also be stored in network-based storage, cloud-based storage, or other mobile-accessible storage and executable by the processing circuit 600.

Furthermore, the claimed developments may be provided as a utility application, a background daemon, or an operating system component, or combinations thereof, and execute in conjunction with the CPU 601 and an operating system, such as Microsoft Windows, UNIX, Solaris, LINUX, Apple MAC-OS, Apple iOS, and other systems known to those skilled in the art.

The hardware elements for implementing the processing circuit 600 may be implemented by various circuit elements. Also, each function of the above-described embodiments may be implemented by a circuit including one or more processing circuits. The processing circuit includes a specifically programmed processor, for example, processor (CPU) 601 as shown in FIG. 42. The processing circuit also includes devices such as application specific integrated circuits (ASICs) and conventional circuit components arranged to perform the enumerated functions.

Alternatively, or additionally, CPU 601 may be implemented on an FPGA, an ASIC, a PLD, or using discrete logic circuitry, as will be appreciated by those skilled in the art. CPU 601 may also be realized as multiple processors operating in parallel and in coordination to execute the instructions of the inventive process described above.

The processing circuit 600 of FIG. 42 also includes a network controller 606, such as an Ethernet PRO network interface card, for interfacing with the network 700. As can be appreciated, the network 700 can be a public network, such as the Internet, or a private network, such as a local area network (LAN) or a wide area network (WAN), or any combination thereof, and can include a public switched telephone network (PSTN) or an integrated services digital network (ISDN) sub-network. The network 700 can also be wired, such as an Ethernet network, a universal serial bus (USB) cable, or wireless, such as a cellular network, including EDGE, 3G and 4G wireless cellular systems. The wireless network can also be Wi-Fi, wireless LAN, Bluetooth, or any other form of wireless communication known in the art. Additionally, the network controller 606 may be compliant with other direct communication standards, such as Bluetooth, near field communication (NFC), infrared, or other.

The processing circuitry 600 further includes a display controller 608, such as a graphics card or graphics adapter, for interfacing with a display 609, such as a monitor. The I/O interface 612 interfaces with a keyboard and/or mouse 614, as well as a touch screen panel 616 on or separate from the display 609. The I/O interface 612 also connects to various peripheral devices 618.

The storage controller 624 connects the storage media disks 604 to a communication bus 626, which may be ISA, EISA, VESA, PCI, or the like, and interconnects all components of the processing circuit 600. A description of the display 609, keyboard and/or mouse 614, as well as the general features and functionality of the display controller 608, storage controller 624, network controller 606, and I/O interface 612 is omitted herein for the sake of brevity, as these features are well known.

The exemplary circuit elements described in the context of this disclosure may be substituted with other elements and may be of different structure than the examples provided herein. Furthermore, circuits configured to perform the functions described herein may be implemented in multiple circuit units (e.g., chips) or features may be combined in circuits on a single chipset.

The functions and features described herein may also be performed by various distributed components of a system. For example, one or more processors may perform these system functions, where the processors are distributed across multiple components that communicate within a network. The distributed components may include one or more client and server machines that may share processing, as well as various human interface and communication devices (e.g., display monitors, smartphones, tablets, personal digital assistants (PDAs)). The network may be a private network, such as a LAN or WAN, or a public network, such as the Internet. Input to the system may be received via direct user input, remotely in real time or as a batch process. Additionally, some implementations may be performed on modules or hardware that are not identical to those described. Thus, other implementations are within the scope that may be claimed.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims.

In addition, the method described in the embodiment can be stored as a program that can be executed by a calculator (computer) on a recording medium such as a magnetic disk (floppy (registered trademark) disk, hard disk, etc.), optical disk (CD-ROM, DVD, MO, etc.), semiconductor memory (ROM, RAM, flash memory, etc.), and can also be distributed by transmitting it via a communication medium. The program stored on the medium side also includes a setting program that configures software means (including not only execution programs but also tables and data structures) that are executed by a computer. The computer that realizes this device reads the program recorded on the recording medium, and in some cases, constructs software means using the setting program, and executes the above-mentioned processing by controlling the operation of this software means. Note that the recording medium referred to in this specification is not limited to a storage medium for distribution, but also includes storage media such as a magnetic disk or semiconductor memory provided inside the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory.
[Additional Notes]
The following is a summary of the claims as originally filed in the original application of this application.
[1]
An information processing system including one or more computer processors,
the one or more computer processors:
A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis unit that analyzes whether the voice includes a specific word based on the voice information;
An information processing system comprising: a display control unit that controls the display of the video based on display control information associated with specific words contained in the audio in accordance with the results of the analysis by the analysis unit.
[2]
The specific word is a word related to an action requiring an operation on the first user terminal,
The information processing system of claim 1, characterized in that the display control information is information for causing an operation object corresponding to the action to appear on the video or the screen of the first user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the first user terminal, and/or for displaying an operation screen corresponding to the action.
[3]
The specific word is a word related to an action requiring an operation on the second user terminal,
The information processing system of claim 1, characterized in that the display control information is information for causing an operation object corresponding to the action to appear on the video or the screen of the second user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the second user terminal, and/or for displaying an operation screen corresponding to the action.
[4]
The display control unit is
When the specific word is a word related to an action requiring an operation on the first user terminal, controlling the display of the video on the first user terminal and the second user terminal;
The information processing system described in claim 1, characterized in that when the specific word is a word related to an action requiring an operation on the second user terminal, the display of the video is controlled only in the video displayed on the second user terminal.
[5]
The one or more computer processors further include:
The information processing system according to claim 2 or 3, characterized in that it further comprises an effect generation unit that generates a specific effect in the first user terminal and/or the second user terminal when the action is performed by selecting the operation object that appears or is displayed highlighted in the video.
[6]
the particular word is a word associated with the request;
The information processing system described in claim 1, characterized in that the display control information is information for making an object corresponding to the request appear in the video and/or information for highlighting the object displayed in the video.
[7]
The information processing system described in claim 6, characterized in that the object associated with the request is a lottery object that allows real products and/or product objects to be obtained by lottery, a shop object that represents a shop where the real products and/or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and/or product objects.
[8]
the one or more computer processors:
The information processing system of claim 7 further comprising an order unit that, when a win for the real product is determined by an operation on the lottery object on the first user terminal, or when a real product is ordered on the first user terminal via the shop object and/or the advertising object, transmits information regarding the win or information regarding the order and at least the address information of the first user contained in the user information of the first user to an information processing device of a physical store associated with the lottery object, the shop object and/or the advertising object.
[9]
The information processing system described in claim 7 or 8, characterized in that the display control unit displays a product object corresponding to a real product in the video when a real product is ordered via the shop object and/or the advertising object on the first user terminal.
[10]
the specific words being words associated with a specific item;
The one or more computer processors further include:
a determination unit that determines whether the particular item is associated with the first user terminal;
When the determination unit determines that the specific item is associated with the first user terminal,
The display control unit is
Information for making a specific object corresponding to the specific item appear in the video;
Information for highlighting the specific object displayed in the video, and/or
The information processing system according to claim 1, characterized in that the display of the video is controlled based on display control information which is information for displaying a list screen of items associated with the first user terminal, including the specific item.
[11]
When the determination unit determines that the specific item is not associated with the first user terminal,
The display control unit is
A lottery object that allows the specific item to be acquired by lottery, a shop object that represents a shop where the specific item can be purchased, or an advertisement object that represents an advertisement related to the specific item, information for making the advertisement appear in the video, and/or
An information processing system as described in claim 10, characterized in that the display of the video is controlled based on display control information which is information for highlighting and displaying the lottery object, the shop object and/or the advertising object displayed in the video.
[12]
When the determination unit determines that the specific item is not associated with the first user terminal,
The information processing system described in claim 10, characterized in that the display control unit controls the video based on display control information, which is information for making a line to a screen related to a user terminal of another user who has the specific item appear in the video.
[13]
the specific word is a word related to an event in real space,
The information processing system according to claim 1 , wherein the display control information is information for making a real object associated with an event in the real space appear in the video.
[14]
the specific word is a word contained in a specific text displayed in the video,
The information processing system according to claim 1 , wherein the display control unit displays the specific text in a highlighted manner.
[15]
15. The information processing system according to claim 14, wherein the specific text is a comment posted from the first user terminal or the second user terminal, or a system comment.
[16]
The information processing system according to claim 15 , wherein the highlighting includes displaying an object related to a character object of the user who posted the comment.
[17]
2. The information processing system according to claim 1, wherein the video displays a character object of the first user and a virtual space in which the character object can move.
[18]
If the second user terminal is associated with the first user terminal,
At least a portion of the virtual space is shared with a second user terminal;
18. The information processing system according to claim 17, wherein the effect of the control of the display of the video by the display control unit extends to both the first user terminal and the second user terminal.
[19]
if the second user terminal is not associated with the first user terminal,
At least a portion of the virtual space is shared with a second user terminal,
20. The information processing system according to claim 18, wherein the effect of the control of the display of the video by the display control unit extends to only one of the first user terminal and the second user terminal.
[20]
the one or more computer processors:
The information processing system according to claim 1 , further comprising a setting unit capable of setting whether or not to control the display of the moving image in accordance with the result of the analysis by the analysis unit.
[21]
2. The information processing system according to claim 1, wherein the first user is a distribution user, and the second user is one or more viewing users.
[22]
The receiving unit receives a plurality of pieces of voice information related to voices of a plurality of users transmitted from a plurality of user terminals including the first user terminal,
The analysis unit analyzes whether each of the plurality of voices includes a specific word,
The information processing system according to claim 1, characterized in that the display control unit controls the display of the video based on display control information associated with a specific word contained in the audio and a number of audio containing the specific word.
[23]
2. The information processing system according to claim 1, wherein the specific word is set based on an operation of the first user terminal.
[24]
The receiving unit receives motion information regarding a motion of the first user transmitted from the first user terminal;
2. The information processing system according to claim 1, wherein the video includes a character object of the first user that moves based on the action information.
[25]
one or more computer processors,
a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis step of analyzing whether the voice includes a specific word based on the voice information;
An information processing method that executes a display control step of controlling the display of the video based on display control information associated with specific words contained in the audio, depending on the results of the analysis in the analysis step.
[26]
one or more computer processors,
a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device;
a receiving step of receiving information for displaying a video related to the first user from the server device;
and a display control step of controlling the display of the video based on display control information associated with the specific word contained in the audio, depending on the results of an analysis of whether the audio contains a specific word based on the audio information.
[27]
one or more computer processors,
a transmitting function for transmitting voice information relating to at least the voice of the first user to the server device;
a receiving function for receiving information for displaying a video related to the first user from the server device;
A computer program that realizes a display control function that controls the display of the video based on display control information associated with a specific word contained in the audio, depending on the results of an analysis of whether the audio contains a specific word based on the audio information.
[28]
one or more computer processors,
a receiving step of receiving information for displaying a moving image related to a first user from a server device;
and a display control step of controlling the display of the video based on display control information associated with a specific word contained in the voice, depending on the results of an analysis of whether the voice contains a specific word based on voice information regarding at least the first user's voice.
[29]
one or more computer processors,
A receiving function of receiving information for displaying a video related to a first user from a server device;
A computer program that realizes a display control function that controls the display of the video based on display control information associated with specific words contained in the voice, in accordance with the results of an analysis of whether the voice contains specific words based on voice information regarding at least the first user's voice.

REFERENCE SIGNS LIST 100 First user terminal 200 Second user terminal 300 Network 400 Server device 410 Receiving unit 420 Transmitting unit 430 Analyzing unit 440 Display control unit

Claims (48)

An information processing system including one or more computer processors,
the one or more computer processors:
A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis unit that analyzes whether the voice includes a specific word based on the voice information;
a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit;
The specific word is a word related to an action requiring an operation on the first user terminal,
The display control information is information for causing an operation object corresponding to the action to appear on the video or the screen of the first user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the first user terminal, and/or for displaying an operation screen corresponding to the action, in an information processing system. An information processing system including one or more computer processors,
the one or more computer processors:
A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis unit that analyzes whether the voice includes a specific word based on the voice information;
a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit;
The specific word is a word related to an action requiring an operation on the second user terminal,
The display control information is information for causing an operation object corresponding to the action to appear on the video or the screen of the second user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the second user terminal, and/or for displaying an operation screen corresponding to the action, in an information processing system. The one or more computer processors further include:
The information processing system according to claim 2, further comprising an effect generating unit that generates a specific effect in the first user terminal and/or the second user terminal when the action is performed by selecting the operation object that appears or is displayed highlighted in the video. An information processing system including one or more computer processors,
the one or more computer processors:
A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis unit that analyzes whether the voice includes a specific word based on the voice information;
a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit;
The display control unit is
When the specific word is a word related to an action requiring an operation on the first user terminal, controlling the display of the video on the first user terminal and the second user terminal;
An information processing system that controls the display of the video only in the case where the specific word is a word related to an action requiring an operation on the second user terminal, in which case the display of the video is controlled in the second user terminal. An information processing system including one or more computer processors,
the one or more computer processors:
A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis unit that analyzes whether the voice includes a specific word based on the voice information;
a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit;
the particular word is a word associated with the request;
the display control information is information for making an object associated with the request appear in the video and/or information for highlighting the object displayed in the video,
An information processing system in which the object associated with the request is a lottery object that allows real products and/or product objects to be obtained by lottery, a shop object that represents a shop where the real products and/or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and/or product objects. the one or more computer processors:
The information processing system described in claim 5 is characterized in that it further comprises an order unit that, when a win for the real product is determined by an operation on the lottery object on the first user terminal, or when a real product is ordered on the first user terminal via the shop object and/or the advertising object, transmits information regarding the win or information regarding the order and at least the address information of the first user contained in the user information of the first user to an information processing device of a physical store associated with the lottery object, the shop object and/or the advertising object. The information processing system according to claim 5 or 6, characterized in that the display control unit, when a real product is ordered on the first user terminal via the shop object and/or the advertising object, causes a product object corresponding to the real product to be displayed in the video. An information processing system including one or more computer processors,
the one or more computer processors:
A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis unit that analyzes whether the voice includes a specific word related to a specific item based on the voice information;
a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit;
a determination unit that determines whether the particular item is associated with the first user terminal;
When the determination unit determines that the specific item is associated with the first user terminal,
The display control unit is
Information for making a specific object corresponding to the specific item appear in the video;
Information for highlighting the specific object displayed in the video, and/or
An information processing system that controls the display of the video based on display control information, which is information for displaying a list screen of items associated with the first user terminal, including the specific item. the one or more computer processors:
a determination unit that determines whether the particular item is associated with the first user terminal;
When the determination unit determines that the specific item is not associated with the first user terminal,
The display control unit is
Information for making a lottery object that allows the specific item to be acquired by lottery, a shop object that represents a shop where the specific item can be purchased, or an advertisement object that represents an advertisement related to the specific item appear in the video, and/or
The information processing system described in claim 8, characterized in that the display of the video is controlled based on display control information, which is information for highlighting and displaying the lottery object, the shop object and/or the advertising object displayed in the video. the one or more computer processors:
a determination unit that determines whether the particular item is associated with the first user terminal;
When the determination unit determines that the specific item is not associated with the first user terminal,
The information processing system described in claim 8, characterized in that the display control unit controls the video based on display control information, which is information for making a line to a screen related to a user terminal of another user who has the specific item appear in the video. An information processing system including one or more computer processors,
the one or more computer processors:
A receiving unit that receives voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission unit that transmits information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis unit that analyzes whether the voice includes a specific word based on the voice information;
a display control unit that controls display of the video based on display control information associated with a specific word included in the audio according to a result of the analysis by the analysis unit;
the specific word is a word contained in a specific text displayed in the video,
The display control unit highlights the specific text,
The specific text is a comment posted from the first user terminal or the second user terminal, or a system comment;
An information processing system in which the highlighting includes displaying an object related to the character object of the user who posted the comment. The information processing system according to claims 1, 2, 4, 5, 8 and 11, characterized in that the video displays a character object of the first user and a virtual space in which the character object can move. If the second user terminal is associated with the first user terminal,
At least a portion of the virtual space is shared with a second user terminal;
The information processing system according to claim 12 , wherein an effect of the control of the display of the video by the display control unit extends to both the first user terminal and the second user terminal. if the second user terminal is not associated with the first user terminal,
At least a portion of the virtual space is shared with a second user terminal,
The information processing system according to claim 13 , wherein the effect of the control of the display of the video by the display control unit extends to only one of the first user terminal and the second user terminal. the one or more computer processors:
The information processing system according to claim 1 , further comprising a setting unit capable of setting whether or not to control the display of the moving image in accordance with the result of the analysis by the analysis unit. The information processing system according to claims 1, 2, 4, 5, 8 and 11, characterized in that the first user is a distribution user and the second user is one or more viewing users. The information processing system according to claims 1, 2, 4, 5, 8 and 11, characterized in that the specific word is set based on an operation of the first user terminal. The receiving unit receives motion information regarding a motion of the first user transmitted from the first user terminal;
12. The information processing system according to claim 1, wherein the video includes a character object of the first user that moves based on the motion information. one or more computer processors,
a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis step of analyzing whether the voice includes a specific word based on the voice information;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step;
The specific word is a word related to an action requiring an operation on the first user terminal,
An information processing method in which the display control information is information for making an operation object corresponding to the action appear on the video or the screen of the first user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the first user terminal, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device;
a receiving step of receiving information for displaying a video related to the first user from the server device;
a display control step of controlling display of the video based on display control information associated with the specific word included in the voice in response to a result of analyzing whether the voice includes a specific word based on the voice information;
the specific word is a word related to an action requiring an operation by the first user;
An information processing method in which the display control information is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
a transmitting function for transmitting voice information relating to at least the voice of the first user to the server device;
a receiving function for receiving information for displaying a video related to the first user from the server device;
a display control function that controls display of the video based on display control information associated with the specific word included in the audio, according to a result of analyzing whether the audio includes a specific word based on the audio information;
the specific word is a word related to an action requiring an operation by the first user;
The display control information is a computer program that is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
a receiving step of receiving information for displaying a moving image related to a first user from a server device;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of analyzing whether the voice includes a specific word based on voice information related to at least the voice of the first user;
the specific word is a word related to an action requiring an operation by the first user;
An information processing method in which the display control information is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
A receiving function of receiving information for displaying a video related to a first user from a server device;
a display control function for controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user;
the specific word is a word related to an action requiring an operation by the first user;
The display control information is a computer program that is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
a transmitting step of transmitting information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis step of analyzing whether the voice includes a specific word based on the voice information;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step;
The specific word is a word related to an action requiring an operation on the second user terminal,
An information processing method in which the display control information is information for making an operation object corresponding to the action appear on the video or the screen of the second user terminal, for highlighting an operation object corresponding to the action displayed on the video or the screen of the second user terminal, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device;
a receiving step of receiving information for displaying a video related to the first user from the server device;
a display control step of controlling display of the video based on display control information associated with the specific word included in the voice in response to a result of analyzing whether the voice includes a specific word based on the voice information;
The specific word is a word related to an action requiring an operation of a second user on a second user terminal of a second user,
An information processing method in which the display control information is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
a transmitting function for transmitting voice information relating to at least the voice of the first user to the server device;
a receiving function for receiving information for displaying a video related to the first user from the server device;
a display control function that controls display of the video based on display control information associated with the specific word included in the audio in response to a result of analyzing whether the audio includes a specific word based on the audio information;
The specific word is a word related to an action requiring an operation of a second user on a second user terminal of a second user,
The display control information is a computer program that is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
a receiving step of receiving information for displaying a moving image related to a first user from a server device;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of analyzing whether the voice includes a specific word based on voice information related to at least the voice of the first user;
The specific word is a word related to an action requiring an operation of a second user on a second user terminal of a second user,
An information processing method in which the display control information is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
A receiving function of receiving information for displaying a video related to a first user from a server device;
a display control function for controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user;
The specific word is a word related to an action requiring an operation of a second user on a second user terminal of a second user,
The display control information is a computer program that is information for making an operation object corresponding to the action appear in the video or screen, for highlighting an operation object corresponding to the action displayed in the video or screen, and/or for displaying an operation screen corresponding to the action. one or more computer processors,
a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis step of analyzing whether the voice includes a specific word based on the voice information;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step;
In the display control step,
When the specific word is a word related to an action requiring an operation on the first user terminal, controlling the display of the video on the first user terminal and the second user terminal;
An information processing method that controls the display of the video only in the video displayed on the second user terminal when the specific word is a word related to an action requiring an operation on the second user terminal. one or more computer processors,
a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device;
a receiving step of receiving information for displaying a video related to the first user from the server device;
a display control step of controlling display of the video based on display control information associated with the specific word included in the voice in response to a result of analyzing whether the voice includes a specific word based on the voice information;
In the display control step,
When the specific word is a word related to an action requiring an operation on a first user terminal of a first user, controlling display of the video on the first user terminal and the second user terminal of a second user;
An information processing method in which, when the specific word is a word related to an action requiring an operation on the second user terminal, the display of the video is controlled only in the video displayed on the second user terminal. one or more computer processors,
a transmitting function for transmitting voice information relating to at least the voice of the first user to the server device;
a receiving function for receiving information for displaying a video related to the first user from the server device;
a display control function that controls display of the video based on display control information associated with the specific word included in the audio, according to a result of analyzing whether the audio includes a specific word based on the audio information;
The display control function includes:
When the specific word is a word related to an action requiring an operation on a first user terminal of a first user, controlling display of the video on the first user terminal and the second user terminal of a second user;
A computer program that controls the display of the video only in the video displayed on the second user terminal when the specific word is a word related to an action requiring an operation on the second user terminal. one or more computer processors,
a receiving step of receiving information for displaying a moving image related to a first user from a server device;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of analyzing whether the voice includes a specific word based on voice information related to at least the voice of the first user;
In the display control step,
When the specific word is a word related to an action requiring an operation on a first user terminal of a first user, controlling display of the video on the first user terminal and the second user terminal of a second user;
An information processing method in which, when the specific word is a word related to an action requiring an operation on the second user terminal, the display of the video is controlled only in the video displayed on the second user terminal. one or more computer processors,
A receiving function of receiving information for displaying a video related to a first user from a server device;
a display control function for controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user;
The display control function includes:
When the specific word is a word related to an action requiring an operation on a first user terminal of a first user, controlling display of the video on the first user terminal and the second user terminal of a second user;
A computer program that controls the display of the video only in the video displayed on the second user terminal when the specific word is a word related to an action requiring an operation on the second user terminal. one or more computer processors,
a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis step of analyzing whether the voice includes a specific word based on the voice information;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step;
the particular word is a word associated with the request;
the display control information is information for making an object associated with the request appear in the video and/or information for highlighting the object displayed in the video,
An information processing method in which the object associated with the request is a lottery object that allows real products and/or product objects to be obtained by lottery, a shop object that represents a shop where the real products and/or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and/or product objects. one or more computer processors,
a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device;
a receiving step of receiving information for displaying a video related to the first user from the server device;
a display control step of controlling display of the video based on display control information associated with the specific word included in the voice in response to a result of analyzing whether the voice includes a specific word based on the voice information;
the particular word is a word associated with the request;
the display control information is information for making an object associated with the request appear in the video and/or information for highlighting the object displayed in the video,
An information processing method in which the object associated with the request is a lottery object that allows real products and/or product objects to be obtained by lottery, a shop object that represents a shop where the real products and/or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and/or product objects. one or more computer processors,
a transmitting function for transmitting voice information relating to at least the voice of the first user to the server device;
a receiving function for receiving information for displaying a video related to the first user from the server device;
a display control function that controls display of the video based on display control information associated with the specific word included in the audio in response to a result of analyzing whether the audio includes a specific word based on the audio information;
the particular word is a word associated with the request;
the display control information is information for making an object associated with the request appear in the video and/or information for highlighting the object displayed in the video,
A computer program in which the object associated with the request is a lottery object that allows real products and/or product objects to be obtained by lottery, a shop object that represents a shop where the real products and/or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and/or product objects. one or more computer processors,
a receiving step of receiving information for displaying a moving image related to a first user from a server device;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of analyzing whether the voice includes a specific word based on voice information related to at least the voice of the first user;
the particular word is a word associated with the request;
the display control information is information for making an object associated with the request appear in the video and/or information for highlighting the object displayed in the video,
An information processing method in which the object associated with the request is a lottery object that allows real products and/or product objects to be obtained by lottery, a shop object that represents a shop where the real products and/or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and/or product objects. one or more computer processors,
A receiving function of receiving information for displaying a video related to a first user from a server device;
a display control function for controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user;
the particular word is a word associated with the request;
the display control information is information for making an object associated with the request appear in the video and/or information for highlighting the object displayed in the video,
A computer program in which the object associated with the request is a lottery object that allows real products and/or product objects to be obtained by lottery, a shop object that represents a shop where the real products and/or product objects can be purchased, or an advertising object for representing an advertisement relating to the real products and/or product objects. one or more computer processors,
a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analyzing step of analyzing whether the voice includes a specific word associated with a specific item based on the voice information;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step;
determining whether the particular item is associated with the first user terminal;
When it is determined in the determining step that the specific item is associated with the first user terminal,
In the display control step,
Information for making a specific object corresponding to the specific item appear in the video;
Information for highlighting the specific object displayed in the video, and/or
An information processing method for controlling the display of the video based on display control information, which is information for displaying a list screen of items associated with the first user terminal, including the specific item. one or more computer processors,
a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device;
a receiving step of receiving information for displaying a video related to the first user from the server device;
a display control step of controlling display of the video based on display control information associated with a specific word included in the audio, according to a result of analyzing whether the audio includes a specific word related to a specific item based on the audio information;
determining whether the particular item is associated with a first user terminal of the first user ;
When it is determined in the determining step that the specific item is associated with the first user terminal,
In the display control step,
Information for making a specific object corresponding to the specific item appear in the video;
Information for highlighting the specific object displayed in the video, and/or
An information processing method for controlling the display of the video based on display control information, which is information for displaying a list screen of items associated with the first user terminal, including the specific item. one or more computer processors,
a transmitting function for transmitting voice information relating to at least the voice of the first user to the server device;
a receiving function for receiving information for displaying a video related to the first user from the server device;
a display control function that controls display of the video based on display control information associated with a specific word included in the audio, according to a result of analyzing whether the audio includes a specific word related to a specific item based on the audio information;
a determining function for determining whether the particular item is associated with a first user terminal of the first user ;
When the determining function determines that the particular item is associated with the first user terminal,
The display control function includes:
Information for making a specific object corresponding to the specific item appear in the video;
Information for highlighting the specific object displayed in the video, and/or
A computer program that controls the display of the video based on display control information, which is information for displaying a list screen of items associated with the first user terminal, including the specific item. one or more computer processors,
a receiving step of receiving information for displaying a moving image related to a first user from a server device;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of analyzing whether the voice includes a specific word related to a specific item based on voice information related to at least the voice of the first user;
determining whether the particular item is associated with a first user terminal of the first user ;
When it is determined in the determining step that the specific item is associated with the first user terminal,
In the display control step,
Information for making a specific object corresponding to the specific item appear in the video;
Information for highlighting the specific object displayed in the video, and/or
An information processing method for controlling the display of the video based on display control information, which is information for displaying a list screen of items associated with the first user terminal, including the specific item. one or more computer processors,
A receiving function of receiving information for displaying a video related to a first user from a server device;
a display control function that controls display of the video based on display control information associated with a specific word related to a specific item included in the voice, in response to a result of analyzing whether the voice includes a specific word based on voice information related to at least the voice of the first user;
a determining function for determining whether the particular item is associated with a first user terminal of the first user ;
When the determining function determines that the particular item is associated with the first user terminal,
The display control function includes:
Information for making a specific object corresponding to a specific item appear in the video;
Information for highlighting the specific object displayed in the video, and/or
A computer program that controls the display of the video based on display control information, which is information for displaying a list screen of items associated with the first user terminal, including the specific item. one or more computer processors,
a receiving step of receiving voice information related to at least the voice of a first user, the voice information being transmitted from a first user terminal of the first user;
A transmission step of transmitting information for displaying a video related to the first user on the first user terminal and/or a second user terminal of a second user to the first user terminal and/or the second user terminal;
an analysis step of analyzing whether the voice includes a specific word based on the voice information;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice according to a result of the analysis in the analysis step;
the specific word is a word contained in a specific text displayed in the video,
In the display control step, the specific text is highlighted,
The specific text is a comment posted from the first user terminal or the second user terminal, or a system comment;
The information processing method, wherein the highlighting includes displaying an object related to a character object of the user who posted the comment. one or more computer processors,
a transmitting step of transmitting voice information relating to at least the voice of the first user to a server device;
a receiving step of receiving information for displaying a video related to the first user from the server device;
a display control step of controlling display of the video based on display control information associated with the specific word included in the voice in response to a result of analyzing whether the voice includes a specific word based on the voice information;
the specific word is a word contained in a specific text displayed in the video,
In the display control step, the specific text is highlighted,
The specific text is a comment posted from a first user terminal of the first user or a second user terminal of a second user, or a system comment;
The information processing method, wherein the highlighting includes displaying an object related to a character object of the user who posted the comment. one or more computer processors,
a transmitting function for transmitting voice information relating to at least the voice of the first user to the server device;
a receiving function for receiving information for displaying a video related to the first user from the server device;
a display control function that controls display of the video based on display control information associated with the specific word included in the audio, according to a result of analyzing whether the audio includes a specific word based on the audio information;
the specific word is a word contained in a specific text displayed in the video,
The display control function highlights the particular text;
The specific text is a comment posted from a first user terminal of the first user or a second user terminal of a second user, or a system comment;
The highlighting includes displaying an object related to the character object of the user who posted the comment. one or more computer processors,
a receiving step of receiving information for displaying a moving image related to a first user from a server device;
a display control step of controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of analyzing whether the voice includes a specific word based on voice information related to at least the voice of the first user;
the specific word is a word contained in a specific text displayed in the video,
In the display control step, the specific text is highlighted,
The specific text is a comment posted from a first user terminal of the first user or a second user terminal of a second user, or a system comment;
The information processing method, wherein the highlighting includes displaying an object related to a character object of the user who posted the comment. one or more computer processors,
A receiving function of receiving information for displaying a video related to a first user from a server device;
a display control function for controlling display of the video based on display control information associated with a specific word included in the voice, in response to a result of an analysis of whether the voice includes a specific word based on voice information related to at least the voice of the first user;
the specific word is a word contained in a specific text displayed in the video,
The display control function highlights the particular text;
The specific text is a comment posted from a first user terminal of the first user or a second user terminal of a second user, or a system comment;
The highlighting includes displaying an object related to the character object of the user who posted the comment.

Images