JP7526401B2 - Computer program, method, and server device - Google Patents

Description

The technology disclosed herein relates to a computer program, method, and server device used to distribute game-related videos from a distributor's terminal to each viewer's terminal.

A service called Mirrativ (Non-Patent Document 1) is known as a service used to distribute game-related videos from a distributor's terminal to each viewer's terminal.

In this service, a distributor can use a terminal to distribute to multiple viewers' terminals videos including avatar animations generated based on motion data related to the distributor's movements, and video related to a game generated based on operation data related to the distributor's operations. Non-Patent Document 1 is incorporated herein in its entirety by reference.

"Mirrativ", [online], August 16, 2019, Mirrativ, Inc., [Retrieved December 23, 2019], Internet (https://apps.apple.com/jp/app/mirrativ-Mirrativ-Simple-Game-Distribution-on-Smartphone/id1028944599)

Assuming that a video is streamed in which the avatars of multiple streamers (e.g., a first streamer and a second streamer) appear together or in which the multiple streamers play a game together, the number of viewers may be greater when the first streamer streams together with the second streamer than when the first streamer streams alone. In this case, if the second streamer who streams together with the first streamer stops streaming and leaves, the number of viewers may decrease due to the impact of the departure, and if the first streamer later streams a game, the interest of the game may be diminished. Therefore, it is desirable to have a configuration that does not diminish the interest of the game that will be streamed later by the first streamer as much as possible, even if the second streamer who streams together with the first streamer stops streaming and leaves.

Therefore, this disclosure provides a computer program, method, and server device that reduces the possibility of losing the interest of the game.

A computer program according to one embodiment causes the processor to function to: distribute a first video including motion data related to the motion of a first distributor or an animation of an avatar of the first distributor generated based on the motion data; and a second video related to a game generated based on operation data related to the operation of the first distributor using a received web page to a viewer terminal of at least one viewer via a communication line; store first data related to at least one user who has jointly distributed the game with the first distributor before the game is played; determine whether a first condition is met after the first distributor and the at least one user have jointly distributed the game; and, if it is determined that the first condition is met, extract second data related to at least one of the at least one users based on the first data; and, during or after the game is played, change at least one current parameter of the avatar of the first distributor based on the second data; or display the avatar of the first distributor and the avatar of at least one of the at least one users in the second video based on the first data.

The method according to one embodiment includes the steps of: by executing an instruction by a processor, a first video including motion data related to the motion of a first broadcaster or an animation of an avatar of the first broadcaster generated based on the motion data; and a second video related to a game generated based on operation data related to the operation of the first broadcaster using a received webpage, to a viewer terminal of at least one viewer via a communication line; storing first data related to at least one user who broadcasted together with the first broadcaster before the game was played; after the first broadcaster and the at least one user broadcasted together, determining whether a first condition is met; if it is determined that the first condition is met, extracting second data related to at least one of the at least one users based on the first data; and during or after the game is played, changing at least one current parameter of the avatar of the first broadcaster based on the second data, or displaying the avatar of the first broadcaster and the avatar of at least one of the at least one users in the second video based on the second data.

A method according to one aspect includes the steps of: receiving, via a communication line, a first video including motion data related to a motion of a first broadcaster or an animation of an avatar of the first broadcaster generated based on the motion data, and a second video related to a game generated based on operation data related to an operation of the first broadcaster using a received web page, by executing instructions by a processor; determining whether a first condition is satisfied after the first broadcaster and the at least one user have jointly broadcasted, and if it is determined that the first condition is satisfied, receiving a first video in which at least one current parameter of an avatar of the first broadcaster is changed based on second data extracted related to at least one of the at least one users based on first data related to at least one user who jointly broadcasted with the first broadcaster before the game was played, or receiving a second video displaying the avatar of the first broadcaster and an avatar of at least one of the at least one users based on the second data.
including.

In one embodiment, the server device has a processor that transmits a first video including motion data related to the motion of a first broadcaster or an animation of an avatar of the first broadcaster generated based on the motion data, and a second video related to a game generated based on operation data related to the operation of the first broadcaster using a received webpage, to a viewer terminal of at least one viewer via a communication line, stores first data related to at least one user who broadcasted together with the first broadcaster before the game is played, and after the first broadcaster and the at least one user broadcast together, determines whether a first condition is met, and if it is determined that the first condition is met, extracts second data related to at least one of the at least one users based on the first data, and during or after the game is played, changes at least one current parameter of the avatar of the first broadcaster based on the second data, or displays the avatar of the first broadcaster and the avatar of at least one of the at least one users in the second video based on the second data.

In one embodiment, the server device transmits a webpage including a computer program to a broadcaster terminal of a broadcaster configured to broadcast a first video including motion data related to the motion of a first broadcaster or an animation of an avatar of the first broadcaster generated based on the motion data, and a second video related to a game generated based on operation data related to the operation of the first broadcaster using the received webpage to a viewer terminal of at least one viewer via a communication line, and the computer program transmits the broadcaster terminal of the first broadcaster to at least one viewer terminal of the viewer who jointly broadcast the game with the first broadcaster prior to the execution of the game. The processor is caused to function to store first data related to users, determine whether a first condition is met after the first broadcaster and the at least one user have jointly broadcast, and if it is determined that the first condition is met, extract second data related to at least one of the at least one users based on the first data, and during or after the game is executed, change at least one current parameter of an avatar of the first broadcaster based on the second data, or display an avatar of the first broadcaster and an avatar of at least one of the at least one user in the second video based on the second data.

FIG. 1 is a block diagram showing an example of a configuration of a video distribution system 1 according to an embodiment. FIG. 2 is a block diagram showing an example of a hardware configuration of the terminal 10 (server device 20) shown in FIG. FIG. 3 is a block diagram illustrating an example of functions of the terminal 10 illustrated in FIG. FIG. 4 is a block diagram illustrating an example of the functions of the server device 20 illustrated in FIG. FIG. 5A is a flow diagram showing an example of the operation performed in the video distribution system 1 shown in FIG. FIG. 5B is a flow diagram showing an example of the operation performed in the video distribution system 1 shown in FIG.

Various embodiments of the present disclosure will now be described with reference to the accompanying drawings. Note that common components in the drawings are given the same reference numerals. It should also be noted that components depicted in one drawing may be omitted in another drawing for ease of explanation. It should also be noted that the accompanying drawings are not necessarily drawn to scale.

1. Configuration of a video distribution system In brief, the video distribution system of the present disclosure enables a user who distributes videos (hereinafter referred to as a "distributor") to distribute, via a communication line, a first video including an animation of an avatar (avatar object) generated based on motion data related to the distributor's motion, and a second video related to a game generated based on operation data related to the distributor's operation, to a terminal of a user who watches the video (hereinafter referred to as a "viewer"). The first example will be described below with reference to Figures 1 to 5B.

FIG. 1 is a block diagram showing an example of the configuration of a video distribution system according to an embodiment. As shown in FIG. 1, the video distribution system 1 can include a plurality of terminals 10 connected to a communication line (communication network) not shown, and one or more server devices 20 connected to the communication line. Each terminal 10 can be connected to one or more server devices 20 via the communication line.

In FIG. 1, for example, the first distributor terminal 11A, the second distributor terminal 11B, the viewer terminal 12A, the viewer terminal 12B, and the viewer terminal 12C are shown as multiple terminals 10, but one or more other terminals 10 may be used in the same way. In the following description, the first distributor terminal 11A and the second distributor terminal 11B may be collectively referred to as distributor terminals 11, and the viewer terminals 12A to 12C may be collectively referred to as viewer terminals 12. In FIG. 1, for example, the server devices 20A and 20B are shown as one or more server devices 20, but one or more other server devices 20 may be used in the same way. In addition, communication lines not shown in the figure may include, but are not limited to, a mobile phone network, a wireless LAN, a fixed telephone network, the Internet, an intranet, and/or Ethernet (registered trademark), etc.

Furthermore, in one embodiment, the video distribution system 1 may also include one or more studio units 30 connected to a communication network. Each studio unit 30 may be connected to one or more server devices 20 or multiple terminals 10 via a communication line. Note that, while FIG. 1 shows, for example, studio units 30A and 30B as the one or more studio units 30, one or more studio units 30 other than these may be used in the same manner. Each studio unit 30 may have the same functions as the terminal 10 or server device 20 described below.

In the following, for simplicity of explanation, attention will be focused on the case where one or more server devices 20 transmit and receive videos, etc. between each terminal 10. Alternatively or in addition to this, it is also possible for one or more server devices 20 to transmit and receive videos, etc. between each studio unit 30, as described below. Furthermore, instead or in addition to this, it is also possible for the studio unit 30 to transmit and receive videos, etc. between each terminal 10, as described below.

1-1. Terminal 10
The multiple terminals 10 may include, for example, multiple broadcaster terminals 11 (e.g., a first broadcaster terminal 11A and a second broadcaster terminal 11B) and one or more viewer terminals 12 (e.g., viewer terminals 12A to 12C). The broadcaster corresponding to the first broadcaster terminal 11A is referred to as the first broadcaster, and the broadcaster corresponding to the second broadcaster terminal 11B is referred to as the second broadcaster. In the following description, when the first broadcaster terminal 11A of the multiple broadcaster terminals 11 is broadcasting a game by itself, the second broadcaster terminal 11B does not need to function as a terminal that broadcasts a game, and may function in the same manner as the viewer terminal 12, for example.

Each terminal 10 has a common configuration and can function as either a terminal for distributing videos (distributor terminal 11) or a terminal for viewing videos (viewer terminal 12).

When each terminal 10 operates as a terminal for distributing videos (distributor's terminal), it executes an installed video distribution application (which may be middleware or a combination of an application and middleware; the same applies below) to acquire motion data related to the distributor's motion, and transmits a first video including an animation of a virtual character (avatar object) changed according to the acquired data to the server device 20 (distribution server system 20A1) via a communication line. Such a first video is distributed by the server device 20 (distribution server system 20A1) via a communication line to a terminal for receiving videos (viewer terminal) 12. Such a viewer terminal 12 can receive the video by executing an installed video viewing application (which may be middleware or a combination of an application and middleware; the same applies below).

When each terminal 10 operates as a distributor's terminal, it can receive a web page (HTML document) from the server device 20 (web server system 20B) and execute a game program included in the web page by executing a browser function built into the installed video distribution application and/or by executing an installed web browser application. By executing this game program, each terminal 10 can generate a second video in which at least one game object is operated based on operation data related to the distributor's operation.

Furthermore, when each terminal 10 operates as a distributor's terminal, it can transmit the second video thus generated to the server device 20 (distribution server system 20A) via a communication line by executing the video distribution application. Such a second video is also distributed by the server device 20 (distribution server system 20A) via a communication line to a terminal (viewer terminal) 10 for receiving videos that executes an installed video viewing application.

Furthermore, when each terminal 10 operates as a distributor's terminal, it can execute the video distribution application to receive, via the server device 20 (distribution server system 20A), gift information indicating that a gift will be given to the distributor and/or comment information indicating that a comment will be sent to the distributor from the viewer terminal 12 viewing the second video (distributed by this distributor terminal 11).

On the other hand, when each terminal 10 operates as a terminal for watching videos (viewer terminal), it can receive the first video and/or the second video distributed by the distributor terminal 11 via the server device 20 (distribution server system 20A) by executing the installed video viewing application.

Furthermore, when each terminal 10 operates as a viewer terminal, it can execute a video viewing application to transmit gift information indicating that a gift will be given to the broadcaster and/or comment information indicating that a comment will be sent to the broadcaster to the first broadcaster terminal 11A via the server device 20 (distribution server system 20A).

The video distribution application and video viewing application described above can be installed and executed on each terminal 10 as a single integrated application or as separate applications.

Each terminal 10 is any terminal capable of performing such operations, and may include, but is not limited to, a smartphone, a tablet, a mobile phone (feature phone), and/or a personal computer. In addition, each terminal 10 is configured to be capable of performing, for example, collaborative distribution (joint distribution or collaborative distribution).

In the following description, a collaborative broadcast is, for example, a broadcast conducted by multiple broadcasters working together using their own terminals. The collaborative broadcast can include, for example, a video broadcast using an avatar of a first broadcaster and an avatar of another broadcaster, and a game broadcast conducted by a first broadcaster and another broadcaster. The game broadcasted by the game broadcast is, for example, a live-streamed game (live game). In a game broadcasted by a collaborative broadcast, users who broadcast and/or watch the game can input operation information and/or voice into their own terminal 10, and transmit the input information to the terminal 10 operated by the other user, enabling the users to communicate with each other.

In addition, when a collaborative broadcast is performed, for example, each of the multiple broadcasters can be treated separately. For example, one of the multiple broadcasters can be treated as, for example, a host broadcaster, and the remaining broadcasters can be treated as, for example, guests. Specifically, for example, when two broadcasters (a first broadcaster and a second broadcaster) perform a collaborative broadcast, the first broadcaster can be treated as a host broadcaster, and the second broadcaster can be treated as a guest. In this case, when the collaborative broadcast ends, the first broadcaster continues the broadcast, and the second broadcaster can no longer continue the broadcast. Note that, in the case where the second broadcaster is no longer able to continue the broadcast, for example, the broadcast can be configured to be viewed as a viewer.

In addition, when multiple broadcasters are treated separately, for example, the display content displayed on the display screen of the device operated by the host broadcaster may be configured to be different from the display content displayed on the display screen of the device operated by the guest. In addition, when multiple broadcasters are treated separately, for example, the host broadcaster may be configured to have more commands that can be operated than the guests.

The above describes an example in which multiple broadcasters are treated separately when performing collaborative broadcasting, but the present invention is not limited to this example, and multiple broadcasters may be configured to be treated without distinction when performing collaborative broadcasting.

1-2. Server device 20
As shown in FIG. 1, the server device 20 includes, for example, a distribution server system 20A and a web server system 20B.

The distribution server system 20A can distribute the first video and/or the second video transmitted by each terminal (each broadcaster terminal) 10 to each terminal (each viewer terminal) 10. The distribution server system 20A can also transmit to the broadcaster terminal 11 gift information transmitted by each terminal (each viewer terminal) 10 indicating that a gift will be given to a certain broadcaster and/or comment information indicating that a comment will be sent to a certain broadcaster.

To perform such operations, in one embodiment, the distribution server system 20A may include a distribution server device 20A1, a database (DB) server device 20A2, a game API server device 20A3, and a collaboration server device 20A4, which are connected to each other via communication lines (including wireless lines and/or wired lines not shown).

The distribution server device 20A1 can distribute the first video and/or the second video transmitted by each distributor terminal 11 to each terminal 10. Furthermore, the distribution server device 20A1 can store the gift information and/or the comment information transmitted by each viewer terminal 12 in the DB server device 20A2.

The DB server device 20A2 stores the gift information and/or comment information received from the distribution server device 20A1, and can read and transmit to the game API server device 20A3 the gift information and/or comment information queried by the game API server device 20A3.

When the game API server device 20A3 receives an inquiry about gift information and/or comment information from each broadcaster terminal 11, it can read the gift information and/or comment information for the broadcaster terminal 11 from the DB server device 20A2 and transmit it to the broadcaster terminal 11. In addition, in order to determine a user to perform a collaborative broadcast, the game API server device 20A3 obtains information on candidate users other than the first broadcaster and stores it in the DB server device 20A2. Here, "candidate users other than the first broadcaster" are, for example, the second broadcaster or a viewer.

The collaboration server device 20A4 (collaboration server device 20A4) communicates, for example, audio data and/or motion data with each terminal 10 during collaboration distribution. For example, during collaboration distribution, if a first broadcaster makes a sound to the first broadcaster terminal 11A, the collaboration server device 20A4 receives data related to the sound from the first broadcaster terminal 11A and transmits the data related to the sound to the second broadcaster terminal 11B and/or the viewer terminal 12. Also, for example, during collaboration distribution, if a second broadcaster makes a sound to the second broadcaster terminal 11B, the collaboration server device 20A4 receives data related to the sound from the second broadcaster terminal 11B and transmits the data related to the sound to the first broadcaster terminal 11A and/or the viewer terminal 12.

In the example shown in FIG. 1, for the purpose of distributing the load, etc., the distribution server system 20A is shown to have four server devices, including a distribution server device 20A1, a DB server device 20A2, a game API server device 20A3, and a collaboration server device 20A4. However, at least one of these four server devices may be integrated with at least one of the remaining server devices.

As shown in FIG. 1, the web server system 20B includes, for example, a game server device 20B1 and a content server device 20B2.

The game server device 20B1 transmits a web page (HTML, for example, a document created according to HTML5) incorporating a game program to each accessing distributor terminal 11. This game program enables the terminal 10 that receives and decodes the game program to execute various operations related to video distribution, including the operations exemplified in (a) to (c) below.
(a) An operation of executing a game; (b) An operation of transmitting a game screen generated in association with the execution of the game to the distribution server system 20A (distribution server device 20A1); and (c) an operation of acquiring gift information and/or comment information transmitted to this distributor from the distribution server system 20A (game API server device 20A3).

For example, when a game is distributed through collaborative distribution, the game server device 20B1 manages operation information in the game and performs calculations of game logic. Furthermore, for example, when a game is distributed through collaborative distribution, the game server device 20B1 transmits and receives game operation information and/or calculation information to and from terminals 10 operated by users who distribute and/or watch the game. During collaborative distribution, the game server device 20B1 stores data related to the second distributor and/or viewers of the game distributed through collaborative distribution. The data stored by the game server device 20B1 can be used to determine the content of a specified process in S324 described below.

The content server device 20B2 is a device that stores, for example, data related to a game (e.g., live game content) and provides game drawing data to a terminal 10 operated by a user who broadcasts and/or watches the game.

1-3. Studio Unit 30
The studio unit 30 may be placed in a studio, room, hall, or the like where a performer (distributor) distributes a video. As described above, the studio unit 30 is capable of performing the same functions as the terminal 10 and/or the server device 20. In Fig. 1, the dashed lines indicate that data can be communicated between the studio unit 30 and other devices, and the solid lines indicate that data can be communicated between other devices.

2. Hardware Configuration of Each Device Next, an example of the hardware configuration of each of the terminal 10, the server device 20, and the studio unit 30 will be described.

2-1. Hardware Configuration of Terminal 10 An example of the hardware configuration of each terminal 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing a schematic example of the hardware configuration of the terminal 10 (server device 20) shown in Fig. 1 (note that in Fig. 2, the reference numerals in parentheses are those described in relation to the server device 20, as described later).

As shown in FIG. 2, each terminal 10 can mainly include a central processing unit 14, a main memory device 15, an input/output interface device 16, an input device 17, an auxiliary memory device 18, and an output device 19. These devices are connected to each other by a data bus and/or a control bus.

The central processing unit 14 is referred to as a "CPU" and performs calculations on the instructions and data stored in the main memory 15, and stores the results of the calculations in the main memory 15. Furthermore, the central processing unit 14 can control an input device 17, an auxiliary memory device 18, an output device 19, and the like via an input/output interface device 16. The terminal 10 can include one or more such central processing units 14.

The main memory device 15 is also referred to as "memory" and stores instructions and data received from the input device 17, the auxiliary memory device 18, and the communication line 30 (such as the server device 20) via the input/output interface device 16, as well as the results of calculations by the central processing unit 14. The main memory device 15 can include, but is not limited to, RAM (random access memory), ROM (read only memory), and/or flash memory.

The auxiliary storage device 18 is a storage device with a larger capacity than the main storage device 15. It can store the instructions and data (computer programs) that constitute the specific applications (video distribution applications, video viewing applications, etc.) and web browser applications described above. Furthermore, the auxiliary storage device 18 can transmit these instructions and data (computer programs) to the main storage device 15 via the input/output interface device 16 by being controlled by the central processing unit 14. The auxiliary storage device 18 can include, without being limited to, a magnetic disk device and/or an optical disk device, etc.

The input device 17 is a device that inputs data from the outside, and includes, but is not limited to, a touch panel, a button, a keyboard, a mouse, and/or a sensor. The sensor can include, but is not limited to, one or more cameras, etc. and/or one or more microphones, etc., as described below.

The output device 19 may include, but is not limited to, a display device, a touch panel, and/or a printer device.

In this hardware configuration, the central processing unit 14 sequentially loads the instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 18 into the main storage device 15, and by calculating the loaded instructions and data, it is possible to control the output device 19 via the input/output interface device 16, or to send and receive various information to and from other devices (such as a server device 20, other terminals 10 and/or a studio unit 30, etc.) via the input/output interface device 16 and the communication line 2.

As a result, the terminal 10 can execute at least one of the following operations (a) to (d) by executing the installed specific application.
(a) Operations necessary for distributing the first video and/or the second video; (b) Operations necessary for receiving gift information and/or comment information sent to the terminal 10 by another terminal 10; (c) Operations necessary for receiving the first video and/or the second video distributed by the other terminal 10; (d) Operations necessary for transmitting gift information and/or comment information to the other terminal 10.

In addition, the terminal 10 may include one or more microprocessors and/or a graphics processing unit (GPU) instead of or in addition to the central processing unit 14.

2-2. Hardware configuration of server device 20 An example of the hardware configuration of each server device 20 will be described with reference to Fig. 2. The hardware configuration of each server device 20 (distribution server device 20A1, DB server device 20A2, game API server device 20A3, game server device 20B1, and content server device 20B2) may be the same as the hardware configuration of each terminal 10 described above. Therefore, reference characters for the components of each server device 20 are shown in parentheses in Fig. 2.

As shown in FIG. 2, each server device 20 can mainly include a central processing unit 24, a main memory device 25, an input/output interface device 26, an input device 27, an auxiliary memory device 28, and an output device 29. These devices are connected to each other by a data bus and/or a control bus.

The central processing unit 24, main memory device 25, input/output interface device 26, input device 27, auxiliary memory device 28, and output device 29 can be substantially the same as the central processing unit 14, main memory device 15, input/output interface device 16, input device 17, auxiliary memory device 18, and output device 19 included in each of the above-mentioned terminals 10, respectively.

In this hardware configuration, the central processing unit 24 sequentially loads the instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 28 into the main storage device 25, and by calculating the loaded instructions and data, it is possible to control the output device 29 via the input/output interface device 26, or to send and receive various information to and from other devices (such as each terminal 10 and/or studio unit 30, etc.) via the input/output interface device 26 and the communication line 2.

This allows the server device 20 to perform operations necessary to distribute the first video and/or the second video transmitted by each broadcaster terminal 11 to each viewer terminal 12, operations necessary to transmit gift information and/or comment information transmitted by each viewer terminal 12 to a certain broadcaster terminal 11, etc. (including various operations described in detail later).

In addition, the server device 20 may include one or more microprocessors and/or a graphics processing unit (GPU) instead of or in addition to the central processing unit 24.

2-3. Hardware Configuration of Studio Unit 30 As described above, the studio unit 30 is capable of performing the same functions as the terminal 10 and/or the server device 20. Therefore, the studio unit 30 can have the same hardware configuration as the terminal 10 or the server device 20 described above.

3. Functions of Each Device Next, an example of the functions of each of the terminal 10, the server device 20, and the studio unit 30 will be described.

3-1. Functions of the Terminal 10 An example of functions of the terminal 10 will be described with reference to Fig. 3. Fig. 3 is a block diagram that illustrates an example of functions of the terminal 10 shown in Fig. 1.

As shown in FIG. 3, the terminal 10 may mainly include a first video generation unit 100, a second video generation unit 110, a communication unit 120, a display unit 130, a memory unit 140, a user interface unit 150, and a gift processing unit 160.

(1) First moving image generator 100
The first moving image generating unit 100 can generate a first moving image including an animation of an avatar object of a distributor based on the motion data related to the motion of the distributor. To achieve this, the first moving image generating unit 100 can include, for example, an acquiring unit 102 and a processing unit 104.

The acquisition unit 102 may include one or more first sensors 102a (not shown) that acquire data related to the broadcaster's body, and one or more second sensors 102b (not shown) that acquire audio data related to speaking and/or singing uttered by the broadcaster.

In a preferred embodiment, the first sensor 102a may include an RGB camera for capturing visible light and a near-infrared camera for capturing near-infrared light. Such a camera may be, for example, the True Depth camera included in the iPhone X. The second sensor 102b may include a microphone for recording audio.

First, regarding the first sensor 102a, the acquisition unit 102 captures an image of the body of the distributor using the first sensor 102a placed close to the body of the distributor. This allows the acquisition unit 102 to generate data (e.g., an MPEG file) in which the images acquired by the RGB camera are associated with a time code (a code indicating the time of acquisition) and recorded over a unit time. Furthermore, the acquisition unit 102 can generate data (e.g., a TSV file) in which a predetermined number (e.g., 51) of numerical values (e.g., floating-point numerical values) indicating depths acquired by the near-infrared camera are associated with the time code and recorded over a unit time. Note that a TSV file is a file format in which multiple pieces of data are recorded with tabs separating the data.

With regard to the near-infrared camera, specifically, a dot projector emits an infrared laser that forms a dot pattern onto the body of the performer, and the near-infrared camera captures the infrared dots projected onto and reflected from the performer's body, generating an image of the infrared dots thus captured. The acquisition unit 102 compares a pre-registered image of the dot pattern emitted by the dot projector with an image captured by the near-infrared camera, and can calculate the depth of each point (feature point) (the distance between each point/feature point and the near-infrared camera) using the positional deviation of each point (feature point) (e.g., each of 51 points/feature points) in both images. The acquisition unit 102 can generate data in which the numerical values indicating the depth thus calculated are associated with a time code as described above and recorded over a unit time.

Next, regarding the second sensor 102b, the acquisition unit 102 acquires audio related to the speech and/or singing uttered by the distributor using the second sensor 102b arranged in close proximity to the distributor's body. This allows the acquisition unit 100 to generate data (e.g., an MPEG file) recorded over a unit time in association with a time code. In one embodiment, the acquisition unit 102 can acquire audio data related to the speech and/or singing uttered by the distributor using the second sensor 102b at the same time as acquiring data related to the distributor's body using the first sensor 102a. In this case, the acquisition unit 102 can generate data (e.g., an MPEG file) recorded over a unit time in association with the same time code, including the image acquired by the RGB camera and the audio data related to the speech and/or singing uttered by the distributor using the second sensor 102b.

The acquisition unit 102 can output the data generated in this manner related to the distributor's body (MPEG files, TSV files, etc.) and/or audio data related to the speaking and/or singing uttered by the distributor (MPEG files, etc.) to the processing unit 104.

Note that, although the case where the first sensor 102a includes an RGB camera and an infrared camera has been described here, the first sensor 102a may also include, for example, any of the following (A) to (C).
(A) A camera that detects infrared light emitted by an infrared laser and reflected off the performer's face. (B) Multiple RGB cameras that capture visible light. (C) A single camera that captures visible light.

In the above case (A), the acquisition unit 102 can calculate the depth of each feature point on the streamer's body using a method similar to that described above. In the above case (B), the acquisition unit 102 can calculate the depth of each feature point on the streamer's body using multiple images captured by multiple RGB cameras. In the above case (C), the acquisition unit 102 can calculate the depth of each feature point on the streamer's body from images captured by a single camera using deep learning, etc. Also, in the above case (C), the acquisition unit 102 may calculate the depth of each feature point on the performer's body by performing an analysis process (image processing, etc.) on the images captured by a single camera.

The processing unit 104 can generate a video including animation of a virtual character (an avatar object of the broadcaster) based on the data related to the broadcaster's body from the acquisition unit 102. With regard to the video of the virtual character itself, the processing unit 104 can generate the video of the virtual character by having a rendering unit (not shown) perform rendering using various information (e.g., geometry information, bone information, texture information, shader information, blend shape information, etc.) stored in a character data storage unit (not shown).

Furthermore, the processing unit 104 can use data about the distributor's body from the acquisition unit 102 (data about the depth of each feature point on the performer's body) to generate a video in which the facial expression of the avatar object is changed (for example, a video in which the facial expression of the avatar object changes in synchronization with the movement of the performer's mouth and eyes, i.e., a video in which the facial expression of the avatar object changes in lip-sync and eye-tracking to the performer's face) using various well-known techniques.

It is also possible to use any other known technology to generate a first video including animation of the distributor's avatar object based on motion data relating to the distributor's movements.

(2) Second moving image generator 110
The second moving image generating unit 110 can generate a second moving image related to the game based on operation data related to the distributor's operation, using the web page received from the web server system 20B.

Specifically, the second video generation unit 110 executes a game program embedded in a web page received from the web server system 20B. This enables the second video generation unit 110 to render a second video (game video) relating to a game in which at least one game object is operating, based on operation data indicating the distributor's operation input by the user interface unit 150.

Furthermore, the second video generation unit 110 can control at least one game object to be displayed in the second video based on gift information generated by the viewer terminal of each viewer watching the second video and transmitted to the user (distributor) of the terminal 10. The gift information is information indicating that a gift is to be given to the distributor.

(3) Communication unit 120
The communication unit 120 can communicate various information required for distribution and/or viewing of videos between the distribution server system 20A and the web server system 20B. For example, when the terminal 10 operates as a distributor terminal 11, the communication unit 120 can access the web server system 20B and receive a web page (HTML document) including a game program required for execution of a game, etc. When the terminal 10 operates as a distributor terminal, the communication unit 120 can transmit the first video and/or the second video to the distribution server system 20A and receive gift information and/or comment information transmitted to the distributor from the distribution server system 20A.

Furthermore, when the terminal 10 operates as a viewer terminal, the communication unit 120 can receive the first video and/or the second video transmitted by the distributor terminal 11 from the distribution server system 20A, and transmit gift information and/or comment information for the distributor to the distribution server system 20A.

(4) Display unit 130
The display unit 130 can display various information required for distribution and/or viewing of videos. For example, the display unit 130 can display the first video and/or the second video to be distributed, and/or the first video and/or the second video received, etc.

(5) Storage unit 140
The storage unit 140 can store various information required for distribution and/or viewing of videos.

(6) User Interface Unit 150
The user interface unit 150 can input various information required for distribution and/or viewing of a video through user operations. For example, the user interface unit 150 can input operation data indicating the content of the distributor's operation when playing a game from the distributor and output the data to the second video generation unit 110.

(7) Gift Processing Unit 160
The gift processing unit 160 can process gift information transmitted and received in relation to the distribution and/or viewing of a video. For example, when the terminal 10 operates as a distributor terminal 11, the gift processing unit 160 can process gift information sent to the distributor. Also, when the terminal 10 operates as a viewer terminal 12, the gift processing unit 160 can process gift information to be sent by the viewer.

3-2. Functions of the Server Device 20 An example of the functions of the server device 20 will be described with reference to Fig. 4. Fig. 4 is a block diagram that illustrates an example of the functions of the server device 20 illustrated in Fig. 1. As illustrated in Fig. 4, the server device 20 includes, for example, a communication unit 200, a storage unit 210, a gift processing unit 220, a determination unit 230, and an extraction unit 240.

(1) Communication unit 200
The communication unit 200 can communicate various information required for distribution and/or viewing of videos between the distributor terminal 11 and/or the viewer terminal 12. For example, when the server device 20 operates as a distribution server system 20A, it can receive the first video and/or the second video from each distributor terminal 11 and distribute it to each viewer terminal 12. When the server device 20 operates as a web server system 20B, it can transmit a web page incorporating a game program to each distributor terminal 11 that has accessed it.

(2) Storage unit 210
The storage unit 210 can store various information required for video distribution and/or viewing. The storage unit 210 stores, for example, data indicating the association between the first broadcaster and other broadcasters and/or viewers. The storage unit 210 stores, for example, data related to the distribution history of collaborative distributions performed by the first broadcaster with other broadcasters. The data stored in the storage unit 210 is updated, for example, every time the terminal 10 performs a distribution and/or views the distribution. Among the data stored in the storage unit 210, data related to at least one user who performed a collaborative distribution with the first broadcaster may be referred to as first data. The first data is, for example, data related to a user who has previously distributed a game together with the first broadcaster and/or a user who has performed video distribution using their own avatar together with the avatar of the first broadcaster.

The data stored in the memory unit 210 includes, for example, information regarding at least one of the following: "collaboration information," "broadcast time/viewing time," "game progress," "match history," "number of followers," "special skills," and "gift information."

"Collaboration information" includes, for example, information indicating parameters of games previously streamed or viewed by other streamers who streamed a game in a collaborative stream with the first streamer. In addition, "collaboration information" may include, for example, information regarding video streaming using the avatar of the first streamer and the avatar of the other streamer. "Streaming time/viewing time" refers to the time that a user operating each terminal 10 streamed or viewed a game in the past. The memory unit 210 stores, for example, the cumulative time that each user streamed and/or viewed each game in the past.

"Game progress" indicates the progress of a game that a distributor has previously distributed. "Match history" indicates, for example, the number of wins, losses, and draws for users who have participated in a game when the game being played is a competitive game. "Match history" may be, for example, a ranking of users who have participated in a game when the game being played is a competitive game. "Match history" may be a score calculated by applying a predetermined weighting to a single win, loss, draw, and ranking, and converting them into a numerical value.

"Number of followers" is the number equivalent to the number of other users who follow a user. The more followers a user has, the more users are interested in that user. "Special skills" refers to skills (special moves) possessed by the distributor's avatar. If the game being played is a fighting game, special skills include, for example, special moves for inflicting damage on the opponent that can be used in the game. Note that the special move inflicts greater damage on the opponent than that of a normal attack, for example. Also, the special move exerts a greater effect than that of a normal attack, for example. The memory unit 210 stores, for example, the name of the special skill, the conditions for using the special skill, etc.

"Gift information" refers to, for example, the number of gifts, the value of the gifts, the type of gifts, the level of the gifts, etc., which are quantified according to a predetermined table, and the total value of each gift is described. Also, for example, "gift information" may include at least one of the time, frequency, and number of times that gifts were given (sent) from the viewer terminal 12 to the broadcaster terminal 11. The number of gifts is the number given by the viewer to the first broadcaster. Here, "gift value" refers to, for example, if the gift is for a fee, the price of the gift corresponds to the value, and if the gift is free, the points consumed for the gift correspond to the value. Also, "gift value" may be determined based on, for example, the usable time of the gift, the display time of the gift, and/or the number of people who can use the gift simultaneously, and the total number of gifts that can be obtained in the game. Note that a short usable time of the gift means that the value of the gift is high. Also, a long usable time of the gift means that the value of the gift is low. Also, a long display time of the gift means that the value of the gift is high. Also, a short display time of the gift means that the value of the gift is low. Additionally, the fewer the number of people who can use the gift at the same time, the higher the value of the gift. Additionally, the more the number of people who can use the gift at the same time, the lower the value of the gift. Additionally, the smaller the total number of gifts available in the game, the higher the value of the gift. Additionally, the larger the total number of gifts available in the game, the higher the value of the gift.

(3) Gift Processing Unit 220
The gift processing unit 220 can process gift information sent from each viewer to each broadcaster. When the server device 20 operates as the web server system 20B, the gift processing unit 220 may be omitted.

(4) Determination unit 230
The determination unit 230 determines various conditions, for example, whether or not a condition for starting a collaborative distribution is satisfied (S314 described below), whether or not a first condition is satisfied (S318 described below), and whether or not a predetermined time has elapsed (S326 described below). Note that the first condition is a condition for determining whether or not to end the collaborative distribution.

(5) Extraction Unit 240
The extraction unit 240 extracts second data used to determine the processing content in S324 described later during or after the collaborative distribution. After the collaborative distribution is ended, the extraction unit 240 extracts second data related to at least one user out of at least one user related to the first broadcaster, based on the first data related to at least one user who has previously performed a collaborative distribution with the first broadcaster.

3-3. Functions of the Studio Unit 30 As described above, the studio unit 30 is capable of performing the same functions as the terminal 10 and/or the server device 20. Therefore, the studio unit 30 is capable of having the functions of the terminal 10 described with reference to Fig. 3 and/or the functions of the server device 30 described with reference to Fig. 4.

4. Overall operation of video distribution system 1 Next, the overall operation of the video distribution system 1 having the above configuration will be described with reference to Figures 5A and 5B. Figures 5A and 5B are flow diagrams showing an example of the operation performed in the video distribution system 1 shown in Figure 1. Note that in this embodiment, for example, the following description will be given assuming that there is a single user (second distributor) who collaborates with the first distributor, but there may be multiple users who collaborate with the first distributor.

First, referring to FIG. 5A, in S302, the terminal 10 (first distributor terminal 11A) launches and executes a video distribution application in accordance with the operation of the distributor (first distributor).

In S304, the first broadcaster terminal 11A generates a first video including an animation of the first broadcaster's avatar object based on the motion data related to the motion of the first broadcaster. As a result, the first video including the animation of the first broadcaster's avatar object is displayed on the display unit 130 of the first broadcaster terminal 11A. The first broadcaster terminal 11A then transmits the generated first video to the distribution server device 20A1 of the distribution server system 20A. The distribution server device 20A1 distributes the first video received from the first broadcaster terminal 11A to each viewer terminal 12 running a video viewing application. As a result, the first video is also displayed on the display unit 130 of the viewer terminal 12 of each viewer.

In S306, when the first distributor taps or otherwise performs an action such as tapping on the "Game" icon 406 (not shown) displayed on the display unit 130 of the first distributor terminal 11A, the first distributor terminal 11A executes a browser function included in the video distribution application. As a result, in S308, the first distributor terminal 11A, while executing the video distribution application (i.e., having distributed the first video to each viewer terminal 12), can access the web server system 20B and receive an HTML5 document incorporating a game program.

In S310, the first broadcaster terminal 11A can generate a video related to the game (a second video) by executing the game program embedded in the received HTML5 document.

In S312, the first broadcaster terminal 11A transmits the second video (game screen) generated in S310 to the distribution server device 20A1 of the distribution server system 20A. The distribution server device 20A1 distributes the second video received from the first broadcaster terminal 11A to each viewer terminal 12 running a video viewing application. This allows the second video to be displayed on the display unit 130 of each viewer terminal 12. For example, after the processing of S312 is executed, for example, after a predetermined time has elapsed, the processing of S314 is executed.

In S314, the server device 20 determines whether or not the conditions for starting a collaborative broadcast have been met. If the server device 20 determines in S314 whether or not the conditions for starting a collaborative broadcast have been met (YES in S314), the process proceeds to S316. On the other hand, if the server device 20 determines in S314 that the conditions for starting a collaborative broadcast have not been met (NO in S314), the process of S314 is performed again.

Note that the processing entity of S314 to S326 is, for example, game API server device 20A3 or game server device 20B1 among server device 20, but is not limited to this and may be, for example, another device among server device 20.

The conditions for starting a collaborative broadcast are met, for example, when the first broadcaster terminal 11A is broadcasting with the collaboration broadcast mode displayed on the display unit 130 enabled (ON), another terminal 10 sends data regarding a collaborative broadcast application to the first broadcaster terminal 11A via the server device 20, and the first broadcaster approves the application by operating the first broadcaster terminal 11A. The first broadcaster can switch the collaboration broadcast mode between enabled (ON) and disabled (OFF) by operating the first broadcaster terminal 11A.

In S316, the server device 20 starts the collaborative distribution. After the collaborative distribution has started, for example, when a predetermined time has elapsed, the processing of S318 is performed. By starting the collaborative distribution in S316, a second video including an animation of the avatar object of the first broadcaster and an animation of the avatar object of a user other than the first broadcaster (for example, a second broadcaster) is displayed on the display unit 130 of the terminal 10 operated by the user who is broadcasting and/or watching the game through the collaborative distribution.

In addition, after the server device 20 starts the collaborative distribution in S316, the user who is broadcasting and/or watching the game through the collaborative distribution can change the display content on the display screen of the terminal 10 and/or convey voice to users operating other terminals 10 by inputting operation information and/or voice into the terminal 10 that the user owns. Also, after the server device 20 starts the collaborative distribution in S316, the terminal 10 of the user who is broadcasting and/or watching the game through the collaborative distribution can read data such as live game content stored in the content server device 20B2.

In addition, in S316, after the server device 20 starts the collaborative distribution, operation information and/or voice input to the user's terminal 10 who is distributing and/or watching the game through the collaborative distribution may be stored in the server device 20 (e.g., game server device 20B1). The data stored in this manner may be used to determine the content of a predetermined process in S324 described below.

In addition, in S316, after the server device 20 starts the collaborative distribution, the server device 20 may configure the display contents of the display units 130 of the terminals 10 operated by the users who distribute and/or watch the game through the collaborative distribution to be the same, or may configure the display contents of the display units 130 of the terminals 10 operated by the users who distribute and/or watch the game through the collaborative distribution to be different. Note that, when the display contents of the display units 130 of the multiple broadcaster terminals 11 are configured to be different from each other, a viewer who uses the terminal 10 to watch the game through the collaborative distribution may configure the display unit 130 of his/her own terminal 10 to display the display contents of the display unit 130 relating to any broadcaster among the multiple broadcasters.

In addition, in S316, an example in which the first and second broadcasters jointly broadcast a game has been described, but this is not limited to this, and any broadcast may be made in which the first and other broadcasters jointly broadcast a game. For example, in S316, instead of the first and second broadcasters jointly broadcasting a game, a video in which the avatar of the first broadcaster and the avatar of the second broadcaster appear together may be broadcast.

In S318, the server device 20 determines whether or not the first condition is satisfied. If the server device 20 determines in S318 that the first condition is satisfied (YES in S318), the collaborative distribution ends and S322 described in FIG. 5B is executed. On the other hand, if the server device 20 determines in S318 that the first condition is not satisfied (NO in S318), the processing of S318 is repeated.

The first condition may be, for example, a condition that is satisfied by the transmission of third data, which is data requesting the end of the collaboration distribution, from the terminal 10 operated by the user who performs and/or watches the collaboration distribution, or a condition that is satisfied by the passage of a predetermined time (first time) since the start of the collaboration distribution, or may correspond to the satisfaction of a condition in the game executed by the collaboration distribution. Here, the above-mentioned "request to end the collaboration distribution" is, for example, a request made by the first or second broadcaster when a collaboration distribution is being performed using the avatar of the first broadcaster (host broadcaster) and the avatar of the second broadcaster (guest). Also, the above-mentioned "condition in the game" is, for example, a condition that a character other than the character operated in a stage prepared in the game is defeated, a predetermined item is obtained in the stage, a character operated in the stage is moved to a predetermined position, or a parameter of a character operated in the stage is equal to or greater than a predetermined value or less than a predetermined value. Defeating a character other than the one being controlled in a stage provided in the game, obtaining a specific item in that stage, or moving the controlled character to a specific position in that stage may correspond to clearing that stage. Also, the parameter of the controlled character in that stage exceeding or falling below a specific value may correspond to the death of the controlled character.

In addition, when the determination in S318 is YES and the collaborative broadcast ends, for example, the first broadcaster terminal 11A is configured to allow the first broadcaster to continue the broadcast, and the second broadcaster terminal 11B is configured to prevent the second broadcaster from broadcasting. In this case, the second broadcaster terminal 11B may be configured to allow the second broadcaster to continue viewing the broadcast content related to the broadcast as a viewer.

In S322, the server device 20 extracts second data related to users other than the first broadcaster based on the first data. The first data is data related to at least one user who has previously performed a collaborative broadcast with the first broadcaster, and is stored in the storage unit 210, for example. The second data includes, for example, at least one of data indicating parameters of a game previously broadcast or viewed by a user other than the first broadcaster, and data indicating an association between the first broadcaster and a user other than the first broadcaster.

In S324, the server device 20 executes a predetermined process based on the second data extracted from the first data. Specifically, in S324, the server device 20 changes at least one current parameter of the avatar of the first broadcaster based on the second data, or displays the avatar of the first broadcaster and an avatar of a user other than the first broadcaster in the second video based on the second data. More specifically, for example, the server device 20 changes the parameters of the avatar of the first broadcaster to the parameters of the avatar of the second broadcaster based on the second data related to the second broadcaster, or displays the avatar of the first broadcaster and the avatar of the second broadcaster in the second video instead of displaying only the avatar of the first broadcaster in the second video.

In S324, when the current parameters of the first broadcaster's avatar are changed to a predetermined parameter (first parameter) based on the second data, this first parameter is a parameter that is more advantageous in terms of game progression than the current parameters in the game. Specifically, when the second data indicates parameters related to a specific user, and the parameters of this specific user's avatar are more advantageous in terms of game progression than the parameters of the first broadcaster, the current parameters of the first broadcaster's avatar are changed to the parameters of this specific user's avatar. In addition, instead of changing the current parameters of the first broadcaster's avatar to the parameters of this specific user's avatar, some of the parameters of this specific user's avatar may be imparted to the first broadcaster's avatar.

In addition, in S324, when the avatar of the first broadcaster and the avatar of a user other than the first broadcaster are displayed in the second video based on the second data, the user is the user who has broadcast games together with the first broadcaster the most, the user who has broadcast games together with the first broadcaster the longest cumulative time, the user who has watched games previously broadcast by the first broadcaster the most, the user who has watched games previously broadcast by the first broadcaster the longest cumulative time, or the user with the highest level in the game.

In addition, in S324, when the avatar of the first broadcaster and the avatar of the user other than the first broadcaster are displayed in the second video based on the second data, for example, the first broadcaster terminal 11A broadcasts the second video including the avatar of the first broadcaster and the avatar of the user other than the first broadcaster to each viewer terminal 12. Note that the specific processing is the same as that of S304.

Next, in S326, the server device 20 determines whether or not to continue the predetermined process executed in S324. If the server device 20 determines in S326 to continue the predetermined process executed in S324 (YES in S326), the process of S326 is repeated. If the server device 20 determines in S326 not to continue the predetermined process executed in S324 (NO in S326), the series of processes shown in Figures 5A and 5B is terminated. Note that if NO in S326, the series of processes shown in Figures 5A and 5B may not be terminated, and any of the processes described in Figures 5A and 5B (e.g., the process of S314) may be performed.

As described above, according to the present disclosure, first data related to at least one user who has jointly broadcast with the first broadcaster before the game is executed is stored, and after the first broadcaster and the at least one user have jointly broadcast, it is determined whether or not the first condition is met, and if it is determined that the first condition is met, second data related to at least one of the at least one user is extracted based on the first data, and at least one current parameter of the avatar of the first broadcaster is changed based on the second data during or after the game is executed, or the avatar of the first broadcaster and at least one of the at least one user can be displayed in the second video based on the second data. Therefore, even if the second broadcaster who broadcasts videos with the first broadcaster stops broadcasting and leaves, the interest of the game that will be broadcast later by the first broadcaster is less likely to be lost. In particular, when viewers are more interested in the second broadcaster who has jointly broadcast with the first broadcaster than in the first broadcaster, the effect of performing the process of S324 is expected to be even greater.

5. Modifications In addition, in S324, when at least one current parameter of the avatar of the first distributor is changed based on the second data, or when the avatar of the first distributor and an avatar of a user other than the first distributor are displayed in the second video based on the second data, the parameters of the avatar of the user (helper) may be changed. In addition, this parameter change means, for example, changing to a parameter that is more advantageous in the progress of the game than the current parameter. In addition, instead of changing the parameters of the avatar of the user, a gift may be given to the user. In this way, the reward for being selected in S322 and S324 can be given to the user. In addition, the degree of change of the above-mentioned parameters and the content of the above-mentioned gift are determined according to the degree of contribution of the user (helper). For example, the higher the degree of contribution of the user (helper), the greater the degree of change of the above-mentioned parameters may be so as to be more advantageous in the progress of the game. Also, for example, the higher the degree of contribution of the user (helper), the greater the number of gifts, the higher the value of the gifts, the greater the variety of gifts, and/or the higher the level of the gifts.

Also, in the above example, if S318 is YES, the process of S322 is executed, and then the process of S324 is executed. However, if S318 is YES and before S322 is executed, or after S322 is executed and before S324 is executed, the server device 20 may count the number of viewers of the game that the first broadcaster broadcasts alone. The server device 20 may then determine whether the number of viewers of the game that the first broadcaster broadcasts alone is equal to or greater than a predetermined number, and execute the subsequent process (S322 or S324) only if it is less than the predetermined number. Alternatively, the server device 20 may determine whether the number of viewers of the game that the first broadcaster broadcasts alone is less than the number of viewers at the time of the collaborative broadcast by a predetermined number or more, and execute the subsequent process (S322 or S324) only if it is less than the predetermined number or more. The number of viewers at the time of the collaborative broadcast is, for example, the maximum number of viewers, the minimum number of viewers, or the average number of viewers at the time of the collaborative broadcast.

In addition, in the above description, an example has been described in which the predetermined processing described in S324 is performed based on the second data when the first broadcaster is broadcasting alone after the second broadcaster who was broadcasting together with the first broadcaster stops broadcasting and leaves in S316, but this is not limited to the above. For example, when there are multiple broadcasters (guests) broadcasting together with the first broadcaster in S316, and at least one of the multiple guests stops broadcasting and leaves, the first broadcaster and the remaining guests are both broadcasting a game, the processing of S322 and S324 may be performed.

In addition, in the above explanation, an example is described in which steps S302 to S318 shown in FIG. 5A are executed in order, but this is not limited thereto, and at least one of the processes from S304 to S312 may be omitted.

In addition, in the various embodiments described above, the distributor terminal 11 has been described as receiving an HTML (particularly HTML5) document incorporating a game program from the web server system 20B in order to generate a video relating to a game (second video). However, instead of receiving an HTML document incorporating a game program from the web server system 20B, the distributor terminal 11 can also generate a second video including a screen relating to a game by executing an installed video distribution application and receiving necessary information from a data server device (not shown) (or some server device (not shown) included in the distribution server system 20A).

In addition, in the various embodiments described above, the distributor terminal 11 may be a smartphone or the like used by a general user, or may be a dedicated terminal installed in a studio or the like. In this case, at least one of the server devices included in the distribution server system 20A, the distribution server device 20A1, the DB server device 20A2, and the game API server device 20A3 (and even the web server system 20B) may be installed together with the dedicated terminal in the studio or the like.

In addition, in the various embodiments described above, a case has been described in which the distributor terminal 11 generates a video including an animation including an avatar object of the distributor based on motion data related to the distributor's motions and audio data related to the distributor's voice, and transmits this video to the server device 20. However, the distributor terminal 11 may transmit motion data related to the distributor's motions and audio data related to the distributor's voice to the server device 20, and the server device 20 may generate a video based on this motion data and audio data and transmit it to each viewer terminal 12. This makes it possible to reduce the amount of information transmitted from the distributor terminal 11 to the server device 20.

The distributor terminal 11 may also transmit motion data related to the distributor's motion and audio data related to the distributor's voice to a separately provided server device, which may then generate a video based on the motion data and audio data and return it to the distributor terminal 11, which may then transmit the received video to the server device 20. This may reduce the amount of information transmitted from the distributor terminal 11 to the separately provided server device 20.

The distributor terminal 11 may also transmit motion data related to the distributor's motions and audio data related to the distributor's audio to each viewer terminal 12 via the server device 20 or the separately provided server device, and each viewer terminal 12 may generate (render) and display a video based on the received motion data and audio data. This can reduce the amount of information transmitted from the server device 20 or the separately provided server device to each viewer terminal 12.

In addition, in either of the above cases, the generation of a video based on the motion data and audio data transmitted by the distributor terminal 11 may be shared among at least two of the server device 20, the separate server device, and each viewer terminal 12. In either case, the device responsible for generating the video may receive and store information (images, etc.) about the avatar object to be operated, for example, from the server device 20, etc.

In addition, in the various embodiments described above, the operations of each of the terminals 10 described above can also be executed by a studio unit 30 having a similar configuration to the terminals 10. In this case, the studio unit 30A illustrated in FIG. 1 can have the same functions as the terminal 10 for distributing videos. Similarly, the studio unit 30B illustrated in FIG. 1 can have the same functions as the terminal 10 for watching videos. Furthermore, the operations of each of the server devices 20 described above can also be executed by a studio unit 30 having a similar configuration to the server device 20.

Furthermore, the various embodiments described above can be used in combination with each other as long as no contradictions or inconveniences arise.

The technology disclosed herein can also be applied to, for example, role-playing games, simulation games, shooting games, action games, card games, mahjong, Go, Othello, puzzle games, quiz games, sports games, and/or board games. Here, the user (helper) related to the second data extracted in S324 can support the first broadcaster when playing a game, for example, as follows. For example, when the first broadcaster plays a role-playing game, a simulation game, and/or a shooting game, the user shows the first broadcaster a sample of how to proceed with the game. For example, when the first broadcaster plays an action game and fights a specific character in the action game, the user participates in the fight to support the first broadcaster. For example, when the first broadcaster plays a card game, the first broadcaster can use a special skill that the user has. For example, when the first broadcaster plays a sports game and fights a specific opponent (team) in the sports game, the user participates in the match to support the first broadcaster. Also, for example, when the first distributor plays a role-playing game, a simulation game, a shooting game, an action game, a card game, mahjong, Go, Othello, a puzzle game, a quiz game, a sports game, and/or a board game, the user provides information such as hints to help the first distributor to play the game to his or her advantage.

In the second example, the first broadcaster terminal 11A of the first broadcaster executes the installed game application and accesses the distribution server system 20A, which also functions as a game server device, so that the screen of the game being played can be distributed to each viewer's terminal device 10 via the distribution server system 20A. In these first and second examples, the first broadcaster terminal 11A of the first broadcaster can generate the second video using the viewing parameters received from the distribution server system 20A, as in the various embodiments described above.

Furthermore, in the third example, in the first example or the second example, the first broadcaster terminal 11A of the first broadcaster can transmit the operation data of the first broadcaster to the web server device 20B or the distribution server system 20A without generating a game screen. In this case, the web server device 20B or the distribution server system 20A can generate a game screen using the operation data, and the distribution server system 20A can distribute the second video including the generated game screen to each viewer's terminal device 10. In this third example, when the web server device 20B generates the game screen, the web server device 20B can use the viewing parameters received from the distribution server system 20A. When the distribution server system 20A generates the game screen, the distribution server system 20A can use the viewing parameters that it manages.

6. Various Aspects The computer program according to the first aspect is a program that, when executed by at least one processor, causes the processor to function as follows: "to broadcast a first video including action data related to an action of a first broadcaster or an animation of an avatar of the first broadcaster generated based on the action data, and a second video related to a game generated based on operation data related to an operation of the first broadcaster using a received web page, to a viewer terminal of at least one viewer via a communication line; to store first data related to at least one user who has broadcast in collaboration with the first broadcaster before the game is executed; to determine whether or not a first condition is satisfied after the first broadcaster and the at least one user have broadcast in collaboration; and, if it is determined that the first condition is satisfied, to extract second data related to at least any one of the at least one users based on the first data; and, during or after the game is executed, to change at least one current parameter of the avatar of the first broadcaster based on the second data; or to cause the processor to display the avatar of the first broadcaster and an avatar of at least any one of the at least one users in the second video based on the second data."
The computer program of the second aspect is the same as in the first aspect above, wherein "the first data is data relating to at least one of at least one user who collaborated with the first broadcaster to broadcast a game, and at least one user who collaborated with the first broadcaster to broadcast using the first broadcaster's avatar and their own avatar."
The computer program of the third aspect is, in the first or second aspect above, "causing the processor to function so that the second data includes at least one of data indicating parameters of a game that the at least one user has previously streamed or viewed, and data indicating a relationship between the at least one user and the first streamer."
The computer program of the fourth aspect is, in any of the first to third aspects, "causing the processor to function such that, when an avatar of the first broadcaster and an avatar of at least one of the at least one user are displayed in the second video based on the second data, at least one of the at least one user is one of the at least one users who has collaborated with the first broadcaster the most number of times, who has spent the longest cumulative time streaming with the first broadcaster, who has watched the most broadcasts by the first broadcaster, who has spent the longest cumulative time watching broadcasts by the first broadcaster, or who has the highest level in the game."
The computer program of the fifth aspect is, in any of the first to fourth aspects, that "causes the processor to function such that the first condition is a condition indicating that third data has been transmitted from a distributor terminal of the first distributor or a distributor terminal of a distributor other than the first distributor, or a condition indicating that a first time has elapsed since the first distributor and the at least one user jointly started distribution."
The computer program of the sixth aspect is the computer program of the fifth aspect above, which "causes the processor to function such that the third data includes data requesting that an avatar of at least one of the at least one user be displayed in the second video together with an avatar of the first distributor."
The computer program of the seventh aspect is, in any of the first to sixth aspects, "causing the processor to function to change parameters relating to an avatar of the at least one user when at least one current parameter of the avatar of the first distributor is changed based on the second data, or when an avatar of the first distributor and at least one of the at least one user is displayed in the second video based on the second data."
The computer program of the eighth aspect is, in any of the first to seventh aspects, "causing the processor to function such that, when the current parameter is changed to a first parameter based on the second data, the first parameter is a parameter that is more advantageous in the game progression than the current parameter."
A computer program according to a ninth aspect causes the processor to function as follows: "When executed by at least one processor, the computer program causes the processor to function as follows: receive, via a communication line, a first video including action data related to the action of a first broadcaster or an animation of an avatar of the first broadcaster generated based on the action data, and a second video related to a game generated based on operation data related to the operation of the first broadcaster using a received web page; determine whether a first condition is met after the first broadcaster and the at least one user have jointly broadcast; and if it is determined that the first condition is met, receive a first video in which at least one current parameter of the avatar of the first broadcaster is changed based on second data extracted related to at least any one of the at least one users based on first data related to the at least one user who jointly broadcast with the first broadcaster before the game was played, or receive a second video displaying the avatar of the first broadcaster and at least any one of the avatars of the at least one user based on the second data."
A computer program according to a tenth aspect is the computer program according to any one of the first to ninth aspects, wherein "the communication line includes the Internet."
The computer program of an eleventh aspect is any one of the first to tenth aspects, wherein "the at least one processor includes a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU)."
The computer program of the twelfth aspect is any one of the first to eleventh aspects, wherein "the at least one processor is installed in a server device, a smartphone, a tablet, a mobile phone, or a personal computer."
The method according to the thirteenth aspect is "a method executed by at least one processor that executes computer-readable instructions, the method including the steps of: distributing, by the processor executing the instructions, a first video including action data related to an action of a first distributor or an animation of an avatar of the first distributor generated based on the action data, and a second video related to a game generated based on operation data related to an operation of the first distributor using a received web page, to a viewer terminal of at least one viewer via a communication line; and storing first data related to at least one user who has jointly distributed the game with the first distributor before the game is played. a step of determining whether a first condition is met after the first broadcaster and the at least one user have jointly broadcast, and if it is determined that the first condition is met, a step of extracting second data related to at least any one of the at least one users based on the first data, and a step of changing at least one current parameter of an avatar of the first broadcaster based on the second data during or after the game is played, or displaying an avatar of the first broadcaster and an avatar of at least any one of the at least one user in the second video based on the second data."
The method according to the fourteenth aspect is "a method executed by at least one processor that executes computer-readable instructions, the method including the steps of: receiving, via a communication line, a first video including motion data related to a motion of a first broadcaster or an animation of an avatar of the first broadcaster generated based on the motion data, and a second video related to a game generated using a received web page based on operation data related to an operation of the first broadcaster; determining whether a first condition is met after the first broadcaster and the at least one user have jointly broadcasted, and if it is determined that the first condition is met, receiving a first video in which at least one current parameter of an avatar of the first broadcaster is changed based on second data extracted related to at least one of the at least one users based on first data related to the at least one user who jointly broadcasted with the first broadcaster before the game was played, or receiving a second video displaying the avatar of the first broadcaster and an avatar of at least one of the at least one user based on the second data."
A method according to a fifteenth aspect is the method according to the thirteenth or fourteenth aspect, wherein "the communication line includes the Internet."
A method according to a 16th aspect is any of the 13th to 15th aspects, wherein "the at least one processor includes a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU)."
A server device according to a seventeenth aspect of the present invention includes "at least one processor, wherein the processor transmits a first video including action data related to the action of a first broadcaster or an animation of an avatar of the first broadcaster generated based on the action data, and a second video related to a game generated based on operation data related to the operation of the first broadcaster using the received web page, to a viewer terminal of at least one viewer via a communication line, stores first data related to at least one user who jointly broadcasted with the first broadcaster before the game is executed, determines whether or not a first condition is met after the first broadcaster and the at least one user jointly broadcast, and if it is determined that the first condition is met, extracts second data related to at least any one of the at least one users based on the first data, and during or after the game is executed, changes at least one current parameter of the avatar of the first broadcaster based on the second data, or displays the avatar of the first broadcaster and an avatar of at least any one of the at least one user in the second video based on the second data."
The server device according to the eighteenth aspect of the present invention is described as comprising: "at least one processor, the processor being configured to transmit, via a communication line, a first video including action data related to the action of a first distributor or an animation of an avatar of the first distributor generated based on the action data, and a second video related to a game generated based on operation data related to the operation of the first distributor using the received web page to a viewer terminal of at least one viewer; and the processor being configured to transmit, via a communication line, a web page including a computer program to a broadcaster terminal of the first distributor, the broadcaster terminal of the first distributor configured to broadcast, via a communication line, a first video including an animation of an avatar of the first distributor, generated based on the action data, and a second video related to a game generated based on operation data related to the operation of the first distributor using the received web page, to a viewer terminal of at least one viewer; and the computer program being configured to transmit, via a communication line, a web page including a computer program to a broadcaster terminal of the first distributor, the broadcaster terminal of the first distributor, the view ... and storing first data relating to at least one user selected from the at least one user selected in the first broadcaster and the at least one user selected in the first broadcaster and the at least one user selected in the at least one user selected in the first broadcaster and the at least one user selected in the at least one user selected in the first broadcaster and the at least one user selected in the at least one user selected in the first broadcaster and the at least one user selected in the at least one user selected in the first broadcaster and the at least one user selected in the at least one user selected in the second ...
The server device according to a nineteenth aspect is the server device according to the seventeenth or eighteenth aspect, wherein "the communication line includes the Internet."
The server device of the twentieth aspect is any one of the seventeenth to nineteenth aspects, wherein "the at least one processor includes a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU)."

In this way, the technology disclosed herein can provide a computer program, method, and server device that reduces the possibility of losing the interest of the game.

REFERENCE SIGNS LIST 1 Video distribution system 10 Terminal 11 Distributor terminal 11A First distributor terminal 11B Second distributor terminal 12, 12A, 12B, 12C Viewer terminal 20 Server device 20A Distribution server system 20A1 Distribution server device 20A2 DB server device 20A3 Game API server device 20A4 Collaboration server device 20B Web server system 20B1 Game server device 20B2 Content server device 30, 30A, 30B Studio unit

Claims (19)

When executed by at least one processor,
distribute, via a communication line, a first video including motion data relating to a motion of a first user or an animation of an avatar of the first user generated based on the motion data, and a second video relating to a game generated based on operation data relating to an operation of the first user, to a second user terminal of at least one second user;
storing first data relating to at least one third user who has jointly broadcast with the first user prior to execution of the game;
After the first user and the at least one third user have jointly performed a broadcast, it is determined whether a first condition is satisfied, and if it is determined that the first condition is satisfied, it is determined whether a second condition is satisfied, in which a number of second users viewing the broadcast of the first user is equal to or less than a predetermined number, and only if it is determined that the second condition is satisfied, second data related to at least any one of the at least one third user is extracted based on the first data;
causing the processor to, during or after the game is executed, modify at least one current parameter of an avatar of the first user based on the second data, or to display an avatar of at least one of the avatar of the first user and the at least one third user in the second video based on the second data;
Computer program. The first data is data related to at least one of at least one third user who collaborated with the first user to distribute a game, and at least one third user who collaborated with the first user to distribute a game using an avatar of the first user and his/her own avatar.
2. The computer program product of claim 1. causing the processor to function so that the second data includes at least one of data indicating parameters of a game previously distributed or viewed by the at least one third user and data indicating a relationship between the at least one third user and the first user;
A computer program according to claim 1 or 2. causing the processor to function so that, when an avatar of the first user and an avatar of at least one of the at least one third user are displayed in the second video based on the second data, at least one of the at least one third user is a user who has collaborated with the first user the most in streaming, a user who has collaborated with the first user for the longest cumulative time in streaming, a user who has watched the most streams by the first user, a user who has watched the longest cumulative time in streaming by the first user, or a user who has the highest level in the game, among the at least one third user;
A computer program according to any one of claims 1 to 3. causing the processor to function so that the first condition is a condition indicating that third data has been transmitted from a first user terminal of the first user or a user terminal of a user other than the first user, or a condition indicating that a first time has elapsed since the first user and the at least one third user jointly started distribution;
A computer program according to any one of claims 1 to 4. causing the processor to function such that the third data includes data requesting that an avatar of at least one of the at least one third user be displayed in the second video together with an avatar of the first user;
6. A computer program according to claim 5. causing the processor to modify a parameter associated with an avatar of the at least one third user when at least one current parameter of the avatar of the first user is modified based on the second data, or when an avatar of at least one of the avatar of the first user and the at least one third user is displayed in the second video based on the second data;
A computer program according to any one of claims 1 to 6. causing the processor to function such that, when changing the current parameter to a first parameter based on the second data, the first parameter is a parameter that is more advantageous in terms of progression of the game than the current parameter;
A computer program according to any one of claims 1 to 7. When executed by at least one processor,
receiving, via a communication line, motion data relating to a motion of a first user or a first video including an animation of an avatar of the first user generated based on the motion data, and a second video relating to a game generated based on operation data relating to an operation of the first user;
causing the processor to function as follows: after the first user and at least one third user have jointly broadcast before the game is played , determine whether a first condition is satisfied, and if it is determined that the first condition is satisfied, determine whether a second condition is satisfied in which a number of second users watching the broadcast of the first user is equal to or less than a predetermined number, and only if it is determined that the second condition is satisfied, receive a first video in which at least one current parameter of an avatar of the first user is changed based on second data extracted related to at least any one of the at least one third users based on first data related to the at least one third user, or receive a second video displaying the avatar of the first user and at least any one of the at least one third users based on the second data;
Computer program. The communication line includes the Internet.
A computer program according to any one of claims 1 to 9. the at least one processor comprises a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU);
A computer program according to any one of claims 1 to 10. The at least one processor:
The device is installed in a server device, a smartphone, a tablet, a mobile phone, or a personal computer.
A computer program according to any one of claims 1 to 11. 1. A method performed by at least one processor executing computer readable instructions, comprising:
The processor executes the instructions to
a step of distributing, via a communication line, a first video including motion data relating to a motion of a first user or an animation of an avatar of the first user generated based on the motion data, and a second video relating to a game generated based on operation data relating to an operation of the first user, to a second user terminal of at least one second user;
storing first data relating to at least one third user who has jointly broadcast with the first user prior to execution of the game;
determining whether a first condition is satisfied after the first user and the at least one third user jointly perform distribution;
when it is determined that the first condition is satisfied, determining whether or not a second condition is satisfied, that is, a number of second users viewing the distribution of the first user is equal to or less than a predetermined number, and extracting second data related to at least any one of the at least one third user based on the first data only when it is determined that the second condition is satisfied;
and modifying at least one current parameter of the avatar of the first user based on the second data during or after execution of the game, or displaying an avatar of at least one of the avatar of the first user and the at least one third user in the second video based on the second data.
Method. 1. A method performed by at least one processor executing computer readable instructions, comprising:
The processor executes the instructions to
receiving, via a communication line, motion data relating to a motion of a first user or a first video including an animation of an avatar of the first user generated based on the motion data, and a second video relating to a game generated based on operation data relating to an operation of the first user;
determining whether a first condition is satisfied after the first user and at least one third user have jointly performed a broadcast before the game is played , and if it is determined that the first condition is satisfied, determining whether a second condition is satisfied, in which a number of second users watching the broadcast of the first user is equal to or less than a predetermined number, and only if it is determined that the second condition is satisfied, receiving a first video in which at least one current parameter of an avatar of the first user is changed based on second data extracted related to at least any one of the at least one third users based on first data related to the at least one third user, or receiving a second video displaying the avatar of the first user and an avatar of at least any one of the at least one third users based on the second data.
Method. The communication line includes the Internet.
The method according to claim 13 or claim 14. the at least one processor comprises a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU);
A method according to any one of claims 13 to 15. At least one processor;
The processor,
Transmitting, via a communication line, to a second user terminal of at least one second user, a first video including motion data relating to a motion of a first user or an animation of an avatar of the first user generated based on the motion data, and a second video relating to a game generated based on operation data relating to an operation of the first user;
storing first data relating to at least one third user who has jointly broadcast with the first user prior to execution of the game;
After the first user and the at least one third user have jointly performed a broadcast, it is determined whether a first condition is satisfied, and if it is determined that the first condition is satisfied, it is determined whether a second condition is satisfied, in which a number of second users viewing the broadcast of the first user is equal to or less than a predetermined number, and only if it is determined that the second condition is satisfied, second data related to at least any one of the at least one third user is extracted based on the first data;
during or after the game is executed, modifying at least one current parameter of an avatar of the first user based on the second data, or displaying an avatar of at least one of the avatar of the first user and the at least one third user in the second video based on the second data;
Distribution server. The communication line includes the Internet.
The distribution server according to claim 17. the at least one processor comprises a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU);
The distribution server according to claim 17.