JP7606715B2 - Video distribution system, video distribution method, and video distribution program - Google Patents

Description

The disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program. More specifically, the disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program that live-distributes videos that include characters generated based on the movements of a user.

Various video distribution services have been known for some time. In recent years, video distribution systems that generate character animation based on the movements of a distribution user and live-distribute videos including the character animation have been attracting attention. Such video distribution systems are disclosed, for example, in JP2015-184689A (Patent Document 1) and "Yusuke Hasegawa, The Dawn of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 10, 2017, Vol. 231, pp. 74-79" (Non-Patent Document 1).

"Virtual Cast," provided by Dwango Co., Ltd., is a known video distribution service that distributes videos that include characters generated based on the movements of broadcasting users. In Virtual Cast, a character from another broadcasting user can participate in a video broadcast by another broadcasting user, allowing the two broadcasting users to virtually appear together in the video through their respective characters.

There is also a known video distribution system that displays a gift object on a display screen corresponding to a gift purchased by a viewing user who is viewing a video in response to a request from the viewing user. For example, in the video distribution system disclosed in JP 2012-120098 A (Patent Document 2), a viewing user can purchase a gift item and provide the purchased gift item as a gift to a broadcasting user. The gift is displayed in the video being broadcast in response to a display request from the viewing user. The gift display request may be automatically generated in response to the purchase of the gift by the viewing user. The specification of Japanese Patent No. 6543403 (Patent Document 3) describes displaying a gifted object in association with a character that moves based on the movement of the broadcasting user.

JP 2015-184689 A JP 2012-120098 A Patent No. 6543403

Yusuke Hasegawa, The Dawn of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 10, 2017, Vol. 231, pp. 74-79 Dwango Co., Ltd., "About [Virtual Cast] Convexity", [online], [searched on July 1, 2019], Internet <URL: https://qa.nicovideo.jp/faq/show/10740?category#id=718&site#domain=default>

When a host user's character and a guest user's character appear together in a co-starring video, the appearance of the host user's character is determined by the host user's settings, and the appearance of the guest user's character is determined by the guest user's settings. In other words, the images of the characters included in the co-starring video are determined independently by each of the co-stars. For this reason, there is a problem in that it is difficult to express a sense of unity in conventional co-starring videos.

The object of the present invention is to provide a technical improvement that solves or alleviates at least part of the problems of the prior art described above. One of the more specific objects of the present invention is to provide a video distribution system, a video distribution method, and a video distribution program that can distribute co-starring videos with improved uniformity.

One aspect of the present invention relates to a video distribution system including one or more computer processors. In one aspect, the one or more computer processors execute computer-readable instructions to distribute a co-starring video including a first character generated based on a movement of a first user and a second character generated based on a movement of a second user, display a first object in association with the first character, determine whether a matching object identical to the first object is displayed in association with the second character, and, if it is determined that the matching object is not displayed in association with the second character, display a matching object identical to the first object in association with the second character in the co-starring video.

In one aspect of the present invention, the matching object displayed in association with the second character is displayed only in the co-starring video.

When it is determined that the matching object is not displayed in association with the second character, the video distribution system according to one aspect of the present invention prompts a display request to display the matching object in association with the second character, and displays the matching object in association with the second character in the co-starring video based on the display request.

When it is determined that the matching object is not displayed in association with the second character, the video distribution system according to one aspect of the present invention prompts one or more viewing users who are viewing the co-starring video to make a display request to display the matching object in association with the second character.

When it is determined that the matching object is not displayed in association with the second character, the video distribution system according to one aspect of the present invention prompts the first user to make a display request to display the matching object in association with the second character.

When it is determined that the matching object is not displayed in association with the second character, the video distribution system according to one aspect of the present invention prompts the second user to make a display request to display the matching object in association with the second character.

The video distribution system according to one aspect of the present invention provides a benefit to the first user when the matching object is displayed in association with the second character in the co-starring video. The video distribution system according to one aspect of the present invention provides a benefit to the second user when the matching object is displayed in association with the second character in the co-starring video. The video distribution system according to one aspect of the present invention provides a benefit to the first viewing user when the matching object is displayed in response to a display request from a first viewing user of one or more viewing users watching the co-starring video to display the matching object in association with the second character. The video distribution system according to one aspect of the present invention provides a benefit to each of the first user, the second user, and one or more viewing users watching the co-starring video when the matching object is displayed in association with the second character in the co-starring video.

In one aspect of the present invention, the co-starring video is generated in response to receiving a co-starring application from the second user requesting to co-star with the first user.

In one aspect of the present invention, the first object is displayed in association with the wearing part of the first character, and the matching object is displayed in association with the wearing part of the second character.

One aspect of the present invention relates to a video distribution method executed by one or more computer processors executing computer-readable instructions. The video distribution method includes a step of distributing a co-starring video including a first character generated based on a movement of a first user, a second character generated based on a movement of a second user, and a first object displayed in association with the first character, a step of determining whether a matching object identical to the first object is displayed in association with the second character, and a step of displaying a matching object identical to the first object in association with the second character in the co-starring video when it is determined that the matching object is not displayed in association with the second character.

One aspect of the present invention relates to a video distribution program. The video distribution program causes one or more computer processors to execute the steps of: distributing a co-starring video including a first character generated based on the movement of a first user, a second character generated based on the movement of a second user, and a first object displayed in association with the first character; determining whether a matching object identical to the first object is displayed in association with the second character; and, when it is determined that the matching object is not displayed in association with the second character, displaying a matching object identical to the first object in association with the second character in the co-starring video.

According to an embodiment of the present invention, it is possible to provide a video distribution system, a video distribution method, and a video distribution program that can distribute co-starring videos with improved uniformity.

1 is a block diagram showing a video distribution system according to an embodiment. 2 is a schematic diagram showing a broadcaster user who broadcasts a video distributed in the video distribution system of FIG. 1 and a broadcaster user device used by the broadcaster user. FIG. 2 is a diagram illustrating gift object information stored in the video distribution system of FIG. 1. 2 is a diagram illustrating owned object information stored in the video distribution system of FIG. 1. 2 is a diagram illustrating object display information stored in the video distribution system of FIG. 1. 1A and 1B are diagrams showing example images of a video displayed on an audience user device 10 in one embodiment. FIG. 13 is a diagram showing an example of a video image displayed on a broadcast user device 20a in one embodiment. FIG. 13 shows an example of a video image displayed on a broadcast user device 20b in one embodiment. 8 is a diagram showing an example of an image of a moving image displayed on an audience user device 10 in one embodiment. 9 is a diagram showing an example of an image of a moving image displayed on an audience user device 10 in one embodiment. FIG. 13 is a diagram showing an example of a video image displayed on a broadcast user device 20a in one embodiment. FIG. 13 shows an example of a video image displayed on a broadcast user device 20b in one embodiment. FIG. 13 is a diagram showing an example of an image of a co-starring video displayed on a viewing user device 10 in FIG. 13 is a diagram showing an example of an image of a co-starring video displayed on a broadcast user device 20a in one embodiment. FIG. 13 is a diagram showing an example of an image of a co-starring video displayed on a broadcast user device 20b FIG. 2 is a diagram showing an example of an image of a co-starring video displayed on a viewing user device 10 in one FIG. 11 is a flow diagram showing a flow of a video distribution process in one embodiment. 1 is a flow diagram showing a process flow for distributing a co-starring video in one embodiment. FIG. 11 is a flow diagram showing a process for displaying matching objects in an embodiment.

Various embodiments of the present invention will now be described with reference to the drawings. The same reference numerals are used to designate the same or similar components in the drawings.

A video distribution system according to one embodiment will be described with reference to Figures 1 and 2. Figure 1 is a block diagram showing a video distribution system 1 according to one embodiment, and Figure 2 is a schematic diagram showing users Ua and Ub who distribute videos in the video distribution system 1 and broadcasting user devices 20a and 20b used by the users Ua and Ub. The broadcasting user device 20a has a function for distributing videos including a character object generated based on the movements of the user Ua in the video distribution system 1, and the broadcasting user device 20b has a function for distributing videos including a character object generated based on the movements of the user Ub in the video distribution system 1.

As will be described in more detail below, the video distribution system 1 can generate videos that include character objects of two or more broadcast users and distribute the videos. In other words, in the video distribution system 1, two or more broadcast users can virtually appear together in a video through their respective character objects. In this way, when two or more broadcast users virtually appear together in a video through their respective character objects, the video is referred to as a "co-starring video." In this specification, the character objects of the broadcast users included in the video may be simply referred to as "characters."

Both user Ua and user Ub are broadcast users who broadcast videos including characters generated based on movements, and are also viewing users who broadcast videos of other broadcast users. In this specification, a user who broadcasts videos using the broadcast user device 10, the broadcast user devices 20a and 20b, or a device other than these, is referred to as a viewing user. For this reason, the broadcast user devices 20a and 20b may have a function to broadcast videos broadcast in the video broadcast system 1.

User Ua can make a co-starring application to request to co-star with user Ub. When this co-starring application is approved, a co-starring video including the characters of user Ub and user Ua is generated, and the co-starring video is distributed. When user Ua participates in a video distributed by user Ub and user Ub and user Ua co-star, user Ua who made the co-starring application and co-starred with user Ub is called a "guest user", and user Ub who distributes a video in which the guest user participates is sometimes called a "host user". The concepts of host user and guest user are relative. For example, conversely to the above example, when user Ub sends a co-starring application to user Ua and user Ub co-stars in user Ua's video based on this co-starring application, user Ua becomes the host user and user Ub becomes the guest user. In this specification, for convenience of explanation, it is assumed that an invitation is sent from user Ub to user Ua. In other words, it is assumed that user Ub is the host user and user Ua is the guest user. However, the description of user Ua in this specification may be expanded to the extent possible to include guest users in general. Similarly, the description of user Ub in this specification may be expanded to the extent possible to include host users in general. For example, even if a description is given of broadcast user Ua in this specification, the description may be understood as a description of guest users in general, and a description of broadcast user Ub may be understood as a description of host users in general.

The video distribution system 1 includes a viewing user device 10, broadcasting user devices 20a and 20b, a server device 60, and a storage 70. The viewing user device 10, the broadcasting user device 20, the server device 60, and the storage 70 are connected to each other via a network 50 so as to be able to communicate with each other. The server device 60 is configured to distribute videos including animations of the characters of the broadcasting user Ua and the broadcasting user Ub, as described below.

This video is distributed from the server device 60 to the viewing user device 10 and the broadcasting user devices 20a and 20b. The distributed video is displayed on the display of the viewing user device 10. A viewing user, who is a user of the viewing user device 10, can view the distributed video using the viewing user device 10. Although only one viewing user device 10 is shown in FIG. 1 for the sake of simplicity, the video distribution system 1 may include multiple viewing user devices. By viewing the distributed video, the broadcasting users Ua and Ub can perform while checking the video within the video.

In the illustrated embodiment, the broadcast user device 20a includes a computer processor 21a, a communication I/F 22a, a display 23a, a camera 24a, and a microphone 25a. Similarly, the broadcast user device 20b includes a computer processor 21b, a communication I/F 22b, a display 23b, a camera 24b, and a microphone 25b. Since the broadcast user device 20a and the broadcast user device 20b have similar configurations and functions, when there is no need to particularly distinguish between the two, they may be collectively referred to as the broadcast user device 20, and their components may also be referred to as the computer processor 21, etc.

The computer processor 21 is an arithmetic device that loads an operating system and various programs that realize various functions from storage into memory and executes instructions contained in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various other arithmetic devices, or a combination of these. The computer processor 21 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. Although the computer processor 21 is illustrated in FIG. 1 as a single component, the computer processor 21 may be a collection of multiple physically separate computer processors.

The communication I/F 22 is implemented as hardware, firmware, or communication software such as a TCP/IP driver or a PPP driver, or a combination of these. The broadcast user device 20 can send and receive data to and from other devices via the communication I/F 22.

The display 23 has a display panel and a touch panel. The touch panel is configured to be able to detect touch operations (contact operations) by the player. The touch panel can detect various touch operations by the player, such as tapping, double tapping, and dragging. The touch panel may be equipped with a capacitance-type proximity sensor and configured to be able to detect non-contact operations by the player.

The camera 24 continuously captures images of the faces of the broadcast users Ua and Ub, and acquires imaging data of the faces of the broadcast users Ua and Ub. The imaging data of the faces of the broadcast users Ua and Ub captured by the camera 24 is transmitted to the server device 60 via the communication I/F 22. The camera 24 may be a 3D camera capable of detecting the depth of a person's face. The camera 24 may capture images of parts of the broadcast users Ua and Ub other than their faces, such as the hands, legs, fingers, or other parts of the face, to acquire imaging data.

The microphone 25 is a sound collection device configured to convert input voice into voice data. The microphone 25 is configured to acquire voice input from the broadcast users Ua and Ub. The voice input from the broadcast users Ua and Ub acquired by the microphone 25 is converted into voice data, and this voice data is transmitted to the server device 60 via the communication I/F 22.

The viewing user device 10 may have components similar to those of the broadcasting user device 20. For example, the viewing user device 10 may have a computer processor, a communication I/F, a display, and a camera. The viewing user device 10 may perform functions similar to those of the broadcasting user device 20 by downloading and installing specific application software.

The viewing user device 10 and the broadcasting user device 20 are information processing devices such as smartphones. In addition to smartphones, the viewing user device 10 and the broadcasting user device 20 may be mobile phones, tablet terminals, personal computers, e-book readers, wearable computers, game consoles, and various other information processing devices capable of playing videos. In addition to the above components, each of the viewing user device 10 and the broadcasting user device 20 may be equipped with a sensor unit equipped with various sensors such as a gyro sensor, and storage for storing various information.

Next, the server device 60 will be described. In the illustrated embodiment, the server device 60 includes a computer processor 61, a communication I/F 62, and storage 63.

The computer processor 61 is an arithmetic device that loads an operating system and various programs that realize various functions from the storage 63 or other storage into memory, and executes instructions contained in the loaded programs. The computer processor 61 is, for example, a CPU, an MPU, a DSP, a GPU, various other arithmetic devices, or a combination of these. The computer processor 61 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. In FIG. 1, the computer processor 21 is illustrated as a single component, but the computer processor 61 may be a collection of multiple physically separate computer processors.

The communication I/F 62 is implemented as hardware, firmware, or communication software such as a TCP/IP driver or a PPP driver, or a combination of these. The server device 60 can send and receive data to and from other devices via the communication I/F 62.

Storage 63 is a storage device accessed by computer processor 61. Storage 63 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or any other storage device capable of storing data. Various programs may be stored in storage 63. At least a portion of the programs and various data that may be stored in storage 63 may be stored in a storage device (e.g., storage 70) that is physically separate from server device 60.

In this specification, a program or instructions included in the program described as being executed by computer processor 21 or computer processor 61 may each be executed by a single computer processor, or may be executed in a distributed manner by multiple computer processors. In addition, a program or instructions included in the program executed by computer processor 21 or computer processor 61 may each be executed by multiple virtual computer processors.

Next, the data stored in storage 63 will be described. In the illustrated embodiment, storage 63 stores model data 63a, object data 63b, gift object information 63c, owned object information 63d, object display information 63e, and various other data necessary for generating and distributing the distribution video.

The model data 63a is model data for generating character animation. The model data 63a may be three-dimensional model data for generating three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 63a includes, for example, rig data (sometimes called "skeleton data") that indicates the skeleton of the character's face and other parts of the body, and surface data that indicates the shape and texture of the character's surface. The model data 63a may include multiple model data that are different from each other. The multiple model data may have different rig data from each other, or may have the same rig data. The multiple model data may have different surface data from each other, or may have the same surface data.

Object data 63b includes asset data for constructing a virtual space that constitutes the video. Object data 63b includes data for drawing the background of the virtual space that constitutes the video, data for drawing various objects that are displayed in the video, and data for drawing various other objects that are displayed in the video. Object data 63b may also include object position information that indicates the position of an object in the virtual space.

Gift object information 63c is information that manages gift objects. An example of gift object information 63c is shown in FIG. 3. As shown, in gift object 63c, object information indicating the characteristics of the object is stored in association with object identification information that identifies the object. The object information of a certain object may include image data showing an image of the object, type data indicating the type of the object, attachment position data indicating the attachment position on the character if the object is an attachment object described below, the price of the object, and various other data that characterize the object.

In one embodiment, a gift object is displayed in a video based on a gift display request from a viewing user who is viewing the video. There are various types of gift objects. Gift objects may include, for example, an effect object corresponding to an effect gift, a normal object corresponding to a normal gift, an attachment object corresponding to an attachment gift, and a message object corresponding to a message gift. A viewing user can purchase a desired gift. The distinction between viewing users and broadcasting users (e.g., broadcasting users Ua and Ub) is based on the actions of the users. For example, in the video broadcasting system 1, when a user watches a video, the user is called a viewing user, but when the user broadcasts a video, the user is called a broadcasting user.

An effect object that indicates an effect gift is an object that affects the overall impression of the viewing screen of the distributed video, for example an object that resembles confetti. The object that resembles confetti may be displayed across the entire viewing screen, thereby changing the overall impression of the viewing screen before and after it is displayed. Effect objects may be displayed so that they overlap with the character, but they differ from wearable objects in that they are displayed without being associated with any particular part of the character.

A normal object indicating a normal gift is an object indicating a gift from a viewing user to a broadcasting user (e.g., broadcasting users Ua and Ub), and is, for example, an object imitating a stuffed animal, a bouquet of flowers, an accessory, or an object that imitates an item suitable for a gift or present other than the above. In one aspect, the normal object is displayed on the video display screen so as not to come into contact with the character. In one aspect, the normal object is displayed on the video display screen so as not to overlap with the character. The normal object may be displayed so as to overlap with an object other than the character in the virtual space. The normal object may be displayed so as to overlap with a character, but is different from an attached object in that it is not displayed in association with a specific part of the character. In one aspect, when a normal object is displayed so as to overlap with a character, the normal object is displayed so as to overlap with a part of the character other than the head, including the face, and not to overlap with the head of the character. In one aspect, when a normal object is displayed so as to overlap with a character, the normal object is displayed so as to overlap with a part of the character other than the upper body, including the face, and not to overlap with the upper body of the character.

The wearable object indicating the wearable gift is an object displayed on the display screen in association with a specific body part (wearable body part) of the character. In one aspect, the wearable object displayed on the display screen in association with a specific body part of the character is displayed on the display screen so as to be in contact with the specific body part of the character. In one aspect, the wearable object displayed on the display screen in association with a specific body part of the character is displayed on the display screen so as to cover a part or all of the specific body part of the character. The specific body part may be specified by three-dimensional position information indicating a position in a three-dimensional coordinate space, or may be associated with position information in a three-dimensional coordinate space. For example, in the case of a character's head, the specific body parts may be defined in units of the front left side, front right side, rear left side, rear right side, front center, rear center, left eye, right eye, left ear, right ear, and all of the hair.

The wearing object is, for example, an accessory (headband, necklace, earrings, etc.) worn by a character, clothing (T-shirt, etc.), costume, and other objects that can be worn by a character. The gift object information 63c corresponding to the wearing object may include wearing part information indicating which part of the character the wearing object is associated with. The wearing part information of a certain wearing object can indicate which part of the character the wearing object is worn on. For example, if the wearing object is a headband, the wearing part information of the wearing object may indicate that the wearing object is worn on the "head" of the character. If the wearing part information on the part on which the wearing object is worn is specified as a position in a three-dimensional coordinate space, the wearing part information may be associated with multiple positions in the three-dimensional coordinate space. For example, the wearing part information indicating the position on which the wearing object indicating a "headband" is worn may be associated with two parts of the character, the "left rear of the head" and the "right rear of the head". In other words, the wearing object indicating a "headband" may be worn on both the "left rear of the head" and the "right rear of the head". If the wearing object is a T-shirt, the wearing part information of the wearing object may indicate that the wearing object is worn on the character's "torso."

Two types of wearable objects that share the same wearing location are displayed in the video at different times. In other words, two types of wearable objects that share the same wearing location are worn by a character at different times. In other words, two types of wearable objects that share the same wearing location are not worn by a character at the same time. For example, if a wearing object showing a headband and a wearing object showing a hat are both set to "head" as the wearing location, the wearing object showing the headband and the wearing object showing the hat will not be displayed at the same time.

Each gift object may have a display time set according to its type. In one embodiment, the display time of the attachment object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the attachment object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

Owned object information 63d is a list showing objects owned by users (viewing users and broadcasting users) of the video distribution system. An example of owned object information 63c is shown in FIG. 4. As shown in the figure, owned object information 63c stores an object ID that identifies an object owned by a viewing user in association with the account information of the viewing user. The account information of a viewing user is, for example, a user ID that identifies the viewing user. An object owned by a viewing user is, for example, the gift object described above. A broadcasting user can equip a character included in a video with an object that he or she owns while the video is being distributed.

Object display information 63e is information for managing attached objects displayed in association with the broadcast user's character in the video. An example of object display information 63d is shown in FIG. 5. As shown in the figure, object display information 63d stores an object ID that identifies an object displayed in the video in association with account information of the broadcast user broadcasting the video. Object display information 63d may also store an object ID that identifies an attached object displayed in the video in association with account information of the broadcast user broadcasting the video in association with the broadcast user's character. The broadcast user's account information is, for example, a user ID that identifies the broadcast user.

Next, the functions realized by computer processors 21a and 21b will be described in more detail. Computer processor 21a functions as face motion data generating unit 21a1 by executing computer readable instructions included in the distribution program. Similarly, computer processor 21b functions as face motion data generating unit 21b1 by executing computer readable instructions included in the distribution program. At least a part of the functions realized by computer processors 21a and 21b may be realized by a computer processor other than computer processors 21a and 21b of video distribution system 1. At least a part of the functions realized by computer processors 21a and 21b may be realized by, for example, computer processor 61 installed in server device 60.

The facial motion data generating unit 21a1 generates facial motion data, which is a digital representation of the facial movement of the broadcasting user Ua, based on the imaging data of the camera 24a. Similarly, the facial motion data generating unit 21b1 generates facial motion data, which is a digital representation of the facial movement of the broadcasting user Ub, based on the imaging data of the camera 24b. The facial motion data is generated as time passes. The facial motion data may be generated at predetermined sampling time intervals. In this way, the facial motion data generated by the facial motion data generating unit 21a1 can digitally represent the facial movement (changes in facial expression) of the broadcasting user Ua in a chronological order, and the facial motion data generated by the facial motion data generating unit 21b1 can digitally represent the facial movement (changes in facial expression) of the broadcasting user Ub in a chronological order. The facial motion data generated by the facial motion data generating units 21a1 and 21b1 is transmitted to the server device 60 via the communication I/Fs 22a and 22b.

In the broadcast user device 20, in addition to the facial motion data generated by the facial motion data generating unit 21a1, body motion data may be generated, which is a digital representation of the position and orientation of each part of the body of the broadcast users Ua and Ub other than the face. In addition to the facial motion data, the broadcast user device 20 may transmit the body motion data to the server device 60. In order to generate the body motion data, the broadcast users Ua and Ub may wear a motion sensor. The broadcast user device 20 may be configured to generate body motion data based on detection information of the motion sensor worn by the broadcast users Ua and Ub. The body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data represents the body movements of the broadcast users Ua and Ub in a time series as digital data. The generation of the body motion data based on the detection information of the motion sensor worn by the broadcast users Ua and Ub may be performed, for example, in a photography studio. The photography studio may be equipped with a base station, a tracking sensor, and a display. The base station may be a multi-axis laser emitter. The motion sensor attached to the broadcasting users Ua and Ub may be, for example, a Vive Tracker provided by HTC CORPORATION. The base station provided in the photography studio may be, for example, a base station provided by HTC CORPORATION. A supporter computer may be installed in a room separate from the photography studio. The display of the photography studio may be configured to display information received from the support computer. The server device 60 may be installed in the same room as the room in which the supporter computer is installed. The room in which the supporter computer is installed and the photography studio may be separated by a glass window. In this case, the operator of the supporter computer (sometimes referred to as a "supporter" in this specification) can visually recognize the broadcasting users Ua and Ub. The supporter computer may be configured to change the settings of various devices provided in the photography studio in response to the operation of the supporter. The supporter computer can, for example, set the scanning interval by the base station, set the tracking sensor, and change various settings of various other devices. Supporters can input messages into the supporter computer and have the input messages displayed on the display in the photography studio.

The broadcast user device 20 may realize functions other than the facial motion data generating unit 21a1 by executing the broadcast program and/or other programs on a computer processor. For example, the broadcast user device 20 may realize a function of playing received videos by executing a viewing program for video viewing. The broadcast program and the viewing program may be packaged in a single application software, or may be provided as separate application software.

The viewing user device 10 may be configured to provide functions similar to those of the broadcasting user device 20. For example, the viewing user device 10 may realize a function of playing received videos by executing a viewing program for video viewing, and may realize a function similar to that of the face motion data generating unit 21a1 by executing a broadcasting program.

Next, we will explain in more detail the functions realized by the computer processor 61. The computer processor 61 executes computer-readable instructions included in the distribution program to function as an animation generation unit 61a, a video generation unit 61b, a video distribution unit 61c, a gift request processing unit 61d, a gift purchase processing unit 61e, a co-starring application processing unit 61f, a determination unit 61g, a matching processing unit 61h, and a privilege granting unit 61i.

The animation generation unit 61a is configured to generate character animation by applying the facial motion data generated by the facial motion data generation unit 21a1 of the broadcasting user device 20 to predetermined model data included in the model data 63a. The animation generation unit 61a can generate animation of the character such that the character's facial expression changes based on the facial motion data. Specifically, the animation generation unit 61a can generate animation of the character that moves in synchronization with the facial movement of broadcasting user Ua based on the facial motion data related to broadcasting user Ua. Similarly, the animation generation unit 61a can generate animation of the character that moves in synchronization with the facial movement of broadcasting user Ub based on the facial motion data related to broadcasting user Ub.

When body motion data relating to broadcast users Ua and Ub is provided from the broadcast user device 20, the animation generation unit 61a can generate animation of a character that moves in synchronization with the body and facial movement of broadcast users Ua and Ub based on the body motion data and facial motion data relating to broadcast users Ua and Ub.

When distributing a video of the broadcast user Ua, the video generation unit 61b can generate a background image showing the background using the object data 63b, and generate a video including this background image and an animation of a character corresponding to the broadcast user Ua. The video generation unit 61b can synthesize the generated video with the voice of the broadcast user Ua, which is generated based on the voice data received from the broadcast user device 20a. Similarly, when distributing a video of the broadcast user Ub, the video generation unit 61b can generate a background image showing the background using the object data 63b, and generate a video including this background image and an animation of a character corresponding to the broadcast user Ub. The video generation unit 61b can attach an object that the broadcast user Ua or broadcast user Ub owns to their own character in response to a request from the broadcast user Ua or broadcast user Ub. The object that can be attached is, for example, the above-mentioned attachment object. The broadcast user Ua or broadcast user Ub can transmit a display request to the server device 60 to attach an attachment object to their own character before or after the start of distribution of the video by operating the broadcast user device 20a or broadcast user device 20b. The video generating unit 61b can have the wearable object attached to the character of the broadcast user device 20a or broadcast user device 20b based on this display request. The video generating unit 61b can synthesize the voice of broadcast user Ub, which is generated based on the voice data received from the broadcast user device 20b, into the generated video. In the video generated by the video generating unit 61b, the characters corresponding to broadcast users Ua and Ub are displayed superimposed on a background image. In this way, the video generating unit 61b can generate animation of a character that moves in synchronization with the facial movements of broadcast user Ua or broadcast user Ub, and generate a video for distribution in which the voice of broadcast user Ua or broadcast user Ub is synthesized into this animation. A co-starring video including both the character of broadcast user Ua and the character of broadcast user Ub will be described later.

The video distribution unit 61c distributes the video generated by the video generation unit 61b. This video is distributed to the viewing user device 10 and other viewing user devices via the network 50. The generated video is also distributed to the broadcasting user devices 20a and 20b. The received video is played back in the viewing user device 10 and the broadcasting user devices 20a and 20b.

Display examples of videos distributed from the video distribution unit 61c are shown in Figures 6, 7a, and 7b. In these figures, it is assumed that broadcast user Ub uses broadcast user device 20b to distribute a video including his/her own character, and that the video is being played on the viewing user device 10 and broadcast user devices 20a and 20b. In Figure 7a, it is assumed that broadcast user Ua is not distributing videos, and is watching a video distributed by another broadcast user, broadcast user Ub. For this reason, in the explanations of Figures 6 and 7a to 7b, broadcast user Ua may also be referred to as a viewing user. Figure 6 shows an example of a display of a video being played on the viewing user device 10, Figure 7a shows an example of a display of a video being played on the broadcast user device 20a, and Figure 7b shows an example of a display of a video being played on the broadcast user device 20b.

As shown in FIG. 6, an image 30 of a video distributed from a server device 60 is displayed on the display of the viewing user device 10. The image 30 displayed on the viewing user device 10 includes a character 31 of the broadcasting user Ub generated by an animation generation unit 61a, a gift button 32, a rating button 33, a comment button 34, and a comment display area 35.

As shown in FIG. 7a, an image 40a of a video distributed from a server device 60 is displayed on the display of the broadcasting user device 20a. Similar to image 30, this image 40a includes a character 31 of broadcasting user Ub, a gift button 32, a rating button 33, a comment button 34, and a comment display area 35. In addition, image 40a includes a co-starring request button 36 for requesting to co-star with broadcasting user Ub in a video being distributed by broadcasting user Ub. The broadcasting user device 20a can display image 40a of a distributed video by, for example, executing application software including a viewing program.

As shown in FIG. 6, in one embodiment, the image 30 of the viewing user device 10 does not include the request to perform together button 36. For example, when application software including a distribution program has not been downloaded or installed in the viewing user device 10, or when application software including a distribution program has not been started in the viewing user device 10, the image 30 of the viewing user device 10 is generated so that the request to perform together button 36 is not included. In other embodiments, the image 30 of the viewing user device 10 may also display the request to perform together button 36. For example, when application software including a distribution program has been downloaded or installed in the viewing user device 10, or when application software including a distribution program has been started in the viewing user device 10, the image 30 of the viewing user device 10 is generated so that the request to perform together button 36 is included.

As described above, character 31 is generated by applying the facial motion data of broadcast user Ub to the model data included in model data 63a, so its facial expression changes in synchronization with the facial movements of broadcast user Ub. When body motion data is provided from broadcast user device 20, body parts of character 31 other than its face can also be controlled to change in synchronization with the body movements of broadcast user Ub.

The gift button 32 is displayed on the image 30 so as to be selectable by an operation on the viewing user device 10. The gift button 32 can be selected, for example, by tapping on an area of the touch panel of the viewing user device 10 where the gift button 32 is displayed. In one embodiment, when the gift button 32 is selected, a window for selecting a gift to be gifted to the broadcasting user (here, broadcasting user Ub) who is broadcasting the video being viewed is displayed on the image 30. The viewing user can purchase a gift to be gifted from the gifts displayed on the window. In another embodiment, in response to the selection of the gift button 32, a window containing a list of purchased gifts is displayed on the image 30. In this case, the viewing user can select a gift to be gifted from the gifts displayed on the window. Gifts that can be gifted or purchased can include effect gifts, normal gifts, wearable gifts, and other gifts.

The rating button 33 is displayed on the image 30 so as to be selectable by a viewing user using the viewing user device 10. The rating button 33 can be selected, for example, by tapping on an area of the touch panel of the viewing user device 10 where the rating button 33 is displayed. When the rating button 33 is selected by a viewing user who is viewing a video, rating information indicating that the video has been positively rated may be transmitted to the server device 60. The server device 60 can aggregate rating information from the viewing user device 10 and other viewing user devices. Selection of the rating button 33 may transmit rating information indicating that the video has been negatively rated to the server device 60. Rating information indicating that a video has been positively rated may be called positive rating information, and rating information indicating that a video has been negatively rated may be called negative rating information.

The comment button 34 is displayed on the image 30 so that it can be selected by the user. When the comment button 34 is selected, for example, by a tap operation, a comment input window for inputting a comment is displayed on the image 30. The viewing user can input a comment via the input mechanism of the viewing user device 10 or the broadcasting user device 20a. The input comment is transmitted from the viewing user device 10 and the broadcasting user device 20a to the server device 60. The server device 60 accepts comments from the viewing user device 10, the broadcasting user device 20a, and other user devices, and displays the comments in the comment display area 35 in the image 30. In the comment display area 35, comments posted by each user are displayed, for example, in chronological order. The comment display area 35 occupies a part of the area of the image 30. There is an upper limit to the number of comments that can be displayed in the comment display area 35. In the illustrated example, up to three comments can be displayed in the comment display area 35. When comments are posted that exceed the upper limit set in the comment display area 35, the comments are deleted from the comment display area 35 in order of oldest posted comments. Therefore, the more frequently comments are received, the shorter the display time of each comment in the comment area 35. In one embodiment, a scroll bar is provided on the image 30, and comments that have been deleted from the comment display area 35 can be viewed by operating the scroll bar to scroll through the comments.

As shown in FIG. 7b, the display of the broadcast user device 20b displays an image 40b of a video broadcast from the server device 60. The image 40b displayed on the broadcast user device 20b includes a character 31 corresponding to the broadcast user Ub, display command buttons 42a-42c for displaying the worn gift requested to be displayed by the viewing user, and a comment display area 35. The image 40b displayed on the broadcast user device 20b includes the same background image, character image, and comment as the images 30 and 40a. On the other hand, the image 40b differs from the images 30 and 40a in that it does not include the gift button 32, rating button 33, comment button 34, or co-star request button 36, but includes the display command buttons 42a-42c.

The display instruction buttons 42a to 42c are displayed on the display screen 40 in response to receiving a display request from a viewing user to display a wearing gift, which will be described later. In the illustrated embodiment, three display instruction buttons 42a to 42c are displayed on the image 40b. Each of the display instruction buttons 42a to 42c is displayed on the display screen 40 so as to be selectable by the broadcasting user. When any of the display instruction buttons 42a to 42c is selected, for example, by a tap operation, an operation is performed to display the wearing gift corresponding to the selected display instruction button. In this way, the display instruction buttons 42a to 42c are display instruction objects for issuing an instruction to display the wearing gift in the video being broadcast. For this reason, in this specification, the display instruction buttons 42a to 42c may be referred to as display instruction objects 42a to 42c. In addition, when it is not necessary to distinguish the display instruction objects 42a to 42c from each other, they may be simply referred to as display instruction objects 42. Specific examples of displaying the wearing gift will be described later. The image 40b may be displayed on the supporter computer described above. The display instruction objects 42a to 42c may be selected in response to the operation of the supporter computer by the supporter.

Each time a display request for displaying an attached gift is received, a display instruction object 42 corresponding to that display request is added to the image 40b. There is an upper limit to the number of display instruction objects 42 that can be displayed on the image 40b. In the illustrated embodiment, the upper limit number of display instruction objects 42 that can be displayed on the image 40b is three. In this case, the image 40b has a display area that can display three display instruction objects. If four or more display requests for attached gifts are received, the display instruction objects 42 corresponding to the fourth and subsequent display requests are not displayed on the image 40b. The display instruction object 42 corresponding to the fourth-received display request for an attached gift is displayed on the image 40b when one of the three display instruction objects 42 already displayed is selected and a space is created in the display area.

The gift request processing unit 61d receives a gift display request from a viewing user and performs processing to display a gift object corresponding to the display request. Each viewing user can transmit a gift display request to the server device 60 by operating their own viewing user device. The gift display request may include the viewing user's user ID, gift identification information (gift ID) that identifies the gift requested to be displayed, and/or object identification information (object ID) that identifies the gift object corresponding to the gift requested to be displayed.

As described above, gift objects representing gifts may include effect objects corresponding to effect gifts, regular objects corresponding to regular gifts, and attachment objects corresponding to attachment gifts.

In one aspect, when the gift request processing unit 61d receives a display request from a viewing user for a specific regular gift, it performs processing for displaying a regular object representing the regular gift requested to be displayed in the video based on the display request. For example, when a display request is made for a regular gift representing a bag, the gift request processing unit 61d displays a regular object 37a representing a bag in the image 30 based on the display request, as shown in FIG. 8. Similarly, when a display request is made for a regular gift representing a stuffed bear, the gift request processing unit 61d displays a regular object 37b representing a stuffed bear in the image 30 based on the display request, as shown in FIG. 8. Although not shown in the figure, the regular objects 37a and 37b are also displayed in the image 40a in the broadcasting user device 20a and the image 40b in the broadcasting user device 20b, similar to the image 30.

In one aspect, when the gift request processing unit 61d receives a display request from a viewing user for a specific effect gift, it performs processing for displaying an effect object corresponding to the effect gift requested to be displayed in the display image of the video based on the display request. For example, when a display request is made for an effect gift showing confetti or fireworks, the gift request processing unit 61d displays an effect object (not shown) corresponding to the effect gift showing confetti or fireworks in images 30, 40a, and 40b based on the display request.

The display request for a normal gift may include a display position designation parameter that designates the display position of a normal object representing the normal gift. In this case, the gift request processing unit 61d can display the normal object at the position designated by the display position designation parameter. When the display position and display range of the character 31 are determined, the display position designation parameter can designate a position relative to the character 31 as the display position of the normal object.

In one aspect, the normal object may be displayed to move within the image 30 of the video. For example, the normal objects 37a and 37b may be displayed to fall from the top to the bottom of the screen. In this case, the normal objects 37a and 37b may be displayed within the image 30 from the start of the fall to the bottom of the image 30, and may disappear from the image 30 after falling to the bottom of the image 30. The movement direction of the normal objects 37a and 37b within the screen may be set arbitrarily. For example, the normal objects 37a and 37b may move from left to right, right to left, upper left to lower left, or in other directions in the image 30. The normal objects 37a and 37b can move on various trajectories. For example, the normal objects 37a and 37b can move on a straight trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or other trajectories. In addition to or instead of the display position designation parameter, the viewing user can include at least one of a movement direction parameter that designates the movement direction of the normal objects 37a and 37b and a trajectory parameter that designates the trajectory along which the normal objects 37a and 37b move, in the display request for the normal objects. In one embodiment, the effect objects and normal objects whose size in the virtual space is smaller than the reference size may be displayed so as to overlap part or all of them with the character 31. In one embodiment, the effect objects and normal objects whose size in the image 30 is larger than the reference size are displayed at a position that does not overlap with the character 31. In another embodiment, the effect objects and normal objects whose size in the virtual space is larger than the reference size may be displayed behind the character 31. The normal objects 37a and 37b may also be displayed so as to move as described above in the images 40a and 40b.

In one aspect, when the gift request processing unit 61d receives a display request from a viewing user to display a specific wearing object, it displays display instruction objects 42a to 42c on the image 40b on the broadcast user device 20 based on the display request, as shown in FIG. 7b. Each of the display instruction objects 42a to 42c is associated with the wearing gift for which the display request has been made. When one of the display instruction objects 42a to 42c is selected, the wearing gift associated with the selected display instruction object is displayed in the video being broadcast. For example, when a headband in the shape of cat ears is associated with the display instruction object 42b, when the display instruction object 42b is selected, the gift request processing unit 61d displays a wearing object 38 representing the headband corresponding to the selected display instruction object 42b in the video being broadcast. Display examples of a video including a wearing object 38 representing a headband are shown in FIG. 9 and FIG. 10a to FIG. 10b. Also, as shown in FIG. 10b, the selected display instruction object 42b is deleted from the image 40b.

The wearing object is displayed in the video in association with a specific part of the character (the wearing part). For example, the wearing object may be displayed in the video so as to be in contact with the wearing part of the character. The wearing object 38 may be displayed in the video so as to be worn on the wearing part of the character. In one embodiment, the wearing object 38 representing a headband is associated with the character's head. Therefore, in the display examples shown in Figures 9 and 10a to 10b, the wearing object 38 is worn on the head of the character 31. The wearing object may be displayed on the display screen of the video so as to move in conjunction with the movement of the wearing part of the character. For example, when the head of the character 31 wearing the wearing object 38 representing a headband moves, the wearing object 38 representing the headband also moves in conjunction with the head of the character 31 as if the headband was worn on the head of the character 31.

As described above, the gift object information 63c may include wearing part information indicating which part of the character the wearing object is associated with. In one aspect, when a wearing object is worn by a character, the gift request processing unit 61d prohibits the display of other wearing objects worn on the same or overlapping parts indicated by the wearing part information of the wearing object until the display time of the wearing object has elapsed. For example, a headband associated with both the "left rear of the head" and the "right rear of the head" overlaps with a hair accessory associated with the "left rear of the head", so when a headband is displayed, the display of a hair accessory with "left rear of the head" set as the wearing part information is prohibited. On the other hand, a headband associated with the "left rear of the head" and the "right rear of the head" and an earring associated with the "left ear (of the head)" and the "right ear (of the head)" can be worn at the same time, since their wearing parts on the character do not overlap.

In one embodiment, in order to prohibit the display of multiple wearing objects with the same or overlapping wearing parts, the display instruction object 42 for displaying the wearing object to be prohibited from being displayed may be deactivated. In the embodiment shown in FIG. 7b, the display instruction object 42a is assumed to be an object (button) for instructing the display of a hair accessory with "left rear of head" set as the wearing part information. In this case, since the character 31 is wearing the wearing object 38 representing a headband, the wearing object representing this hair accessory is prohibited from being displayed in the video while the wearing object 38 is worn by the character 31. In one embodiment, in order to prohibit the wearing object representing this hair accessory from being displayed in the video, the display instruction object 42a associated with the wearing object representing the hair accessory is deactivated. For example, the display instruction object 42a is made unselectable even if it is operated while the wearing object 38 is worn by the character 31. In another embodiment, the display instruction object 42a is erased from the image 40b while the wearing object 38 is worn by the character 31. The deactivated display instruction object 42a is activated again when the display time of the headband has elapsed. To reactivate the display instruction object 42a, for example, the display instruction object 42a that was made unselectable may be made selectable again, or the display instruction object 42a that was hidden may be displayed again in the image 40b.

The gift request processing unit 61d performs processing for displaying a gift object in response to a gift display request from a viewing user, as well as processing for updating the object display information 63e. For example, if an attachment object 38 is displayed in a video being distributed by the broadcasting user Ub, an object ID identifying the attachment object 38a is stored in the object display information 63e in association with a user ID identifying the broadcasting user Ub. Similarly, if another attachment object is displayed, an object ID identifying the displayed attachment object is stored in association with the user ID of the broadcasting user Ub. If an attachment object displayed in the video disappears from the screen (if the attachment object is no longer worn), the gift request processing unit 61d may delete the object ID identifying the attachment object that disappeared from the screen from the object display information 63e.

In one aspect, the gift purchase processing unit 61e transmits, in response to a request from a viewing user of a video, purchase information for each of a plurality of gift objects that can be purchased in relation to the video to the viewing user device of the viewing user (e.g., the viewing user device 10 and the broadcasting user device 20a). The purchase information for each gift object may include the type of the gift object (effect object, normal object, or wearable object), an image of the gift object, the price of the gift object, and other information necessary for purchasing the gift object. The viewing user can select a gift object to purchase based on the purchase information of the gift object displayed on the viewing user device 10 or the broadcasting user device 20a. The selection of the gift object to be purchased may be performed by operating the viewing user device 10 or the broadcasting user device 20a. When the gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 60. The gift purchase processing unit 61e performs a payment process based on the purchase request. When this payment process is completed, the purchased gift object is held by the viewing user. The storage 23 may store the gift ID of the purchased gift (or the gift object ID of the gift object indicating the gift) in association with the user ID of the viewing user who purchased the gift. The purchase of the gift object may be performed using a lottery, a loot box, or a roulette. In other words, the viewing user may obtain a gift item through the purchase of a lottery, a loot box, or a roulette without specifying the gift object to be purchased. In this specification, obtaining a gift item without specifying the gift object to be purchased may also be included in the "purchase" of a gift item.

The purchasable gift objects may be different for each video. The purchasable gift objects may be purchasable across multiple videos. That is, the purchasable gift objects may include unique gift objects that are unique to each video and common gift objects that are purchasable across multiple videos. For example, an effect object showing confetti may be a common gift object that is purchasable across multiple videos.

In one aspect, when an effect object is purchased while watching a specific video, the effect object to be purchased may be automatically displayed in the video being watched in response to completion of the payment process to purchase the effect object. When a normal object is purchased while watching a specific video, similar to the above, the normal gift object to be purchased may be automatically displayed in the video being watched in response to completion of the payment process to purchase the normal object.

In another aspect, in response to the completion of the payment process in the gift purchase processing unit 61e for the effect object to be purchased, a payment completion notification may be transmitted to the viewing user device 10, and a confirmation screen may be displayed on the viewing user device 10 to confirm to the viewing user whether or not to make a display request for the purchased effect object. If the viewing user selects to make a display request for the purchased effect object, a display request requesting the display of the purchased effect object may be transmitted from the viewing user's client device to the gift request processing unit 61d, and the gift request processing unit 61d may perform processing to display the effect object to be purchased in the video 70. When the object to be purchased is a normal object, a confirmation screen may be displayed on the viewing user device 10 to confirm to the viewing user whether or not to make a display request for the purchased normal object, as described above.

When a broadcast user receives a request to co-star from another broadcast user, the co-starring request processing unit 61f generates a co-starring video in which the broadcast user and the other broadcast user virtually co-star based on the co-starring request. The following explanation assumes a case in which broadcast user Ua, who is watching a video including broadcast user Ub's character 31, requests to co-star with broadcast user Ub. The co-starring request processing unit 61f can generate co-starring videos based on co-starring requests from various broadcast users, not just from a co-starring request from broadcast user Ua.

In one embodiment, the co-starring application processing unit 61f accepts a co-starring application from the broadcast user Ua and generates a co-starring video in response to the co-starring application. The broadcast user Ua can send a co-starring application to the server device 60 by operating the broadcast user device 20a. Specifically, when the co-starring application button 36 displayed on the broadcast user device 20a is selected, a co-starring application is sent from the broadcast user device 20a to the server device 60. The co-starring application button 36 can be selected, for example, by a tap operation on an area on the touch panel of the broadcast user device 20a where the co-starring application button 36 is displayed. In response to the selection of the co-starring application button 36, application software including a broadcast program may be launched in the broadcast user device 20a. The co-starring application sent from the broadcast user device 20a may include a user ID that identifies the broadcast user Ua. The co-starring application button 36 may be displayed from the time the video is distributed, or may be displayed in response to the broadcast user Ub inviting the broadcast user Ua. The broadcast user Ub may send an invitation to the broadcast user Ua to perform together from the broadcast user device 20b to the broadcast user device 20a, either via the server device 60 or without the server device 60.

The co-starring request processing unit 61f may determine whether or not to approve the co-starring request in response to receiving the co-starring request from the broadcast user device 20a. The co-starring request processing unit 61f may determine whether or not to approve the co-starring request based on various information about the broadcast user Ua who made the co-starring request. For example, if the broadcast user Ua's evaluations from other users are higher than a predetermined standard, the co-starring request from the broadcast user Ua may be approved, and conversely, if the broadcast user Ua's evaluations from other users are lower than a predetermined standard, the co-starring request from the broadcast user Ua may be rejected. In addition, the co-starring request processing unit 61f may inquire of the broadcast user Ub as to whether or not to approve the co-starring request from the broadcast user Ua, and determine whether or not to approve the co-starring request depending on the response.

In one embodiment, when a co-starring request from the broadcast user Ua is approved, the co-starring request processing unit 61f generates a co-starring video in which the broadcast user Ua and the broadcast user Ub appear together. To generate the co-starring video, the co-starring request processing unit 61f acquires face motion data and voice data of the broadcast user Ua from the broadcast user Ua. The face motion data of the broadcast user Ua may be transmitted from the broadcast user device 20a to the server device 60 together with the co-starring request, or may be transmitted from the broadcast user device 20a to the server device 60 in response to a request from the server device 60 after the co-starring request is approved. When the body movements of the broadcast user Ua are also represented as animation, the body motion data may be provided to the server device 60 together with the face motion data of the broadcast user Ua. When the co-starring request processing unit 61f cannot acquire face motion data from the broadcast user Ua, it may acquire only voice data from the broadcast user Ua. For example, if the broadcast user device 20a used by the broadcast user Ua does not have the function of the facial motion data generation unit 21a1 or other functions for video distribution, if that function is disabled, or in other cases, the co-starring request processing unit 61f may acquire audio data from the broadcast user Ua without acquiring facial motion data (and body motion data).

In one embodiment, the co-starring application processing unit 61f generates a co-starring image by adding animation of the character of broadcast user Ua to a video including character 31 of broadcast user Ub based on the facial motion data of broadcast user Ua. The animation of the character of broadcast user Ua may be generated by animation generation unit 61a based on the facial motion data of broadcast user Ua. The animation of the character of broadcast user Ua may be generated by applying the facial motion data of broadcast user Ua to model data for broadcast user Ua included in model data 63a. For example, the co-starring application processing unit 61f can generate a co-starring video including the character of broadcast user Ua and character 31 of broadcast user Ub by generating a layer including animation of the character of broadcast user Ua and superimposing this layer on a video including character 31 of broadcast user Ub. When the co-starring application processing unit 61f acquires voice data but not face motion data (and body motion data) from the broadcast user Ua, it can generate a co-starring video including the character 31 of the broadcast user Ub and the voice of the broadcast user Ua by superimposing a voice generated based on the voice data acquired from the broadcast user Ua onto a video including the character 31 of the broadcast user Ub. Even when model data for the broadcast user Ua is not set as the model data 63a, the co-starring application processing unit 61f can generate a co-starring video including the character 31 of the broadcast user Ub and the voice of the broadcast user Ua by superimposing a voice generated based on the voice data acquired from the broadcast user Ua onto a video including the character 31 of the broadcast user Ub. In this way, the broadcast user Ua can co-star with the broadcast user Ub using his or her own voice.

When the co-starring application processing unit 61f cannot obtain face motion data from the broadcast user Ua, it distributes a co-starring video including the voice of the broadcast user Ua and the character 31 of the broadcast user Ub, and then generates a character for the broadcast user Ua based on the face motion data of the broadcast user Ua at the timing when the face motion data is obtained from the broadcast user Ua, thereby generating a co-starring video including the character of the broadcast user Ua and the character 31 of the broadcast user Ub. In this way, the co-starring application processing unit 61f can switch a co-starring video including the voice of the broadcast user Ua and the character 31 of the broadcast user Ub to a co-starring video including the character of the broadcast user Ua and the character 31 of the broadcast user Ub. Conversely, the co-starring application processing unit 61f can switch a co-starring video including the character of the broadcast user Ua and the character 31 of the broadcast user Ub to a co-starring video including the voice of the broadcast user Ua and the character 31 of the broadcast user Ub. In this way, it may be possible to alternate between a co-starring video in which audio is played together (sometimes called an "audio co-starring video") and a co-starring video in which characters are played together (sometimes called a "character co-starring video").

The generated co-starring video is distributed by the video distribution unit 61c. The co-starring video may be created by the broadcast user device 20a or the broadcast user device 20b. When the co-starring video is generated by the broadcast user device 20a, the co-starring video is transmitted from the broadcast user device 20a to the server device 60 and distributed by the video distribution unit 61c of the server device 60. When the co-starring video is generated by the broadcast user device 20b, the co-starring video is transmitted from the broadcast user device 20b to the server device 60 and distributed by the video distribution unit 61c of the server device 60.

Display examples of a co-starring video distributed from video distribution unit 61c are shown in Fig. 11 and Fig. 12a to Fig. 12b. In these figures, it is assumed that broadcast user Ua has applied to co-star in a video distributed by broadcast user Ub, and as a result, a co-starring video including broadcast user Ua's character and the broadcast user's character is distributed, and broadcast user Ua has selected the co-starring application button 36 while viewing the image shown in Fig. 10a.

As shown in FIG. 11, the display of the viewing user device 10 displays an image 130 of the co-starring video distributed from the server device 60. The image 130 of the co-starring video displayed on the viewing user device 10 includes a character 131 of the broadcasting user Ua in addition to a character 31 of the broadcasting user Ub. The character 131 of the broadcasting user Ua is generated in the animation generation unit 61a or the co-starring application processing unit 61f, as described above. The image 130 of the co-starring video includes a gift button 32, a rating button 33, a comment button 34, and a comment display area 35, similar to the original distribution image shown in FIG. 6.

The image 130 of the co-starring video is displayed horizontally as shown. When the co-starring application processing unit 61f or the video distribution unit 61c distributes the co-starring image, it distributes it as a horizontally long image. As a result, the co-starring video is displayed as a horizontally long image 130 on the viewing user device 10. In one embodiment, as shown in FIG. 6, even if the original video (image) is vertically long, the co-starring image is converted to a horizontally long image and distributed. Since the co-starring image includes characters of two distribution users, by making it a horizontally long image, it is easier to display the characters of two users without overlapping. For example, in the co-starring image, the left half from the viewpoint of the viewing user may be an area assigned to the character of the original distribution user (host user), and the right half may be an area assigned to the character of the distribution user (guest user) who made the co-starring application. The allocation of areas to each distribution user may be determined arbitrarily so that the characters do not overlap.

12a and 12b, image 140a of the co-starring video distributed from server device 60 is displayed on broadcast user device 20a, and image 140b of the co-starring video is displayed on the display of broadcast user device 20b. These images 140a and 140b contain the same background image, character image, and comment as image 130. On the other hand, images 140a and 140b differ from image 130 in that they do not contain gift button 32, rating button 33, and comment button 34, but contain display instruction buttons 42a, 42c, and 42d. Since broadcast user Ua and broadcast user Ub appear together in the same co-starring image, image 140a displayed on broadcast user device 20a of broadcast user Ua and image 140b displayed on broadcast user device 20b of broadcast user Ub may be the same. Images 140a and 140b are also displayed horizontally in the same way as image 130, from the viewpoint of arranging multiple characters without overlapping. In the example shown in FIG. 11 and FIG. 12a-FIG. 12b, it is assumed that a viewing user viewing the co-starring image shown in FIG. 11 makes a display request for a wearing gift showing earrings, and as a result, a display instruction object 42d is added to the display image of the broadcast user device 20a and the broadcast user device 20b in response to the display request. The display instruction object 42d is an object (button) for instructing the display of earrings with "ear" set as the wearing body part information.

When an object is displayed in association with one of the characters of the host user and the guest user in the co-starring video, the determination unit 61g determines whether an object identical to the object is displayed in association with the other character. Therefore, when one of the characters of the host user and the guest user is wearing an attachment object, the determination unit 61g can determine whether the other character is wearing the same attachment object. The determination by the determination unit 61g may be performed with reference to the object display information 63e. As described above, the object display information 63e stores an object ID that identifies an attachment object displayed in association with the character of the broadcast user in the video in association with the account information of the broadcast user. Therefore, based on the object display information 63e, it is possible to identify the attachment object attached to the character 31 of the host user and the attachment object attached to the character 131 of the guest user. Based on the object display information 63e, the determination unit 61g can determine whether the host user and the guest user are wearing the same attachment object.

A specific example of the determination by the determination unit 61g will be described using the co-starring video shown in FIG. 11 as an example. In the image 130 of the co-starring video shown in FIG. 11, the attachment object 38 is displayed in association with the host user's character 31, but there is no attachment object displayed in association with the guest user's character 131. Therefore, based on the object display information 63e, the determination unit 61g determines that the attachment object 38 displayed in association with the host user's character 31 is not displayed in association with the guest user's character 131 (the character 131 is not equipped with the attachment object 38). When at least one of the host user's character 31 and the guest user's character 131 is wearing multiple attachment objects, the determination unit 61g can make the above determination for each of the multiple attachment objects.

The matching processing unit 61h displays a matching object in the co-starring video according to the determination result by the determination unit 61g. Specifically, when the determination unit 61g determines that an object identical to the attachment object is not displayed in association with the other character when an attachment object is displayed for one of the characters of the host user and the guest user, the matching processing unit 61h performs processing to display a matching object that is identical to the object displayed in association with the one character in association with the other character.

A specific example of the processing in the matching processing unit 61h will be described with reference to FIG. 11 and FIG. 13. When the co-starring video illustrated in FIG. 11 is being distributed, the determination unit 61g determines that the wearing object 38 displayed in association with the character 31 of the distribution user Ub (host user) is not displayed in association with the character 131 of the distribution user Ua (guest user). Based on the determination in the determination unit 61g, the matching processing unit 61h displays the matching object 138 in association with the guest user's character 131 that is not wearing the wearing object 38. In other words, the character 131 is made to wear the matching object 138. The matching object 138 is the same object as the wearing object 38. In the illustrated example, both the wearing object 38 and the matching object 138 are objects representing headbands that resemble cat ears. Since the wearing object 38 and the matching object 138 are the same wearing object, they may be identified by the same object ID.

The matching processing unit 61h may perform a process of displaying the matching object based on a display request requesting the display of the matching object. In one embodiment, when it is determined that the attachment object 38 displayed in association with the host user's character 31 in the co-starring video is not displayed in association with the guest user's character 131, the matching processing unit 61h can perform a process of prompting the viewing user of the co-starring video to send a display request for the matching object. For example, the gift button 32 can be highlighted in the image 130 of the viewing user device 10 playing the co-starring video. The highlighting of the gift button 32 can be performed, for example, by blinking the gift button 32, changing the color of the gift button 32, changing the size of the gift button 32, and in other ways. Various ways can be considered for the process of prompting the viewing user to make a display request for the matching object. The process of prompting the viewing user to make a display request for the matching object can include, for example, a process of highlighting the attachment object 38 attached to the character 31 in the image 130, a process of displaying a message indicating that the attachment object 38 is attached to only one of the characters in the image 130, a process of displaying a message prompting the viewing user to make a display request for the other matching objects, and other processes.

When a process is performed to prompt the viewing user to make a display request for the matching object, the viewing user can operate the viewing user device 10 to send a display request for the matching object to the server device 60. For example, the viewing user can select an object identical to the attachment object 38 as an object to be gifted by operating the gift button 32, and send a display request for the selected object (matching object) to the server device 60. The display request for the matching object may include an object ID that identifies the matching object to be displayed. When the server device 60 receives a display request for the matching object from the viewing user device 10, the gift request processing unit 61d displays the matching object 138 in association with the character 131 based on the display request. Since the matching object 138 is a type of attachment object, a display instruction object associated with the matching object 138 may be displayed in at least one of the image 140a displayed on the broadcast user device 20a and the image 140b displayed on the broadcast user device 20b when a display request for the matching object is made. In this case, the matching object 138 may be displayed in the co-starring video in response to the selection of the display instruction object associated with the matching object 138. The matching object 138 may be displayed in the co-starring video in response to a request to display the matching object 138 being accepted by the server device 60, regardless of the selection of the display instruction object.

A display example of the matching object 138 is shown in FIG. 13. FIG. 13 shows a display example of an image of a co-starring video in which the matching object 138 is displayed in association with the character 131. As shown in FIG. 13, in the co-starring video 130 displayed on the viewing user device 10, the matching object 138 is displayed in association with the character 131. Similarly, the matching object 138 is displayed in association with the character 131 in the image 140a displayed on the broadcasting user device 20a and the image 140b displayed on the broadcasting user device 20b. As shown in the figure, the attachment object 38 and the matching object 138 are attached to the same attachment parts of the character 31 and the character 131. Specifically, the attachment object 38 and the matching object 138 are displayed in association with the head of the character 31 and the head of the character 131, respectively.

In another embodiment, when it is determined that the attachment object 38 displayed in association with the host user's character 31 in the co-starring video is not displayed in association with the guest user's character 131, the matching processing unit 61h can perform a process of prompting the user of the character 131 (broadcast user Ua) who is not wearing the attachment object 38 to send a display request for the matching object. Various aspects can be considered for the process of prompting the broadcast user Ua, who is the user of the character 131 who is not wearing the attachment object 38, to send a display request for the matching object. The process of prompting the broadcast user Ua to send a display request for the matching object may include, for example, a process of highlighting the attachment object 38 attached to the character 31 in the image 140a, a process of displaying a message indicating that the attachment object 38 is attached to only one of the characters in the image 140a, a process of displaying a message prompting the broadcast user Ua to make a display request for the other matching object, and other processes. When the process of prompting the broadcast user Ua to make a display request for the matching object is performed, the broadcast user Ua can operate the broadcast user device 20a to send a display request for the matching object to the server device 60. The video generating unit 61b displays the matching object 138 in association with the character 131 based on the display request.

In another embodiment, when it is determined that the attachment object 38 displayed in association with the host user's character 31 in the co-starring video is not displayed in association with the guest user's character 131, the matching processing unit 61h can perform a process of prompting the user of the character 31 wearing the attachment object 38 (broadcast user Ub) to send a display request for the matching object. Various aspects can be considered for the process of prompting the broadcast user Ub, who is the user of the character 31 wearing the attachment object 38, to send a display request for the matching object. The process of prompting the broadcast user Ub to send a display request for the matching object may include, for example, a process of highlighting the attachment object 38 worn on the character 31 in the image 140b, a process of displaying a message indicating that the attachment object 38 is worn on only one of the characters in the image 140b, a process of displaying a message prompting the broadcast user Ub to make a display request for the other matching object, and other processes. When the process of prompting the broadcast user Ub to send a display request for the matching object is performed, the broadcast user Ub can operate the broadcast user device 20b to send a display request for the matching object to the server device 60. The video generating unit 61b displays the matching object 138 in association with the character 131 based on the display request.

By displaying the matching object 138 in the co-starring video, both the character 31 and the character 131 will be wearing the same attachment object. This improves the uniformity of the co-starring video. More specifically, the uniformity of the appearance of the host user's character and the guest user's character in the co-starring video will be improved.

The matching object 138 is displayed in the co-starring video based on a display request for the matching object 138 from the viewing user, a display request by the broadcasting user Ua, or a display request by the broadcasting user Ub. The matching object 138 may be made attachable to the character 131 only in that co-starring video. In other words, a matching object (e.g., matching object 138) displayed in a specific co-starring video based on a display request for the matching object 138 from the viewing user, a display request by the broadcasting user Ua, or a display request by the broadcasting user Ub cannot be used by other videos.

When a matching object is displayed in association with one of the characters of the users who appear together in the co-starring video, the bonus granting unit 61i grants a bonus to the other user. For example, in the example shown in FIG. 11 and FIG. 13, when the matching object 138 is displayed in association with the character 131, the bonus granting unit 61i grants a bonus to the distribution user Ub who is the user of the character 31. When the matching object 138 is displayed in association with the character 131, the bonus granting unit 61i may grant a bonus to the distribution user Ua who is the user of the character 131. When the matching object 138 is displayed in association with the character 131, the bonus granting unit 61i may grant a bonus to the viewing user who is viewing the co-starring video. The bonus granting unit 61i may grant a bonus to all viewing users who are viewing the co-starring video, or may grant a bonus only to some of the viewing users who are viewing the co-starring video. The reward granting unit 61i may grant rewards to each of the broadcast user Ua, the broadcast user Ub, and the viewing user. The reward granting unit 61i may grant rewards only to the viewing users who have gifted the matching object 138 among the viewing users who are watching the co-starring video. The rewards granted by the reward granting unit 61i may include points that can be used in the video distribution service provided by the video distribution system 1, points that can be used on a specific platform other than the video distribution system 1, crypto assets such as bitcoin, gifts to be gifted to other broadcast users (e.g., broadcast user Ub), objects that can be displayed in the distributed video, and various other rewards.

Next, a video distribution process according to one aspect will be described with reference to Figs. 14 to 16. Fig. 14 is a flow diagram showing the flow of video distribution process in one embodiment, Fig. 15 is a flow diagram showing the flow of processing for distributing a co-starring video in one embodiment, and Fig. 16 is a flow diagram showing the flow of processing for displaying a matching object in one embodiment. In the video distribution process described with reference to these figures, a video generated based on face motion data acquired by broadcast user Ub using broadcast user device 20b is distributed, and it is assumed that a broadcast user Ua who is watching this video will make a co-starring request.

First, in step S11, face motion data, which is a digital representation of the facial movements (facial expressions) of broadcast user Ub, is generated. The generation of the face motion data is performed, for example, by the face motion data generation unit 121b of the broadcast user device 20b. In the broadcast user device 20b, voice data may be generated based on voice input from broadcast users Ua and Ub. The generated face motion data and voice data are transmitted to the server device 60.

Next, in step S12, the facial motion data from the broadcast user device 20b is applied to the model data for broadcast user Ub, thereby generating an animation of the character object 31 that moves in synchronization with the facial movements of broadcast user Ub. This animation is generated, for example, by the animation generation unit 61a described above.

Next, in step S13, a video including an animation of the character object 31 of the broadcast user Ub is generated. The voice of the broadcast user Ub may be synthesized into this video. The animation of the character object 31 is displayed superimposed on a background image. The generation of this video is performed, for example, by the video generation unit 61b described above.

Next, the process proceeds to step S14, where the video generated in step S13 is distributed. This video is distributed via the network 50 to the viewing user device 10, other viewing user devices, and distribution user devices. When the distributed video is played on the viewing user device 10, for example, an image of the video as shown in FIG. 5 is displayed on the viewing user device 10. The video is continuously distributed for a predetermined distribution period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, or any other time. This video is distributed, for example, by the video distribution unit 61c described above.

Next, the process proceeds to step S15, where it is determined whether or not the end condition for ending the distribution of the video has been met. The end condition may be, for example, that the end time of the distribution has been reached, that the broadcast user Ub has performed an operation to end the distribution on the broadcast user device 20b, or other conditions. If the end condition has not been met, the processes of steps S11 to S14 are repeatedly executed, and the distribution of the video including animation synchronized with the movements of the broadcast user Ub, or the co-starring video if the co-starring with the broadcast user Ua is continuing, is continued. If it is determined that the end condition for the video has been met, the distribution process of the video is terminated.

Next, the distribution process of a co-starring video in one embodiment will be described with reference to FIG. 15. FIG. 15 is a flow diagram showing the flow of the process of distributing a co-starring video in one embodiment. In the distribution process of a co-starring video described with reference to FIG. 15, it is assumed that a co-starring request is made to broadcast user Ub from broadcast user Ua, who is watching a video including a character object of broadcast user Ub. The distribution process of a co-starring video is performed in parallel with the distribution process of the video shown in FIG. 14.

First, during distribution of a video including a character object of broadcast user Ub, in step S21, it is determined whether a co-starring request has been made from a user other than broadcast user Ub. A co-starring request is made, for example, by broadcast user Ua. If a co-starring request has been made by broadcast user Ua, processing proceeds to step S22.

In step S22, one or more guest users are selected from among the broadcast user Ua who requested the co-starring and other users. In this embodiment, it is assumed that the broadcast user Ua is selected as the guest user. The decision as to whether or not to approve this co-starring request is made, for example, by the co-starring request processing unit 61f.

If the co-starring request from broadcast user Ua is approved in step S22, processing proceeds to step S23. In step S23, animation of broadcast user Ua's character object 131 is generated based on the face motion data of broadcast user Ua. A co-starring video is then generated by adding animation of broadcast user Ua's character object 131 to the video being distributed (video including broadcast user Ub's character object 31). The processing in step S22 is performed, for example, by the above-mentioned co-starring request processing unit 61f.

Next, the process proceeds to step S24. In step S24, the co-starring video generated in step S23 is distributed. This co-starring video is distributed via network 50 to the viewing user device 10 and other viewing user devices and broadcasting user devices. The co-starring video includes, for example, an animation of the character object 131 of broadcasting user Ua and an animation of the character object 31 of broadcasting user Ub, as shown in Figures 11 and 12a to 12b.

Next, the process proceeds to step S25. In step S25, it is determined whether the co-starring end condition has been met. For example, it is determined that the co-starring end condition has been met when any of the following conditions is met: the character object 131 of the guest user, broadcast user Ua, is in an inactive state; the co-starring user evaluation points have fallen below a predetermined threshold; a co-starring end instruction has been received from the host user, broadcast user Ub; or a predetermined amount of time has passed since the start of broadcast of the co-starring video. If the co-starring end condition has been met, the process proceeds to step S26.

In step S26, processing is performed to end the distribution of the co-starring video. For example, the character object 131 of broadcast user Ua, who is a guest user, is removed from the co-starring video, thereby ending the co-starring between broadcast user Ua and broadcast user Ub. Even if the co-starring ends, the video may continue to be distributed. The video distributed after the co-starring ends does not include character object 131 of broadcast user Ua.

Next, with further reference to FIG. 16, the flow of processing for displaying a matching object in one embodiment will be described. In the display processing for a matching object described with reference to FIG. 16, as shown in FIG. 11, a co-starring video is distributed in which a character 31 of a broadcast user Ub and a character 131 of a broadcast user Ua appear together, and it is assumed that the character 131 is not wearing the wearing object 38 that the character 31 is wearing. The display processing for a matching object may be performed in parallel with the distribution processing for the co-starring video shown in FIG. 15.

First, in step S31, a co-starring video in which the character 31 of the broadcast user Ub and the character 131 of the broadcast user Ua appear together is distributed. The generation and distribution of the co-starring video is performed, for example, by the co-starring application processing unit 61f and the video distribution unit 61c described above.

Next, in step S32, it is determined whether the characters appearing together in the co-starring video are wearing the same attachment object. The determination process in step S32 is performed, for example, by the above-mentioned determination unit 61g. In the co-starring video, character 31, one of the characters appearing together, is wearing attachment object 38, so it is determined whether character 131, the other of the characters appearing together, is wearing attachment object 38. If character 131 is wearing the same object as attachment object 38, the display process of the matching object ends. If character 131 is not wearing the same object as attachment object 38, as in the example shown in FIG. 11, the process proceeds to step S33.

In step S33, it is determined whether a display request for the matching object has been made. The display request for the matching object is made, for example, by the viewing user of the co-starring video, the broadcast user Ua, or the broadcast user Ub. In step S33, a process may be performed to prompt at least one of the viewing users of the co-starring video, the broadcast user Ua, and the broadcast user Ub to send a display request for the matching object. In response to the process of prompting the transmission of the display request for the matching object, the viewing user of the co-starring video, the broadcast user Ua, or the broadcast user Ub can operate the viewing user device 10, the broadcast user device 20a, or the broadcast user device 20b to send a display request for the matching object to the server device 60. The determination of whether a display request for the matching object has been made is performed, for example, in the above-mentioned matching processing unit 61h. If a display request for the matching object has been made, the process proceeds to step S34.

In step S34, a display process is performed to display the matching object. For example, the matching object 138 is displayed in association with the character 131 in the co-starring video. As a result, the character 31 of the broadcast user Ub and the character 131 of the broadcast user Ua can wear the same wearable object in the co-starring video.

The matching object display process shown in FIG. 16 may be performed repeatedly during distribution of the co-starring video. In the matching object display process, the matching object may be displayed automatically when it is determined that the characters appearing together are not wearing the same attachment object. For this reason, step S33 may be omitted.

Next, an example of the effect of the above embodiment will be described. According to the above embodiment, it is possible to have each of the characters appearing together in a co-starring video wear the same wearable object. For example, when character 31 wears wearable object 38 in a co-starring video, it is possible to have character 131 wear a matching object 138 that is the same as the wearable object. This can improve the uniformity of the co-starring videos.

According to the above embodiment, the matching object is available only in the co-starring video in which the matching object is displayed. In one embodiment, the broadcasting user purchases an object (e.g., an attachment object) to be displayed in association with a character in the video and then displays the object in the video. For this reason, if an object that the broadcasting user purchased for a fee is given to other users who are broadcasting with the user in a form that allows them to use the object freely and free of charge, fairness between users will be lacking. In the above embodiment, the matching object displayed in the co-starring video is available only in the co-starring video, and cannot be used in other videos. In this way, by limiting the scope of use of the matching object, it is possible to improve uniformity in the co-starring videos while maintaining fairness between users of the video broadcasting system.

According to the above embodiment, a matching object can be displayed in a co-starring video based on a display request from a viewing user. Therefore, according to the above embodiment, gifting of a matching object by a viewing user can be encouraged. If a viewing user does not own a matching object, the viewing user may purchase the matching object and then gift it. In this case, the purchase of a matching object is also encouraged.

According to the above embodiment, a matching object can be displayed in a co-starring video based on a display request from a user of a character wearing the wearable object (e.g., broadcast user Ub). Therefore, according to the above embodiment, a user who does not own a wearable object or owns a small number of wearable objects can be given an incentive to appear in a co-starring video.

According to the above embodiment, a matching object can be displayed in a co-starring video based on a display request from a user of a character not wearing an attachment object (e.g., broadcast user Ua). If a user of a character not wearing an attachment object does not own the matching object at the time when prompted to make a display request for the matching object, the user purchases the matching object before making a display request. Therefore, according to the above embodiment, it is possible to encourage users of characters not wearing attachment objects to purchase matching objects.

According to the above embodiment, when a matching object 138 is displayed in association with the character of broadcast user Ua (guest user) and broadcast user Ub (host user) who appear together in a co-starring video, a benefit is given to broadcast user Ub, who is the host user. Therefore, when broadcasting a co-starring video, an opportunity to obtain a benefit is provided by wearing a wearable object. Therefore, it is possible to provide an incentive for participants in the co-starring video (host user and guest user) to wear many wearable objects. This promotes the acquisition and purchase of wearable objects.

According to the above embodiment, when a matching object 138 is displayed in association with the character of broadcast user Ua, of broadcast user Ua and broadcast user Ub who appear together in a co-starring video, a benefit is granted to broadcast user Ua, who is a guest user. Therefore, by becoming a guest user in a co-starring video, a benefit can be obtained, and it is possible to encourage viewing users to apply to appear together.

According to the above embodiment, a benefit is given to viewing users who are watching the co-starring video and who have gifted a matching object 138. This makes it possible to give the viewing users an incentive to gift a matching object 138.

According to the above embodiment, when a matching object 138 is displayed in association with the character of broadcast user Ua, of broadcast user Ua and broadcast user Ub who appear together in a co-starring video, a bonus may be granted to each of broadcast user Ua, broadcast user Ub, and the viewing user. This allows bonuses to be granted to all users involved in the co-starring video, which in turn increases the amount of gifting and message sending that occurs after the bonus is granted, creating excitement in the co-starring video.

According to the above embodiment, the matching object is worn in the same wearing part as the matching object worn by the co-star. For example, the matching object 138 is worn in the same wearing part (i.e., the head) as the wearing object 38. This can further improve the sense of unity in the co-starring video.

In the video distribution system 1 according to the above embodiment, the broadcast users Ua and Ub can distribute videos including characters that move according to their facial expressions using a broadcast user device 20 equipped with a camera such as a smartphone. In this way, in the video distribution system 1, the equipment required for the broadcast users Ua and Ub to distribute videos is simplified, and a platform that is easy for the broadcast users Ua and Ub to participate in is realized.

In the processing procedures described in this specification, particularly in processing procedures described using flow diagrams, it is possible to omit some of the processes (steps) that make up the processing procedures, to add processes that are not explicitly stated as processes that make up the processing procedures, and/or to change the order of the steps, and processing procedures in which such omissions, additions, or changes in order have been made are also included within the scope of the present invention as long as they do not deviate from the spirit of the present invention.

At least a part of the functions realized by the computer processor 61 may be realized by a computer processor other than the computer processor 61 of the video distribution system 1. At least a part of the functions realized by the computer processor 61 may be realized, for example, by the computer processor 21 of the broadcasting user device 20, or by the computer processor of the viewing user device 10. Specifically, some or all of the functions of the animation generation unit 61a and the video generation unit 61b may be executed in the broadcasting user device 20. For example, a video generated in the broadcasting user device 20 may be transmitted to the server device 60 and distributed from the server device 60 to the viewing user device 10.

When a broadcast user Ua who is watching a video including the character 31 of broadcast user Ub makes a request to perform together with broadcast user Ub, the animation of the character 131 of the broadcast user Ua who made the request to perform together may be generated by the server device 60, the broadcast user device 20a of the broadcast user Ua, the broadcast user device 20b of the broadcast user Ub, the viewing user device 10, or other devices. In one example, when the animation of the character 131 of the broadcast user Ua is generated by the broadcast user device 20b of the broadcast user Ub, the face motion data and voice data of the broadcast user Ua are transmitted from the broadcast user device 20a of the broadcast user Ua to the broadcast user device 20b of the broadcast user Ub. In the broadcast user device 20b, the animation of the character 131 is generated by applying the face motion data and voice data of the broadcast user Ua received from the broadcast user device 20a to the model data for the broadcast user Ua. This model data for the broadcast user Ua may be transmitted from the server device 60 to the broadcast user device 20a. In another example, when animation of the character 131 of the broadcast user Ua is generated in the viewing user device 10, facial motion data and voice data of the broadcast user Ua are transmitted from the broadcast user device 20a of the broadcast user Ua to the viewing user device 10, and facial motion data and voice data of the broadcast user Ub are transmitted from the broadcast user device 20b of the broadcast user Ub to the viewing user device 10. In the viewing user device 10, animation of the character 131 may be generated by applying the facial motion data and voice data of the broadcast user Ua received from the broadcast user device 20a to model data for the broadcast user Ua, and animation of the character 31 may be generated by applying the facial motion data and voice data of the broadcast user Ub received from the broadcast user device 20b to model data for the broadcast user Ub. This model data for the broadcast user Ua and the model data for the broadcast user Ub may be transmitted from the server device 60 to the viewing user device 10. In this way, a co-starring video including animation of the broadcast user's character and/or animation of the character object may be generated in any device included in the video distribution system 1. Character animation may be generated in a device not explicitly shown in FIG. 1. The facial motion data and voice data of broadcast user Ua are transmitted from broadcast user device 20a of broadcast user Ua to the device that generates the character animation, and the facial motion data and voice data of broadcast user Ub are transmitted from broadcast user device 20b of broadcast user Ub. Body motion may be transmitted in addition to facial motion.

In addition, the generation of the co-starring video including the generated character 131 of broadcast user Ua and the broadcast video and character 31 of broadcast user Ub may be performed by any of the server device 60, the broadcast user device 20a of broadcast user Ua, the broadcast user device 20b of broadcast user Ub, or the viewing user device 10. The co-starring video may be generated by the server device 60, the broadcast user device 20a, the broadcast user device 20b, the viewing user device 10, and other devices in a shared manner. If a gift object is included in the co-starring video, data for displaying the gift object may be transmitted from the server device 60 or other devices to the device generating the co-starring video.

A co-starring video may include characters from three or more broadcast users. In other words, three or more broadcast users may virtually appear together in a video using their respective characters.

The inventions described in the claims of the original application of this application are set forth below.
[1]
one or more computer processors;
The one or more computer processors execute the computer readable instructions to:
Distributing a co-starring video including a first character generated based on a movement of a first user and a second character generated based on a movement of a second user;
displaying a matching object, which is the same as a first object displayed in association with the first character and is available only in the co-starring video, in association with the second character in the co-starring video;
Video distribution system.
[2]
the matching object being an object purchased by the first user;
The video distribution system according to [1].
[3]
determining whether a matching object identical to the first object is displayed in association with the second character;
when it is determined that the matching object is not displayed in association with the second character, prompting a display request to display the matching object in association with the second character;
displaying the matching object in association with the second character in the co-starring video based on the display request;
A video distribution system according to [1] or [2].
[4]
when it is determined that the matching object is not displayed in association with the second character, prompting one or more viewing users who are viewing the co-starring video to make a display request to display the matching object in association with the second character;
The video distribution system according to [3].
[5]
when it is determined that the matching object is not displayed in association with the second character, prompting the first user to make a display request to display the matching object in association with the second character;
A video distribution system according to [3] or [4].
[6]
when it is determined that the matching object is not displayed in association with the second character, prompting the second user to make a display request to display the matching object in association with the second character;
A video distribution system according to any one of claims [3] to [5].
[7]
When the matching object is displayed in association with the second character in the co-starring video, a benefit is given to the first user.
A video distribution system according to any one of claims [1] to [6].
[8]
giving a benefit to the second user when the matching object is displayed in association with the second character in the co-starring video;
A video distribution system according to any one of claims [1] to [6].
[9]
When the matching object is displayed in the co-starring video in association with the second character, a benefit is given to one or more viewing users who are viewing the co-starring video.
A video distribution system according to any one of claims [1] to [6].
[10]
when the matching object is displayed in response to a display request from a first viewing user among one or more viewing users viewing the co-starring video to display the matching object in association with the second character, a privilege is given to the first viewing user.
A video distribution system according to any one of claims [1] to [6].
[11]
When the matching object is displayed in the co-starring video in association with the second character, a privilege is given to each of the first user, the second user, and one or more viewing users who are viewing the co-starring video.
A video distribution system according to any one of claims [1] to [6].
[12]
The co-starring video is generated in response to receiving a co-starring application from the second user to co-star with the first user.
A video distribution system according to any one of claims [1] to [11].
[13]
the first object is displayed in association with an attachment portion of the first character;
the matching object is displayed in correspondence with the attachment portion of the second character;
A video distribution system according to any one of claims [1] to [12].
[14]
1. A method for streaming video that is executed by one or more computer processors executing computer-readable instructions, comprising:
A step of distributing a co-starring video including a first character generated based on a movement of a first user, a second character generated based on a movement of a second user, and a first object displayed in association with the first character;
a step of displaying a matching object, which is identical to the first object and is available only in the co-starring video, in association with the second character in the co-starring video;
A video distribution method comprising:
[15]
one or more computer processors,
A step of distributing a co-starring video including a first character generated based on a movement of a first user, a second character generated based on a movement of a second user, and a first object displayed in association with the first character;
a step of displaying a matching object, which is identical to the first object and is available only in the co-starring video, in association with the second character in the co-starring video;
A video distribution program that executes the following.

1 Video distribution system 10 Viewing user devices 20a, 20b Distributor user device 61a Animation generation unit 61b Video generation unit 61c Video distribution unit 61d Gift request processing unit 61e Gift purchase processing unit 61f Co-starring application processing unit 61g Determination unit 61h Matching processing unit 61i Benefit granting unit

Claims (17)

one or more computer processors;
The one or more computer processors execute the computer readable instructions to:
distributing a co-starring video including a first character generated based on a movement of a first user, a second character generated based on a movement of a second user, and a first object displayed in association with the first character based on a first display request;
displaying a matching object identical to the first object in the co-starring video in association with the second character based on a second display request;
Video distribution system. determining whether a matching object identical to the first object is displayed in association with the second character;
when it is determined that the matching object is not displayed in association with the second character, prompting one or more viewing users who are viewing the co-starring video to make the second display request;
The video distribution system according to claim 1 . determining whether a matching object identical to the first object is displayed in association with the second character;
prompting the first user to make the second display request when it is determined that the matching object is not displayed in association with the second character;
The video distribution system according to claim 1 . determining whether a matching object identical to the first object is displayed in association with the second character;
prompting the second user to make the second display request when it is determined that the matching object is not displayed in association with the second character;
The video distribution system according to claim 1 . the matching object being an object purchased by the first user;
The video distribution system according to any one of claims 1 to 4. the matching object is an object purchased by the second user;
The video distribution system according to any one of claims 1 to 4. The matching object is an object purchased by the one or more viewing users.
The video distribution system according to claim 2. the second display request is different from the first display request;
A video distribution system according to any one of claims 1 to 7. When the matching object is displayed in association with the second character in the co-starring video, a benefit is given to the first user.
The video distribution system according to any one of claims 1 to 8. providing a benefit to the second user when the matching object is displayed in association with the second character in the co-starring video;
The video distribution system according to any one of claims 1 to 8. When the matching object is displayed in the co-starring video in association with the second character, a benefit is given to one or more viewing users who are viewing the co-starring video.
The video distribution system according to any one of claims 1 to 7. when the matching object is displayed in response to a display request from a first viewing user among one or more viewing users viewing the co-starring video to display the matching object in association with the second character, a privilege is given to the first viewing user;
The video distribution system according to any one of claims 1 to 8. When the matching object is displayed in the co-starring video in association with the second character, a privilege is given to each of the first user, the second user, and one or more viewing users who are viewing the co-starring video.
The video distribution system according to any one of claims 1 to 8. The co-starring video is generated in response to receiving a co-starring application from the second user to co-star with the first user.
The video distribution system according to any one of claims 1 to 13. the first object is displayed in association with an attachment portion of the first character;
the matching object is displayed in correspondence with the attachment portion of the second character;
The video distribution system according to any one of claims 1 to 14. 1. A method for streaming video that is executed by one or more computer processors executing computer-readable instructions, comprising:
a step of distributing a co-starring video including a first character generated based on a movement of a first user, a second character generated based on a movement of a second user, and a first object displayed in association with the first character based on a first display request;
displaying a matching object identical to the first object in the co-starring video in association with the second character based on a second display request;
A video distribution method comprising: one or more computer processors,
a step of distributing a co-starring video including a first character generated based on a movement of a first user, a second character generated based on a movement of a second user, and a first object displayed in association with the first character based on a first display request;
displaying, in the co-starring video, a matching object identical to the first object in correspondence with the second character based on a second display request;
A video distribution program that executes the following: