JP7104097B2 - Distribution A video distribution system, video distribution method, and video distribution program that delivers live videos including animations of character objects generated based on user movements. - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Law 1. GREE Co., Ltd. disclosed the invention related to the application at the business policy briefing session of its subsidiary, Bright Flyer Live Entertainment Co., Ltd., held on August 7, 2018. 2. https: // le. brightflyer. net / reality / GREE Co., Ltd. has released the invention related to the application on the VTuber dedicated live distribution platform "REALITY" provided by Bright Flyer Live Entertainment Co., Ltd. from August 7, 2018 at the above URL.

The disclosure in the present specification relates to a video distribution system, a video distribution method, and a video distribution program for live distribution of a video including an animation of a character object generated based on the movement of a distribution user.

Conventionally, there has been known a video distribution system that generates an animation of a character object based on the movement of a distribution user and delivers a video including the animation of the character object live. Such a video distribution system is described in, for example, Japanese Patent Application Laid-Open No. 2015-184689 (Patent Document 1) and "Yusuke Hasegawa, the dawn of a new era of virtual idols PROJECT MariA, CG WORLD, Japan, Bone Digital Co., Ltd., November 2017. 10th, Vol. 231 pp. 74-79 ”(Non-Patent Document 1).

There is also known a content distribution system that displays a gift object corresponding to a gift purchased by the viewing user on a display screen in response to a request from a viewing user who views the content. For example, in the video distribution system disclosed in Japanese Patent Application Laid-Open No. 2012-121998 (Patent Document 2), a viewing user purchases a gift item and provides the purchased gift item as a gift to the distribution user. Can be done. The gift is displayed in the video being delivered in response to a display request from the viewing user. The gift display request may also be automatically generated in response to the gift being purchased by the viewing user.

JP 2015-184689 Japanese Unexamined Patent Publication No. 2012-121998

Yusuke Hasegawa, Dawn of a new era of virtual idols PROJECT MariA, CG WORLD, Japan, Bone Digital Co., Ltd., November 10, 2017, Volume 231 and pp. 74-79

In the above-mentioned prior art, the gift is automatically displayed in the video being distributed in response to the gift display request from the viewing user. Therefore, the gift may be displayed in the video at a timing undesired by the distribution user. This causes a problem for the distribution user that the performance through the character object is hindered. For example, if a gift is prominently displayed in a video during a performance, the performance cannot be fully expressed in the video.

Further, if the gift is displayed in the video at a timing that does not match the desire of the distribution user, the viewing experience of the viewing user may be deteriorated. For example, if a major part of a video is hidden by a gift, the viewer may feel that the video has been blocked. This problem can be exacerbated, especially if a large number of gifts are displayed in duplicate with the video. Therefore, in Patent Document 2, the gift object is not displayed in the content display area where the moving image is displayed, but is displayed in the background area outside the content display area. In this way, in the conventional video distribution system, a gift may be displayed in the video at a timing that does not match the desire of the distribution user. Therefore, a gift is given to the main part of the video (for example, around the character object). There is a restriction that it is difficult to arrange the display area of.

An object of the present disclosure is to provide technical improvements that solve or alleviate at least some of the problems of the prior art described above. One of the more specific purposes of the present disclosure is to provide a video distribution system, a video distribution method, and a video distribution program capable of displaying a gift at a desired timing of a distribution user during distribution video.

One aspect of the present invention relates to a video distribution system for live distribution of a video including an animation of a character object generated based on the movement of a distribution user. The video distribution system includes one or more computer processors, which receive a first display request for a first gift from the viewing user by executing a computer-readable instruction. Accordingly, the display instruction object is displayed in the display area that occupies a part of the display screen in the distribution user device used by the distribution user, and the first gift is given in response to the operation on the display instruction object. Display in the video. In the display area, an upper limit number of the display instruction objects that can be displayed in the display area is set. In one embodiment, when the display instruction object is displayed in the display area by the upper limit number when the first display request is received, the display of the upper limit number displayed in the display area is displayed. After any of the instruction objects is operated, a new display instruction object corresponding to the first display request is displayed in the display area.

In one aspect of the present invention, the first gift is a wearing gift associated with the wearing part of the character object, and the wearing gift is the wearing part in the moving image in response to an operation on the display instruction object. Is displayed at the corresponding position.

In one aspect of the present invention, the wearing gift includes a first wearing gift associated with the first wearing part of the wearing parts, and the first wearing gift includes a first wearing part displayed in the moving image. When the display time is set and the one or more computer processors display the first wearing gift in the moving image, the first wearing gift among the wearing gifts is displayed until the first display time elapses. The display of the second wearing gift associated with the first wearing part in the moving image is prohibited.

In one aspect of the present invention, when the first wearing gift is displayed in the moving image, the one or more computer processors will use the first wearing gift among the wearing gifts until the first display time elapses. Deactivate the display instruction object for displaying the second wearing gift associated with the wearing site.

In one aspect of the present invention, in response to receiving a message gift associated with a message from the viewing user, the distribution user device is made to display the message, and the display instruction operation to the distribution user device is performed. The message gift is displayed on the moving image.

In one aspect of the present invention, the voice of the distribution user is synthesized in the moving image, and the distribution is made in response to receiving a voice change gift for changing the voice of the distribution user from the viewing user. A voice change instruction object is displayed on the user device, and the voice of the distribution user is changed to the voice specified by the voice change gift in response to an operation on the voice change instruction object.

In one aspect of the present invention, in response to receiving a second display request regarding a second gift displayed in the moving image without being associated with a specific part of the character object from a viewing user who views the moving image. The second gift is displayed on the moving image.

In one aspect of the present invention, a gift display prohibition period is set within the distribution period of the moving image, and the second gift is displayed on the moving image at a timing other than the gift display prohibiting period in the distribution period of the moving image.

One aspect of the present invention relates to a video distribution method for live distribution of a video including an animation of a character object generated based on the movement of a distribution user by executing a computer-readable instruction by one or more computer processors. .. The video distribution method receives a display instruction object in a display area that occupies a part of the display screen of the distribution user device used by the distribution user in response to receiving the first display request regarding the first gift from the viewing user. A step of displaying the first gift and a step of displaying the first gift on the moving image in response to an operation on the display instruction object. In the display area, an upper limit number of the display instruction objects that can be displayed in the display area is set.

One aspect of the present invention relates to a video distribution program for live distribution of a video including an animation of a character object generated based on the movement of a distribution user. The video distribution program is a part of the display screen of the distribution user device used by the distribution user in response to the reception of the first display request regarding the first gift from the viewing user by one or more computer processors. The step of displaying the display instruction object in the display area occupying the display area and the step of displaying the first gift on the moving image in response to the operation on the display instruction object are executed. In the display area, an upper limit number of the display instruction objects that can be displayed in the display area is set.

According to the embodiment of the present invention, the gift can be displayed at a desired timing of the distribution user during the distribution video.

It is a block diagram which shows the moving image distribution system by one Embodiment. It is a schematic diagram which shows typically the distribution user who distributes the moving image distributed by the moving image distribution system of FIG. 1, and the distribution user apparatus used by the distribution user. It is a figure which shows the example of the display screen displayed on the viewing user apparatus 10 in one Embodiment. It is a figure which shows the example of the display screen displayed on the distribution user apparatus 20 in one Embodiment. It is a figure which shows the example of the display screen displayed on the viewing user apparatus 10 in one Embodiment. An example of a normal object is displayed on the display screen of FIG. It is a figure which shows the example of the display screen displayed on the viewing user apparatus 10 in one Embodiment. An example of the attached object is displayed on the display screen of FIG. 5a. It is a figure which shows the example of the display screen displayed on the distribution user apparatus 20 in one Embodiment. An example of the attached object is displayed on the display screen of FIG. 5b. It is a figure which shows the example of the display screen displayed on the distribution user apparatus 20 in one Embodiment. An example of a message confirmation window is displayed on the display screen of FIG. It is a figure which shows the example of the display screen displayed on the viewing user apparatus 10 in one Embodiment. An example of a message window is displayed on the display screen of FIG. 7a. It is a figure which shows the example of the display screen displayed on the distribution user apparatus 20 in one Embodiment. An example of a message window is displayed on the display screen of FIG. 7b. It is a flow figure which shows the flow of the moving image distribution processing in one Embodiment. It is a flow chart which shows the flow of the process of displaying a normal gift in one Embodiment. It is a flow chart which shows the flow of the process of displaying a wearing gift in one Embodiment. It is a flow chart which shows the flow of the process of displaying a message gift in one Embodiment. It is a figure for demonstrating the gift display prohibition period set for the moving image distributed in the moving image distribution system of FIG.

Hereinafter, various embodiments of the present invention will be described with reference to the drawings as appropriate. The same or similar components are designated by the same reference numerals in a plurality of drawings.

A video distribution system according to an embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a block diagram showing a video distribution system 1 according to an embodiment, and FIG. 2 shows a distribution user U1 that distributes a video distributed by the video distribution system 1 and a distribution user device used by the distribution user. It is a schematic diagram which shows 20 schematically.

The video distribution system 1 includes a viewing user device 10, a distribution user device 20, a server device 60, and a storage 70. The viewing user device 10, the distribution user device 20, the server device 60, and the storage 70 are connected to each other so as to be able to communicate with each other via the network 50. As will be described later, the server device 60 is configured to distribute a moving image including an animation of the character of the distribution user U1.

This moving image is distributed from the server device 60 to the viewing user device 10 and the distribution user device 20. The delivered moving image is displayed on the display of the viewing user device 10. A viewing user who is a user of the viewing user device 10 can view the distributed moving image on the viewing user device 10. Although only one viewing user device 10 is shown in FIG. 1 for the sake of brevity in the drawings, the video distribution system 1 may include a plurality of viewing user devices. By viewing the distributed video, the distribution user U1 can perform the performance while checking the video in the video.

First, the distribution user device 20 will be described. In the illustrated embodiment, the distribution user device 20 includes a computer processor 21, a communication I / F 22, a display 23, a camera 24, and a microphone 25.

The computer processor 21 is an arithmetic unit that loads various programs that realize an operating system and various functions from the storage into a memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic units other than these, or a combination thereof. The computer processor 21 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, or MCU. Although the computer processor 21 is illustrated as a single component in FIG. 1, the computer processor 21 may be a collection of a plurality of physically separate computer processors.

The communication I / F 22 is implemented as hardware, firmware, communication software such as a TCP / IP driver or PPP driver, or a combination thereof. The distribution user device 20 can send and receive data to and from other devices via the communication I / F 22.

The display 23 has a display panel and a touch panel. The touch panel is configured to be able to detect a player's touch operation (contact operation). The touch panel can detect various touch operations such as tapping, double tapping, and dragging of the player. The touch panel may include a capacitive proximity sensor and may be configured to be capable of detecting a player's non-contact operation.

The camera 24 continuously images the face of the distribution user U1 and acquires the image data of the face of the distribution user U1. The imaged data of the face of the distribution user U1 imaged by the camera 24 is transmitted to the server device 60 via the communication I / F22. The camera 24 may be a 3D camera capable of detecting the depth of a person's face.

The microphone 25 is a sound collecting device configured to convert the input voice into voice data. The microphone 25 is configured to be able to acquire the voice input of the distribution user U1. The voice input of the distribution user U1 acquired by the microphone 25 is converted into voice data, and this voice data is transmitted to the server device 60 via the communication I / F 22.

The viewing user device 10 may include the same components as the distribution user device 20. For example, the viewing user device 10 may include a computer processor, a communication I / F, a display, and a camera.

The viewing user device 10 and the distribution user device 20 are information processing devices such as smartphones. In addition to smartphones, the viewing user device 10 and the distribution user device 20 are mobile phones, tablet terminals, personal computers, electronic book readers, wearable computers, game consoles, and various information processing devices capable of playing moving images other than these. You may. In addition to the above components, each of the viewing user device 10 and the distribution user device 20 may include a sensor unit including various sensors such as a gyro sensor, and a storage for storing various information.

Next, the server device 60 will be described. In the illustrated embodiment, the server device 60 includes a computer processor 61, a communication I / F 62, and a storage 63.

The computer processor 61 is an arithmetic unit that loads various programs that realize an operating system and various functions from the storage 63 or other storage into a memory and executes instructions included in the loaded programs. The computer processor 61 is, for example, a CPU, an MPU, a DSP, a GPU, various arithmetic units other than these, or a combination thereof. The computer processor 61 may be realized by an integrated circuit such as an ASIC, PLD, FPGA, or MCU. Although the computer processor 21 is illustrated as a single component in FIG. 1, the computer processor 61 may be a collection of a plurality of physically separate computer processors.

The communication I / F 62 is implemented as hardware, firmware, communication software such as a TCP / IP driver or PPP driver, or a combination thereof. The server device 60 can send and receive data to and from other devices via the communication I / F 62.

The storage 63 is a storage device accessed by the computer processor 61. The storage 63 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various storage devices other than those capable of storing data. Various programs can be stored in the storage 63. At least a part of the program and various data that can be stored in the storage 63 may be stored in a storage (for example, a storage 70) that is physically separate from the server device 60.

In the present specification, the program described as being executed by the computer processor 21 or the computer processor 61 or the instructions contained in the program may be executed by a single computer processor or distributed by a plurality of computer processors. May be executed. Further, the program executed by the computer processor 21 or the computer processor 61 or the instructions included in the program may be executed by a plurality of virtual computer processors, respectively.

Next, the data stored in the storage 63 will be described. In the illustrated embodiment, the storage 63 stores model data 63a, object data 63b, and various data necessary for generation and distribution of distribution moving images other than the above.

The model data 63a is model data for generating a character animation. The model data 63a may be three-dimensional model data for generating a three-dimensional animation, or may be two-dimensional model data for generating two-dimensional model data. The model data 63a includes, for example, rig data (sometimes referred to as “skeleton data”) indicating the face of the character and the skeleton of a portion other than the face, and surface data indicating the shape and texture of the surface of the character. The model data 63a can include a plurality of model data different from each other. The plurality of model data may have different rig data from each other, or may have the same rig data. The plurality of model data may have different surface data from each other, or may have the same surface data.

The object data 63b includes asset data for constructing a virtual space constituting a moving image. The object data 63b is data for drawing the background of the virtual space constituting the moving image, data for drawing various objects displayed in the moving image, and various objects displayed in the moving image other than these. Contains data. The object data 63b may include object position information indicating the position of the object in the virtual space.

The object data 63b may include a gift object in addition to the above. The gift object is displayed in the video based on the gift display request from the viewing user who is watching the video. The gift object may include an effect object corresponding to an effect gift, a normal object corresponding to a normal gift, a wearing object corresponding to a wearing gift, and a message object corresponding to a message gift. The viewing user can purchase the desired gift.

The effect object indicating the effect gift is an object that affects the impression of the entire viewing screen of the distributed video, for example, an object that imitates confetti. The object imitating confetti may be displayed on the entire viewing screen, whereby the impression of the entire viewing screen before and after the display can be changed. The effect object may appear to overlap the character object, but differs from the wearing object in that it is displayed without being associated with a particular part of the character object.

A normal object showing a normal gift is an object showing a gift from a viewing user to a distribution user (for example, distribution user U1), and imitates, for example, a stuffed animal, a bouquet, an accessory, or an item suitable for a gift or present other than the above. It is an object. In one aspect, the normal object is displayed on the moving image display screen so as not to come into contact with the character object. In one aspect, the normal object is displayed on the moving image display screen so as not to overlap with the character object. Ordinary objects may appear to overlap objects other than character objects in virtual space. Ordinary objects may appear to overlap with character objects, but differ from wearing objects in that they are not displayed in association with a particular part of the character object. In one aspect, when the normal object is displayed overlapping with the character object, the normal object overlaps with a part other than the head including the face of the character object and does not overlap with the head of the character object. Is displayed. In one aspect, when the normal object is displayed overlapping with the character object, the normal object overlaps with the part other than the upper body including the face of the character object and does not overlap with the upper body of the character object. Is displayed.

The wearing object indicating the wearing gift is an object displayed on the display screen in association with a specific part (wearing part) of the character object. In one aspect, the attached object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, the wearing object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to cover a part or all of the specific part of the character object. The specific part may be specified by the three-dimensional position information indicating the position in the three-dimensional coordinate space, or may be associated with the position information in the three-dimensional coordinate space. For example, in the character's head, the specific parts are the front left side of the head, the front right side, the back left side, the back right side, the center front side, the center back side, the left eye, the right eye, the left ear, the right ear, and the entire hair. It may be determined.

The wearing object is, for example, an accessory (caterpillar, necklace, earring, etc.) attached to the character object, clothes (T-shirt, etc.), a costume, and an object that can be attached to other character objects. The object data 63b corresponding to the wearing object may include the wearing part information indicating which part of the character object the wearing object is associated with. The attachment part information of a certain attachment object can indicate to which part of the character object the attachment object is attached. For example, when the wearing object is a Katyusha, the wearing part information of the wearing object may indicate that the wearing object is mounted on the "head" of the character object. When the mounting site information on which the mounting object is mounted is specified as a position in the three-dimensional coordinate space, the mounting site information may be associated with a plurality of positions in the three-dimensional coordinate space. For example, the wearing part information indicating the position where the wearing object indicating "Katyusha" is mounted may be associated with two parts of the character object, "the left side behind the head" and "the right side behind the head". That is, the wearing object indicating the "alice band" may be mounted on both the "left side behind the head" and the "right side behind the head". When the wearing object is a T-shirt, the wearing part information of the wearing object may indicate that the wearing object is mounted on the "body" of the character object.

Two types of mounting objects having a common mounting site are displayed in the moving image at intervals. That is, the two types of mounting objects having the same mounting portion are mounted on the character object at intervals of time. In other words, the two types of mounting objects having the same mounting site are not mounted on the character object at the same time. For example, with respect to the wearing object indicating the hat, and the wearing object indicating the hat, when the "head" is set as the wearing part, the wearing object indicating the Katyusha and the wearing object indicating the hat are not displayed at the same time.

The message object indicating the message gift includes a message from the viewing user. The message object may be displayed in the moving image in a manner more conspicuous than the comment displayed in the comment display area 35 described later. The message object may be displayed in the moving image for a longer time than the comment displayed in the comment display area 35.

Each gift object may have a display time set according to its type. In one aspect, the display time of the attached object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the attached object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

Next, the functions realized by the computer processor 21 will be described more specifically. The computer processor 21 functions as the face motion data generation unit 21a by executing a computer-readable instruction included in the distribution program. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor other than the computer processor 21 of the moving image distribution system 1. At least a part of the functions realized by the computer processor 21 may be realized by, for example, the computer processor 61 mounted on the server device 60.

The face motion data generation unit 21a generates face motion data, which is a digital representation of the face movement of the distribution user U1, based on the image data of the camera 24. Face motion data is generated at any time with the passage of time. Face motion data may be generated at predetermined sampling time intervals. In this way, the face motion data can digitally represent the movement (change in facial expression) of the face of the distribution user U1 in time series. The face motion data generated by the face motion data generation unit 21a is transmitted to the server device 60 via the communication I / F22.

In the distribution user device 20, in addition to the face motion data generated by the face motion data generation unit 21a, body motion data which is a digital representation of the position and orientation of each part other than the face of the body of the distribution user U1 is generated. You may. The distribution user device 20 may transmit body motion data to the server device 60 in addition to the face motion data. In order to generate body motion data, the distribution user U1 may wear a motion sensor. The distribution user device 20 may be configured to be able to generate body motion data based on the detection information of the motion sensor attached to the distribution user U1. Body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data expresses the body movement of the distribution user U1 in chronological order as digital data. The generation of body motion data based on the detection information of the motion sensor mounted on the distribution user U1 may be performed, for example, in a shooting studio. The shooting studio may be equipped with a base station, a tracking sensor, and a display. The base station may be a multi-axis laser emitter. The motion sensor mounted on the distribution user U1 may be, for example, the Vive Tracker provided by HTC CORPORATION. The base station provided in the shooting studio may be, for example, a base station provided by HTC CORPORATION. In addition, a supporter computer may be installed in a room separate from the shooting studio. The display in the shooting studio may be configured to display information received from the support computer. The server device 60 may be installed in the same room where the supporter computer is installed. The room where the supporter computer is installed and the shooting studio may be separated by a glass window. In this case, the operator of the supporter computer (sometimes referred to as "supporter" in the present specification) can visually recognize the distribution user U1. The supporter computer may be configured so that the settings of various devices provided in the shooting studio can be changed according to the operation of the supporter. The supporter computer can, for example, set the scanning interval by the base station, set the tracking sensor, and change various settings of various other devices. The supporter can input a message to the supporter computer and display the input message on the display of the shooting studio.

Next, the functions realized by the computer processor 61 will be described more specifically. The computer processor 61 functions as an animation generation unit 61a, a video generation unit 61b, a video distribution unit 61c, a gift request processing unit 61d, and a gift purchase processing unit 61e by executing a computer-readable instruction included in the distribution program. do. At least a part of the functions realized by the computer processor 61 may be realized by a computer processor other than the computer processor 61 of the moving image distribution system 1. At least a part of the functions realized by the computer processor 61 may be realized by, for example, the computer processor 21 of the distribution user device 20 or the computer processor of the viewing user device 10. Specifically, a part or all of the functions of the animation generation unit 61a and the moving image generation unit 61b may be executed by the distribution user device 20. For example, the moving image generated by the distribution user device 20 may be transmitted to the server device 60 and distributed from the server device 60 to the viewing user device 10.

The animation generation unit 61a generates an animation of the character object by applying the face motion data generated by the face motion data generation unit 21a of the distribution user device 20 to the predetermined model data included in the model data 63a. It is composed of. The animation generation unit 61a can generate an animation of the character object so that the facial expression of the character object changes based on the face motion data. Specifically, the animation generation unit 61a can generate an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user U1 based on the face motion data related to the distribution user U1.

When the distribution user device 20 provides the body motion data related to the distribution user U1, the animation generation unit 61a moves the body and facial expression of the distribution user U1 based on the body motion data and the face motion data related to the distribution user U1. It is possible to generate an animation of a character object that moves in synchronization with.

The moving image generation unit 61b can generate a background image showing the background using the object data 63b, and can generate a moving image including the background image and the animation of the character object corresponding to the distribution user U1. In the moving image generated by the moving image generation unit 61b, the character object corresponding to the distribution user U1 is displayed superimposed on the background image.

The video generation unit 61b can synthesize the voice of the distribution user U1 generated based on the voice data received from the distribution user device 20 with the generated video. As described above, the moving image generation unit 61b generates an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user U1, and generates a moving image for distribution in which the voice of the distribution user U1 is synthesized with this animation. can do.

The video distribution unit 61c distributes the video generated by the video generation unit 61b. This moving image is distributed to the viewing user device 10 and other viewing user devices via the network 50. The generated moving image is also distributed to the distribution user device 20. The received moving image is played back in the viewing user device 10 and the distribution user device 20.

A display example of a video distributed from the video distribution unit 61c and played on the viewing user device 10 is shown in FIG. 3a, and a display example of the video distributed from the video distribution unit 61c and played on the distribution user device 20 is shown. It is shown in FIG. 3b. As shown in FIG. 3a, the display of the viewing user device 10 displays the display image 30 of the moving image distributed from the server device 20. The display image 30 displayed on the viewing user device 10 includes a character object 31 of the distribution user U1 generated by the animation generation unit 61a, a gift button 32, an evaluation button 33, a comment button 34, and a comment display. Region 35 and is included.

Since the character object 31 is generated by applying the face motion data of the distribution user U1 to the model data included in the model data 63a as described above, the character object 31 is synchronized with the movement of the facial expression of the distribution user U1. The expression changes. When the body motion data is provided from the distribution user device 20, the character object 31 can be controlled so that the parts other than the face also change in synchronization with the body movement of the distribution user U1.

The gift button 32 is displayed on the display screen 30 so as to be selectable by operating the viewing user device 10. The gift button 32 can be selected, for example, by tapping the area of the touch panel of the viewing user device 10 on which the gift button 32 is displayed. In one embodiment, when the gift button 32 is selected, the display screen 30 displays a window for selecting a gift to give to the distribution user who is distributing the video being viewed. The viewing user can purchase a gift to be gifted from the gifts displayed in the window. In another embodiment, the display screen 30 displays a window containing a list of purchased gifts in response to the selection of the gift button 32. In this case, the viewing user can select a gift to be gifted from the gifts displayed in the window. Gifting or purchaseable gifts may include effect gifts, regular gifts, wearing gifts, message gifts, and other gifts.

The evaluation button 33 is displayed on the display screen 30 so as to be selectable by the viewing user who uses the viewing user device 10. The evaluation button 33 can be selected, for example, by tapping the area of the touch panel of the viewing user device 10 on which the evaluation button 33 is displayed. When the evaluation button 33 is selected by the viewing user who is viewing the moving image, evaluation information indicating that the moving image has been positively evaluated may be transmitted to the server device 60. The server device 60 can aggregate evaluation information from the viewing user device 10 and other viewing user devices.

The comment button 34 is displayed on the display screen 30 so as to be selectable by the viewing user. When the comment button 34 is selected by, for example, a tap operation, a comment input window for inputting a comment is displayed on the display screen 30. The viewing user can input a comment via the input mechanism of the viewing user device 10. The input comment is transmitted from the viewing user device 10 to the server device 60. The server device 60 receives comments from the viewing user device 10 and other viewing user devices, and displays the comments in the comment display area 35 in the display image 30. In the comment display area 35, comments posted from the viewing user device 10 and other viewing user devices are displayed, for example, in chronological order. The comment display area 35 occupies a part of the display screen 30. There is an upper limit to the number of comments that can be displayed in the comment display area 35. In the illustrated example, up to three comments can be displayed in the comment display area 35. When a comment exceeding the upper limit set in the comment display area 35 is posted, the comment with the oldest posting time is deleted from the comment display area 35 in order. Therefore, the higher the frequency of comments received from the viewing user, the shorter the display time of each comment in the comment area 35.

As shown in FIG. 3b, the display of the distribution user device 20 displays the display image 40 of the moving image distributed from the server device 20. The display image 40 displayed on the distribution user device 20 includes a character object 31 corresponding to the distribution user U1, display instruction buttons 42a to 42c for displaying a wearing gift for which a display request has been made by the viewing user, and a comment. The display area 35 and the like are included. The display image 40 displayed on the distribution user device 20 includes the same background image, character object image, and comment as the display image 30 displayed on the viewing user device 10. On the other hand, the display image 40 is different from the display image 30 in that it does not include the gift button 32, the evaluation button 33, and the comment button 34, but includes the display instruction buttons 42a to 42c.

The display instruction buttons 42a to 42c are displayed on the display screen 40 in response to receiving a display request for displaying the attached gift, which will be described later, from the viewing user. In the illustrated embodiment, three display instruction buttons 42a to 42c are displayed on the display image 40. Each of the display instruction buttons 42a to 42c is displayed on the display screen 40 so as to be selectable by the distribution user. When any of the display instruction buttons 42a to 42c is selected by, for example, a tap operation, an operation for displaying the attached gift corresponding to the selected display instruction button is performed. As described above, the display instruction buttons 42a to 42c are display instruction objects for giving an instruction to display the attached gift on the moving image being distributed. Therefore, in the present specification, the display instruction buttons 42a to 42c may be referred to as display instruction objects 42a to 42c. When it is not necessary to distinguish the display instruction objects 42a to 42c from each other, the display instruction objects 42a to 42c may be simply referred to as display instruction objects 42. A specific example of displaying the attached gift will be described later. The display screen 40 may be displayed on the above-mentioned supporter computer. The display instruction objects 42a to 42c may be selected according to the operation of the supporter computer by the supporter.

Each time a display request requesting the display of the attached gift is received, a display instruction object 42 corresponding to the display request is added to the display screen 40. There is an upper limit to the number of display instruction objects 42 that can be displayed on the display screen 40. In the illustrated embodiment, the upper limit of the number of display instruction objects 42 that can be displayed on the display screen 40 is 3. In this case, the display screen 40 has a display area capable of displaying three display instruction objects. When four or more display requests for the attached gift are received, the display instruction object 42 corresponding to the fourth and subsequent display requests is not displayed on the display screen 40. The display instruction object 42 corresponding to the display request of the attached gift received fourth is when any of the three display instruction objects 42 already displayed is selected and a space is created in the display area. It is displayed on the display screen 40.

The gift request processing unit 61d receives a gift display request from the viewing user, and performs a process for displaying the gift object in response to the display request. Each viewing user can send a gift display request to the server device 60 by operating his / her viewing user device. The gift display request includes the user ID of the viewing user, the gift identification information (gift ID) that identifies the gift that requests the display, and / or the gift object identification information that identifies the gift object that corresponds to the gift that requests the display (the gift object identification information (gift ID). Gift object ID) and may be included.

As described above, the gift object indicating the gift may include an effect object corresponding to the effect gift, a normal object corresponding to the normal gift, and a wearing object corresponding to the wearing gift. The attached gift is an example of the first gift. The attached object may be referred to as the first gift object. The display request requesting the display of the attached gift (or attached object) is an example of the first display request. Effect gifts and regular gifts are examples of second gifts. The effect object and the normal object may be collectively referred to as a second gift object. A display request requesting the display of an effect gift (or effect object) or a normal gift (or normal object) is an example of a second display request.

In one aspect, when the gift request processing unit 61d receives a display request for a specific normal gift from the viewing user, the gift request processing unit 61d displays a normal object indicating the normal gift for which the display is requested in the moving image based on the display request. Perform processing. For example, when a display request for a normal gift indicating a bag is made, as shown in FIG. 4, the gift request processing unit 61d displays a normal object 36 indicating the bag on the display image 30 based on the display request. .. Similarly, when a display request for a normal gift indicating a teddy bear is made, as shown in FIG. 4, the gift request processing unit 61d displays a display image of a normal object 37 indicating the teddy bear based on the display request. It is displayed at 30. Although not shown, the display image 40 in the distribution user device 20 also displays the normal object 36 and the normal object 37 in the same manner as the display image 30.

In one aspect, when the gift request processing unit 61d receives a display request for a specific effect gift from the viewing user, the effect object corresponding to the effect gift requested to be displayed is converted into a video display image based on the display request. Perform processing to display. For example, when a display request for an effect gift indicating confetti or fireworks is made, the gift request processing unit 61d displays an effect object (not shown) corresponding to the effect gift indicating confetti or fireworks based on the display request. ) Is displayed on the display image 30 and the display image 40.

The display request for a normal gift may include a display position specification parameter that specifies the display position of a normal object indicating the normal gift. In this case, the gift request processing unit 61d can display the normal object at the position specified by the display position specification parameter. When the display position and display range of the character object 31 are defined, the position relative to the character object 31 can be specified as the display position of the normal object by the display position designation parameter.

In one aspect, when the gift request processing unit 61d receives a display request for a specific wearing object from the viewing user, the gift request processing unit 61d gives a display instruction on the display screen 40 of the distribution user device 20 based on the display request, as shown in FIG. 3b. Display objects 42a-42c. Each of the display instruction objects 42a to 42c is associated with a wearing gift for which a display request has been made. When any of the display instruction objects 42a to 42c is selected, the wearing gift associated with the selected display instruction object is displayed in the video being delivered. For example, when the display instruction object 42b is associated with a cat ears imitating a cat ears and the display instruction object 42b is selected, the gift request processing unit 61d receives the cutie corresponding to the selected display instruction object 42b. The attached object 38 indicating the above is displayed on the moving image being distributed. Display examples of moving images including the wearing object 38 showing the Katyusha are shown in FIGS. 5a and 5b. Further, as shown in FIG. 5b, the selected display instruction object 42b is deleted from the display screen 40.

The wearing object is displayed in the moving image in association with a specific part (wearing part) of the character object. For example, the wearing object may be displayed in the moving image so as to be in contact with the wearing part of the character object. The attached object 38 may be displayed in the moving image so as to be attached to the attached portion of the character object. In one embodiment, the wearing object 38 indicating the Katyusha is associated with the head of the character object. Therefore, in the display examples shown in FIGS. 5a and 5b, the wearing object 38 is mounted on the head of the character object 31. The attached object may be displayed in the moving image display screen so as to move along with the movement of the attached portion of the character object. For example, when the head of the character object 31 equipped with the attachment object 38 indicating the alice band moves, the attachment object 38 indicating the alice band also moves the head of the character object 31 as if the alice bander is attached to the head of the character object 31. It moves with the part.

As described above, the object data 63b may include the wearing part information indicating which part of the character object the wearing object is associated with. In one aspect, when the attached object is attached to the character object, the gift request processing unit 61d is the same as the portion indicated by the attached portion information of the attached object until the display time of the attached object elapses. Prohibit the display of other mounted objects mounted on overlapping parts. For example, the hair accessory associated with both the "rear left side of the head" and the "right side of the back of the head" and the hair accessory associated with the "left side of the back of the head" overlap with the "left side of the back of the head". Therefore, when the hairstyle is displayed, the display of the hair accessory for which "the left side behind the head" is set as the wearing part information is prohibited. On the other hand, the Katyusha associated with "left behind the head" and "right behind the head" and the earrings associated with "left ear (of the head)" and "right ear (of the head)" Since the mounting parts of the character object do not overlap, they can be mounted at the same time.

In one embodiment, in order to prohibit the display of a plurality of wearing objects having the same or overlapping mounting parts, the display instruction object 42 for displaying the wearing objects whose display is prohibited may be deactivated. In the embodiment shown in FIG. 5b, it is assumed that the display instruction object 42a is a hair accessory in which "the left side behind the head" is set as the attachment site information. In this case, since the character object 31 is wearing the wearing object 38 indicating the hair accessory, the wearing object indicating the hair accessory is prohibited from being displayed in the moving image while the wearing object 38 is mounted on the character object 31. Will be done. In one embodiment, the display instruction object 42a associated with the wearing object indicating the hair accessory is deactivated in order to prohibit the display of the wearing object indicating the hair accessory in the moving image. For example, the display instruction object 42a cannot be selected even if it is operated while the attachment object 38 is attached to the character object 31. In another embodiment, the display instruction object 42a is erased from the display screen 40 while the attachment object 38 is attached to the character object 31. The deactivated display instruction object 42a is reactivated as the display time of the Katyusha elapses. In order to reactivate the display instruction object 42a, for example, the display instruction object 42a that has been made unselectable may be made selectable again, or the hidden display instruction object 42a may be displayed again on the display screen 40. It may be displayed.

In one aspect, a viewing user viewing a video can send a display request to the server device 60 requesting that a message gift containing a particular message be displayed on the video. When the gift request processing unit 61d receives a message gift display request associated with a specific message from the viewing user, the gift request processing unit 61d receives a message on the display screen 40 of the distribution user device 20 based on the display request, as shown in FIG. The confirmation screen 43 is displayed. On the message confirmation screen 43, a message input by the viewing user who made the display request, a button for permitting the display of the message in the video, and a button for rejecting the display of the message in the video. Is included. On the message confirmation screen 43, the distribution user U1 confirms the message from the viewing user, and selects the button labeled "Display" when permitting the display of the message gift including the message in the video. By doing so, the message gift display instruction operation is performed. On the contrary, when rejecting the display of the message gift in the moving image, the distribution user U1 performs the display refusal operation by selecting the button marked "not displayed".

When the display of the message gift is permitted by the distribution user U1, as shown in FIGS. 7a and 7b, the message gift is displayed on the display screen 30 of the viewing user device 10 and the display screen of the distribution user device 20. Message object 39 indicating is displayed. The message object 39 includes text data indicating a message associated with the message gift. The message object 39 may include a display (for example, a user name, a nickname, etc. of the viewing user) indicating the viewing user who has requested the display of the message gift.

In one aspect, the viewing user who is viewing the moving image can transmit a voice change gift for changing the voice of the distribution user U1 synthesized in the moving image being distributed to the server device 60. When the gift request processing unit 61d receives the voice change gift, the gift request processing unit 61d displays a confirmation screen (not shown) on the display screen 40 of the distribution user device 20. The confirmation screen for confirming whether or not the voice can be changed may include information for identifying the content of the voice change. For example, this confirmation screen contains information that identifies changes in voice, such as changing a male voice to a female voice, changing a human voice to a robot-like electronic sound, and so on. You may. In addition, the confirmation screen includes a button for permitting the voice change requested in the voice change gift and a button for rejecting the voice change. On this confirmation screen, the distribution user U1 confirms the changed content of the voice and performs an instruction operation for permitting or denying the change.

In one aspect, the viewing user who is viewing the moving image can send a motion gift specifying a movement other than the head of the character object 31 included in the moving image to the server device 60. When the gift request processing unit 61d receives the motion gift, the gift request processing unit 61d controls the movement of the character object 31 so that the character object 31 takes the movement specified by the motion gift. A confirmation screen (not shown) for confirming whether or not the movement specified by the motion gift can be reflected in the character object 31 is displayed on the display screen 40 of the distribution user device 20, and the movement specified by the distribution user U1 is displayed. The movement specified by the motion gift may be reflected in the character object 31 only when the instruction operation for permitting the reflection is performed.

In one aspect, the gift purchase processing unit 61e, in response to a request from a video viewing user, obtains purchase information of each of a plurality of gift objects that can be purchased in connection with the video, by the viewing user's viewing user device (for example,). , Transmit to the viewing user device 10). The purchase information for each gift object includes the type of gift object (effect object, regular object, or wearing object), the image of the gift object, the price of the gift object, and the information required to purchase other gift objects. Can be included. The viewing user can select the gift object to be purchased based on the purchase information of the gift object displayed on the viewing user device 10. The gift object to be purchased may be selected by operating the viewing user device 10. When the gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 60. The gift purchase processing unit 61e performs payment processing based on the purchase request. When this payment process is completed, the purchased gift object is held by the viewing user. The storage 23 may store the gift ID of the purchased gift (or the gift object ID of the gift object indicating the gift) in association with the user ID of the viewing user who purchased the gift.

The gift objects that can be purchased may vary from video to video. The gift objects that can be purchased may be available for purchase in a plurality of videos. That is, the gift object that can be purchased may include a unique gift object that is unique to each video and a common gift object that can be purchased in a plurality of videos. For example, the effect object indicating confetti may be a common gift object that can be purchased in a plurality of videos.

In one aspect, when an effect object is purchased while watching a predetermined video, the effect object to be purchased becomes the video being viewed in response to the completion of the payment process for purchasing the effect object. It may be displayed automatically. If a normal object is purchased while watching a predetermined video, the normal gift object to be purchased is the video being watched in response to the completion of the payment process for purchasing the normal object, as described above. May be displayed automatically.

In another aspect, a payment completion notification is transmitted to the viewing user device 10 in response to the completion of the payment processing in the gift purchase processing unit 61e for the effect object to be purchased, and the effect object is purchased in the viewing user device 10. A confirmation screen may be displayed to confirm with the viewing user whether or not to request the display of the effect object. When the viewing user chooses to make a display request for the purchased effect object, the display request requesting the display of the purchased effect object is sent from the client device of the viewing user to the gift request processing unit 61d. The gift request processing unit 61d may perform a process of displaying the effect object to be purchased on the moving image 70. Even when the purchase target is a normal object, a confirmation screen for confirming with the viewing user whether or not to request the display of the purchased normal object may be displayed on the viewing user device 10 in the same manner as described above.

Next, with reference to FIGS. 8 to 11, a moving image distribution process according to one aspect will be described. FIG. 8 is a flow chart showing a flow of video distribution processing in one embodiment, FIG. 9 is a flow chart showing a flow of processing for displaying a normal object in one embodiment, and FIG. 10 is a flow chart showing a flow of processing for displaying a normal object in one embodiment. FIG. 11 is a flow chart showing a flow of processing for displaying a mounted object, and FIG. 11 is a flow chart showing a flow of processing for displaying a message object in one embodiment. In the moving image distribution process described with reference to these figures, it is assumed that the distribution user U1 distributes the moving image based on the face motion data acquired by using the distribution user device 20.

First, in step S11, face motion data, which is a digital representation of the facial movement (facial expression) of the distribution user U1, is generated. The face motion data is generated, for example, by the face motion data generation unit 21a of the distribution user device 20. In the distribution user device 20, voice data may be generated based on the voice input from the distribution user U1. The generated face motion data and voice data are transmitted to the server device 60.

Next, in step S12, the face motion data from the distribution user device 20 is applied to the model data for the distribution user U1 to generate an animation of a character object that moves in synchronization with the movement of the facial expression of the distribution user U1. Will be done. This animation is generated, for example, by the animation generation unit 61a described above.

Next, in step S13, a moving image including an animation of the character object corresponding to the distribution user U1 is generated. The audio of the distribution user U1 may be combined with this moving image. The animation of the character object is displayed superimposed on the background image. This moving image is generated, for example, by the moving image generation unit 61b described above.

Next, the process proceeds to step S14, and the moving image generated in step S13 is distributed. This moving image is distributed to the viewing user device 10 and other viewing user devices and distribution user devices via the network 50. The video is continuously distributed over a predetermined distribution period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any other time.

Next, the process proceeds to step S15, and it is determined whether or not the termination condition for terminating the distribution of the moving image is satisfied. The end condition is, for example, that the end time of the distribution has been reached, that the distribution user U1 has performed an operation for ending the distribution in the distribution user device 20, or other conditions. If the end condition is not satisfied, the processes of steps S11 to S14 are repeatedly executed, and the distribution of the moving image including the animation synchronized with the movements of the distribution user U1 and the distribution user A2 is continued. If it is determined that the end condition for the video is satisfied, the distribution process of the video is terminated.

Next, with reference to FIG. 9, a normal gift display process performed during the distribution of the moving image will be described. Normally, the gift display process is performed in parallel with the moving image distribution process shown in FIG.

During the distribution of the moving image, it is determined in step S21 whether or not the display request for the normal gift is made. For example, the viewing user selects one or more specific normal gifts from the normal gifts he / she owns, and sends a display request requesting the display of the selected normal gifts from the viewing user device 10 to the server device 60. Can be sent to. As described above, a request for displaying the predetermined ordinary gift may be generated in response to the purchase processing or the settlement processing of the predetermined ordinary gift.

When a normal gift display request is made, the display process proceeds to step S22. In step S22, based on the display request, a process for displaying the requested normal gift on the video being distributed is performed. For example, when a display request for a normal gift is made during distribution of a predetermined video, as shown in FIG. 4, a normal gift corresponding to the normal gift for which the display request is made in the display screen 30 of the viewing user device 10 is normally performed. Object 36 is displayed. Although not shown, the normal object 36 may also be displayed in the display image 40 of the distribution user device 20.

If the normal gift display request is not made, the normal gift display process ends. The normal gift display process shown in FIG. 9 is repeated during the video distribution period. The effect gift display process can also be performed in the same procedure as the normal gift display process described above.

Next, with reference to FIG. 10, a display process of the attached gift performed during the distribution of the moving image will be described. The display process of the attached gift is performed in parallel with the distribution process of the moving image shown in FIG. Further, the display process of the attached gift may be performed in parallel with the display process of the normal gift shown in FIG.

During the distribution of the moving image, it is determined in step S31 whether or not the display request for the attached gift is made. For example, the first viewing user can transmit a display request requesting the display of the attached gift owned by the first viewing user from the viewing user device 10 to the server device 60.

When a display request for the attached gift is made, the display process proceeds to step S32. In step S32, the display instruction object associated with the wearing gift requested to be displayed is displayed on the display screen 40 of the distribution user device 20 based on the display request. For example, when a display request for a wearing gift indicating a Katyusha is made, the display instruction object 42b associated with the wearing gift is displayed on the display screen 40 of the distribution user device 20.

Next, in step S33, it is determined whether or not a specific display instruction object is selected from the display instruction objects included in the display screen 40 of the distribution user device 20.

When a specific display instruction object is selected, in step S34, a process of displaying a wearing gift corresponding to the selected specific display instruction object is performed on the display screen of the moving image being distributed. For example, when the display instruction object 42b included in the display screen 40 is selected, the selected display instruction object is selected for the display image 30 and the display image 40 as shown in FIGS. 5a and 5b. The attached object 38 associated with 42b is displayed. Further, the selected display instruction object 42b is deleted from the display screen 40.

When none of the display instruction objects is selected in step S33, or when the display process of the attached gift is completed in step S34, the display process of the attached gift ends.

Next, with reference to FIG. 11, a message gift display process performed during the distribution of the moving image will be described. The message gift display process is performed in parallel with the moving image distribution process shown in FIG. Further, the message gift display process may be performed in parallel with the normal gift display process shown in FIG. 9 and the wearing gift display process shown in FIG.

During the distribution of the moving image, it is determined in step S41 whether or not the message gift display request is made. For example, the first viewing user can send a display request requesting the display of a message gift including a message entered by himself / herself from the viewing user device 10 to the server device 60.

When the message gift display request is made, the display process proceeds to step S42. In step S42, the message confirmation screen 43 associated with the message gift requested to be displayed is displayed on the display screen 40 of the distribution user device 20 based on the display request.

Next, in step S43, it is determined whether or not the display of the message gift in the moving image is permitted. For example, it is determined whether or not the button associated with the permission to display the message gift included in the message confirmation screen 43 included in the display screen 40 of the distribution user device 20 in the moving image is selected.

When the button associated with the permission to display the message gift on the video is selected, the process of displaying the message gift is performed on the display screen of the video being delivered in step S44. For example, when the button associated with the permission to display the message gift in the video included in the message confirmation screen 43 is selected, the display image 30 and the display image 30 and 7b are shown. The message gift 39 for which the display request has been made is displayed on the display image 40.

In step S43, when the button associated with the refusal to display the message gift in the video included in the message confirmation screen 43 is selected, and when the message gift display process is completed in step S44 (for example,). When the display time set for the message gift has elapsed), the message gift display process ends.

In one embodiment, an object display prohibition section in which the display of the gift object is prohibited may be provided in the video distribution. FIG. 12 is a diagram schematically illustrating an object display prohibited section. FIG. 12 shows that the moving image is delivered between the time t1 and the time t2. That is, the time t1 is the video distribution start time, and the time t2 is the video distribution end time. Of the video distribution period, the gift display prohibition period 81 is between the time t3 and the time t4. Even if the gift display request r1 is made during the gift display prohibition period 81, the gift object is not displayed in the display image of the moving image in the gift display prohibition period 81. Specifically, when an effect gift or a normal gift is requested to be displayed among the gifts in the gift display prohibition period 81, the effect gift or the normal gift for which this display is requested is being delivered in the gift display prohibition period 81. It is not displayed in the video, but is displayed in the video after the gift display prohibition period 81 has elapsed (that is, after the time t4). When the display request of the attached gift is made in the gift display prohibition period 81, the display instruction button for instructing the display of the attached gift for which the display request is made is not displayed on the display screen 40 of the distribution user device 20. , It is displayed on the display screen 40 at a time after the gift display prohibition period 81 has elapsed. When a message gift display request is made during the gift display prohibition period 81, the message confirmation screen 43 for confirming whether or not the message gift for which the display request has been made can be displayed is displayed on the display screen 40 of the delivery user device 20. Instead, it is displayed on the display screen 40 at a time after the gift display prohibition period 81 has elapsed. As a result, the distribution user U1 can distribute the video without being interfered by the display of the effect gift or the normal gift during the gift display prohibition period 81. In addition, during the gift display prohibition period 81, the distribution user U1 can perform performance in the video being distributed without being distracted by adding a display instruction button for confirming the attached gift or confirming whether or not the gift message can be displayed. You can concentrate. Even if the gift display prohibition period is 81, if any of the display instruction buttons 42a to 42c is selected by the distribution user U1, even if the attached gift corresponding to the selected display instruction button is displayed. good. As a result, the distribution user U1 can distribute the performance by the character object wearing the desired wearing gift.

According to the above embodiment, among the gifts displayed in the moving image, only the wearing object is displayed in association with the character object. In a moving image in which an animation of a character object is displayed, the animation of the character object is considered to be an element that attracts the attention of the viewing user. In the above embodiment, even if there is a display request for the attached gift displayed in association with the character object 31, a display instruction button for displaying the attached gift is displayed on the distribution user device 20 of the distribution user U1. Since the attached gift is not displayed in the moving image until the display instruction button is selected, it is possible to prevent the attached gift from being randomly displayed in the vicinity of the character object or in the character object. As a result, deterioration of the viewing experience of the viewing user can be prevented.

In the conventional video distribution system, regardless of the type of gift object, the gift object is displayed on the video in response to a request for display on the video. Therefore, if the gifts can be displayed in duplicate in the video, a large number of gifts are displayed in the video, and the viewing experience of the user who watches the video deteriorates. In the above embodiment, by providing the category of the wearing gift that is displayed in association with the character object in the gift, the display timing of the wearing gift that is displayed in association with the character object that is the main part of the video is delivered by the distribution user. Made it possible to control in U1.

The display time of the normal gifts 36 and 37 can be set shorter than that of the attached gift 38, and the normal objects 36 and 37 are not in contact with the character object 31 or behind the character object 31 instead of in front of the character object 31. It may be displayed in. In this case, the normal objects 36 and 37 have little influence on the visibility of the character object 31 in the moving image being distributed. Therefore, even if the normal gift is automatically displayed in the video (without the permission of the distribution user U1) in response to the display request from the viewing user, the viewing experience of the user deteriorates due to the deterioration of the visibility of the character object 31. Is hard to connect.

In the video distribution system 1 according to the above embodiment, the user can present the wearing object to the character. As a result, it is possible to provide a system having a high degree of originality as compared with a system in which such a wearing object cannot be given, and it is possible to provide a service having a high degree of originality by the system. As a result, more users can be attracted to the video distribution system 1, so that the number of times the video is viewed on the video distribution system 1 can be increased.

In the video distribution system 1 according to the above embodiment, the distribution user U1 can distribute a video including a character object that moves according to its own facial expression by a distribution user device 20 provided with a camera such as a smartphone. As described above, in the video distribution system 1, since the equipment for the distribution user U1 to distribute the video is simplified, a platform in which the distribution user U1 can easily participate is realized.

Hereinafter, the effects of the above embodiments will be further described.

In one aspect of the present invention, the display instruction object 42 is displayed on the distribution user device 20 used by the distribution user U1 in response to the reception of the first display request regarding the first gift from the viewing user, and the display instruction object 42 is displayed. In response to the operation to 42, the first gift is displayed in the video being delivered. According to the above aspect, the timing of displaying the first gift for which the viewing user has requested the display in the moving image is determined by the operation on the display instruction object 42 displayed on the distribution user device 20. As a result, it is possible to prevent the first gift from being displayed in the moving image at a timing undesired by the distribution user U1.

The first gift may be a wearing gift associated with the wearing part of the character object. The attached gift is displayed at a position corresponding to the attached portion set for the attached gift in the moving image being distributed in response to the operation on the display instruction object 42 displayed on the distribution user device 20. An example of a wearing gift is a gift that represents a Katyusha associated with the head of a character object. The wearing gift representing the Katyusha is displayed in the moving image as if it is worn on the head of the character object 31 in response to the operation on the display instruction object 42 corresponding to the wearing gift. Wearing gifts that overlap or appear around the character object tend to interfere with the performance of the distribution user U1 through the character object 31, and also tend to degrade the viewing experience of the viewing user. According to the above embodiment, the display timing of the wearing gift associated with the wearing part of the character object 31 in the moving image is determined according to the operation on the display instruction object 42 displayed on the distribution user device 20. .. As a result, it is possible to prevent the distribution user U1 from displaying the wearing gift, which tends to lead to deterioration of the performance through the character object 31 by the distribution user U1 and the viewing experience of the viewing user, in the moving image at an undesired timing.

The display time displayed in the moving image may be set for each of the attached gifts. This display time may be different depending on the type of the attached gift, and a predetermined display time may be uniformly set. In one aspect, when the first wearing gift is displayed in the video, the same wearing part as the first wearing gift is set until the display time set for the first wearing gift elapses. Display of other wearing gifts that have been made on the video is prohibited. In a specific aspect, when the first wearing gift is displayed in the video, the same wearing part as the first wearing gift is set until the display time set for the first wearing gift elapses. The display instruction object 42 for displaying other wearing gifts that have been displayed is deactivated. According to this aspect, it is possible to prevent a plurality of wearing gifts from being duplicately displayed on the wearing part of the character object.

In one aspect, the delivery user apparatus 20 displays a message confirmation screen 43 for confirming the message in response to receiving the message gift associated with the message from the viewing user. When the delivery user U1 is allowed to display the message gift including the message in the moving image, the delivery user U1 performs a message gift display instruction operation via the delivery user device 20. Messages posted by viewers through message gifts may include those that are not desirable to appear in the video. According to the above aspect, the distribution user U1 can determine whether or not to display the message gift based on the message displayed on the message confirmation screen 43 displayed on the distribution user device 20. This makes it possible to prevent the display of message gifts that are not desirable to be displayed in the video.

In one aspect, the audio of the distribution user U1 is synthesized in the moving image, and the audio is changed to the distribution user device 20 in response to receiving a voice change gift for changing the audio of the distribution user U1 from the viewing user. The instruction object is displayed, and the voice of the distribution user is changed to the voice specified by the Gear Voice Change Gift in response to the operation on the voice change instruction object. According to this aspect, it is possible to prevent the distribution user U1 from changing to an undesired voice.

In one aspect, in response to receiving a second display request regarding a second gift displayed in the video without being associated with a specific part of the character object 31 from the viewing user, the video is given the second gift. Is displayed. Second gifts include effect gifts and regular gifts. According to this aspect, the second gift displayed in the video without being associated with a specific part of the character object is displayed in the video in response to the display request from the viewing user (without the operation or instruction by the distribution user). Can be displayed inside. Since the second gift is not displayed in association with a specific part of the character object, it is unlikely to interfere with the performance of the distribution user U1 through the character object 31 or deteriorate the viewing experience of the viewing user. Therefore, the second gift can be displayed on the moving image without requiring the operation by the distribution user U1, so that the interaction with the viewing user can be easily activated.

In one aspect, the gift display prohibition period 81 is set within the video distribution period, and the second gift is displayed on the video at a timing other than the gift display prohibition period 81. According to this aspect, during the gift display prohibition period 81, a moving image that does not include the second gift can be delivered to the viewing user. For example, by setting the time zone in which the distribution user U1 performs a performance through the character object 31 as the gift display prohibition period 81, it is possible to prevent the attention of the viewing user from being dissipated from the character object 31.

In the processing procedure described in the present specification, particularly the processing procedure described using the flow chart, a part of the steps (steps) constituting the processing procedure is omitted, as a step constituting the processing procedure. It is possible to add steps that are not specified and / or to change the order of the steps, and the processing procedure in which such omissions, additions, and changes in order are made does not deviate from the gist of the present invention. It is included in the scope of the invention.

The inventions described in the claims at the time of filing the original application of the present application are added below.
[1]
Distribution A video distribution system that delivers live video including animation of character objects generated based on the movement of the user.
Equipped with one or more computer processors
The one or more computer processors may execute computer-readable instructions.
In response to receiving a motion gift that specifies the movement of the character object from the viewing user, the character object is made to perform the movement instructed by the motion gift.
Video distribution system.
[2]
The one or more computer processors causes the distribution user device to display a confirmation screen for confirming whether or not the character object can perform the movement specified by the motion gift, and instruct the distribution user device to display the display. In response to the operation, the character object is made to perform the movement instructed by the motion gift.
The video distribution system according to [1].
[3]
The motion gift specifies a movement other than the head of the character object.
The video distribution system according to [1] or [2].
[4]
The animation of the character object is generated based on the movement of the face of the distribution user.
The video distribution system according to any one of [1] to [3].
[5]
In response to receiving the first display request regarding the first gift from the viewing user, the one or more computer processors causes the distribution user device used by the distribution user to display the display instruction object, and causes the display instruction object to display the display instruction object. In response to the operation of, the first gift is displayed in the moving image.
The video distribution system according to any one of [1] to [4].
[6]
When the display instruction object is displayed in the display area by the upper limit number when the first display request is received, any of the display instruction objects of the upper limit number displayed in the display area is displayed. After the operation, a new display instruction object corresponding to the first display request is displayed in the display area.
The video distribution system according to [5].
[7]
The first gift is a wearing gift associated with the wearing part of the character object.
The attached gift is displayed at a position corresponding to the attached portion in the moving image in response to an operation on the display instruction object.
The video distribution system according to [5] or [6].
[8]
The wearing gift includes a first wearing gift associated with a first wearing part of the wearing parts.
The first display time displayed in the moving image is set for the first wearing gift.
When the first wearing gift is displayed in the moving image, the one or more computer processors are associated with the first wearing part of the wearing gift until the first display time elapses. Prohibiting the display of the second wearing gift in the video,
The video distribution system according to [7].
[9]
When the first wearing gift is displayed in the moving image, the one or more computer processors are associated with the first wearing part of the wearing gift until the first display time elapses. Deactivate the display instruction object for displaying the second wearing gift,
The video distribution system according to [8].
[10]
In response to the reception of the second display request regarding the second gift displayed in the moving image without being associated with the specific part of the character object from the viewing user, the second gift is displayed in the moving image.
The video distribution system according to any one of [5] to [9].
[11]
A gift display prohibition period is set within the distribution period of the video,
The second gift is displayed on the video at a timing other than the gift display prohibition period during the distribution period of the video.
The video distribution system according to [10].
[12]
A video distribution method in which one or more computer processors execute a computer-readable instruction to perform live distribution of a video including an animation of a character object generated based on the movement of a distribution user.
A moving image distribution method comprising a step of causing the character object to perform a movement instructed by the motion gift in response to receiving a motion gift that specifies the movement of the character object from a viewing user.
[13]
Distribution A video distribution program that delivers live video including animation of character objects generated based on the movement of the user.
Video distribution that causes one or more computer processors to execute a step of causing the character object to perform a motion instructed by the motion gift in response to receiving a motion gift that specifies the movement of the character object from a viewing user. program.

1 Video distribution system

Claims (18)

A system that enables live playback of a video including an animation of a character object generated based on the movement of a distribution user on a viewing user terminal used by the viewing user.
Equipped with one or more computer processors
The one or more computer processors may execute computer-readable instructions.
In response to receiving the first display request regarding the first gift from the viewing user, the display instruction object is displayed on the distribution user device used by the distribution user and displaying the moving image .
In response to the operation on the display instruction object, the first gift is displayed on the moving image.
system. The display instruction object is selected by a contact operation with the distribution user device.
The first gift corresponding to the display instruction object selected by the contact operation is displayed in the moving image.
The system according to claim 1. The display instruction object displayed on the distribution user device is deactivated so that it cannot be selected.
The system according to claim 1 or 2. The deactivated display instruction object is activated so that it can be selected.
The system according to claim 3. When the first display request is received and the upper limit number of the display instruction objects is displayed in the display area of the distribution user device, the upper limit number of the display instruction objects displayed in the display area is displayed. A new display instruction object corresponding to the first display request is displayed in the display area after any of the above is operated.
The system according to any one of claims 1 to 4. The first gift is a first wearing gift associated with the wearing part of the character object.
When the one or more processors receive a second display request regarding a second wearing gift associated with the wearing part of the character object from the viewing user or a viewing user different from the viewing user, the moving image is described. While the first wearing gift is displayed, the display instruction object for displaying the second wearing gift is deactivated.
The system according to any one of claims 1 to 5. The one or more processors activate the display instruction object for displaying the deactivated second wearing gift in response to the end of the display of the first wearing gift.
The system according to claim 6. The first gift is a first wearing gift associated with the wearing part of the character object.
When the one or more processors receive a second display request regarding a second wearing gift associated with the wearing part of the character object from the viewing user or a viewing user different from the viewing user, the moving image is described. While the first wearing gift is displayed, the display instruction object for displaying the second wearing gift is hidden.
The system according to any one of claims 1 to 5. The one or more processors respond to the end of the display of the first wearing gift.
, Display the display instruction object for displaying the second wearing gift on the distribution user device.
The system according to claim 8. The display instruction object is also displayed on the display of the supporter computer that changes the setting for generating the moving image.
By selecting the display instruction object displayed on the supporter computer, the first gift corresponding to the display instruction object is displayed in the moving image.
The system according to any one of claims 1 to 9. The one or more computer processors
In response to receiving a motion gift that specifies the movement of the character object from the viewing user, the character object is made to perform the movement instructed by the motion gift.
The system according to any one of claims 1 to 10. A confirmation screen for confirming whether or not the character object can perform the movement specified by the motion gift is displayed on the distribution user device used by the distribution user, and the display instruction operation to the distribution user device is performed. , Make the character object perform the movement instructed by the motion gift,
The system according to claim 11. The motion gift specifies a movement other than the head of the character object.
The system according to claim 11 or 12. The animation of the character object is generated based on the movement of the face of the distribution user.
The system according to claim 13 . In response to the reception of the third display request regarding the third gift displayed in the moving image without being associated with the specific part of the character object from the viewing user, the third gift is displayed in the moving image.
The system according to any one of claims 1 to 14. A gift display prohibition period is set within the distribution period of the video,
The third gift is displayed on the video at a timing other than the gift display prohibition period during the distribution period of the video.
The system according to claim 15. By executing a computer-readable instruction by one or more computer processors, a video including an animation of a character object generated based on the movement of a distribution user can be played live on a viewing user terminal used by the viewing user. It ’s a method,
A process of displaying a display instruction object on the distribution user device used by the distribution user and displaying the moving image in response to receiving the first display request regarding the first gift from the viewing user.
A step of displaying the first gift on the moving image in response to an operation on the display instruction object, and
How to prepare. A program that enables live playback of a video including an animation of a character object generated based on the movement of a distribution user on a viewing user terminal used by the viewing user.
For one or more computer processors
A process of displaying a display instruction object on the distribution user device used by the distribution user and displaying the moving image in response to receiving the first display request regarding the first gift from the viewing user.
A step of displaying the first gift on the moving image in response to an operation on the display instruction object, and
A program that executes.

Images