JP7202967B2 - Video distribution system, video distribution method, and video distribution program - Google Patents

Description

The present invention relates to a moving image distribution system, a moving image distribution method, and a moving image distribution program.

2. Description of the Related Art Conventionally, there has been known a moving picture distribution system that generates animation of a character object based on the motion of an actor and distributes a moving picture including the animation of the character object (see, for example, Patent Document 1).

In this type of moving image distribution system, a system has been proposed in which an arbitrary object is displayed in a moving image distributed to a plurality of viewing users by the operation of the viewing users. The object displayed in the moving image by the viewing user is, for example, a gift object for the character object.

JP 2015-184689 A

In a video distribution system, in order to increase the number of viewing users or the number of viewing times, it is important to increase opportunities for communication between actors and viewing users through character objects, in addition to the uniqueness of character objects themselves. However, the actor must animate the character object, utter sounds as necessary, and respond to the gift object as well. Moreover, increasing opportunities for communication with viewing users is actually difficult because the number of objects to pay attention to increases.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mechanism for increasing opportunities for communication with viewing users.

A video distribution system for solving the above problems is a video distribution system for distributing a video including animation of a character object generated based on the movement of an actor to a client device used by a viewing user, and comprising one or more computer processors a storage that stores an object associated with the viewing user; and a display device that is visible to the actor, wherein the one or more computer processors execute computer-readable instructions to perform the A request for displaying the object is received from the viewing user, and information on the object for which the display request is received and identification information of the viewing user who has made the display request for the object are displayed on a display device arranged at a position visible from the actor. Display object information associated with .

A moving image distribution method for solving the above problems is provided by one or more computer processors executing computer-readable instructions, whereby a viewing user uses a moving image including animation of a character object generated based on the movement of an actor. a moving image distribution method for distributing to a client device, comprising the steps of: storing an object associated with the viewing user in a storage; receiving a request to display the object from the viewing user; and a position visible from the actor. and displaying, on a display device arranged in the apparatus, object information in which the information of the object for which the display request has been accepted and the identification information of the viewing user who has made the display request for the object are associated with each other.

A video distribution program for solving the above problem is a video distribution program for distributing a video including animation of a character object generated based on the movement of an actor to a client device used by a viewing user, the program comprising one or more computer processors a step of storing an object associated with the viewing user in a storage; receiving a display request for the object from the viewing user; a step of displaying object information in which the information of the object for which the object has been received and the identification information of the viewing user who has made the display request of the object are associated with each other.

According to the present invention, it is possible to provide a mechanism for increasing opportunities for communication with viewing users.

1 is a schematic diagram of a video distribution system according to an embodiment; FIG. FIG. 2 is a schematic diagram schematically showing facilities of a studio that produces moving images distributed by the moving image distribution system. FIG. 2 is a block diagram showing part of the moving picture distribution system; FIG. 2 is a block diagram showing a client device that constitutes the moving picture distribution system; The figure which shows the example of the user management data in one embodiment. The figure which shows the example of the possession list|wrist in one embodiment. FIG. 4 is a diagram showing an example of a candidate list in one embodiment; The figure which shows the example of the posting message in one embodiment. FIG. 4 is a diagram showing an example of a moving image displayed on a client device in one embodiment; FIG. 4 is a diagram showing an example of a moving image displayed on a client device in one embodiment; FIG. 4 is a diagram showing an example of a moving image displayed on a client device in one embodiment; FIG. 4 is a diagram showing an example of a moving image displayed on a client device in one embodiment; FIG. 4 is a diagram showing an example of a screen displayed on a display viewed by an actor in one embodiment; FIG. 4 is a diagram showing an example of a screen displayed on a display viewed by an actor in one embodiment; FIG. 4 is a diagram showing an example of a screen displayed on a display viewed by an actor in one embodiment; 4 is a flowchart showing the flow of video distribution processing in one embodiment. 4 is a flow chart showing the flow of processing for receiving decoration objects in one embodiment. 4 is a flow chart showing the flow of processing for displaying a decoration object in one embodiment. 4 is a flow chart showing the flow of processing for displaying a posted message in one embodiment.

A video distribution system according to an embodiment of the present invention will be described below with reference to the drawings.
As shown in FIG. 1, the video distribution system 1 includes a client device 10, a server 20, and a studio unit 30. The client device 10, the server 20, and the studio unit 30 are connected via a network 11 so as to be able to communicate with each other. The network 11 includes various networks such as a local area network and the Internet.

In the moving image distribution system 1, the distributor uses the studio unit 30 to create moving images of content including animation of character objects based on the movements of actors. A character object is an individual such as a virtual person or animal. The created moving image is delivered to the client device 10 used by the viewing user via the server 20 . A distributor may be an actor, an operator of studio unit 30, or otherwise.

An overview of the studio unit 30 will be described with reference to FIG. The studio unit 30 includes a tracking system 31 , controller 40 , main display 41 , sub-display 43 (display device), microphone 44 (see FIG. 3), and supporter computer 45 .

The tracking system 31 acquires information about the movement of actor A. Actor A is, for example, a performing human, an animal, or a moving object. Actor A may be, for example, a robot capable of autonomous movement. The number of actors in the studio room R may be plural.

A tracking system 31 detects the position of actor A. FIG. Also, the tracking system 31 can detect the facial expression of actor A, the position of a virtual camera set in the virtual space, and the like. For example, tracking system 31 includes external sensor 32 , mounted sensor 33 and localization device 35 portions. These detect at least one of the orientation and position of the wearing sensor 33 worn by the actor A in an outside-in manner.

The wearing sensor 33 is worn on the actor A. A plurality of mounted sensors 33 are mounted on the actor A. FIG. For example, the wearing sensors 33 are worn on the actor A's left wrist, right wrist, left instep, right instep, waist, and top of the head. The wearing sensor 33 may be worn on the actor A via a wearing tool, or the actor A may wear clothes on which the wearing sensor 33 is worn. The wearing sensor 33 can be worn on various parts of the actor A. FIG. For example, the wearing sensor 33 may be worn on a finger and detect the movement of the finger. The number of attached sensors 33 attached to the actor A may be five or less, or may be seven or more.

The mounted sensor 33 cooperates with the external sensor 32 to output information for identifying its own orientation and position to the position identifying device 35 . One of the external sensors 32 in the outside-in method is, for example, a multi-axis laser emitter. The external sensor 32 emits pulsed laser light for synchronization. The mounting sensor 33 has a sensor that detects laser light, and detects its own position and orientation while synchronizing with a synchronization pulse. As the mounting sensor 33, for example, Vive Tracker (registered trademark) and Vive Base Station provided by HTC Corporation (registered trademark) can be used. In addition to or instead of the above configuration, the mounting sensor 33 may incorporate a sensor for autonomously specifying the position. For example, the wearable sensor 33 may include at least one of a multi-axis acceleration sensor, a gyro, and a geomagnetic sensor. Also, the attached sensor 33 may be both one that cooperates with the external sensor 32 and one that does not cooperate with the external sensor 32 . Also, the mounting sensor 33 may be one that can detect its orientation or position by itself.

Tracking system 31 also includes viewpoint position sensor 36 and camera 37 . The viewpoint position sensor 36 is configured such that its position can be changed by the user. The viewpoint position sensor 36 has the same configuration as the mounting sensor 33 . The viewpoint position sensor 36 outputs information for identifying its orientation and position to the position identifying device 35 via wireless communication or a communication cable. The viewpoint position sensor 36 is set as the viewpoint of the virtual camera in the virtual space. The viewpoint position sensor 36 may be supported by a stand, a gimbal, or a stabilizer, for example. The gimbal may be configured in a shape that can be held by an actor or other person. Camera shake can be suppressed by supporting the viewpoint position sensor 36 with a gimbal or stabilizer.

The camera 37 is arranged so as to capture an image of the actor A's face. For example, the camera 37 is attached to the actor A's head, neck, or the like, or is placed in front of the actor A. The camera 37 continuously images the face of the actor A, acquires imaged data of the face of the actor A, and transmits the imaged data to the server 20 . The camera 37 may be a 3D camera capable of detecting the depth of a person's face.

A microphone 44 is placed at a position where the voice uttered by the actor A can be collected. For example, the microphone 44 is attached to the actor A's head, neck, or the like, or is placed in front of the actor A. The microphone 44 transmits a signal corresponding to the voice to the server 20 .

The controller 40 is operated by the actor A. The controller 40 outputs a control signal according to the operation of the actor A to the server 20 . Also, the controller 40 may incorporate a sensor for autonomously identifying the position. For example, controller 40 may include at least one of a multi-axis acceleration sensor, a gyro, and a geomagnetic sensor. In addition to or instead of the above configuration, the controller 40 may be configured to detect the position in cooperation with the external sensor 32 .

The main display 41 is configured to display moving images generated by the server 20 . The number of main displays 41 may be one, or may be plural as shown. The moving images displayed on the main display 41 include animation of character objects.

Sub-display 43 is configured to display information received from server 20 or supporter computer 45 . The number of sub-displays 43 may be one or plural. Information transmitted from the server 20 or the supporter computer 45 to the main display 41 may include, for example, text information, image information, and various other information. The main display 41 and the sub-display 43 are arranged at positions where the actor A can visually recognize them.

The supporter computer 45 is a computer used by an operator next to the studio room (referred to herein as a "supporter"). Since the room in which the supporter computer 45 is installed and the studio room R are separated by a glass window, the supporter using the supporter computer 45 can see the actor A. In the illustrated embodiment, supporter B1 and supporter B2 are in the room. The supporter computer 45 outputs various information to the sub-display 43 according to the operation of the supporter. In this specification, the supporter B1 and the supporter B2 may be collectively referred to as a "supporter" when there is no need to distinguish between the supporter B1 and the supporter B2. The components and functions of studio unit 30 shown in FIG. 2 are exemplary. A studio unit 30 applicable to the present invention may comprise various components not shown. For example, studio unit 30 may include a projector. The projector is capable of projecting moving images to be distributed to the client device 10 or other client devices on the screen.

The server 20 will be described according to FIG. The server 20 is configured to distribute moving images including animations of character objects based on actions of actors to viewing users. A character object included in this moving image may be motion-controlled in the virtual space. The server 20 includes a computer processor 21, a communication I/F 22, and a storage 23 (storage medium).

The computer processor 21 is an arithmetic device that loads an operating system and various programs that implement various functions from the storage 23 or other storage into its memory, and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, MPU, DSP, GPU, various arithmetic units other than these, or a combination thereof. The computer processor 21 may realize at least a part of the processing that it executes by circuitry such as ASIC, PLD, FPGA, and MCU. Although computer processor 21 is illustrated as a single component in FIG. 3, computer processor 21 may be a collection of a plurality of physically separate computer processors. In this specification, a program or instructions included in the program described as being executed by the computer processor 21 may be executed by a single computer processor, or may be executed by a plurality of computer processors in a distributed manner. good too. Also, the program executed by the computer processor 21 or the instructions contained in the program may be executed by multiple virtual computer processors.

The computer processor 21 executes the computer-readable instructions contained in the distribution program stored in the storage 23 or other storage to process the motion data processing unit 21A, the animation generation unit 21B, the animation distribution unit 21C, and the user requests. It functions as a processing section 21D, a user information management section 21E, and a purchase processing section 21F. At least part of the functions implemented by the computer processor 21 may be implemented by a computer processor other than the computer processor 21 of the video distribution system 1 . At least part of the functions implemented by the computer processor 21 may be implemented by a computer processor included in the computer included in the studio unit 30, for example.

The motion data processing unit 21A generates body motion data based on tracking information detected by each of the wearing sensors 33 attached to the actor. Body motion data is a time-series digital representation of at least one of the position and orientation of each part of the actor's body. Body motion data is generated as needed over time. For example, body motion data may be generated at predetermined sampling intervals.

The motion data processing unit 21A also generates face motion data, which is a time-series digital representation of facial movements of the actor, based on the photographed data of the camera 37 of the studio unit 30 . Face motion data is generated as needed over time. For example, face motion data may be generated at predetermined sampling intervals.

The moving image generator 21B applies the body motion data and face motion data generated by the motion data processor 21A to predetermined model data included in the model data 23A stored in the storage 23 . Thereby, the moving image generation unit 21B is configured to generate an animation of a character object that moves in the virtual space and whose expression changes.

Furthermore, the moving image generation unit 21B constructs a virtual space using the object data 23B stored in the storage 23, and generates a moving image including the image of this virtual space and the animation of the character object corresponding to the actor A. The moving image generator 21B can set the position of the viewpoint position sensor 36 to the position of the virtual camera, which is the viewpoint of the moving image. Then, the position of the actor A relative to the position of the virtual camera is set as the position of the character object in the virtual space. Therefore, by changing the position or orientation of the viewpoint position sensor 36 to any position or orientation, the actor A can create a wide variety of animations, such as a video of the character object viewed from the left side, a video viewed from the right side, a bird's-eye view video, and the like. It can generate videos. Also, the moving image generator 21B may change the setting information (focus, angle of view, etc.) of the virtual camera based on the position of the virtual camera.

Further, when the viewing user is associated with the drawing data of his/her own avatar, the moving image generation unit 21B may display the animation of the viewing user's avatar in addition to the animation of the character object. The avatar may be displayed to move within the video based on an instruction to the client device 10 by the viewing user.

The moving image distribution unit 21C transmits the list of distribution moving images to the client device 10, and distributes the moving images generated by the moving image generation unit 21B. The moving image distribution unit 21C may distribute a moving image shot in the studio room R in real time, or may distribute a previously recorded moving image according to a distribution schedule or the like. The moving image distribution unit 21C may be configured to be able to distribute a plurality of moving images in the same time slot. For example, the moving picture distribution unit 21C distributes the distributed moving picture of "character X" played by actor A1 and the distributed moving picture of "character Y" played by actor A2 at the same distribution start time (for example, "20:00") or It is possible to distribute in overlapping time zones. In response to a list display request from the client device 10 , the moving image distribution unit 21</b>C transmits a list of distributable videos to the client device 10 . Upon receiving a video distribution request from the client device 10, the video distribution unit 21C transmits the selected video to the client device 10 based on the video distribution request.

The user request processing unit 21D receives an object display request and a posted message display request from the client device 10 of the viewing user, and performs processing according to the display request. A viewing user can transmit an object display request to the server 20 by operating his/her own client device 10 . Objects include gift objects that viewers provide to content. A gift object is an object that becomes a digital gift from a viewing user to an actor or the like. A gift object may be an object that can be displayed without paying a consideration, or it may be an object that requires a consideration, and a consideration is paid when it is displayed in response to the display request. There may be. The gift object may be one that is continuously displayed in the virtual space, or one that temporarily adds an effect to the virtual space. The gift object display request may include the user ID of the viewing user and the identification information (object ID) of the object for which the display request is made.

When the user request processing unit 21D receives a gift object display request from a viewing user, the user request processing unit 21D determines whether or not the gift object requires a determination as to whether an actor or a supporter can be displayed. When the user request processing unit 21D determines that the object requested to be displayed does not require the judgment of the actor or the supporter, the object requested to be displayed is displayed in the virtual space via the animation generation unit 21B. Let

On the other hand, when the user request processing unit 21D determines that the object requested to be displayed requires the determination of the actor or the supporter, the sub-display 43 displays the gift object requested to be displayed. When the actor or supporter issues a display instruction to the gift object for which the display request has been made, the object for which the display request has been made is displayed.

Further, the user request processing unit 21D performs processing for displaying a posted message received from the client device 10 in a moving image. The posted message includes the content of the message, the identification information of the viewing user (user ID or terminal ID), and the posted date and time.

Upon receiving the posted message, the user request processing unit 21D determines whether or not the posted message can be displayed. When the user request processing unit 21D determines that the received posted message can be displayed, the user request processing unit 21D displays the posted message in a predetermined area of the moving image via the moving image generating unit 21B. User request processing unit 21</b>D also displays the posted message and the attribute information of the posted message on sub-display 43 .

The user information management unit 21E acquires the viewing status of the viewing user and stores the viewing status in the storage 23 in association with the viewing user. The user information management unit 21E stores, as a history, the video that the viewing user is viewing in the viewing application, that is, the "room" of the actor "entering" the viewing user, in association with the user ID of the viewing user. Also, the user information management unit 21E groups the viewing users according to the viewing status of the viewing users.

The purchase processing unit 21F receives from the client device 10 a request to display a purchased medium such as a gift object related to the distributed moving image by the operation of the viewing user. After accepting the display request for the purchased medium, the purchase processing unit 21</b>F transmits information on the purchased medium to the client device 10 . The purchase medium information may include the type of purchase medium, the image of the purchase medium, the price, and various information necessary for purchase. The viewing user confirms the information on the purchased media displayed on the client device 10 and selects an arbitrary purchased medium. When the viewing user selects a purchase medium, the client device 10 transmits a purchase request for the purchase medium to the server 20 . The purchase processing unit 21F performs settlement processing based on the purchase request. When this settlement process is completed, the purchased medium is stored in the server 20 as owned by the viewing user. In addition to the gift object, the purchase medium may be an object other than the gift object related to viewing a moving image, or viewing conditions such as the image quality of the moving image, a two-dimensional image, or a three-dimensional image. Alternatively, the purchased medium may be the moving image itself. Sales of purchasable gift objects and other media are shared with distributors. At this time, a part of the sales may be distributed to the operator of the studio unit 30.

The communication I/F 22 is implemented as hardware, firmware, communication software such as a TCP/IP driver, or a combination thereof. Server 20 can transmit and receive data to and from other devices via communication I/F 22 .

Storage 23 is a storage device accessed by computer processor 21 . The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or various other storage devices capable of storing data. Various programs can be stored in the storage 23 . At least part of the programs and various data that can be stored in the storage 23 may be stored in a storage that is physically separate from the server 20 .

Next, the locating device 35 and the supporter computer 45 of the studio unit 30 will be further described. The locating device 35 of the studio unit 30 includes a computer processor 35A, storage 35B (storage medium), and communication interface (I/F) 35C. The computer processor 35A, like the computer processor 21 of the server 20, is various arithmetic units such as a CPU. The storage 35B, like the storage 23 of the server 20, is various storage devices such as magnetic disks. A communication interface (I/F) 35C, like the communication interface 22 of the server 20, is various drivers, software, or a combination thereof for communicating with other devices. The computer processor 35A acquires tracking information from the external sensors 32 or the mounted sensors 33 and identifies the positions of the mounted sensors 33 by executing a position detection program stored in the storage 35B or other storage. Further, the computer processor 35A acquires tracking information from the external sensor 32 or the viewpoint position sensor 36 by executing a position detection program stored in the storage 35B or other storage, and identifies the position of the viewpoint position sensor 36. do. The position specifying device 35 also transmits the specified position to the server 20 .

The supporter computer 45 has a computer processor 46 , a communication I/F 47 , a storage 48 (storage medium), a display 49 and an input interface 50 .

The computer processor 46, like the computer processor 21 of the server 20, is various arithmetic units such as a CPU. The communication I/F 47 is, like the communication I/F 22, various drivers, software, or a combination thereof for communicating with other devices. The storage 48 is, like the storage 23, various storage devices such as magnetic disks that can store data. Various programs are stored in the storage 48 . The display 49 is a liquid crystal display, an organic EL display, an inorganic EL display, or any other display device capable of displaying images. The input interface 50 includes any pointing device that accepts input from a supporter such as a mouse and keyboard.

The computer processor 46 functions as a display control section 46A and a progress management section 46B by executing computer-readable instructions included in programs stored in the storage 48 or the like. At least part of the functions implemented by the computer processor 46 may be implemented by a computer processor other than the computer processor 46 of the video distribution system 1 . Also, at least some of the functions implemented by computer processor 46 herein may be implemented by computer processor 21 of server 20, for example.

The display control unit 46A displays, on the main display 41 or the sub-display 43, a screen that can be viewed by the actor but cannot be viewed by the viewing user, in response to various operation inputs by the supporter via the input interface 50. Also, it is configured to add various additional information to the distribution video distributed to the viewing user.

The supporter computer 45 may be configured to change the settings of the components of the studio unit 30 according to the operation of the supporter. The supporter computer 45 can, for example, set the scanning interval by the external sensor 32, set the position or orientation of the mounted sensor 33, and change various settings of various devices other than these. A supporter can input a message to the supporter computer 45 and display the input message on the main display 41 .

Next, referring to FIG. 4, the client device will be described.
The client device 10 is an information processing device such as a smart phone. The client device 10 is a mobile phone, a tablet terminal, a personal computer, an electronic book reader, a wearable computer including a head-mounted display, a game console, and other various information processing devices capable of reproducing moving images, in addition to smartphones. good too.

The client device 10 includes a computer processor 12 , storage 13 (storage medium), input interface (I/F) 14 , communication interface (I/F) 15 and display 16 . The computer processor 12, like the computer processor 21 of the server 20, is various arithmetic units such as a CPU. The storage 13, like the storage 23 of the server 20, is various storage devices such as magnetic disks. The storage 13 stores an application program for viewing moving images distributed from the server 20 . The input I/F 14 is an arbitrary input interface such as a touch panel that receives input from the viewing user. The communication I/F 15, like the communication I/F 22, is various drivers, software, or a combination thereof for communicating with other devices. The display 16 is, for example, an organic EL display integrated with a touch panel, a liquid crystal display, or any other display device capable of displaying images.

The client device 10 activates the viewing application program installed in the client device 10 by accepting the viewing user's operation via the input I/F 14 . The viewing application may at least be capable of viewing, and may have other functions. The computer processor 12 executes readable instructions contained in the viewing application program to retrieve the list of broadcast videos from the server 20 . The client device 10 displays the transmitted list on the display. The viewing user selects one of the videos displayed in the list. Upon receiving the selection operation of the viewing user, the client device 10 transmits to the server 20 a moving image distribution request requesting distribution of the selected moving image. Alternatively, the client device 10 accesses the server 20 to activate the web browser stored in the storage 13 and display a web page written in a markup language such as HTML or XML on the display 16. may be configured. The web page displays a list of videos. Alternatively, the client device 10 may use both the viewing program and the web browser (in-app browser) stored in its own storage 13 to display the video list.

When the client device 10 receives the moving image data from the server 20, the client device 10 displays the moving image on the display 16 based on the received data. The viewing user can input a message regarding the distributed video via the input I/F 14 of the client device 10 and post this message to the server 20 . The message posted by each viewing user may be displayed superimposed on the video. This facilitates interaction between actors and viewing users, and interaction between viewing users.

Next, various data stored in the storage 23 of the server 20 will be described. The storage 23 stores model data 23A, object data 23B, user management data 23C, possessed lists 23D, candidate lists 23E, and posted messages 23F. In addition, the storage 23 may store moving images that are being distributed or have already been distributed by the moving image distribution system 1 .

The model data 23A is model data for generating character animation. The model data 23A may be three-dimensional model data for generating a three-dimensional animation, or two-dimensional model data for generating two-dimensional model data. The model data 23A includes, for example, rig data (sometimes referred to as "skeleton data") indicating the skeleton of the character, and surface data indicating the shape and texture of the surface of the character. The model data 23A can include a plurality of different model data. The plurality of model data may have rig data different from each other, or may have the same rig data. The plurality of model data may have surface data different from each other, or may have the same surface data. In the illustrated embodiment, the model data 23A has at least two different types of model data for generating character objects corresponding to actors.

The object data 23B includes asset data for constructing a virtual space that constitutes a moving image. The object data 23B includes data for drawing the background of the virtual space that constitutes the moving image, data for drawing various objects displayed in the moving image, and data for drawing various objects displayed in the moving image. Contains data. The object data 23B may include object position information indicating the position of the object in the virtual space.

In addition to the above, the object data 23B may include gift objects that are displayed in moving images based on display requests from the viewing user of the client device 10 . Gift objects can include effect objects, decoration objects, and normal objects. Gift objects may include those that require consideration for holding by viewing users and those that do not require consideration. An upper limit may be set on the number of objects that can be purchased or the purchase price of the objects.

The effect object is an object that affects the impression of the entire viewing screen of the distributed moving image, and is, for example, an object that imitates confetti, an object that imitates fireworks, or the like. The confetti-like object may be displayed on the entire viewing screen, thereby changing the impression of the entire viewing screen before and after the display. For example, an effect object may be represented by a particle system representing an event composed of moving particles. In the particle system, the display time may be set for each particle. An effect object may be a static object or a dynamic object. Effect objects may be displayed so as to overlap with character objects, but differ from decoration objects in that they are not displayed in association with specific parts of character objects.

A decoration object is an object displayed on the display screen in association with a specific part of the character object. The decoration object displayed on the display screen in association with the specific part of the character object is displayed on the display screen so as to be in contact with the specific part of the character object. A decoration object displayed on the display screen in association with a specific part of the character object is displayed on the display screen so as to cover part or all of the specific part of the character object.

Decoration objects are, for example, accessories (headbands, necklaces, earrings, etc.), clothes (T-shirts, etc.), costumes, and other objects that can be worn on character objects. The object data 23B corresponding to the decoration object may include attachment position information indicating which part of the character object the decoration object is associated with. The mounting position information of a certain decoration object can indicate on which part of the character object the decoration object is mounted. For example, when the decoration object is a headband, the attachment position information of the decoration object may indicate that the decoration object is attached to the "head" of the character object. When the decoration object is a T-shirt, the attachment position information of the decoration object may indicate that the decoration object is attached to the "torso" of the character object.

The decoration object is added to the list stored by the server 20 in the storage 23 or other storage, and then attached to the character object by being selected by an actor or a supporter. The viewing user feels a sense of familiarity with the character object by having the character object wear the decoration gift object sent by the viewing user. On the other hand, even if the viewing user makes a display request for a decoration object, the decoration object is not attached to the character object unless it is selected by the actor or the supporter. When the actor selects a decoration object, the actor confirms the list displayed on the sub-display 43 and selects the decoration object by using a pointing device such as the controller 40 or by instructing the supporter. Also, the supporter confirms the list displayed on the supporter computer 45 and selects a decoration object using the input interface 50 .

A normal object is a gift object other than a decorative object placed as an object in the virtual space, such as a stuffed toy or a bouquet of flowers. A normal object may be displayed so as to overlap with a character object, but differs from a decoration object in that it is not displayed in association with a specific part of the character object. A regular object may differ in that a regular object can have its position changed by an actor, whereas an effect object cannot have its position changed by an actor. Also, the normal object and the effect object may have different display times.

A display time corresponding to the type of gift object may be set for each gift object. In one aspect, the display time of the decoration object may be set longer than the display time of the effect object or the display time of the normal object. For example, the display time of the decoration object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

As shown in FIG. 5, the user management data 23C stores information about viewing users who have viewed the moving image for each content of the character object. Basically, content is delivered multiple times. For example, "distributor A" distributes "content P" with "character P" as the main character a plurality of times. Another "distributor B" distributes "contents Q" with "character Q" as the main character a plurality of times. The contents are not necessarily different for each character object. For example, even if the animations of the same character object are not related to each other, different contents may be configured respectively. The user management data 23C stores the activity of the viewing user after the start of distribution of the content for the first time. An activity is a viewing user's activity with respect to content, and may include at least one of a viewing history of content, a status of posting messages to content, a status of providing gift objects to content, a status of billing for content, and the like. Further, when "viewing user C" has viewed both "content P" and "content Q", the activity of "viewing user C" in "content P" and the activity in "content Q" The activities of "viewing user C" are stored respectively.

The user management data 23C can include identification information (user ID) of the viewing user, the group to which the viewing user belongs, the room entry status of the viewing user, the ranking of the viewing user, and the billing status of the viewing user for each content viewing user.

A group corresponding to content indicates a group to which the viewing user belongs to the content. A plurality of groups may be used to divide viewing users. Viewing users are divided into groups based on conditions related to their activity in the content they have viewed. The conditions for grouping may be preset by the distributor or the operator of the studio unit 30 . For example, based on conditions related to content activity, viewing users are divided into a group of viewing users who are enthusiastic fans of the content and a group of viewing users who are less involved in the content, such as viewing users who view the content for the first time. be able to.

The condition for dividing the groups may include at least one of the number of times the content is viewed, the number of times a message is posted to the content, the number of times a gift object is sent to the content, and the amount charged for the content. For example, if the condition for dividing the groups is the number of views, viewing users who have viewed "content P" a predetermined number of times (eg, 10 times) or more are included in the first group (eg, "VIP group"), Viewing users less than the number of times are included in the second group. Also, if the condition for dividing the groups is the number of message postings, viewing users who have posted messages a predetermined number of times (for example, 20 times) are included in the first group, and viewing users who have posted messages less than a predetermined number of times are included in the first group. Include in the second group. If the condition for grouping is the number of times gift objects are provided, viewing users who have provided gift objects a predetermined number of times (e.g., 5 times) or more are included in the first group, and viewing users who have provided gift objects less than a predetermined number of times are included in the first group. Users are included in the second group. If the condition for dividing the groups is the charge amount, viewing users whose charge amount is equal to or greater than a predetermined amount are included in the first group, and viewing users whose charge amount is less than the predetermined amount are included in the second group. Grouping may also be performed by combining a plurality of the number of views of the content, the number of times of posting messages to the content, the number of times of sending gift objects to the content, the amount charged to the content, and other conditions.

The grouping conditions may be other than the above conditions. For example, the status of use of viewing applications (frequency of use, years of use, most recent date and time of use), user attributes (age, gender, occupation, place of residence, language used, etc.) may be used. Grouping may be performed by combining these conditions.

The entering state associated with the content is data indicating whether or not the content is being viewed while logged in to the video distribution system 1 . When the content is distributed to the client device 10 of the viewing user, data indicating "entered room" is stored as the entry state. If the content has not been delivered to the client device 10, data indicating "leaving" is stored in the entry state. After the content is delivered to the client device 10, viewing of the moving image may be interrupted, and data indicating "exit" may be stored when a predetermined time has passed since the interruption. On the other hand, if the moving image being distributed has not been viewed from the beginning of the distribution, data other than "exited" such as "unviewed" may be stored.

The ranking associated with content is data indicating the ranking of viewing users in the content. The ranking method can be determined by the operator of the studio unit 30 or the distributor. For example, the ranking may be determined according to the number of views of the content, the number of messages posted to the content, the number of gift objects sent to the content, the amount charged for the content, and the like. The ranking may be based on all viewing users of the content, or may be based on at least one of a plurality of groups (for example, the first group).

The ranking associated with content is data indicating the billing status of viewing users for the content. The charging state is data such as "charged" or "no charge". Alternatively, the billing state may be the billing amount.

As shown in FIG. 6, the owned list 23D is a list of objects owned by the viewing user. The owned list 23D can include identification information (object ID) of owned objects in association with the user ID. Objects held by the viewing user may differ for each content, objects held by the viewing user may be common among different contents, or may include both of them. When the object differs for each content, the list 23D held by the viewing user stores the identification information of the object for each content. This holding list 23D is continuously stored over a plurality of video distributions. Alternatively, the possessed list 23D may be newly generated or reset each time a content for one delivery is distributed.

As shown in FIG. 7, the candidate list 23E is a list of gift objects associated with moving images. The candidate list 23E is preferably generated or reset each time a moving image is distributed. When the viewing user sends a request to display a gift object in the moving image, information regarding that gift object is added to the candidate list 23E. The candidate list 23E contains the identification information (user ID) of the viewing user who sent the gift object, the identification information (object ID) of the gift object, the type of the gift object (decoration object, effect object, normal object), and the transmission of the gift object. It may include the time of day, the selection state of the gift object. The selection state of the gift object indicates whether or not the decoration object is selected by the actor or the supporter when the gift object is the decoration object. As the selection state, data indicating "selected" is stored when the decoration object is selected, and data indicating "unselected" is stored when the decoration object is not selected. If the gift object is not a decoration object, "unselected" or data other than "unselected" and "selected" are stored.

As shown in FIG. 8, the posted message 23F may include information regarding the message posted to the video by the viewing user. The posted message 23F may include, for each content, identification information (user ID) of the viewing user, the group to which the viewing user belongs, the content of the posted message, and the date and time when the message was posted. Since the group to which the viewing user belongs is stored in the user management data 23C, this may be omitted. The posted message 23F is newly generated or reset each time the content for one time is distributed.

Next, screens to be confirmed by viewing users, actors, and supporters will be described along with the flow of content distribution. When the viewing application program is activated by the viewing user's operation, the client device 10 requests the server 20 for a content list. The server 20 transmits information for displaying the content list to the client device 10 .

As shown in FIG. 9 , a content list screen 100 is displayed on the display 16 of the client device 10 . A content list screen 100 displays a list of content that is being delivered or is scheduled to be delivered. In addition to the image 101 of the content, the list displays the delivery date and time of the content, the name of the content, the name of the character appearing in the content, and the like.

A viewing user selects one content from the list. The client device 10 transmits a distribution request for the selected content to the server 20 .
When the server 20 receives a content distribution request from the client device 10 , the server 20 distributes the requested content to the client device 10 . The client device 10 displays the video when receiving the content.

As shown in FIG. 10 , a video viewing screen 105 is displayed on the display 16 of the client device 10 . The video viewing screen 105 displays a virtual space with the viewpoint position sensor 36 as a camera viewpoint, and a character object 110 reflecting the action of the actor. A gift selection section 112 and a post selection section 113 are also displayed on the video viewing screen 105 .

When the viewing user selects the gift selection section 112 of the video viewing screen 105 , the client device 10 acquires the holding list 23D from the server 20 . Alternatively, the client device 10 acquires the possessed list 23D acquired from the server 20 in advance and stored in the storage 13 . Further, the client device 10 displays a list of gift objects owned by the viewing user based on the owned list 23D.

When the viewing user selects a normal object from the list of gift objects, the client device 10 sends a display request for the normal object to the server 20 . The display request usually includes object identification information (object ID) and user identification information (user ID). In addition, since the display request of the gift object requires transmission of the user's identification information, before transmitting the display request, log in to the moving image distribution system 1 or another user authentication system linked with the moving image distribution system 1 There is a need.

In response to the display request for the normal object, the server 20 displays the normal object 111 in the moving image distributed to the viewing user who made the display request and other viewing users. In the illustrated embodiment, a plurality of types of normal objects 111A-111C are displayed. The normal object 111A is a stuffed bear object and is placed at a predetermined position in the virtual space. The normal object 111A may be movable in the virtual space by contact with the character object 110, for example, when the character object 110 performs a grasping motion. The normal object 111B is a hanging scroll object and is displayed at a predetermined position in the virtual space. The normal object 111C is an object that can move within the virtual space. After moving in the virtual space, the normal object 111C may remain displayed at the position finally reached, or may disappear from the screen.

As shown in FIG. 11, similar to the display request for a normal object, when the viewing user makes a display request for an effect object, the effect object is displayed on the video viewing screen 105 . In the illustrated embodiment, an effect object 115 corresponding to confetti is displayed.

As shown in FIG. 12, when the viewing user makes a display request for a decoration object, a decoration object 120 is displayed on the moving image viewing screen 105, similarly to the display request for a normal object. The decoration object 120 is displayed on the moving image viewing screen 105 in association with a specific part of the character object. The decoration object 120 may be displayed so as to touch a specific portion of the character object. For example, the decoration object 120 imitating cat ears is attached to the center of the head of the character object 110 because it is associated with the center of the head of the character object. When the character object 110 moves, the decoration object 120 also moves with the head as if it were attached to the character object 110 while being associated with the character object 110 .

When a video has a period during which a message can be posted, a screen other than the video viewing screen 105 or a video viewing screen is displayed when the post selecting section 113 is posted by one of the viewing users watching the video. A message input screen is displayed in the screen 105 . When a message is input on the input screen, information on the posted message is transmitted to server 20 .

When the server 20 receives the posted message within the postable period, the server 20 transmits the video data including the posted message to the client device 10 . The client device 10 causes the posted message 130 to be displayed within the video viewing screen 105 . Posted message 130 is displayed in a predetermined message display area 131 . Posted messages 130 are arranged in order of posted date and time. For example, the latest posted message 130 is displayed at the top of message display area 131 . Next, when the server 20 receives a new posted message, the posted message 130 displayed at the top is moved downward, and the new posted message is displayed at the top. A posted message that has reached the bottom of the message display area 131 moves further downward and is no longer displayed when a new posted message is added to the top. Alternatively, the message display area 131 may be able to display only one posted message.

Next, the screen that the actor confirms in the studio room R will be explained.
FIG. 13 shows an example of the notification screen 200 displayed on the sub-display 43 installed in the studio room R. As shown in FIG. A notification screen 200 may display a notification 201 to an actor. The data for displaying the notification screen 200 may be automatically generated by the supporter computer 45, or may require an input operation by the supporter. In the illustrated embodiment, notification 201 displays time remaining, schedule, information to notify actors, and the like. The actor performs the performance while checking the notification screen 200. - 特許庁Note that the notification 201 may be displayed on the screen of the main display 41 so as to be superimposed on or side by side with the animation of the character object.

FIG. 14 shows an example of gift list screen 210 displayed on sub-display 43 . The gift list screen 210 displays a list (object information) in which gift objects requested by viewing users are displayed in association with the viewing users. The gift list screen 210 displays a list of all gifts 211, a list of worn gifts 212 (first list), and a list of unworn gifts 213 (second list).

The all-gift list 211 includes the image of the gift object requested by the viewing user during video distribution, the name of the gift object, and the identification information of the viewing user who requested the display of the gift object (user account name). or user ID), wearing state. The full gift list 211 preferably includes other types of gift objects in addition to decorative objects. Note that the avatar of the viewing user may be displayed as the identification information of the viewing user. In the illustrated embodiment, the all gift list 211 displays all types of gift objects including normal objects, effect objects, and decoration objects.

"Wearing state" of the all-gift list 211 indicates whether or not the character object is wearing a decoration object when the gift object displayed in the all-gift list 211 is a decoration object. When the character object is wearing the decoration object, "wearing" is displayed. When the attachment of the character object is completed, "equipped" is displayed. In the content being distributed, "equipped" is displayed for decoration objects that have already been attached to the character object. Actors and supporters can confirm the gift objects requested by viewers to be displayed from the start of the distribution of the video in this all-gift list 211 . In addition, since the identification information of the user is displayed in association with the gift object in the all gift list 211, the actor sends a message (for example, " Mr. A, thank you,” etc.). As a result, the actor can increase communication with the viewing user, thereby improving satisfaction of the viewing user.

A display time may be defined for the decoration object. A decoration object whose display time has passed has a selection state of "attached" in the list of all gifts 211, and is displayed in a different display mode, such as grayout, from a decoration object whose display time has not passed. Also, the decorative object whose display time has passed is hidden in the moving image.

Note that when a different viewing user requests the display of the same decoration object in a moving image being distributed, and only one decoration object is attached by a character object, the decoration object is set as "equipped" and the other decoration object is attached. The decoration object may be "unmounted". Alternatively, both decoration objects may be "attached".

The attached gift list 212 displays decoration gift objects selected by the actor or the supporter and attached to the character object. Items in the attached gift list 212 are the same as in the all gift list. In the attached gift list 212, among the decoration objects being attached, the latest display request date and time is displayed at the top, and the latest display request date and time are displayed in descending order. They are displayed in order from top to bottom. Actors and supporters can grasp the decoration object that the character object is wearing by checking the attached gift list 212 . Therefore, the actor can convey a message such as impressions of the decoration object attached to the character object (for example, "I like this cat ear") to the viewing user through the sound of the moving image. As a result, the actor can increase communication with the viewing user through the decoration object. Motivation to provide objects can be increased.

A decoration object whose display time has passed is erased from the attached gift list 212, or is displayed in a different display mode, such as grayout, from a decoration object whose display time has not passed.

The unmounted gift list 213 displays decorative gift objects that have not been selected by the actor or the supporter after the viewing user has made a display request. The items of the unmounted gift list 213 are the same as those of the all gift list. In the unworn gift list 213, the gift with the earliest date and time when the display request was made, that is, the gift with the longest time that has elapsed since the display request was made is displayed at the top, and the display request is made. They are arranged from top to bottom, starting with the earliest date and time. In this way, the decorative gift objects that have not been worn are displayed in a list, so that the actor or supporter can grasp the decorative objects that have been provided by the viewing user and have not been selected. Since the actor can easily check the unselected decoration objects in this way, it is possible to efficiently select as many decoration objects as possible. Furthermore, since the date and time when the display request is made is displayed at the top, omission of selection can be suppressed.

Among the decoration gift objects, the object whose display time is limited disappears from the moving image viewing screen 105 when the display time elapses after the object is started to be attached to the character object. The erased decoration object is erased from the attached gift list 212 . The selection state of the decoration object deleted from the moving image viewing screen 105 in this way is updated to "attached" in the list of all gifts 211. FIG. The display time of the gift object may be displayed in the all gift list 211, the attached gift list 212, and the unattached gift list 213. FIG.

When an actor or a supporter selects one of the decorative gifts included in the unmounted gift list 213, the server 20 deletes the information about the selected decorative object from the unmounted gift list 213, and removes the information about the selected decorative object from the unmounted gift list 213. It is newly added to the list 212 . In addition, the selection state of the selected decorative gift object in the list of all gifts 211 is updated from "unselected" to "wearing".

In this way, the attached gift list 212 and the unattached gift list 213 are separately displayed on the gift list screen 210. Therefore, even if many decoration objects are provided by the viewing user, the actor or the supporter can To efficiently select a decoration object by grasping the decoration object being selected and the decoration object not yet selected. By selecting as many decoration objects as possible and attaching them to the character object within the limited delivery time, it is possible to increase opportunities for communication with the viewing user. As a result, it is possible to improve the degree of satisfaction of viewing users with respect to the distributed moving image.

FIG. 15 shows a message display screen 220 displayed on the sub-display 43. As shown in FIG. The message display screen 220 may be displayed on the same sub-display 43 as the gift list screen 210, or may be displayed on a different sub-display 43 if there are a plurality of sub-displays 43. FIG. A first message display area 221 , a second message display area 222 , and an entry log 223 are displayed on the message display screen 220 .

In the first message display area 221, the computer processor 21 of the server 20 reads the posted messages 23F corresponding to the content being distributed from the storage 23 and lists them in order of posted date and time. The latest posted message, that is, the latest posted message may be displayed at the top of the list. When a new posted message is posted, the posted message is added to the top of the first message display area 221, and posted messages already displayed in the first message display area 221 are moved downward. Note that the moving direction of the posted message may be the opposite direction. The list may include viewing user identification information (viewing user account name, etc.), posting time, and message content for each posted message. Note that the avatar of the viewing user may be displayed as the identification information of the viewing user.

In the second message display area 222, the computer processor 21 of the server 20 extracts and lists only the posted messages of the viewing users belonging to the first group (VIP group) from the posted messages 23F stored in the storage 23. It is. In the illustrated embodiment, the posted message displayed in the second message display area 222 may also be displayed in the first message display area 221 or may be displayed only in the second message display area 222 . The second message display area 222 may include viewing user identification information (viewing user account name, etc.), posting time, message content, and ranking. Note that the avatar of the viewing user may be displayed as the identification information of the viewing user.

The entry log 223 is a list of viewing users viewing the content being distributed. The computer processor 21 of the server 20 refers to the user management data 23C corresponding to the content being distributed, and extracts the viewing users whose entry state is "entered". The room entry log 223 can include identification information of the viewing user who is viewing the content, room entry time, room entry status, and group. Note that the avatar of the viewing user may be displayed as the identification information of the viewing user.

By referring to the entry log 223, the actor can send a message such as "Hello, Mr. N" to the viewing user who has started viewing through the voice of the moving image. In this way, since the actor can communicate with the viewing user who has started viewing, the viewing user develops attachment to the character and is more satisfied with the content.

Also, by checking the first message display area 221 and the second message display area 222, the actor can respond to the posted message from the viewing user. At this time, by separately displaying the first message display area 221 and the second message display area 222 to which the viewing users of the first group belong, it is possible to easily grasp the tendency of the users who have sent the posted messages. . For example, the actor can prioritize responding to messages posted by viewing users belonging to the first group. As a result, it is possible to particularly increase the degree of satisfaction of the viewing users belonging to the first group to the content. In addition, if priority is given to responding to messages posted by viewing users belonging to the second group, it is possible to particularly increase the degree of satisfaction of the viewing users belonging to the second group to the content.

Next, with reference to FIG. 16, moving image distribution processing in one embodiment will be described. In the moving image distribution process, it is assumed that the actors are performing in the studio room R. First, in step S11, the motion data processing unit 21A of the server 20 converts body motion data, which is a digital expression of body movements of the actor, and face motion data, which is a digital expression of facial movements (expressions) of the actor. generated.

Next, in step S12, a moving image is generated by the moving image generating section 21B. In this step, by applying the actor's body motion data and face motion data to the actor's model data 23A, an animation of the character object that moves in synchronization with the actor's body and facial expression is generated. Furthermore, a moving image is generated using this animation. The voice of the actor is synthesized in this animation.

Next, in step S13, the video generated in step S12 is distributed by the video distribution unit 21C. Content is delivered to the client device 10 via the network 11 . This content may be distributed to the supporter computer 45 and projected onto the main display 41 in the studio room R. A single content is delivered continuously over a predetermined delivery period. The video distribution period can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any time other than these.

Next, proceeding to step S14, it is determined whether or not the end condition for ending the distribution of the moving image is satisfied. The end condition is, for example, that the delivery end time has been reached, that the supporter computer 45 has issued an instruction to end the delivery, or other conditions. If the termination condition is not satisfied, the processes of steps S11 to S13 are repeatedly executed, and the delivery of moving images including animation synchronized with the movements of the actors is continued. When it is determined that the termination condition is satisfied for the moving image, the distribution processing for the moving image is terminated.

Next, referring to FIG. 17, processing for accepting a gift object will be described. When the user request processing unit 21D of the server 20 receives the gift object display request transmitted from the client device 10, the gift object is accepted (step S20). The display request may include identification information of the viewing user, identification information of the gift object, transmission date and time, and the like.

The user request processing unit 21D adds the received gift object information to the candidate list 23E and adds the gift object information to the all gift list 211 on the gift list screen 210 (step S21).

Next, the user request processing section 21D determines whether or not the added gift object is a decoration object (step S22). If the gift object is not a decoration object but an effect object or normal object (step S22: NO), the processing for accepting the gift object ends.

If the gift object is a decoration object (step S22: YES), the gift object is added to the unmounted gift list 213 (step S23).
Next, with reference to FIG. 18, the decoration object selection process will be described. When it is determined that a decoration object has been selected by the operation of the actor or the supporter (step S30: YES), the user request processing unit 21D deletes the selected decoration object from the unmounted gift list 213, and removes the selected decoration object from the attached gift list 212. is displayed (step S31). Also, the selected decoration object is displayed at a predetermined part of the character object associated with the decoration object by the moving image generation unit 21B (step S32).

Further, it is determined whether or not the display period of the decorative object displayed in the moving image has ended (step S33). If the display period of the decoration object has not ended (step S33: NO), the display of the decoration object is continued. On the other hand, when the display time of the decoration object has expired (step S33: YES), the decoration object whose display time has expired is updated in the attached gift list 212 (step S34). Specifically, a decoration object whose display time has expired is erased from the attached gift list 212, or is grayed out, or otherwise displayed in a manner different from other decoration objects whose display time has not expired.

Next, with reference to FIG. 19, display processing of posted messages will be described. When the identification information of the viewing user and the posted message are received, the user request processing unit 21D determines whether or not the posted message is a posted message from a viewing user belonging to the first group (step S40). ). Grouping of viewing users is performed at a predetermined timing by the user information management unit 21E.

When it is determined that the received posted message is a posted message from a viewing user belonging to the first group (step S40: YES), the user request processing unit 21D displays the posted message in the first message display area 221 and the first message display area 221. 2 is displayed in the message display area 222 (step S41). On the other hand, if it is determined that the received posted message is a posted message from a user belonging to the second group (step S40: YES), the posted message is displayed only in the second message display area 222 (step S42).

As described above, according to this embodiment, the following effects are obtained.
(1) In the above embodiment, the video distribution system receives an object display request from a viewing user. Also, a list of objects for which display requests have been accepted is displayed on the sub-display 43 arranged at a position visible from the actor. By checking the list displayed on the sub-display 43, the actor performing the performance can quickly grasp the object requested to be displayed and the viewing user who requested the display of the object. Furthermore, by quickly grasping the object and the viewing user, the actor can send a message to the viewing user who requested the display at a suitable timing. Therefore, opportunities for communication with the viewing user can be increased.

(2) In the above embodiment, an object selected from the gift list screen 210 by a user other than the viewing user, such as an actor, is displayed in the moving image. Since the object for which the display request has been made is displayed on the gift list screen 210, the actor or the like can efficiently select the object. Therefore, the effect of the list can be more exhibited.

(3) In the above embodiment, on the gift list screen 210, the selected objects and the unselected objects are displayed in separate lists. Actor performance can be assisted, such as being able to select

(4) In the above embodiment, only decoration objects are displayed in the attached gift list 212 and the unattached gift list 213 . That is, since only objects that need to be selected by users other than the viewing user are displayed in the first list and the second list, the actor can easily select a desired decoration object.

(5) In the above embodiment, messages posted by viewing users belonging to the first group are displayed in areas different from messages posted by viewing users belonging to other groups. You can prioritize and respond to messages posted by Therefore, it is possible to increase opportunities for communication with specific viewing users.

Each of the above embodiments can be implemented with the following modifications. This embodiment and the following modified examples can be implemented in combination with each other within a technically consistent range.
In the above-described embodiment, the gift list screen 210 is displayed on the sub-display 43 including the attached gift list 212 and the unattached gift list 213 . Alternatively or additionally, at least one of a list of gifts from viewing users belonging to the first group and a list of gifts from viewing users belonging to the second group may be displayed on the sub-display 43 . Further, the list of gifts from viewing users belonging to the first group may be divided into a list of gifts being worn and a list of gifts not being worn. Similarly, the list of gifts from viewing users belonging to the second group may be divided into a list of gifts being worn and a list of gifts not being worn. According to this, the decorative gift object can be displayed separately from the viewpoint of the group to which the viewing user belongs, in addition to the viewpoint of whether the decorative gift object is worn or not. can.

- In the above embodiment, the gift list screen 210 and the message display screen 220 are different screens. Alternatively, a plurality of the attached gift list 212, the unattached gift list 213, the first message display area 221, the second message display area 222, and the entry log 223 may be displayed side by side on one screen. Also, the actor or the supporter can select any one of the list of all gifts 211, the list of wearing gifts 212, the list of unworn gifts 213, the first message display area 221, the second message display area 222, and the entry log 223. It may be configured so that it can be arranged freely within the screen.

- In the above embodiment, the gift list screen 210 and the message display screen 220 may be alternately displayed on one sub-display 43 . Screen switching may be performed when either a gift object display request or a posted message is received. For example, when a gift object display request is received, the gift list screen 210 is displayed for a predetermined period of time, and when a posted message is received, the message display screen 220 is displayed for a predetermined period of time.

- In the above embodiment, the gift list screen 210 and the message display screen 220 are displayed on the sub-display 43 . Alternatively, at least one of the gift list screen 210 and the message display screen 220 may be displayed on the main display 41 .

- In the above embodiment, the decoration object is hidden after a predetermined display time has elapsed after being attached to the character object. Alternatively, the decoration object may be configured to be hidden by an actor's or supporter's operation.

- In the above embodiment, the gift list screen 210 and the message display screen 220 are displayed on the sub-display 43 . Instead of or in addition to this, it may be displayed on a head-mounted display worn by the actor. The head mounted display may be transmissive or non-transmissive. The head-mounted display may display a moving image including character animation, or may display at least one of the gift list screen 210 and the message display screen 220 without displaying the moving image.

- In the above embodiment, viewing users are divided into a plurality of groups according to the number of times content is viewed, the number of times messages are posted to the content, the number of gift objects sent to the content, and the amount charged for the content. . Instead, the viewing users are divided into a group (eg, second group) to which viewing users who behave inappropriately to distributed videos belong, and a group to which other viewing users belong (eg, first group). ) can be separated. Information that identifies the viewing user, such as the viewing user's real name and address, is not disclosed to the distributor or other viewing users, except for necessary information such as the account name, user ID, or avatar. may behave inappropriately in activities such as posting messages to videos or requesting display of gift objects. In order to prevent troubles, the distributor needs to quickly grasp that these viewing users have "entered" (logged in), posted messages, and the like. Conditions for grouping are that an inappropriate message has been sent on the video in the past or that the number of times has reached a threshold. As a method for judging an inappropriate message, for example, when the server 20 analyzes the content of the message and determines that the phrase included in the message corresponds to an inappropriate phrase, the method judges the message as inappropriate. There is In addition, the method by which the distributor or operator visually checks the message posted in the video to determine whether or not the message is inappropriate, There is a method of judging that it is inappropriate by receiving a report. When the distributor or operator determines whether or not the message is inappropriate, the distributor or operator operates the supporter computer 45 or the like to classify the viewing users who sent the message into, for example, a "second group." attributed to Alternatively, the distributor or operator operates the supporter computer 45 or the like to update the number of inappropriate remarks made by the viewing user who sent the message. The server 20 receives such information from the supporter computer 45 or the like and updates the user management data. These groupings may be managed for each content in the same manner as in the above embodiment, or may be managed as common to the entire platform that distributes moving images. Also, in the entry log 223, the identification information of the viewing user and the group to which the viewing user belongs may be displayed. When a viewing user belonging to the second group who needs to be monitored "enters the room", the identification information of the viewing user is displayed in the room entry log 223 (FIG. 15), so the broadcaster can force the viewing user to leave the room. is also possible. Alternatively, the server 20 may automatically forcibly leave the room when the viewing user "enters" the room. Alternatively, even without forcibly leaving the room, the entry of the viewing user is only displayed in the entry log 223, and the broadcaster can pay attention so as not to disturb other viewing users.

- In one embodiment, a large number of infrared LEDs are mounted on each of the actor and the plurality of mounting sensors 33 mounted on the actor, and the light from the infrared LEDs is projected onto the floor and walls of the studio room R. The position and orientation of each of the mounting sensors 33 may be detected by detecting with an infrared camera. The position and orientation of each mounting sensor 33 may be detected by using a visible light LED instead of the infrared LED and detecting light from the visible light LED with a visible light camera. In this way, each of the plurality of attached sensors 33 attached to the actor is provided with a light emitting unit (for example, an infrared LED or a visible light LED), and the light from the light emitting unit is received by a light receiving unit ( For example, the position and orientation of each mounting sensor 33 may be detected by detecting with an infrared camera or a visible light camera. In one embodiment, multiple markers can be used in place of the mounted sensor 33 . A marker is provided for each of the actors. Alternatively, the markers may be provided on the actor's clothing (for example, a top, bottom, or combination suit, etc.). At least one of the position and orientation of the marker can be detected by capturing an image of the actor provided with the marker in this way, generating image data, and performing image processing on the image data. In addition, it is possible to transmit and receive signals to and from the external sensor 32 and the server 20, such as the mounting sensor 33, a sensor capable of detecting at least one of the position and orientation such as an acceleration sensor or a gyro, or a capacitive sensor. sensors are provided on the actor's clothing (eg, upper or lower clothing, or a suit in which these are integrated), and based on the signals emitted from these sensors, at least one of the position, orientation, and movement of the sensors You may make it detect a part. Also, the tracking system 31 may detect the movement of the actor only with the external sensor 32 without using the attached sensor 33 .

The method described in the embodiment can be executed by a computer (computer), for example, magnetic disk (floppy (registered trademark) disk, hard disk, etc.), optical disk (CD-ROM, DVD, MO, etc.), semiconductor It can be stored in a recording medium such as a memory (ROM, RAM, flash memory, etc.), or can be transmitted and distributed via a communication medium. The programs stored on the medium also include a setting program for configuring software means (including not only execution programs but also tables and data structures) to be executed by the computer. A computer that realizes this apparatus reads a program recorded on a recording medium, and in some cases, builds software means by a setting program, and executes the above-described processes by controlling the operation by this software means. The term "recording medium" as used herein is not limited to those for distribution, and includes storage media such as magnetic disks and semiconductor memories provided in computers or devices connected via a network.
Next, technical ideas that can be grasped from the above embodiment and another example will be added below.
[1] A moving picture distribution system for distributing a moving picture containing animation of a character object generated based on the movement of an actor to a client device used by a viewing user,
one or more computer processors;
a storage for storing objects associated with the viewing user;
a display device visible to the actor;
with
The one or more computer processors, by executing computer readable instructions,
receiving a display request for the object from the viewing user;
Displaying on the display device object information in which the information of the object for which the display request has been accepted and the identification information of the viewing user who has made the display request for the object are associated with each other;
video distribution system.
[2] When the object information is selected by a user other than the viewing user who requested to display the object, and the selection of the object is accepted, the object is displayed in the moving image.
The moving image distribution system according to [1].
[3] The object information includes a first list containing object information about selected objects and a second list containing object information about unselected objects.
[2] The moving image distribution system according to [2].
[4] The objects include a decoration object displayed in the moving image when selected by a user other than the viewing user who made the display request, and an object displayed in the moving image when the display request is received. including
Only the information of the decoration object is displayed in the first list and the second list;
[3] The moving image distribution system according to [3].
[5] The computer processor
When the viewing user's behavior toward the video satisfies a predetermined condition, the viewing user is associated with one of a plurality of groups;
[1] The moving image distribution system according to any one of [4].
[6] the viewing user is associated with one of a plurality of groups;
the computer processor
Receiving a posted message sent from the viewing user for the video being distributed,
A message display area for displaying posted messages sent by viewing users who belong to a predetermined group among the plurality of groups, and a message display capable of displaying messages from viewing users who are not included in the predetermined group, on the display device. to display the area and
[1] The moving image distribution system according to any one of [4].
[7] One or more computer processors execute computer-readable instructions to distribute a moving image containing animation of a character object generated based on the movement of an actor to a client device used by a viewing user. A delivery method,
storing an object associated with the viewing user in a storage;
receiving a display request for the object from the viewing user;
displaying, on a display device arranged at a position visible from the actor, object information in which the information of the object that has received the display request is associated with the identification information of the viewing user that has made the display request of the object; When,
A video distribution method having
[8] A video distribution program for distributing a video containing animation of a character object generated based on the movement of an actor to a client device used by a viewing user,
to one or more computer processors;
storing an object associated with the viewing user in a storage;
receiving a display request for the object from the viewing user;
displaying, on a display device arranged at a position visible from the actor, object information in which the information of the object that has received the display request is associated with the identification information of the viewing user that has made the display request of the object; When,
A video distribution program that runs

DESCRIPTION OF SYMBOLS 1... Video distribution system, 10... Client apparatus, 20... Server.

Claims (7)

A moving picture distribution system for distributing a moving picture containing animation of a character object generated based on the movement of an actor to a client device used by a viewing user,
one or more computer processors;
a storage for storing objects associated with the viewing user;
a display device visible to the actor;
with
The one or more computer processors, by executing computer readable instructions,
receiving a display request for the object from the viewing user;
The display device is provided with object information including information on a decoration object, which is an object for which the display request has been received and which is displayed in the moving image in association with a specific part of the character object, and information on an object other than the decoration object. along with displaying
The displayed object information includes a selection state indicating whether or not the decoration object has been selected, and does not include a selection state indicating whether or not the object other than the decoration object has been selected.
video distribution system. The object information includes a first list containing object information about the selected decoration object and a second list containing object information about the unselected decoration object.
The moving picture delivery system according to claim 1 . The objects include the decoration object displayed in the moving image when selected by a user other than the viewing user who made the display request, and an object displayed in the moving image when the display request is accepted. ,
3. The moving picture delivery system according to claim 1 or 2 . the computer processor
When the viewing user's behavior toward the video satisfies a predetermined condition, the viewing user is associated with one of a plurality of groups;
The moving image distribution system according to any one of claims 1 to 3 . The viewing user is associated with one of a plurality of groups,
the computer processor
Receiving a posted message sent from the viewing user for the video being distributed,
A message display area for displaying posted messages sent by viewing users who belong to a predetermined group among the plurality of groups, and a message display capable of displaying messages from viewing users who are not included in the predetermined group, on the display device. to display the area and
The moving image distribution system according to any one of claims 1 to 4 . A video distribution method in which one or more computer processors execute computer-readable instructions to distribute a video containing animation of a character object generated based on the movement of an actor to a client device used by a viewing user. There is
the computer processor
receiving a request from the viewing user to display an object associated with the viewing user;
Information about the decoration object and information about the object other than the decoration object, which is the object for which the display request has been accepted and which is displayed in the moving image in association with a specific part of the character object, on a display device visible from the actor. and displaying object information including
In the step of displaying the object information, a selection state indicating whether or not the decoration object is selected is displayed, and a selection state indicating whether or not the object other than the decoration object is selected is not displayed. . A video distribution program for distributing a video containing animation of a character object generated based on the movement of an actor to a client device used by a viewing user,
to one or more computer processors;
a function of accepting a request from the viewing user to display an object associated with the viewing user;
Information about the decoration object and information about the object other than the decoration object, which is the object for which the display request has been accepted and which is displayed in the moving image in association with a specific part of the character object, on a display device visible from the actor. and a function to display object information including
The moving image distribution program , wherein the function of displaying the object information displays a selection state indicating whether or not the decoration object is selected, and does not display a selection state indicating whether or not the object other than the decoration object is selected. .

Images