JP7629610B2 - Computer program, information processing method, and information processing system - Google Patents

Description

Patent Act Article 30, Paragraph 2 applied March 12th to March 24th, 2019 An "Official Program Debut Event" will be held on the official DL site (https://le.wrightflyer.net/reality/) of the VTuber-exclusive live listening and distribution app "REALITY".

The present invention relates to a computer program, an information processing method, and an information processing system.

There has been known a video distribution system that generates animation of a character object based on the movement of a broadcasting user and live-broadcasts a video including the animation of the character object. Such a video distribution system is disclosed, for example, in Patent Document 1 and Non-Patent Document 1.

Recently, specific file formats have also begun to be provided that allow character objects to be used with common 3D data across different video distribution platforms (Non-Patent Document 2).

JP 2015-184689 A

Yusuke Hasegawa, The Dawn of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 10, 2017, Vol. 231, pp. 74-79 "VRM 3D Humanoid Avatar format for VR", VRM Consortium, [Retrieved May 20, 2019], Internet: https://vrm.dev/

However, even if common 3D data created in the specific file format mentioned above can be used between different video distribution platforms, if the required data content differs, there is a possibility that there will not be enough information to generate a character object.

In that case, the missing parts of the 3D data would have to be re-created, which could discourage streamers from distributing the content on other video streaming platforms.

Therefore, an object of the present disclosure is to provide a technical improvement that solves or alleviates at least some of the problems of the conventional technology described above. One of the more specific objects of the present disclosure is to provide an information processing system, an information processing method, and a computer program that can smoothly link systems that require different data contents in video distribution.

The computer program of the present invention is a computer program for distributing a video including an animation of a character object generated based on the movement of a distributing user, and is characterized in that it causes one or more computer processors to realize an acquisition function for acquiring first avatar information including first body part information related to a first body part of the character, a specification function for identifying second body part information related to a second body part of the character not included in the first avatar information based on the first body part information acquired by the acquisition function, and a generation function for generating second avatar information based on the first body part information acquired by the acquisition function and the second body part information identified by the specification function.

The identification function can extract one or more pieces of second body part information associated with the first body part information, and identify one piece of second body part information based on user selection information for the extracted one or more pieces of second body part information.

The acquisition function acquires first avatar information including first body part information associated with one or more pieces of attachment object information;
The identification function can identify second part information including one or more attachment object information associated with the second part based on the one or more attachment object information.

The first avatar information can be information for generating an avatar with at least a moving face based on facial motion information of an actor acquired by a facial capture function provided in a specific information processing terminal.

The second avatar information can be information for generating an avatar whose entire body moves based on whole-body motion information of an actor acquired by a motion capture function of a specified information processing device.

The computer program of the present invention further causes one or more computers to realize a type acquisition function that acquires the type of avatar information requested when a character appears in a program, and when the type acquired by the type acquisition function is the type of second avatar information, the generation function can generate the second avatar information.

The computer program of the present invention further causes one or more computers to realize a determination function for determining whether or not second avatar information has already been generated, and when the determination function determines that second avatar information has not yet been generated and the type acquired by the type acquisition function is the type of second avatar information, the generation function can generate the second avatar information.

The identification function can identify second part information that pairs with the first part information acquired by the acquisition function.

The information processing method of the present invention is an information processing method for distributing a video including an animation of a character object generated based on the movement of a distributing user, and is characterized in that it causes one or more computer processors to execute an acquisition step of acquiring first avatar information including first body part information related to a first body part of a character, a specification step of identifying second body part information related to a second body part of the character not included in the first avatar information based on the first body part information acquired in the acquisition step, and a generation step of generating second avatar information based on the first body part information acquired in the acquisition step and the second body part information identified in the specification step.

The information processing system of the present invention is an information processing system that distributes videos including animations of character objects generated based on the movements of a broadcasting user, and is equipped with one or more computer processors, and the one or more computer processors are characterized by having an acquisition unit that acquires first avatar information including first body part information related to a first body part of a character, an identification unit that identifies second body part information related to a second body part of the character not included in the first avatar information based on the first body part information acquired by the acquisition unit, and a generation unit that generates second avatar information based on the first body part information acquired by the acquisition unit and the second body part information identified by the identification unit.

The present invention provides a technical improvement that solves or alleviates at least some of the problems of the prior art described above. The present invention enables smooth collaboration between systems that require different data content in video distribution.

1 is a system configuration diagram showing an example of an information processing system according to the present invention. FIG. 1 is a system configuration diagram showing an example of an information processing system with which the information processing system of the present invention can cooperate; FIG. 13 is a conceptual diagram showing an image of a distribution screen for mobile distribution. FIG. 13 is a conceptual diagram showing an image of a distribution screen for studio distribution. FIG. 2 is a block diagram showing a functional configuration of an information processing device according to an embodiment of the present invention. 13 is a conceptual diagram showing an image of an attachment object associated with the upper body of a character. FIG. 13 is a conceptual diagram showing an image of an attachment object associated with the lower body of a character. FIG. 13 shows an example of a data table of attachment objects and coordinate points. 13 shows a data table of priority of attached objects. FIG. 13 is a configuration diagram showing a functional configuration of an information processing device according to another embodiment of the present invention. FIG. 2 is a configuration diagram showing an example of a hardware configuration of an information processing device according to an embodiment of the present invention. FIG. 2 is a flow diagram showing an example of the flow of an information processing method according to an embodiment of the present invention. FIG. 2 is a circuit configuration diagram showing an example of a circuit for realizing the functional configuration of a computer program according to an embodiment of the present invention.

First, we will explain the overview of the information processing system of the present invention with reference to the drawings.

The information processing system according to an embodiment of the present invention is an information processing system that distributes videos including animations of character objects generated based on the movements of a broadcasting user, and includes one or more computer processors.

<System Configuration>
As shown as an example in Figure 1, the information processing system 100 may include one or more viewing user terminals 200, and an information processing device (support computer) 400 located in a video distribution studio, etc., which is connected to these viewing user terminals 200 via a network 300.

In addition, the information processing device 400 may be connected to a server device 500 (not shown) via the Internet, and some of the processing to be performed by the information processing device 400 (described later) may be performed by the server device 500.

In this specification, distribution by such information processing system 100 is referred to as studio distribution.

In studio streaming, the entire body movements of the streaming user (actor) are captured by a camera installed in the studio using markers attached to the streaming user, and are reflected in the character in real time using known motion capture technology.

The information processing system 100 of the present invention can also be linked to another information processing system 10 shown as an example in FIG. 2. The information processing system 10 shown in FIG. 2 can include a broadcast user terminal 20, one or more viewing user terminals 30, and an information processing device (server device) 50 connected to the broadcast user terminals 20 and the viewing user terminals 30 via a network 40.

In the above example, the broadcast user terminal 20 can be an information processing terminal such as a smartphone. In this specification, broadcasting by such an information processing system 10 is referred to as mobile broadcasting.

In mobile distribution, the facial movements of the broadcasting user are captured by a camera on the broadcasting user's information processing terminal, and are reflected on the character's face in real time using known face tracking technology.

The videos generated by the information processing system 100 and the information processing system 10 can be distributed to viewing users from a single video distribution platform, as an example.

As an example, it is assumed here that a general broadcasting user is only permitted to perform mobile broadcasting via the information processing system 10 on the video broadcasting platform. As shown in FIG. 3, in mobile broadcasting, only the upper body of the broadcasting user's character is displayed, and the lower body is not displayed. Therefore, the only 3D data required for the character is the data for the upper body.

Note that the upper body here does not include at least the legs, but may include the waist and buttocks, as shown in Figure 3.

On the other hand, an official distribution user is someone who is permitted to perform studio distribution using the information processing system 100 on the video distribution platform. Here, the official distribution user refers to a character actor who appears in an official program defined by the operator of the video distribution platform.

As shown in Figure 4, in studio broadcasts, the broadcast user's character is displayed entirely. Therefore, the 3D data required for the character is data for the entire body.

In this embodiment, mobile distribution and studio distribution are realized on a common video distribution platform, and the link between these distributions is described, but the present invention can also be applied to link between distributions on separate video distribution platforms. In such a case, there is no limitation on the video distribution format (e.g., mobile distribution or studio distribution).

Here, on the video distribution platform, general distribution users may carry out studio distribution.

As an example, the operator of a video distribution platform can hold an "official program debut event" for general distribution users. The details of the event will not be explained here, but for example, the event can be one in which gifts received from viewing users are converted into an event score and participants compete for ranking. The characters of the top three general distribution users who win this "official program debut event" will earn the right to appear on the official program (i.e., the right to broadcast in the studio). Note that the number of distribution users who can earn this right is not limited to three.

In the present embodiment, the information processing system 100 stores the event results of broadcast users as data, and flags the top performers. It then generates full-body 3D data (second avatar information, described later) of the characters of the flagged top performers, which is required when they appear on official programs.

Ordinary broadcasting users do not usually have 3D data of the entire body of a character prepared for studio broadcasting. General broadcasting users generate 3D data of the upper body of their own original characters by freely combining pre-prepared character parts (body type, skin color, hairstyle, etc.) and wearable items (clothes, accessories, etc.), and use this for mobile broadcasting. This is because preparing 3D data of the entire body of such a wide variety of original characters in advance would require a huge amount of work and is not realistic.

Therefore, the one or more computer processors of the present invention include an acquisition unit 410, an identification unit 420, and a generation unit 430, as shown in FIG. 5.

The acquisition unit 410 acquires the first avatar information.

The first avatar information includes first body part information related to a first body part of the character, and is, for example, 3D data of the content required for mobile distribution.

A character is made up of multiple parts. A character may be made up of two parts, an upper body and a lower body, or may be made up of smaller parts such as a head, neck, chest, shoulders, arms, torso, and legs.

The first body part is at least one of the above body parts. The first body part information includes gender information, color information, and/or size information of the first body part. The first body part information may include information of a wearable object associated with the first body part. The wearable object associated with the first body part may be an item such as clothing, an accessory, and/or a small item.

The identification unit 420 identifies the second body part information based on the first body part information acquired by the acquisition unit 410. As an example, the identification unit 420 identifies the second body part information including the same gender information, color information and/or size information based on the gender information, color information and/or size information included in the first body part information. Variations in the method of identifying the second body part information will be described later.

The second body part information relates to a second body part of the character that is not included in the first avatar information. The second body part information also includes gender information, color information, and/or size information, etc., of the second body part. As will be described in detail later, the second body part information may also include information on a wearable object associated with the second body part. The wearable object associated with the second body part may be an item such as clothing, an accessory, and/or a small item.

As an example, if the first part is the upper body, the second part is the lower body.

Then, the generating unit 430 generates second avatar information based on the first body part information acquired by the acquiring unit 410 and the second body part information identified by the identifying unit 420.

As an example, the second avatar information is 3D data of the entire body of the character that is generated based on first body part information, which is information about the upper body, and second body part information, which is information about the lower body. And, as an example, this 3D data of the entire body is 3D data of the content required for studio distribution.

With the above configuration, second avatar information can be automatically generated from first avatar information. This allows smooth cooperation between systems that require different data content in video distribution.

For example, in an event like the one described above, 3D data of the entire body of a character for studio distribution can be easily generated from 3D data of the upper body of a character for mobile distribution for general distribution users, thereby reducing the workload of distribution users and/or administrators.

As described above, the first avatar information can be information for generating an avatar with at least a moving face based on facial motion information of an actor acquired by a facial capture function provided in a specific information processing terminal.

Similarly, the second avatar information can be information for generating an avatar whose entire body moves based on whole-body motion information of an actor acquired by a motion capture function of a specified information processing device.

In addition, the acquisition unit 410 acquires first avatar information that includes first body part information associated with one or more pieces of attachment object information.

As shown in FIG. 6, the character displayed by the first avatar information is usually not displayed naked but wearing clothes. The first avatar information includes attachment object information associated with the first body part information, and therefore includes at least top information when the first body part is the upper body.

The first avatar information may also include, as wearable object information, a top such as a T-shirt or jacket, a headband worn on the head, a hat, glasses, earrings, or a bracelet or watch worn on the arm, a ring worn on the finger, etc.

Then, the identification unit 420 can identify second part information including one or more pieces of attachment object information associated with the second part based on the one or more pieces of attachment object information.

As shown in Figure 7, the character displayed based on the second avatar information is usually not displayed naked but wearing clothes. Therefore, it is important to coordinate the attachment objects for the upper and lower body.

As an example, coordination information that associates a certain top with a matching bottom can be stored, and this information can be used to determine one or more pieces of wearable object information associated with a second body part based on one or more pieces of wearable object information associated with a first body part.

In other words, the coordination information manages an attachment object by associating it with other attachment objects that can be coordinated with the attachment object. This association may be a one-to-one relationship, or a one-to-many or many-to-many relationship.

When the correspondence is one-to-one, the identification unit 420 can identify the second part information that pairs with the first part information acquired by the acquisition unit 410.

This is an effective method for identifying clothing such as one-piece dresses, yukatas, swimsuits, overalls, and uniforms and suits that consist of a top and bottom set.

In addition, when the correspondence is one-to-many or many-to-many, the identification unit 420 can identify the second part information associated with the first part information acquired by the acquisition unit 410.

For example, top A is associated with bottoms a, b, c, and d. At this time, coordination points with top A may be defined for these multiple bottoms. FIG. 8 shows a data table of attachment objects and coordination points stored in the storage unit of the information processing system 100 of the present invention or in an external storage device.

In this way, when multiple attachment objects are associated with one attachment object, the priority may be determined by the coordinate points, the top-level attachment object may be determined, and the second body part information associated with this attachment object may be specified. When there are multiple top-level attachment objects, one attachment object may be determined randomly.

In addition, when the correspondence is one-to-many or many-to-many, the identification unit 420 can extract one or more pieces of second body part information associated with the first body part information, and identify one piece of second body part information based on the user's selection information for the extracted one or more pieces of second body part information.

For example, in the example of FIG. 8, all of the second body part information associated with each of the multiple bottoms may be displayed on the display screen of the information processing terminal, and the user may select one of the second body part information from the displayed information.

The "user" here can refer to the actor, the broadcasting user, or the operator.

This allows users to choose the lower half of their body wearing their preferred bottoms from among the multiple bottoms presented, allowing for greater freedom in coordinating their character's outfits.

In addition, when multiple attachment objects are associated with the first body part information, the second body part information can be identified based on the predetermined priority of the attachment objects. Figure 9 shows a data table of attachment object priority stored in the storage unit of the information processing system 100 of the present invention or in an external storage device.

In the example of FIG. 9, the second body part information associated with the bottoms that correspond to the tops with the highest priority among the multiple wearing objects is identified. This priority can be determined based on the degree of impression that the wearing object gives to the character's coordination.

The information processing system 100 of the present invention may further include a type acquisition unit 440, as shown in FIG. 10.

The type acquisition unit 440 acquires the type of avatar information that is requested when a character appears in a program.

The type of avatar information may be, for example, the type of data format of the avatar information. The data format may be a file format called VRM, which is a file format for handling humanoid 3D avatar (3D model) data for VR applications.

Then, when the type acquired by the type acquisition unit 440 is the type of second avatar information, the generation unit 430 can generate the second avatar information.

In the above, it has been explained that the type of data format of the first avatar information is the same. In other words, the second avatar information is generated simply by generating information that is missing from the first avatar information. Therefore, the type acquisition unit 440 can confirm that the type of requested avatar information is the type (data format) of the second avatar information that can be generated by the present invention, and generate the second avatar information.

The information processing system 100 of the present invention may further include a determination unit 450.

The determination unit 450 determines whether the second avatar information has already been generated.

Then, if the determination unit 450 determines that the second avatar information has not yet been generated and the type acquired by the type acquisition unit 440 is the type of the second avatar information, the generation unit 430 can generate the second avatar information.

According to the embodiment described above, by using VRM as an example, a full-body avatar for studio distribution can be automatically generated based on an avatar (upper body only) used for mobile distribution, allowing for smooth studio distribution (e.g., official programs) without any effort on the part of the user.

For example, it would be possible to automatically determine avatar information for other body parts from avatar data for the upper body, or to present the player with candidates for avatar information for other body parts that match the avatar data for the upper body. This is expected to be useful for VTuber applications that support both studio and mobile distribution.

<Hardware Configuration>
11, a hardware configuration of the information processing device 400 included in the information processing system 100 will be described. The information processing device 400 includes a processor 401, a memory 402, a storage 403, an input/output interface (input/output I/F) 404, and a communication interface (communication I/F) 405. The components are connected to each other via a bus B.

The information processing device 400 can realize the functions and methods described in this embodiment through cooperation between the processor 401, memory 402, storage 403, input/output I/F 404, and communication I/F 405.

The processor 401 executes functions and/or methods realized by codes or instructions included in a program stored in the storage 403. The processor 401 includes, for example, a central processing unit (CPU), a micro processing unit (MPU), a graphics processing unit (GPU), a microprocessor, a processor core, a multiprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc., and may realize each process disclosed in each embodiment by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (an integrated circuit (IC) chip, a large scale integration (LSI)), etc.). In addition, these circuits may be realized by one or more integrated circuits, and multiple processes shown in each embodiment may be realized by one integrated circuit. In addition, an LSI may be called a VLSI, a super LSI, an ultra LSI, etc. depending on the degree of integration.

The memory 402 temporarily stores the programs loaded from the storage 403 and provides a working area for the processor 401. The memory 402 also temporarily stores various data generated while the processor 401 is executing the programs. The memory 402 includes, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), etc.

Storage 403 stores programs. Storage 403 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), flash memory, etc.

The communication I/F 405 is implemented as hardware such as a network adapter, communication software, or a combination of these, and transmits and receives various data via the network 600. The communication may be performed either wired or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication I/F 405 communicates with other information processing devices via the network 600. The communication I/F 405 transmits various data to other information processing devices according to instructions from the processor 401. The communication I/F 405 also receives various data transmitted from other information processing devices and transmits it to the processor 401.

The input/output I/F 404 includes an input device that inputs various operations to the information processing device 400, and an output device that outputs the results of processing by the information processing device 400. The input/output I/F 404 may be an integrated input device and output device, or may be separate input device and output device.

The input device is realized by any of all types of devices, or a combination of devices, that can receive input from a user and transmit information related to the input to the processor 401. Examples of input devices include hardware keys such as a touch panel, a touch display, and a keyboard, pointing devices such as a mouse, a camera (operation input via images), and a microphone (operation input via voice).

The output device outputs the processing results processed by the processor 401. The output device includes, for example, a touch panel, a speaker, etc. The viewing user terminal 200 can also be configured with the same hardware configuration as that shown in FIG. 11, except where otherwise noted.

Next, an example of an information processing method according to an embodiment of the present invention will be described.

As shown in FIG. 12, the information processing method of the present invention is an information processing method in an information processing system that distributes videos including animations of character objects generated based on the movements of a broadcasting user, and causes one or more computer processors to execute an acquisition step S110, a determination step S120, and a generation step S130.

The acquisition step S110 acquires first avatar information including first body part information related to a first body part of the character. The acquisition step S110 can be executed by the acquisition unit 410 described above.

The identification step S120 identifies second body part information related to a second body part of the character that is not included in the first avatar information, based on the first body part information acquired in the acquisition step. The identification step S120 can be executed by the identification unit 420 described above.

The generating step S130 generates second avatar information based on the first body part information acquired in the acquiring step and the second body part information identified in the identifying step. The generating step S130 can be executed by the generating unit 430 described above.

With the above configuration, second avatar information can be automatically generated from first avatar information. This allows smooth cooperation between systems that require different data content in video distribution.

Finally, we will explain the computer program of the present invention.

The computer program of the present invention is a computer program for distributing videos including animations of character objects generated based on the movements of a distributing user, and causes one or more computer processors to realize an acquisition function, a specification function, and a generation function.

The acquisition function acquires first avatar information including first body part information related to a first body part of the character.

The identifying function identifies second body part information related to a second body part of the character that is not included in the first avatar information based on the first body part information acquired by the acquiring function.

The generating function generates second avatar information based on the first body part information acquired by the acquiring function and the second body part information identified by the identifying function.

The above-mentioned acquisition function, identification function, and generation function can be realized by the acquisition circuit 1410, identification circuit 1420, and generation circuit 1430 shown in FIG. 13. The acquisition circuit 1410, identification circuit 1420, and generation circuit 1430 are realized by the acquisition unit 410, identification unit 420, and generation unit 430 described above, respectively. Details of each unit are as described above.

With the above configuration, second avatar information can be automatically generated from first avatar information. This allows smooth cooperation between systems that require different data content in video distribution.

In addition, an information processing device such as a computer or a mobile phone can be suitably used to function as the server device or terminal device according to the above-mentioned embodiment. Such an information processing device can be realized by storing a program describing the processing contents for realizing each function of the server device or terminal device according to the embodiment in the storage unit of the information processing device, and reading and executing the program by the CPU of the information processing device.

Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are included in the scope of the invention and its equivalents described in the claims.

In addition, the method described in the embodiment can be stored as a program that can be executed by a calculator (computer) on a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, etc.), a semiconductor memory (ROM, RAM, flash memory, etc.), etc., and can also be distributed by transmitting it via a communication medium. The program stored on the medium side also includes a setting program that configures software means (including not only execution programs but also tables and data structures) that are executed by a computer. The computer that realizes this device reads the program recorded on the recording medium, and in some cases, constructs software means using a setting program, and executes the above-mentioned processing by controlling the operation of this software means. Note that the recording medium referred to in this specification is not limited to a storage medium for distribution, but also includes storage media such as a magnetic disk or semiconductor memory provided inside the computer or in a device connected via a network. The storage unit may function as, for example, a main storage device, an auxiliary storage device, or a cache memory.
[Additional Notes]
The claims as originally filed of the original application of this application are set forth below.
[1] A computer program for distributing a video including an animation of a character object generated based on a distributor user's movement, the computer program comprising:
an acquisition function for acquiring first avatar information including first body part information related to a first body part of a character;
a specifying function for specifying second body part information related to a second body part of the character that is not included in the first avatar information, based on the first body part information acquired by the acquiring function;
a generating function of generating second avatar information based on the first body part information acquired by the acquiring function and the second body part information identified by the identifying function.
[2] The computer program described in [1] above, characterized in that the identification function extracts one or more second part information corresponding to the first part information, and identifies one piece of second part information based on user selection information for the extracted one or more pieces of second part information.
[3] The acquiring function acquires first avatar information including first body part information associated with one or more pieces of attachment object information;
The computer program described in [1] or [2] above, wherein the identification function identifies the second part information including one or more attachment object information associated with the second part based on the one or more attachment object information.
[4] The computer program according to any one of [1] to [3] above, characterized in that the first avatar information is information for generating an avatar whose face moves at least based on facial motion information of an actor acquired by a facial capture function of a specific information processing terminal.
[5] The computer program according to any one of [1] to [4] above, wherein the second avatar information is information for generating an avatar whose entire body moves, based on motion information of an actor's entire body acquired by a motion capture function of a predetermined information processing device.
[6] The one or more computers further include:
A type acquisition function is realized to acquire the type of avatar information required when the character appears in a program;
The computer program according to any one of claims 1 to 5, wherein, when the type acquired by the type acquisition function is the type of the second avatar information, the generation function generates the second avatar information.
[7] The one or more computers further include:
A judgment function is realized to judge whether the second avatar information has already been generated;
The computer program according to the above-mentioned [6], wherein when the second avatar information has not been generated yet as a result of the determination by the determining function and the type acquired by the type acquiring function is the type of second avatar information, the generating function generates the second avatar information.
[8] A computer program described in any one of [1] to [7] above, characterized in that the identification function identifies the second part information that pairs with the first part information acquired by the acquisition function.
[9] An information processing method for distributing a video including an animation of a character object generated based on a distributor user's movement, comprising:
an acquiring step of acquiring first avatar information including first body part information related to a first body part of a character;
a specifying step of specifying second body part information related to a second body part of the character that is not included in the first avatar information based on the first body part information acquired in the acquiring step;
and a generating step of generating second avatar information based on the first body part information acquired in the acquiring step and the second body part information identified in the identifying step.
[10] An information processing system for distributing a video including an animation of a character object generated based on a distributor user's movement, comprising one or more computer processors,
the one or more computer processors:
an acquisition unit that acquires first avatar information including first body part information related to a first body part of a character;
an identification unit that identifies second body part information related to a second body part of the character that is not included in the first avatar information, based on the first body part information acquired by the acquisition unit;
a generation unit that generates second avatar information based on the first body part information acquired by the acquisition unit and the second body part information identified by the identification unit.
The following are the claims as originally filed in the parent application:
[1] A computer program for distributing video including animation of a character object, comprising:
an acquisition function for acquiring first avatar information, which is character data required in a first distribution format;
a specifying function for specifying required information required to generate second avatar information required in a second delivery format based on the first avatar information acquired by the acquiring function;
a generating function of generating the second avatar information based on the first avatar information acquired by the acquiring function and the request information specified by the specifying function.
[2] the first delivery format is a mobile delivery format;
The computer program product according to claim 1, wherein the second distribution format is a studio distribution format.
[3] The first distribution format is a distribution format in a first video distribution platform,
The computer program according to [1] or [2], wherein the second distribution format is a distribution format in a second video distribution platform that is different from the first video distribution platform and that can be linked to the first video distribution platform.
[4] The computer program according to [1], [2] or [3], wherein the request information is additional information required to generate the second avatar information from the first avatar information, and the second avatar information has a larger amount of information than the first avatar information.
[5]
The acquiring function acquires first avatar information including one or more pieces of attachment object information;
The computer program according to any one of [1] to [4], characterized in that the identification function identifies the request information including one or more pieces of mounting object information based on the one or more pieces of mounting object information.
[6] The one or more computer processors further comprising:
a type acquisition function for acquiring a type of avatar information required for generating the character object;
a confirmation function for confirming whether avatar information of the type acquired by the type acquisition function has already been generated;
Realize this,
the identifying function, when it is determined by the checking function that the avatar information has not yet been generated, identifying the request information based on the first avatar information acquired by the acquiring function;
The generating function generates the second avatar information of the same type as the type acquired by the type acquiring function, based on the first avatar information acquired by the acquiring function and the request information specified by the identifying function.
[7] The computer program described in any one of [1] to [6], characterized in that the first avatar information is information for generating an avatar whose face moves at least based on motion information of an actor's face acquired by a facial capture function provided in a specified information processing terminal.
[8] The computer program described in any one of [1] to [7], characterized in that the second avatar information is information for generating an avatar whose entire body moves based on whole-body motion information of an actor acquired by a motion capture function of a specified information processing device.
[9] An information processing method for distributing moving images including animations of character objects, comprising:
an acquisition step of acquiring first avatar information which is character data required in a first distribution format;
a specifying step of specifying required information required to generate second avatar information required in a second delivery format based on the first avatar information acquired in the acquiring step;
a generating step of generating the second avatar information based on the first avatar information acquired in the acquiring step and the request information specified by the specifying function.
[10] An information processing system for distributing moving images including animations of character objects, comprising one or more computer processors,
the one or more computer processors:
an acquisition unit that acquires first avatar information, which is character data required in a first distribution format;
a specification unit that specifies required information required to generate second avatar information required in a second delivery format based on the first avatar information acquired by the acquisition unit;
a generating unit configured to generate the second avatar information based on the first avatar information acquired by the acquiring unit and the request information identified by the identifying unit.

REFERENCE SIGNS LIST 100 Information processing system 200 Viewing user terminal 300 Network 400 Information processing device 410 Acquisition unit 420 Identification unit 430 Generation unit 440 Type acquisition unit 450 Determination unit

Claims (10)

one or more computer processors,
an acquisition function for acquiring first information, which is data necessary for displaying a first character object having a first portion ;
a specifying function for specifying required information required to generate second information, which is data required to display a second character object having the first portion and a second portion , based on the first information acquired by the acquiring function;
a generating function that generates the second information based on the first information acquired by the acquiring function and the request information specified by the specifying function;
the first information includes first body part information related to a first body part of the first character object, the first body part information further including first attachment object information of an attachment object associated with the first body part;
The request information includes second part information including second attachment object information of an attachment object associated with the second part, the second attachment object information being specified based on the first attachment object information included in the first part information;
the first character object is displayed in a state in which one or more attachment objects based on the first attachment object information are attached to the first body part;
The second character object is
Attaching one or more attachment objects based on the first attachment object information to the first part; and
A computer program that displays the second portion in a manner such that one or more attachment objects based on the second attachment object information are attached to the second portion . The one or more computer processors further include:
a type acquisition function for acquiring a type of information required for generating the second character object;
a confirmation function for confirming whether the type information acquired by the type acquisition function has already been generated;
Realize this,
The computer program of claim 1, wherein the generation function generates, when the confirmation function determines that information of the type acquired by the type acquisition function has not yet been generated, the second information of the same type as the type acquired by the type acquisition function based on the first information acquired by the acquisition function. The computer program product according to claim 1, characterized in that the first information is information for generating the first character object having at least a moving facial portion based on facial motion information of an actor acquired by a facial capture function provided in a specified information processing terminal . The computer program according to claim 1, characterized in that the second information is information for generating the second character object whose entire body moves based on whole-body motion information of an actor obtained by a motion capture function provided in a specified information processing device. The computer program according to claim 1, characterized in that the identifying function identifies one piece of required information determined from one or more pieces of required information that is required to generate second information based on the first information acquired by the acquiring function. 6. The computer program product according to claim 5 , wherein the one piece of requested information is determined by a user's selection. 6. The computer program product according to claim 5 , wherein the one piece of requested information is automatically determined based on a priority. The computer program according to claim 1, characterized in that the computer program is a computer program for distributing video including animation of a character object. one or more computer processors,
an acquisition step of acquiring first information which is data necessary for displaying a first character object having a first portion ;
a specifying step of specifying required information necessary for generating second information, which is data necessary for displaying a second character object having the first portion and a second portion , based on the first information acquired in the acquiring step;
a generating step of generating the second information based on the first information acquired in the acquiring step and the request information identified in the identifying step;
the first information includes first body part information related to a first body part of the first character object, the first body part information further including first attachment object information of an attachment object associated with the first body part;
The request information includes second part information including second attachment object information of an attachment object associated with the second part, the second attachment object information being specified based on the first attachment object information included in the first part information;
the first character object is displayed in a state in which one or more attachment objects based on the first attachment object information are attached to the first body part;
The second character object is
Attaching one or more attachment objects based on the first attachment object information to the first part; and
The information processing method includes displaying the second part in a state in which one or more attachment objects based on the second attachment object information are attached to the second part . an acquisition unit that acquires first information, which is data necessary to display a first character object having a first portion ;
an identification unit that identifies required information required to generate second information, which is data required to display a second character object having the first portion and a second portion, based on the first information acquired by the acquisition unit;
a generating unit that generates the second information based on the first information acquired by the acquiring unit and the request information identified by the identifying unit,
the first information includes first body part information related to a first body part of the first character object, the first body part information further including first attachment object information of an attachment object associated with the first body part;
The request information includes second part information including second attachment object information of an attachment object associated with the second part, the second attachment object information being specified based on the first attachment object information included in the first part information;
the first character object is displayed in a state in which one or more attachment objects based on the first attachment object information are attached to the first body part;
The second character object is
Attaching one or more attachment objects based on the first attachment object information to the first part; and
An information processing system in which the second part is displayed in a state in which one or more attachment objects based on the second attachment object information are attached to the second part .

Images