JP7589920B2 - Computer program, method, and server - Google Patents

Description

The present disclosure relates to a computer program, a method, and a server.

It has been proposed to display the spatial layout of multiple zones in a single virtual area within a network communication environment (see Patent Document 1).

Special Publication No. 2012-515398

Patent document 1 merely describes that a user interacts with other communicators within the virtual area. The above-mentioned patent document 1 is incorporated herein in its entirety by reference.

This disclosure provides a computer program, method, and server that are more interesting than ever before.

A computer program according to one embodiment is a computer program executed by at least one processor, which causes the at least one processor to function as follows: acquire first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal; determine whether a first condition related to the data included in the first data is satisfied; and, if the first condition is satisfied, determine control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among the at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar; and control the display unit based on the control data.

A computer program according to one embodiment is a computer program executed by at least one processor, which causes the at least one processor to function as follows: receive first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal via a communication line; determine whether a first condition related to the data included in the first data is satisfied; and, if the first condition is satisfied, determine control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among the at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar; and transmit the control data to the first terminal.

A method according to one embodiment is a method executed by at least one processor, and includes the steps of: acquiring first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal; determining whether a first condition related to the data included in the first data is satisfied; determining, if the first condition is satisfied, control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among the at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar; and controlling the display unit based on the control data.

A method according to one embodiment is a method executed by at least one processor, and includes the steps of receiving first data including motion data of a first avatar in a virtual space operated using a first terminal of a first user via a communication line, determining whether a first condition related to the data included in the first data is satisfied, and if the first condition is satisfied, determining control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar, and transmitting the control data to the first terminal.

A server according to one embodiment includes at least one processor, receives first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal via a communication line, determines whether a first condition related to the data included in the first data is satisfied, and if the first condition is satisfied, determines control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar, and transmits the control data to the first terminal.

This Summary section is provided to introduce in a simplified form selected concepts that are described below in the Detailed Description section. All trademarks used herein are the property of their respective owners. The statements in this Summary section are not intended to identify key features or essential features of the claimed inventions, nor are they intended to limit the scope of the claimed inventions. The above and other objects, features, and advantages of the claimed inventions will become more apparent from the following Detailed Description section taken in conjunction with the accompanying drawings.

FIG. 1 is a block diagram showing an example of the configuration of a system 1000 according to an embodiment. FIG. 2 is a block diagram showing an example of the configuration of the terminal 10 and the server 20 shown in FIG. FIG. 3 is a block diagram showing an example of the functions of the terminal 10 shown in FIG. FIG. 4 is a block diagram showing an example of the functions of the server 20 shown in FIG. FIG. 5 is a diagram showing an example of a display screen displayed by the display unit 140 of the terminal 10. As shown in FIG. FIG. 6 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in FIG. FIG. 7 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in FIG. FIG. 8 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in FIG. FIG. 9 is an example of a flowchart showing the process carried out in this embodiment. FIG. 10 is an example of a flowchart showing the process carried out in this embodiment. FIG. 11 is a block diagram showing an example of the functions of the terminal 10 and the configuration connected to the terminal 10 shown in FIG. FIG. 12 is a block diagram illustrating a computing environment 1400 .

This specification is described in terms of representative embodiments that are not intended to be limiting in any manner. As used in this application, the singular forms "a," "the," "said," "above," "the," "the," "this," and "it" can include the plural, unless the plural is clearly not indicated. Also, the term "comprises" can mean "comprises" or "has." Furthermore, the terms "coupled," "coupled," "connected," "connected," and "connected" encompass mechanical, electrical, magnetic, and optical methods of coupling, connecting, or joining objects together, as well as other methods, and do not exclude the presence of intermediate elements between objects so coupled, coupled, connected, connected, or joined.

The various systems, methods, and devices described herein should not be construed as being limited in any manner. Indeed, the present disclosure is directed to all novel features and aspects of each of the various disclosed embodiments, combinations of these various embodiments with each other, and combinations of portions of these various embodiments with each other. The various systems, methods, and devices described herein are not limited to specific aspects, specific features, or combinations of such specific aspects with specific features, nor do the products and methods described herein require that one or more specific advantages be present or problems be solved. Moreover, various features or aspects of the various embodiments described herein, or portions of such features or aspects, may be used in combination with each other.

Although the operations of some of the various methods disclosed herein have been described in a particular order for convenience, it should be understood that description in this manner encompasses rearranging the order of the operations, unless a particular order is required by specific text below. For example, operations described in a sequence may in some cases be rearranged or performed simultaneously. Furthermore, for purposes of simplicity, the accompanying drawings do not show various ways in which the various items and methods described herein may be used with other items and methods. In addition, this specification may use terms such as "generate," "generate," "display," "receive," "evaluate," and "deliver." These terms are high-level descriptions of various actual operations that may be performed. The actual operations that correspond to these terms may vary depending on the particular implementation and may be readily recognized by one of ordinary skill in the art having the benefit of the disclosure herein.

Any theory of operation, scientific principles, or other theoretical descriptions presented herein relating to the devices or methods of the present disclosure are provided for purposes of better understanding and are not intended to limit the scope of the technology. The devices and methods of the appended claims are not limited to devices and methods that operate in a manner described by such theories of operation.

Any of the various methods disclosed herein may be implemented and executed in a computer using computer-executable instructions stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media, such as one or more optical media disks, volatile memory components, or non-volatile memory components), where the volatile memory components include, for example, DRAM or SRAM, and the non-volatile memory components include, for example, hard drives and solid-state drives (SSDs). Additionally, the computer may include any computer available on the market, including, for example, smart phones and other mobile devices having hardware to perform computations.
Any such computer-executable instructions for implementing the techniques disclosed herein, along with any data generated and used during the implementation of the various embodiments disclosed herein, may be stored on one or more computer-readable media (e.g., non-transitory computer-readable storage media). Such computer-executable instructions may, for example, be part of a separate software application, or may be part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may, for example, be executed on a single local computer (e.g., as an agent executing on any suitable computer available on the market) or in a network environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more networked computers.

For clarity, only certain selected aspects of various software-based implementations are described. Other details that are well known in the art are omitted. For example, the techniques disclosed herein are not limited to a particular computer language or program. For example, the techniques disclosed herein may be implemented by software written in C, C++, Java, or any other suitable programming language. Similarly, the techniques disclosed herein are not limited to a particular computer or type of hardware. Specific details of suitable computers and hardware are well known and need not be described in detail herein.

Moreover, any of the various software-based embodiments (e.g., including computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) may be uploaded, downloaded, or accessed in a remote manner by any suitable communication means, including, for example, the Internet, the World Wide Web, an intranet, a software application, cable (including fiber optic cable), magnetic communication, electromagnetic communication (including RF communication, microwave communication, infrared communication), electronic communication, or other such communication means.

Various embodiments of the present invention will now be described with reference to the accompanying drawings. Note that common components in the drawings are given the same reference numerals. It should also be noted that components depicted in one drawing may be omitted in another drawing for ease of explanation. Furthermore, it should also be noted that the accompanying drawings are not necessarily drawn to scale.

1. Configuration of the system 1000 Fig. 1 is a block diagram showing an example of the configuration of a system 1000 according to an embodiment. As shown in Fig. 1, the system 1000 includes, for example, a plurality of terminals 10 connected to a communication line (communication network) not shown, and one or a plurality of servers 20 connected to the communication line. The terminals 10 include a first terminal 11 and a second terminal 12. The server 20 includes, for example, a first server system 21 and a second server system 22.

The communication links may include, but are not limited to, a cellular network, a wireless network (e.g., Bluetooth, WiFi (such as IEEE 802.11a/b/n), WiMax, cellular, satellite, laser, infrared, RF connection), a landline network, the Internet, an intranet, a local area network (LAN), a wide area network (WAN), and/or an Ethernet network.

1-1. Terminal 10
The terminal 10 is connected to one or more servers 20 via, for example, a communication line. The terminal 10 is, for example, a smartphone, a tablet device, and/or a personal computer. The terminal 10 is configured to be able to install a specific application and execute the specific application. The terminal 10 can also receive a web page (for example, an HTML document, in some examples, an HTML document that encodes executable code such as JavaScript or PHP code) from the server 20 (second server system 22).

Hereinafter, a user who operates a terminal 10 may be simply referred to as a user, a user who operates a first terminal 11 as a first user, and a user who operates a second terminal 12 as a second user. In addition, FIG. 1 shows an example in which a first terminal 11 and a second terminal 12 are provided as multiple terminals 10, but this is not limited to this. The multiple terminals 10 may include, for example, three or more terminals. In addition, in the following description, the first terminal 11 and the second terminal 12 may be collectively referred to as terminals 10.

1-2. Server 20
The first server system 21 includes a distribution server 21A1 and a server storage device 21A2. The distribution server 21A1 receives, for example, data requested for an application executed on the terminal 10 from the terminal 10. In addition, the distribution server 21A1 transmits, for example, data used in the application executed on the terminal 10 to the terminal 10 in response to the request. The server storage device 21A2 stores, for example, data to be transmitted from the distribution server 21A1 to the terminal 10. In addition, the server storage device 21A2 stores, for example, data received by the distribution server 21A1 from the terminal 10. In addition, the first server system 21 transmits, for example, data used in the application executed by the terminal 10 to the terminal 10.

Although the example in which the terminal 10 executes an application has been described, the present invention is not limited to this. For example, a web browser installed in the terminal 10 may be used to execute a process equivalent to executing the application. In this way, when a web browser installed in the terminal 10 is used, the server 20 may include a web server (not shown), for example. When the server 20 includes a web server (not shown), the web server transmits data related to an HTML document such as HTML5, the terminal 10 uses the web browser to display the data related to the HTML document, user instruction data is transmitted to the terminal 10 (the web browser), and the server 20 performs display control. By performing the display control, the server 20 generates display data and transmits the display data to the terminal 10 (the web browser). In addition, the display control may be performed using a script such as JavaScript (registered trademark) in the web browser.

In addition, in FIG. 1, an example has been described in which the first server system 21 includes a distribution server 21A1 and a server storage device 21A2, but this is not limiting. For example, the first server system 21 may include other components in addition to the distribution server 21A1 and the server storage device 21A2. In this case, the other components may have the functions of at least one of the distribution server 21A1 and the server storage device 21A2. Also, for example, the first server system 21 may be configured with a single component that has the functions of the distribution server 21A1 and the server storage device 21A2.

The second server system 22 is a server that transmits data related to content to the terminal 10. Here, for example, assume that the user operates the terminal 10 to execute an application. In this case, when the second server system 22 receives a request for data related to content from the terminal 10 while the application is being executed, the second server system 22 transmits data related to content to the terminal 10. The data related to content transmitted from the second server system 22 to the terminal 10 is, for example, data related to video.

2. Hardware Configuration of Each Device Next, an example of the hardware configuration of each of the terminal 10 and the server 20 will be described.

2-1. Hardware Configuration of Terminal 10 An example of the hardware configuration of each terminal 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the hardware configuration of the terminal 10 (server 20) shown in Fig. 1. In Fig. 2, the reference symbols in parentheses are those described in relation to the server 20, as described later.

As shown in FIG. 2, each terminal 10 includes, for example, a central processing unit 14, a main memory device 15, an input/output interface device 16, an input device 17, an auxiliary memory device 18, and an output device 19. The components shown in FIG. 2 are connected to each other by a data bus and/or a control bus.

The central processing unit 14 is referred to as a "CPU" and performs calculations on the instructions and data stored in the main memory device 15, and stores the results of the calculations in the main memory device 15. Furthermore, the central processing unit 14 can control an input device 17, an auxiliary memory device 18, an output device 19, and the like via an input/output interface device 16. The terminal 10 can include one or more such central processing units 14.

The main memory 15 is referred to as a "memory" and stores instructions and data received from the input device 17, the auxiliary memory 18, and the communication line 30 (such as the server 20) via the input/output interface device 16, as well as the results of calculations by the central processing unit 14. The main memory 15 can include, but is not limited to, computer-readable media such as volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drive (HDD), solid-state drive (SSD), magnetic tape, optical media). As will be readily understood, the term "computer-readable recording medium" can include media for data storage such as memory and storage, as well as transmission media such as modulated data signals, i.e., temporary signals.

The input device 17 is a device that inputs data from the outside, and includes, but is not limited to, a touch panel, a button, a keyboard, a mouse, and/or a sensor. The sensor may include, but is not limited to, one or more cameras, etc. and/or one or more microphones, etc., as described below.

The auxiliary storage device 18 is a storage device with a larger capacity than the main storage device 15. It can store the instructions and data (computer programs) that constitute the specific applications (video distribution applications, video viewing applications, etc.) and web browser applications described above. Furthermore, the auxiliary storage device 18 can transmit these instructions and data (computer programs) to the main storage device 15 via the input/output interface device 16 by being controlled by the central processing unit 14. The auxiliary storage device 18 can include, without being limited to, a magnetic disk device and/or an optical disk device, etc.

The output device 19 may include, but is not limited to, a display device, a touch panel, and/or a printer device.

In this hardware configuration, the central processing unit 14 sequentially loads the instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 18 into the main storage device 15, and by calculating the loaded instructions and data, it is possible to control the output device 19 via the input/output interface device 16, or to transmit and receive various data to and from other devices (e.g., a server 20, another terminal 10) via the input/output interface device 16 and the communication line 2.

2-2. Hardware configuration of server 20 An example of the hardware configuration of each server 20 will be described with reference to Fig. 2. The hardware configuration of each server 20 (each of the distribution server 21A1 and the server storage device 21A2) may be the same as that of each of the terminals 10 described above. Therefore, the reference characters for the components of each server 20 are shown in parentheses in Fig. 2.

As shown in FIG. 2, each server 20 can mainly include a central processing unit 24, a main memory device 25, an input/output interface device 26, an input device 27, an auxiliary memory device 28, and an output device 29. These devices are connected to each other by a data bus and/or a control bus.

The central processing unit 24, main memory device 25, input/output interface device 26, input device 27, auxiliary memory device 28, and output device 29 can be substantially the same as the central processing unit 14, main memory device 15, input/output interface device 16, input device 17, auxiliary memory device 18, and output device 19 included in each of the above-mentioned terminals 10, respectively.

In this hardware configuration, the central processing unit 24 sequentially loads the instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 28 into the main storage device 25, and by calculating the loaded instructions and data, it is possible to control the output device 29 via the input/output interface device 26, or to transmit and receive various data to and from other devices (e.g., each terminal 10) via the input/output interface device 26 and the communication line 2.

In addition, the server 20 may include one or more microprocessors and/or a graphics processing unit (GPU) instead of or in addition to the central processing unit 24.

3. Functions of Each Device Next, an example of the functions of the terminal 10 and the server 20 will be described with reference to FIGS. 3 and 4, respectively.

3-1. Functions of the terminal 10 Fig. 3 is a block diagram showing an example of functions of the terminal 10 shown in Fig. 1. As shown in Fig. 3, the terminal 10 includes, for example, a communication unit 110, an acquisition unit 120, a control unit 130, a display unit 140, a user interface unit 150, and a storage unit 160.

(1) Communication unit 110
The communication unit 110 is used, for example, to transmit various data to the server 20. The communication unit 110 is also used, for example, to receive various data from the server 20. The data received by the communication unit 110 is sent to the control unit 130, for example.

(2) Acquisition Unit 120
The acquisition unit 120 acquires, for example, operation data related to an operation from a user. The acquisition unit 120 also acquires, for example, data detected by various sensors. The data acquired by the acquisition unit 120 is sent to, for example, the control unit 130. The acquisition unit 120 performs, for example, processes S121 in Fig. 9, S122 in Fig. 9, S121 in Fig. 10, and S122 in Fig. 10, which will be described later. For example, the operation data may include one or more of the following data.
Data indicating how the broadcaster swiped the touchpad display; Data indicating which objects the broadcaster tapped or clicked on; Data indicating how the broadcaster dragged the touchpad display; and Other such operational data.

The data acquired by the acquisition unit 120 may be data related to no operation (data indicating that no operation was performed), for example, data indicating that the terminal 10 was not operated for a specific time (specific period) and/or data indicating that a specific location within the virtual space 300 was not entered.

In addition, in the present disclosure, in addition to or instead of using the terminal 10, a wearable device may be used to perform displays such as those shown in Figs. 6 to 8 described below. Here, the wearable device includes, for example, AR (Augmented Reality) glasses, smart glasses, HMDs (Head Mounted Displays), and the like. Note that, when the wearable device described above is AR glasses, for example, the AR glasses display a virtual display screen so as to be superimposed on a real area based on data related to position information, data obtained by reading a specified marker, and/or data obtained by identifying a specified object present in space.

When using such a wearable device, a user wearing the wearable device can move and/or select an object on the display screen displayed by the wearable device by performing gestures and/or gaze-related actions. Here, the gesture is, for example, a movement of the user's head forward, backward, left, or right. Also, a gaze-related action is, for example, a blinking action by the user, or a movement of the user's eyes up, down, left, or right. The object is, for example, an avatar corresponding to the user. When the object is, for example, an avatar corresponding to the user, performing a movement of moving the user's head forward, backward, left, or right causes the avatar to move forward, backward, left, or right in accordance with the movement.

In addition, when moving and/or selecting an object on the display screen displayed by the wearable device, for example, a separate controller (not shown) may be provided. Here, the controller includes, for example, a touch pad (not shown). With this, for example, a user can move and/or select an object on the display screen displayed by the wearable device by performing a touch operation on the touch pad. Here, a "touch operation" refers to at least one of tapping, double tapping, swiping, flicking, pinching in, and pinching out, for example. In addition, the controller may include, for example, an acceleration sensor and/or a gyro sensor. With this, based on the tilt and/or movement of the controller, an object on the display screen displayed by the wearable device can be moved and/or selected. The controller may be, for example, a device that is held by the user and used, or may be a device that is worn on the user's finger.

(3) Control unit 130
The control unit 130 performs various controls based on, for example, data received by the communication unit 110. The control unit 130 also performs various controls based on data acquired by the acquisition unit 120. The control unit 130 performs, for example, some or all of the processes of S131 to S151 in Fig. 9, which will be described later. The control unit 130 also performs, for example, some or all of the processes of S141 to S151 in Fig. 10, which will be described later.

(4) Display unit 140
The display unit 140 displays, for example, display content based on control data output from the control unit 130. The display unit 140 displays, for example, a screen for selecting a specific application. In addition, the display unit 140 displays, for example, a screen relating to a virtual space when a specific application is selected and executed.

(5) User Interface Unit 150
The user interface unit 150 is used to input various data used for executing applications through user operations.

(6) Storage unit 160
The storage unit 160 can store various data used to execute applications. For example, the storage unit 160 stores data used to control the display unit 140. For example, the storage unit 160 stores module data used to generate an avatar of a user.

The module data is, for example, data related to the parts used to generate an avatar. Here, the parts used to generate an avatar include, for example, data on each part of the avatar (eyes, nose, mouth, eyebrows, skin color, hairstyle, hair color, clothes, body, etc.). The module data also includes data related to an ID assigned to each part used to generate an avatar. Note that if the avatar part is the body, the data related to the parts used to generate the avatar may include data that is subdivided into body type, such as skinny, slightly skinny, normal, slightly obese, and obese.

In addition, when the display unit 140 displays an avatar 80 (another person's avatar) other than the first avatar 80A, the server 20 may transmit ID data used to generate the avatar 80 other than the first avatar 80A to the first terminal 11, and the first terminal 11 may construct the avatar 80 other than the first avatar 80A based on the ID data.

In addition, when the display unit 140 displays an avatar 80 (another person's avatar) other than the first avatar 80A, the display unit 140 may display the avatar 80 other than the first avatar 80A colored black, or may display the avatar 80 other than the first avatar 80A using parts and/or colors determined based on the gender (e.g., male or female) of the user corresponding to the avatar 80 other than the first avatar 80A.

3-2. Functions of the Server 20 Fig. 4 is a block diagram showing an example of functions of the server 20 shown in Fig. 1. As shown in Fig. 4, the server 20 includes, for example, a communication unit 210, a storage unit 220, and a control unit 230.

(1) Communication unit 210
The communication unit 210 is used, for example, to transmit various data to the terminal 10. The communication unit 210 is also used, for example, to receive various data from the terminal 10. The data received by the communication unit 210 is sent to the control unit 230. The communication unit 210 is, for example,
9 described later, the communication unit 210 receives second data from the second terminal 12, and transmits the second data to the first terminal 11 in Fig. 9 described later. The communication unit 210 receives first data from the first terminal 11 in Fig. 10 described later, transmits control data to the first terminal 11 in Fig. 10 described later, receives second data from the second terminal 12 in Fig. 10 described later, and transmits the second data to the first terminal 11 in Fig. 10 described later, for example.

(2) Storage unit 220
The storage unit 220 stores various data used for executing applications. For example, the storage unit 220 stores first data transmitted from the first terminal 11 and data transmitted from the second terminal 12.

(3) Control unit 230
The control unit 230 performs various controls based on, for example, data received by the communication unit 210. The control unit 230 performs, for example, the process of S133 in Fig. 10, which will be described later.

Fig. 5 is a diagram showing an example of a display screen displayed by the display unit 140 of the terminal 10. Fig. 5 is a diagram showing an example of a display displayed on the display unit 140 of the terminal 10 by operating the terminal 10 and starting an application. As shown in Fig. 5, the display unit 140 displays a virtual space 300. The virtual space 300 is, for example, a three-dimensional space. An avatar 80 and a first virtual venue 310 are shown within the virtual space 300.

The avatar 80 is configured to be able to perform, for example, at least one of walking, running, and jumping (jumping) within the virtual space 300 by user operation. The avatar 80 is also configured to be able to perform, for example, one of examining a virtual object and sitting on a virtual object by user operation. Here, the virtual object is, for example, an object corresponding to the avatar 80, such as a door or a chair. When the user operates the avatar 80 using the terminal 10, data related to the operation is transmitted to the server 20.

It should be noted that at least one of the multiple avatars 80 displayed on the display unit 140 may act based on a user's operation, or may act based on a predetermined action. Here, when the avatar 80 acts based on a predetermined action, this means that the avatar 80 acts as an NPC (Non Player Character).

In addition, the display modes of the avatars 80 shown in FIG. 5 are all the same, but are not limited to this. The display mode of the avatar 80 may be determined based on data related to the user operating the avatar 80. Here, the "display mode of the avatar 80" refers to the shape and/or color of the avatar 80.

The movement of the avatar in the virtual space may also change in response to the user's movement. For example, when the user nods, the avatar in the virtual space may also nod. Here, the movement data may be acquired, for example, using a motion capture system. As will be readily understood by those skilled in the art having the benefit of this disclosure, some examples of suitable motion capture systems that may be used with the apparatus and methods disclosed in this application include optical motion capture systems using passive or active markers or without markers, and inertial and magnetic non-optical systems. The motion data may be acquired using an image capture device (such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide semiconductor) image sensor) coupled to a computer that converts the motion data into video or other image data.

When operating the first avatar 80A shown in FIG. 5, for example, the display unit 140 of the first terminal 11 displays a screen such as that shown in FIG. 6.

Figure 6 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. As shown in Figure 6, the display unit 140 displays a virtual space 300. Specifically, for example, the display unit 140 displays an avatar 80 and a first virtual venue 310 that exist within the virtual space 300. Note that hereafter, when the term "control unit 130" is simply written, this refers to the "control unit 130 of the first terminal 11," and when the term "display unit 140" is simply written, this refers to the "display unit 140 of the first terminal 11."

The avatars 80 include, for example, a first avatar 80A and a second avatar 80B. The first avatar 80A is, for example, an avatar operated by a first user having a first terminal 11 that displays the virtual space 300 shown in FIG. 6. The second avatar 80B is, for example, an avatar operated by a user who has been registered as a friend by the first user. The display unit 140 displays the rear of the first avatar 80A, and the line of sight of the first user operating the first terminal 11 and the line of sight of the first avatar 80A corresponding to the first user are in the same direction.

The avatar 80 may include users other than the first avatar 80A and the second avatar 80B. For example, the avatar 80 may include an avatar operated by a user who is not registered as a friend by the first user. In the case where the avatar 80 includes an avatar operated by a user who is not registered as a friend by the first user, the first user may be configured to be able to register as a friend the avatar operated by the user who is not registered as a friend by the first user.

6, the display unit 140 may display a virtual object corresponding to the first avatar 80A instead of displaying the first avatar 80A. Also, in FIG. 6, the display unit 140 may display a virtual object corresponding to the second avatar 80B instead of displaying the second avatar 80B. The first avatar 80A is, for example, an avatar generated based on module data stored in the storage unit 160 of the first terminal 11. Similarly, the other avatar 80 is, for example, an avatar generated based on module data stored in the storage unit 160 of the terminal 10 corresponding to the other avatar 80. On the other hand, the virtual object corresponding to the first avatar 80A is, for example, drawn based on less data than the data used to draw the first avatar 80A. The virtual object corresponding to the first avatar 80A and the virtual object corresponding to the other avatar 80 may be, for example, configured with approximately the same shape and/or color. In this way, by using virtual objects corresponding to avatars 80, it is possible to reduce the load of simultaneously drawing multiple people by simplifying the representation, and it becomes possible to view the content on a device such as a smartphone.

The display unit 140 displays an area in the virtual space including the first avatar 80A, for example, based on a virtual viewpoint located closer to the page surface of FIG. 6 than the first avatar 80A. The display unit 140 displays an area in the virtual space 300 including the traveling direction of the first avatar 80A, for example. Note that the display unit 140 displays a predetermined area in the virtual space 300 based on the movement of the first avatar 80A. For example, when the traveling direction of the first avatar 80A is changed by 180 degrees, the display unit 140 may display a virtual object or the like that exists behind the first avatar 80A in FIG. 6, instead of the display in FIG. 6. In this way, the display unit 140 may display an area other than the area shown in FIG. 6 based on the movement of the first avatar 80A.

When a user operating the first terminal 11 operates the first avatar 80A and the first avatar 80A shown in FIG. 6 is located inside the first virtual venue 310, the display unit 140 displays, for example, the display screen of FIG. 7. Hereinafter, the mode related to the display screen of FIG. 7 may be referred to as the first mode. Note that the condition for the display unit 140 to display the display screen of FIG. 7 is not limited to the first avatar 80A shown in FIG. 6 being located inside the first virtual venue 310. For example, when the first user uses the first terminal 11 to launch the application described in the present disclosure, if the first user performs an operation to select the first mode using the first terminal 11, the display unit 140 may display the display screen of FIG. 7.

In FIG. 6, when the first user operates the first avatar 80A, the first terminal 11, for example, acquires data regarding the position of the first avatar 80A within the virtual space 300. Also, for example, the data regarding the position of the first avatar 80A within the virtual space 300 acquired by the first terminal 11 is transmitted to the server 20. The timing at which the first terminal 11 acquires the data regarding the position of the first avatar 80A within the virtual space 300 may be any timing. Also, for example, the timing at which the data regarding the position of the first avatar 80A within the virtual space 300 acquired by the first terminal 11 is transmitted to the server 20 may also be any timing.

In addition, any area of the display unit 140 of the first terminal 11 may be configured to be touch-operated. In addition, the first terminal 11 may be configured to have an acceleration sensor (not shown), and when the first terminal 11 is operated, the display area and/or direction displayed by the display unit 140 may be changed based on the acceleration sensor. Here, the above-mentioned "any area" includes, for example, area 301 and/or area 314 in FIG. 6. Area 301 and/or area 314 are operation user interfaces for performing a predetermined display control by performing a touch operation. In addition, "touch operation" refers to at least one of the operations of, for example, tapping, double tapping, swiping, flicking, pinching in, and pinching out. In addition, as shown in FIG. 6, two areas 301 may be provided, or one or three or more areas may be provided. In addition, when two or more regions 301 are provided, one region 301 corresponds to, for example, the region used to make the first avatar 80A walk, and the other region 301 corresponds to, for example, the region used to make the first avatar 80A walk. Furthermore, the region 301 and/or the region 314 may be displayed in the same position or in different positions not only when the display in FIG. 6 is performed, but also when other drawings (for example, FIG. 7 and/or FIG. 8) described later are displayed.

The first terminal 11 may also be configured so that the first user can make the first avatar 80A jump and/or walk by performing a touch operation on the display unit 140. Here, the touch operation for making the first avatar 80A jump is, for example, an operation of tapping or double tapping any area or area 301 of the first avatar 80A. In this case, when an operation of tapping or double tapping an arbitrary point is performed, the display unit 140 displays a line segment connecting the first avatar 80A and the arbitrary point in an arbitrary color, and the first avatar 80A walks along the line segment to the arbitrary point. In addition, the touch operation for making the first avatar 80A walk is an operation of tapping or double tapping an arbitrary point. In this case, when an operation of tapping or double tapping an arbitrary point is performed, the display unit 140 displays a line segment connecting the first avatar 80A and the arbitrary point in an arbitrary color, and the first avatar 80A walks along the line segment to the arbitrary point. Furthermore, the touch operation for making the first avatar 80A walk is an operation of flicking any area of the first avatar 80A to change the direction of travel, and then tapping or double-tapping any point on the imaginary line of the new direction of travel.

The first terminal 11 may be configured so that the first user can chat with a user corresponding to at least one of all the avatars 80 via the area 314 of the display unit 140. Here, the area 314 is an area that displays a message input by the user corresponding to the avatar 80. The user who chats with the first user is an individual user or an exhibiting company. When multiple messages are displayed in the area 314, if it is not possible to display all the messages in the area 314, a touch operation can be performed to display messages that are not displayed in the area 314. Here, the touch operation when it is not possible to display all the messages in the area 314 is, for example, a swipe.

Figure 7 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. The first mode shown in Figure 7 will be described below. Figure 7 shows the first virtual venue 310. The first virtual venue 310 is an example of a venue provided in the virtual space 300. As shown in Figure 7, the display unit 140 displays, for example, the first avatar 80A, the virtual object 81B, and the first display area 311. Note that the URL when the display screen when the first avatar 80A is outside the first virtual venue 310 (e.g., Figure 6) is displayed using the web browser of the first terminal 11 is different from the URL when the display screen when the first avatar 80A is inside the first virtual venue 310 (e.g., Figure 7) is displayed using the web browser of the first terminal 11. Therefore, when the web browser of the first terminal 11 is used, if the first avatar 80A shown in Figure 6 is located inside the first virtual venue 310, the URL will be changed.

The first avatar 80A is, for example, an avatar operated by the first user using the first terminal 11. The first user can move the first avatar 80A within the first virtual venue 310 using the first terminal 11. In the first mode, the control unit 130 controls the display unit 140 based on operation data for moving the first avatar 80A within the first virtual venue 310.

The virtual object 81B is a virtual object corresponding to the avatar 80. The virtual object 81B is, for example, a virtual object corresponding to the second avatar 80B of a user who has registered the first user as a friend. Note that the virtual object 81B may include not only a virtual object corresponding to the second avatar 80B of a user who has registered the first user as a friend, but also a virtual object corresponding to the avatar 80 of a user who has not registered the first user as a friend. Also, in FIG. 7, an example in which two virtual objects 81B are provided is described, but the number of virtual objects 81B is not limited to two.

The first display area 311 is an area for displaying a predetermined content. The predetermined content is, for example, a video, but is not limited to this.

When the virtual object 81B includes a virtual object corresponding to the second avatar 80B of a user who is registered as a friend of the first user, and a virtual object corresponding to the avatar 80 of a user who is not registered as a friend of the first user, the display unit 140 may display the virtual object corresponding to the second avatar 80B of the user who is registered as a friend of the first user with the virtual object corresponding to the avatar 80 of the user who is not registered as a friend of the first user, with or without distinguishing between them. As shown in FIG. 7, the color of each virtual object 81B is, for example, black.

In the first mode, when the display unit 140 distinguishes between a virtual object corresponding to the second avatar 80B of a user who is registered as friends with the first user and a virtual object corresponding to the avatar 80 of a user who is not registered as friends with the first user, the display unit 140 displays the appearance of the virtual object corresponding to the second avatar 80B of the user who is registered as friends with the first user in a different manner from the appearance of the virtual object corresponding to the avatar 80 of the user who is not registered as friends with the first user. Note that the "appearance of the virtual object" refers to, for example, the shape and/or color of the virtual object.

In the first mode, the first user performs a predetermined operation using the first terminal 11, which causes the display unit 140 to display the first avatar 80A sitting (taking a seat) at a predetermined position in the first virtual venue 310. Note that in the first mode, the display unit 140 may display locations where the first avatar 80A can sit (take a seat), or may not display locations where the first avatar 80A can sit (take a seat). When the display unit 140 does not display locations where the first avatar 80A can sit (take a seat), the first avatar 80A can sit (take a seat) at any location.

In addition, when the avatar 80 sits on the virtual object, or when the avatar 80 sits anywhere other than the virtual object, the display unit 140 may display a display screen different from the display screen before the avatar 80 sat down, or may hide the user interface. When the display unit 140 displays a display screen different from the display screen before the avatar 80 sat down, the display unit 140 may display the screen to be displayed in full screen.

In the first mode, when the display unit 140 displays a place where the first avatar 80A can be seated, the display unit 140 may display multiple chairs where the first avatar 80A can be seated. In this case, for example, when the first user uses the first terminal 11 to position the first avatar 80A near one of the multiple chairs, and performs a predetermined operation using the first terminal 11, the display unit 140 displays that the first avatar 80A is seated on one of the multiple chairs. When the first avatar 80A sits or is seated, the first mode shown in FIG. 7 transitions to the second mode shown in FIG. 8. That is, the display unit 140 displays a first-person perspective instead of a third-person perspective. That is, the display unit 140 displays a display that does not include the first avatar 80A instead of a display that includes the first avatar 80A.

Also, for example, the user may operate the first avatar 80A to approach a specific chair among the multiple chairs and perform a predetermined operation, causing the display unit 140 to display a message asking whether to sit in the specific chair. When the display unit 140 displays a message asking whether to sit in the specific chair, the first user may use the first terminal 11 to perform a predetermined operation indicating an intention to sit in the specific chair in response to the message, causing the display unit 140 to display that the first avatar 80A is sitting in one of the multiple chairs. When the first avatar 80A sits down or is seated, the first mode shown in FIG. 7 is transitioned to the second mode shown in FIG. 8.

In addition, in the first mode, the control unit 130 may control the display unit 140 to display a virtual object 81B corresponding to at least one avatar 80 other than the first avatar 80A, and a second display area displaying a message included in message data transmitted from a terminal 10 used by a user who operates at least one avatar 80 other than the first avatar 80A. In this case, the display unit 140 displays the second display area around the virtual object 81B corresponding to the avatar 80 that transmitted the message data, and displays the message included in the message data in the second display area. This clarifies the correspondence between the second display area and the user who operates the terminal 10 that transmitted the message data. Therefore, the first user can recognize the user who transmitted the message contained in the second display area. The second display area is, for example, a speech bubble.

When at least one virtual object 81B and at least one speech bubble are displayed, if any of the virtual objects 81B overlaps with any of the speech bubbles, the display unit 140 may change the display position of the virtual object 81B and/or the speech bubble so that the virtual object 81B and the speech bubble do not overlap.

In addition, when at least one virtual object 81B and at least one speech bubble are displayed, if any of the virtual objects 81B overlap with any of the speech bubbles, the display unit 140 may display the virtual object 81B and the speech bubble at different times so that the virtual object 81B and the speech bubble do not overlap.

In addition, when the distance between an arbitrary position in the virtual space and the virtual object 81B is equal to or greater than a predetermined value, the display unit 140 may display around the virtual object 81B that data related to a message has been sent from a terminal of a user who operates at least one second avatar corresponding to the virtual object 81B. Here, the above-mentioned "arbitrary position" is, for example, the position of the first avatar 80A existing in the virtual space 300. As a result, when a message is sent from a user corresponding to at least one second avatar corresponding to the virtual object 81B, even if the first user cannot view the message via the display unit 140, the display unit 140 can display the virtual object 81B corresponding to the message. Therefore, the first user can identify the virtual object 81B corresponding to the message.

Figure 8 is a diagram showing an example of a display screen displayed by the display unit 140 of the first terminal 11. Figure 8 is a diagram showing an example of display content displayed by the display unit 140 of the first terminal 11 when the first user has registered four friends. Figure 8 is also a diagram showing a display example relating to a viewing mode (second mode) in which content displayed in the first display area 311 is viewed. The second mode shown in Figure 8 is described below. Here, the friends displayed in Figure 8 are users who have logged in and are running the same application as the application run by the first user using the first terminal 11.

In the second mode, the display unit 140 displays the second avatar 80B of the user who has registered as a friend and/or a virtual object 81B corresponding to the second avatar 80B of the user who has registered as a friend. On the other hand, the display unit 140 does not display the first avatar 80A, for example. The display unit 140 may display the second avatar 80B of some of the four users who have registered as friends, and display the virtual object 81B corresponding to the second avatar 80B of the remaining users of the four users who have registered as friends. In this way, the display unit 140 performs display from a first-person perspective instead of a third-person perspective, thereby improving the sense of immersion for the user operating the terminal 10. In addition, by displaying some users as avatars rather than virtual objects corresponding to the avatars, a richer representation is achieved.

In the second mode, the display unit 140, for example, displays a speech bubble 82 around the second avatar 80B and/or the virtual object 81B. The display unit 140 also displays, in the speech bubble 82, a message contained in message data sent from the terminal of the user who has registered the user as a friend. This makes the correspondence between the message contained in the speech bubble 82 and the user who has registered the user as a friend clear. Therefore, the first user can recognize the user who sent the message contained in the speech bubble 82. The display unit 140 also displays, for example, the second avatar 80B and/or the virtual object 81B within a predetermined distance based on a predetermined position in the first virtual venue 310.

In the second mode, the display unit 140 displays, for example, the virtual object 81B so that the first display area 311 does not overlap with other areas. Here, "other areas" are, for example, the areas of the second avatar 80B, the virtual object 81B, and/or the speech bubble 82. This can reduce the possibility that the visibility of the content displayed in the first display area 311 will be impaired when the content is viewed.

In the second mode, when the display unit 140 displays the second avatar 80B, the first terminal 11 acquires, for example, part data including part identification information of at least one second avatar 80B. The display unit 140 displays at least one second avatar 80B determined based on the part identification information.

In the second mode, a specified content is played in the first display area 311 at a specified time. Here, the time used in the virtual space may be a time synchronized to be the same as the real time, or may be a time used in the virtual space 300 separately from the real time. Note that the condition for playing a video in the first display area 311 does not have to be related to time. For example, the condition for playing a video in the first display area 311 may be, for example, that the first avatar 80A is seated (seated) at a specified position in the first virtual venue 310.

In the second mode, when the display unit 140 displays a plurality of second avatars 80B, the second avatars 80B of the plurality of users who have registered as friends with the first user may be displayed in different modes. For example, if a user corresponding to the second avatar 80B selects an avatar part before the second mode is performed, the display unit 140 uses the selected avatar part to display the second avatar 80B when displaying the plurality of second avatars 80B. In addition, in the second mode, when the display unit 140 displays a plurality of virtual objects corresponding to the second avatars 80B of the plurality of users who have registered as friends with the first user, the plurality of virtual objects corresponding to the second avatars 80B of the plurality of users who have registered as friends with the first user may be displayed in different modes. Here, "displaying in different modes" refers to displaying virtual objects corresponding to each of the set avatar parts. As a result, the display unit 140 displays each virtual object, for example, in a different shape and/or a different color.

In addition, in the second mode, the first user may perform a first operation using the first terminal 11 to switch from the second mode to the first mode. The first operation is, for example, an operation to request switching from the second mode to the first mode. The first operation is, for example, an operation performed when the first user leaves the seat after finishing viewing the content displayed in the first display area 311. The first operation is, for example, an operation performed when the first user stops viewing and leaves the seat while viewing the content displayed in the first display area 311. As a result, the display unit 140 displays, for example, a screen as shown in FIG. 7. As a result, the display unit 140 displays the first avatar 80A, the virtual object 81B, and the first display area 311 again.

In addition, in the second mode, when the first user performs an operation other than the first operation, the first terminal 11 may be configured not to accept operations other than the first operation. As a result, even if the first user mistakenly performs an operation to move the first avatar 80A in the second mode, the display unit 140 can continue to display the display screen as shown in FIG. 8.

The control unit 130 may also determine an upper limit (first upper limit) of the number of second avatars 80B and/or virtual objects 81B that the display unit 140 displays in the second mode. For example, when the number of users who have registered as friends exceeds the first upper limit, when transitioning from the first mode to the second mode, the control unit 130 may determine at least one user from among the multiple users who have registered as friends. In this case, the control unit 130 may determine at least one user from among the multiple users who have registered as friends based on operation data transmitted from the first terminal 11 by the first user operating the first terminal 11. The control unit 130 may also randomly determine at least one user from among the multiple users who have registered as friends. The control unit 130 may also determine at least one user from among the multiple users who have registered as friends based on a predetermined priority order. When the control unit 130 determines at least one user from among the multiple users who have registered as friends, the number of at least one user is equal to or less than the first upper limit. In this way, in the second mode, the display unit 140 displays the second avatar 80B corresponding to at least one user selected from among the multiple users who have registered as friends, and/or the virtual object 81B corresponding to at least one user selected from among the multiple users who have registered as friends. Note that the predetermined priority is determined in consideration of the commonality of at least one of the past group viewing history, past chat history, user attribute information, and avatar parts information, for example.

The server 20 may transmit data on at least one of the number of simultaneous connections, users, and event attributes to the first terminal 11. The first terminal 11 may then receive the data and determine the total number of avatars 80 to be displayed by the display unit 140, taking into account the rendering performance. As a result, even if the first terminal 11 does not have high performance, the first terminal 11 can render the avatar 80 within the range of the performance of the first terminal 11 so that the first user operating the first avatar 80A feels synchronized. The first terminal 11 also determines the total number of avatars 80 as described above, taking into account at least one of the number of vertices, materials, and number of textures of the mesh of the 3D model that can be rendered.

The display unit 140 may simultaneously display the speech bubble 82 and the message displayed in the speech bubble 82, or may display the speech bubble 82 prior to the message displayed in the speech bubble 82. The display unit 140 may also hide the message contained in the speech bubble 82 a predetermined time after displaying the message contained in the speech bubble 82. In this way, the display unit 140 displays the speech bubble 82 prior to the message, thereby notifying the user that a message will be displayed in the future. This makes it possible to prevent the user from missing the message.

In addition, when the first avatar 80A exists in the virtual space 300 shown in FIG. 6, the first user may be configured to be able to use the first terminal 11 to register another user as a friend. In addition, when the first avatar 80A exists in the first virtual venue 310 shown in FIG. 7 and before the transition from the first mode shown in FIG. 7 to the second mode shown in FIG. 8, the first user may be configured to be able to use the first terminal 11 to register another user as a friend.

The condition for the first user to register another user as a friend may be satisfied when the first terminal 11 transmits data requesting that the first user register another user as a friend. The condition for the first user to register another user as a friend may be satisfied when the first terminal 11 transmits data requesting that the first user register another user as a friend, and when the terminal 10 of the other user transmits data approving the request by the first user to register the other user as a friend.

In addition, in the first mode, when there are multiple locations in the first virtual venue 310 where the first avatar 80A can be seated, the display unit 140 may display a display screen related to the second mode corresponding to the location where the first avatar 80A is seated, or the display unit 140 may display a display screen related to the second mode that does not depend on the location where the first avatar 80A is seated. For example, in the case where three locations where the first avatar 80A can be seated are provided in the virtual venue shown in FIG. 7, the display unit 140 may display FIG. 8 as a display related to the second mode regardless of which of the three locations the first avatar 80A is seated in. This allows the display unit 140 to display the entire area of the first display area 311 regardless of the location where the first avatar 80A is seated. By displaying a display screen related to the second mode corresponding to the location where the first avatar 80A is seated, a greater sense of reality can be achieved. Furthermore, the display unit 140 can reduce the load of the drawing process by displaying a display screen related to the second mode that is independent of where the first avatar 80A is seated.

In addition, an example in which the display unit 140 switches from the first mode to the second mode when the first avatar 80A is seated in the first mode has been described, but the present invention is not limited to this. For example, when the first avatar 80A is operated and the first avatar 80A is located within a predetermined area of the first virtual venue 310, the display unit 140 may display a display screen related to the second mode. In addition, for example, when an operation is performed to instruct the first avatar to enter the first virtual venue 310 from an area of the virtual space 300 different from the first virtual venue 310, the display unit 140 may display a display screen related to the second mode. Here, the "operation to instruct the first avatar to enter the first virtual venue 310 from an area of the virtual space 300 different from the first virtual venue 310" refers to, for example, a case in which a predetermined operation is performed when the first avatar 80A is present in the virtual space 300 shown in FIG. 6. The "predetermined operation when present in the virtual space 300 shown in FIG. 6" is, for example, an operation including an instruction by the first user to cause the first avatar 80A to enter the first virtual venue 310 using the first terminal 11. In addition, when the first user launches the application described in the present disclosure using the first terminal 11, if the first user performs an operation to select the second mode using the first terminal 11, the display unit 140 may display a display screen related to the second mode.

In addition, the display unit 140 may display a third display area (not shown) that displays chats in chronological order in at least one of the first and second modes. The third display area is, for example, a rectangular frame. The display unit 140 displays a message included in the message data transmitted from the terminal 10 within the rectangular frame. The display unit 140 may display at least one message within the rectangular frame, and if a new message is subsequently displayed, the message may be preferentially displayed. In addition, when displaying a message within the rectangular frame, the display unit 140 may display the time when the message data related to the message was transmitted together with the message. Note that the terminal 10 may include, for example, only the first terminal 11 and the second terminal 12, or may include terminals other than the first terminal 11 and the second terminal 12. The third display area is, for example, an area that displays a message transmitted from the terminal 10. The third display area is, for example, a rectangular frame, and the display unit 140 displays a message included in the message data transmitted from the terminal 10 within the rectangular frame. The display unit 140 displays, for example, a message included in the message data transmitted from the first terminal 11 in the third display area. The display unit 140 displays, for example, a message included in the message data transmitted from the second terminal 12 in the third display area.

Here, when the display unit 140 displays the third display area, if message data is sent from the second terminal 12, the display unit 140 displays the message in the speech bubble 82 around the second avatar 80B corresponding to the second terminal 12, and also displays the message in the third display area.

In addition, when the display unit 140 displays the third display area, the display unit 140 may display the third display area so that the third display area does not overlap with other areas. Here, "other areas" are, for example, the areas of the second avatar 80B, the virtual object 81B, the speech bubble 82, and/or the first display area 311. This can reduce the possibility that the visibility of a message displayed in the third display area will be impaired when checking the message.

Here, after the message is displayed in the third display area at the first time, the message may continue to be displayed in the third display area regardless of the passage of time. Also, for example, after the message is displayed in the third display area at the first time, the message may no longer be displayed in the third display area after a predetermined time has elapsed. Also, for example, if the message is displayed in the third display area at the first time and at least one other message is displayed in the third display area after the first time, the message displayed in the third display area at the first time may be made non-displayable.

When the display unit 140 displays the third display area and users chat with each other, the user ID and the avatar 80 in the chat may or may not be linked to each other.

4. Operation of System 1000 The operation of system 1000 will be described with reference to Figures 9 and 10. Figures 9 and 10 are flow charts showing an example of an operation performed by using system 1000 shown in Figure 1.

First, steps S111 to S151 will be explained in order with reference to FIG.

In S111, the first user operates the first terminal 11 to start an application, and in S112, the second user operates the second terminal 12 to start an application. Here, the second user is assumed to be a user who is registered as a friend by the first user.

In S115, the first terminal 11 acquires operation data in which the first user selects at least one second avatar from among a plurality of second avatars. This determines a user who will view the predetermined content displayed in the first display area 311 together with the first user. Once a user who will be registered as a friend of the first user has been determined, data relating to the first user and the user who will be registered as a friend (data relating to friend registration in FIG. 9) is transmitted to the server 20.

Note that in FIG. 9, an example is described in which there are two terminals 10, a first terminal 11 and a second terminal 12. However, the terminals 10 may include at least one other terminal in addition to the first terminal 11 and the second terminal 12.

In S121, the first terminal 11 acquires first data. The first data includes, for example, data related to an avatar in a virtual space that is operated using the first terminal 11. The first data includes, for example, operation data for operating the first avatar 80A when the first avatar 80A exists in the first virtual venue 310.

In S131, the first terminal 11 performs a first determination process. Here, the first determination process is to determine whether or not a first condition regarding the data included in the first data is satisfied. The first determination process is, for example, to determine whether or not the first data includes predetermined operation data. Here, the predetermined operation data is, for example, data instructing the first avatar 80A to take a seat when the first avatar 80A is present in the first virtual venue 310 shown in FIG. 7.

In S131, the first terminal 11 performs a first determination process. In S131, if the first terminal 11 determines that the first condition is satisfied, it determines control data for controlling the display unit 140 of the first terminal 11, and the process of S141 is executed. On the other hand, if the first terminal 11 determines in S131 that the predetermined condition is not satisfied, the process of S131 is repeated. The control data determined in S131 is data for controlling the display screen of the first terminal 11. In addition, the control data determined in S131 includes data for controlling the display unit 140 of the first terminal 11 to switch from the first mode shown in FIG. 7 to the second mode shown in FIG. 8.

In S141, the first terminal 11 performs a process (first display control process) for controlling the display unit 140 of the first terminal 11 based on the control data. The first display control process refers to, for example, a display control process for performing a display related to the second mode (e.g., FIG. 8). Specifically, for example, the display unit 140 of the first terminal 11 displays an avatar 80 and/or a virtual object 81B corresponding to the user who was registered as a friend in S115.

After the process of S112, in S122, the second terminal 12 acquires the second data, and the second terminal 12 transmits the second data to the server 20. Here, the second data is, for example, message data transmitted from the second terminal 12 that operates the second avatar. The server 20 receives the second data from the second terminal 12, and transmits the second data to the first terminal 11. After the first terminal 11 performs the process of S141 and after the first terminal 11 receives the second data from the server 20, the process of S151 is performed.

In S151, the first terminal 11 performs a process (second display control process) to control the display unit 140 of the first terminal 11 based on the second data. The second display control process refers to display control to display a message contained in the message data transmitted from the second terminal 12 in a speech bubble 82 while a display related to the second mode (e.g., FIG. 8) is being performed, for example.

Next, steps S111 to S151 will be explained in order with reference to FIG. 10.

In S111, the first user operates the first terminal 11 to start an application, and in S112, the second user operates the second terminal 12 to start an application. Here, the second user is assumed to be a user who is registered as a friend by the first user.

In S115, the first terminal 11 acquires operation data in which the first user selects at least one second avatar from among a plurality of second avatars. This determines a user who will view the specified content displayed in the first display area 311 together with the first user. Once a user who will be registered as a friend of the first user has been determined, data relating to the first user and the user who will be registered as a friend (data relating to friend registration in FIG. 10) is transmitted to the server 20.

Note that in FIG. 10, an example is described in which there are two terminals 10, a first terminal 11 and a second terminal 12. However, the terminals 10 may include at least one other terminal in addition to the first terminal 11 and the second terminal 12.

In S121, the first terminal 11 acquires the first data. The first data includes, for example, data related to an avatar in a virtual space that is operated using the first terminal 11. The first data includes, for example, operation data for operating the first avatar 80A when the first avatar 80A exists in the first virtual venue 310. After S121, the server 20 receives the first data from the first terminal 11.

In S133, the server 20 performs a first determination process. Here, the first determination process of S133 in FIG. 10 is similar to the first determination process of S131 in FIG. 9. If the server 20 determines in S133 that a predetermined condition (first condition) is satisfied, the server 20 determines control data and transmits the control data to the first terminal 11, and the process of S141 is executed. On the other hand, if the server 20 determines in S133 that the predetermined condition is not satisfied, the process of S133 is repeated. Note that the control data determined in S133 is data that controls the display screen of the first terminal 11.

In S141, the first terminal 11 performs a process (first display control process) for controlling the display unit 140 of the first terminal 11 based on the control data. The first display control process refers to, for example, a display control process for performing a display related to the second mode (e.g., FIG. 8).

After the process of S112, in S122, the second terminal 12 acquires the second data, and the second terminal 12 transmits the second data to the server 20. Here, the second data is, for example, message data transmitted from the second terminal 12 that operates the second avatar. The server 20 receives the second data from the second terminal 12, and transmits the second data to the first terminal 11. After the first terminal 11 performs the process of S141 and after the first terminal 11 receives the second data from the server 20, the process of S151 is performed.

In S151, the first terminal 11 performs a process (second display control process) to control the display unit 140 of the first terminal 11 based on the second data. The second display control process refers to display control to display a message contained in the message data transmitted from the second terminal 12 in a speech bubble 82 while a display related to the second mode (e.g., FIG. 8) is being performed, for example.

When the first terminal 11 receives the control data and the second data from the server 20 after the process of S121, the first terminal 11 may perform the first display control process of S141 and the second display control process of S151. In this case, the control unit 130 performs display control (first display control process) to switch from the first mode to the second mode, and also performs display control (second display control process) to display in the speech bubble 82 a message included in the message data transmitted from the second terminal 12 in the second mode.

In addition, in FIG. 9 and/or FIG. 10, the server 20 performs various processes using data related to friend registration received from the first terminal 11. For example, in FIG. 9 and/or FIG. 10, when the server 20 receives second data from the second terminal 12, the server 20 determines whether or not the user operating the second terminal 12 that transmitted the second data is a user who has registered the first user as a friend. Then, if the user operating the second terminal 12 that transmitted the second data is a user who has registered the first user as a friend, the server 20 transmits the second data to the first terminal 11.

Furthermore, at least a portion of the processing in FIG. 9 and/or the processing in FIG. 10 may be omitted as appropriate.

As described above, control data for controlling the display unit 140 to display the first display area 311, the second avatar 80B, and the message contained in the message data transmitted from the second terminal 12 that operates the second avatar 80B is determined, and the display unit 140 is controlled based on the control data. Therefore, the user operating the first avatar 80A can check the messages displayed around the second avatar 80B of the user who has registered him/her as a friend while watching the video displayed in the first display area 311. This makes it more interesting than ever before.

5. Modifications

As shown in FIG. 11, a first sensor 102a, a second sensor 102b, a camera 102c, and a microphone 102d may be provided in addition to the terminal 10 shown in FIG. 3. FIG. 11 is a block diagram showing an example of the terminal 10 shown in FIG. 3 and a configuration connected to the terminal 10. Here, the terminal 10 is connected to each of the first sensor 102a, the second sensor 102b, the camera 102c, and the microphone 102d, for example, by wire or wirelessly.

The first sensor 102a is connected to the camera 102c, for example, by wire or wirelessly. The camera 102c can include, for example, an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. For example, the camera 102c can be one included in the True Depth camera of the iPhone X (registered trademark). The second sensor 102b is connected to the microphone 102d, for example, by wire or wirelessly. The first sensor 102a and the camera 102c may be provided as a single configuration. The second sensor 102b and the microphone 102d may be provided as a single configuration.

In this way, the terminal 10 may transmit images captured by the camera 102c to the server 20. The terminal 10 may also transmit audio data input to the microphone 102d to the server 20. The terminal 10 may also transmit video data captured using the camera 102c and the microphone 102d to the server 20.

Figure 12 illustrates a generalized example of a suitable computing environment 1400 in which the embodiments, techniques, and technologies described herein, including transmitting and using tokens to render video in a computing environment, may be implemented. For example, the computing environment 1400 may implement any of the terminal devices (or broadcasters, or viewers), or broadcast server systems, etc., as described herein.

The computing environment 1400 is not intended to suggest any limitation as to the scope of use or functionality of the technology, as the technology may be implemented in a variety of general-purpose or special-purpose computing environments. For example, the technology disclosed herein may be implemented in a variety of other computer system configurations, including a variety of handheld devices, a variety of multiprocessor systems, a variety of microprocessor-based or programmable consumer electronics products, a variety of network PCs, a variety of minicomputers, a variety of mainframe computers, and the like. The technology disclosed herein may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

12, the computing environment 1400 includes at least one central processing unit 1410 and memory 1420. In FIG. 12, this most basic configuration 1430 is included within the dashed line. The central processing unit 1410 executes computer-executable instructions, and the central processing unit 1410 may be a real processor or a virtual processor. In a multiprocessing system, multiple processors can run simultaneously, as multiple processing units execute computer-executable instructions to increase processing power. The memory 1420 may be volatile memory (e.g., registers, cache, RAM), non-volatile memory (e.g., ROM, EEPROM, flash memory, etc.), or some combination of the two. The memory 1420 stores, for example, software 1480, various images, and videos that can implement the techniques described herein. The computing environment may have various additional functions. For example, the computing environment 1400 includes storage 1440, one or more input devices 1450, one or more output devices 1460, and one or more communication connections 1470. An interconnection mechanism (not shown), such as a bus, controller, or network, interconnects the various components of the computing environment 1400. Typically, operating system software (not shown) provides an operating environment for other software executing in the computing environment 1400 and coordinates the various activities of the various components of the computing environment 1400.

Storage 1440 may be removable or non-removable and may include magnetic disks, magnetic tapes or cassettes, CD-ROMs, CD-RWs, DVDs, or any other medium used to store information and that may be accessed within computing environment 1400. Storage 1440 stores instructions for software 1480, plug-in data, and messages that may be used to implement the techniques described herein.

The one or more input devices 1450 may be a keyboard, a keypad, a mouse, a touch screen display, a touch input device such as a pen or a trackball, a voice input device, a scanning device, or another device that provides input to the computing environment 1400. In the case of audio, the one or more input devices 1450 may be a sound card or similar device that accepts audio input in analog or digital form, or a CD-ROM reader that provides various audio samples to the computing environment 1400. The one or more output devices 1460 may be a display, a printer, speakers, a CD writer, or another device that provides output from the computing environment 1400.

The one or more communications connections 1470 enable communication to another computing entity over a communications medium (e.g., a connected network). The communications medium conveys information such as computer-executable instructions, compressed graphics information, video, or other data contained in a modulated data signal. The one or more communications connections 1470 include, but are not limited to, wired connections (e.g., megabit or gigabit Ethernet, InfiniBand, or Fibre Channel over electrical or optical fiber connections), but also wireless technologies (e.g., Bluetooth, WiFi (IEEE 802.11a/b/n), WiMax, cellular, satellite, laser, infrared, RF connections), and other suitable communications connections for providing network connectivity to the various agents, bridges, and data consumers of the destination agents disclosed herein. In a virtual host environment, the one or more communications connections may be virtualized network connections provided by the virtual host.

Various embodiments of the methods disclosed herein may be performed in the compute cloud 1490 using computer-executable instructions that implement all or a portion of the techniques disclosed herein. For example, various agents may perform various vulnerability scanning functions in the compute environment, while agent platforms (e.g., bridges) and destination agent data consumer services may run on various servers located within the compute cloud 1490.

A computer readable medium is any available medium that can be accessed within computing environment 1400. By way of example and not limitation, with respect to computing environment 1400, computer readable media includes memory 1420 and/or storage 1440. As will be readily understood, the term computer readable medium includes media for data storage, such as memory 1420 and storage 1440, and does not include transmission media, such as various modulated data signals.

The various embodiments described above can be used in combination with one another as long as no contradiction or inconvenience arises. In consideration of the many possible embodiments to which the principles of the invention disclosed herein may be applied, it should be understood that the illustrated embodiments are merely preferred examples and should not be considered to limit the scope of the claimed invention to these preferred examples. In practice, the scope of the claimed invention is defined by the appended claims. Accordingly, we request the grant of a patent as our invention to all that fall within the scope of the claimed invention.

The computer program according to the first aspect is "a computer program executed by at least one processor, which causes the at least one processor to function as follows: acquire first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal; determine whether a first condition related to the data included in the first data is satisfied; and, if the first condition is satisfied, determine control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among the at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar; and control the display unit based on the control data."

The computer program according to the second aspect is "a computer program executed by at least one processor, which causes the at least one processor to function as follows: receive first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal via a communication line; determine whether a first condition related to the data included in the first data is satisfied; and, if the first condition is satisfied, determine control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among the at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar; and transmit the control data to the first terminal."

The computer program according to the third aspect is the one according to the first or second aspect described above, in which "the at least one second avatar is determined before making the determination."

The computer program according to the fourth aspect is any one of the first to third aspects described above, in which "the display unit displays the message around an avatar operated by the device that transmitted the message data and in a manner that does not overlap with the first display area."

The computer program according to the fifth aspect is the fourth aspect described above, in which "the display unit hides the message contained in the message data transmitted from the terminal that controls the at least one second avatar after a predetermined time has elapsed since displaying the message."

The computer program according to the sixth aspect is any one of the first to fifth aspects described above, in which "the display unit displays the at least one second avatar and the first display area so as not to overlap each other."

The computer program according to the seventh aspect is any one of the first to sixth aspects described above, in which "the display unit displays the at least one second avatar within a predetermined distance from a predetermined position."

The computer program according to the eighth aspect is one in any one of the first to seventh aspects described above, in which "the at least one second avatar is a plurality of second avatars, and the display unit displays at least two of the plurality of avatars in different aspects."

The computer program according to the ninth aspect is the computer program according to the eighth aspect described above, which "obtains part data including part identification information of the at least one second avatar, and the display unit displays the at least one second avatar determined based on the part identification information on the display unit."

The computer program according to the tenth aspect is any one of the first to ninth aspects described above, in which "the display unit displays a third avatar that is displayed in a manner different from the first avatar and the at least one second avatar."

The computer program according to the eleventh aspect is any one of the first to tenth aspects described above, in which "the first condition is that the first data includes data regarding an instruction to have the first avatar sit or be seated in response to a selection of a seat provided in the first virtual venue."

The computer program according to the twelfth aspect is any one of the first to tenth aspects described above, in which "the first condition is that the first data includes data regarding an instruction to cause the first avatar to enter the first virtual venue from an area of the virtual space that is different from the first virtual venue."

The computer program according to the thirteenth aspect is, in any one of the first to twelfth aspects described above, "the determination is performed in a first mode in which the display unit displays the first avatar, and the control data determined when the first condition is satisfied includes data for controlling the display unit of the first terminal to switch from the first mode to a second mode, and in the second mode, at least one second avatar among at least one avatar other than the first avatar and a message included in message data transmitted from a terminal operating the at least one second avatar are displayed on the display unit, and the first avatar is not displayed on the display unit."

The computer program according to the fourteenth aspect is the thirteenth aspect described above, in which "when a first operation is performed on the terminal in the second mode, the second mode is switched to the first mode."

The computer program according to the fifteenth aspect is the computer program according to the fourteenth aspect described above, in which "the first operation is an operation requesting switching from the second mode to the first mode."

The computer program according to the sixteenth aspect is the thirteenth aspect described above, in which "in the first mode, the display unit is controlled based on operation data for moving the first avatar within the first virtual venue."

The computer program according to the seventeenth aspect is a thirteenth aspect dependent on the tenth aspect described above, in which "in the first mode, the display unit is controlled to display a virtual object corresponding to the at least one avatar, and a second display area that displays a message included in message data transmitted from a terminal used by a user who operates the at least one avatar."

The computer program according to the eighteenth aspect is any one of the first to seventeenth aspects described above, in which "the virtual space is a three-dimensional space."

The computer program according to the 19th aspect is the computer program according to any of the above-mentioned 2nd aspect or any of the 3rd to 18th aspects subordinate to the 2nd aspect, in which "the communication line includes the Internet."

The computer program according to the twentieth aspect is any one of the first to nineteenth aspects described above, in which "the at least one processor includes a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU)."

The computer program according to the twenty-first aspect is any one of the first to twentieth aspects described above, in which "the at least one processor is installed in a server, a smartphone, a tablet, a mobile phone, or a personal computer."

The method according to the 22nd aspect is "a method executed by at least one processor, comprising the steps of: acquiring first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal; determining whether a first condition related to the data included in the first data is satisfied; determining, if the first condition is satisfied, control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among the at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar; and controlling the display unit based on the control data."

The method according to the 23rd aspect is "a method executed by at least one processor, and includes the steps of receiving, via a communication line, first data including motion data of a first avatar in a virtual space operated using a first terminal of a first user, determining whether a first condition related to the data included in the first data is satisfied, and, if the first condition is satisfied, determining control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among the at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar, and transmitting the control data to the first terminal."

The method according to the 24th aspect is the method according to the 22nd or 23rd aspect described above, in which "the virtual space is a three-dimensional space."

The method according to the 25th aspect is the above-mentioned 23rd aspect or the 24th aspect dependent on the 23rd aspect, in which "the communication line includes the Internet."

The method according to the 26th aspect is any of the above-mentioned 22nd to 25th aspects, in which "the at least one processor includes a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU)."

The method according to the 27th aspect is any of the above-mentioned 22nd to 26th aspects, in which "the at least one processor is installed in a server, a smartphone, a tablet, a mobile phone, or a personal computer."

The server according to the twenty-eighth aspect "has at least one processor, receives first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal via a communication line, determines whether a first condition related to the data included in the first data is satisfied, and if the first condition is satisfied, determines control data for controlling a display unit of the first terminal to display a first display area for displaying a video in a first virtual venue in the virtual space, at least one second avatar among the at least one avatar other than the first avatar, and a message included in message data transmitted from a terminal operating the at least one second avatar, and transmits the control data to the first terminal."

The server according to the twenty-ninth aspect is the twenty-eighth aspect described above, in which "the virtual space is a three-dimensional space."

The server according to the 30th aspect is the server according to the 28th or 29th aspect described above, where "the communication line includes the Internet."

The server according to the 31st aspect is any of the above-mentioned 28th to 30th aspects, in which "the at least one processor includes a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU)."

In this way, the technology disclosed herein can provide computer programs, methods, and servers that are more interesting than ever before.

2 Communication line 10 Terminal 11 First terminal 12 Second terminal 14, 24 Central processing unit 15, 25 Main memory device 16, 26 Input/output interface 17, 27 Input device 18, 28 Auxiliary memory device 19, 29 Output device 20 Server 21 First server system 21A1 Distribution server 21A2 Server memory device 22 Second server system 30 Communication line 80 Avatar 80A First avatar 80B Second avatar 81B Virtual object 82 Speech bubble 102a First sensor 102b Second sensor 102c Camera 102d Microphone 110 Communication unit 120 Acquisition unit 130 Control unit 140 Display unit 150 User interface unit 160 Memory unit 210 Communication unit 220 Memory unit 230 Control unit 300 Virtual space 310 First virtual venue 311 First display area 1000 System 1400 Computing environment 1410 Processing unit 1420 Memory 1430 Configuration 1440 Storage 1450 Input device 1460 Output device 1470 Communication connection 1480 Software instructions 1490 Computing cloud

Claims (34)

A computer program executed by at least one processor, comprising:
acquiring first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal;
determining whether or not a first condition related to data included in the first data is satisfied in a first mode in which at least the first avatar is displayed on a display unit of the first terminal;
When the first condition is satisfied, determine control data for controlling the display unit so as to display a first display area for displaying a predetermined content in a first virtual venue of the virtual space, a plurality of second avatars other than the first avatar, and a message included in message data transmitted from a terminal operating the plurality of second avatars, in a second mode different from the first mode;
causing the at least one processor to operate to control the display based on the control data;
The plurality of second avatars include
Only avatars of users determined based on a priority order determined in advance before the determination is made or a designation by the first user ,
The first condition is:
the first data includes data regarding an instruction to specify a position of the first avatar in response to the first user selecting a predetermined position provided in the first virtual venue;
the determination is performed in the first mode in which the display unit displays the first avatar,
the control data determined when the first condition is satisfied includes data for controlling a display unit of the first terminal to switch from the first mode to the second mode, and in the second mode, the second avatars and a message included in message data transmitted from a terminal operating the second avatars are displayed on the display unit, and the first avatar is not displayed on the display unit .
Computer program. A computer program executed by at least one processor, comprising:
receiving first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal via a communication line;
In a first mode in which at least the first avatar is displayed on a display unit of the first terminal,
determining whether a first condition is satisfied with respect to data included in the first data;
When the first condition is satisfied, determine control data for controlling the display unit so as to display a first display area for displaying a predetermined content in a first virtual venue of the virtual space, a plurality of second avatars other than the first avatar, and a message included in message data transmitted from a terminal operating the plurality of second avatars, in a second mode different from the first mode;
causing the at least one processor to transmit the control data to the first terminal;
The plurality of second avatars include
Only avatars of users determined based on a priority order determined in advance before the determination is made or a designation by the first user ,
The first condition is:
the first data includes data regarding an instruction to specify a position of the first avatar in response to the first user selecting a predetermined position provided in the first virtual venue;
the determination is performed in the first mode in which the display unit displays the first avatar,
the control data determined when the first condition is satisfied includes data for controlling a display unit of the first terminal to switch from the first mode to the second mode, and in the second mode, the second avatars and a message included in message data transmitted from a terminal operating the second avatars are displayed on the display unit, and the first avatar is not displayed on the display unit .
Computer program. A computer program as described in claim 1 or 2, which displays the message around the first display area, the multiple second avatars, and an avatar operated by the terminal that sent the message data, but without overlapping with the first display area. The predetermined priority order is determined in consideration of commonality between the first user and the second avatar user in at least one of a past group viewing history, a past chat history, user attribute information, and avatar part information.
A computer program according to any one of claims 1 to 3 . At least two of the second avatars among the plurality of second avatars have different shapes and/or colors.
A computer program according to any one of claims 1 to 4 . the display unit displays the message around the first display area, the plurality of second avatars, and an avatar operated by the terminal that transmitted the message data, without overlapping with the first display area, based on a location that is independent of the location in the first virtual venue where the position of the first avatar is specified.
A computer program according to any one of claims 1 to 5 . The display unit is
displaying a message included in message data transmitted from a terminal operating the second avatars, and then hiding the message after a predetermined time has elapsed;
3. A computer program according to claim 2. The display unit is
displaying the second avatars and the first display area so as not to overlap each other;
A computer program according to any one of claims 1 to 7 . The display unit is
displaying the second avatars within a predetermined distance from the location;
7. A computer program according to claim 6 . acquiring part data including part identification information of the plurality of second avatars;
The display unit displays the second avatars determined based on the part identification information on the display unit.
2. The computer program product of claim 1. A first operation is performed on the terminal in the second mode, thereby switching from the second mode to the first mode.
3. A computer program according to claim 1 or 2 . The first operation is
An operation to request switching from the second mode to the first mode.
12. A computer program product as claimed in claim 11. In the first mode, the display unit is controlled based on operation data for moving the first avatar within the first virtual venue.
3. A computer program according to claim 1 or 2 . In the first mode, the display unit is controlled to display a second display area that displays a virtual object corresponding to each of the plurality of second avatars and a message included in message data transmitted from a terminal used by a user who operates each of the plurality of second avatars.
3. A computer program according to claim 1 or 2 . The virtual space is a three-dimensional space.
A computer program according to any one of claims 1 to 14. The communication line includes the Internet.
A computer program according to claim 2 or any one of claims 3 to 15 dependent on claim 2. The at least one processor:
including a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU);
17. A computer program according to any one of claims 1 to 16. The at least one processor is installed in a server, a smartphone, a tablet, a mobile phone, or a personal computer.
18. A computer program according to any one of claims 1 to 17. 1. A method executed by at least one processor, comprising:
acquiring first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal;
In a first mode in which at least the first avatar is displayed on a display unit of the first terminal,
determining whether a first condition is satisfied with respect to data included in the first data;
determining control data for controlling the display unit so that, when the first condition is satisfied, a first display area for displaying a predetermined content in a first virtual venue of the virtual space, a plurality of second avatars other than the first avatar, and a message included in message data transmitted from a terminal for operating the plurality of second avatars are displayed in a second mode different from the first mode;
controlling the display unit based on the control data;
The plurality of second avatars include
Only avatars of users determined based on a priority order determined in advance before the determination is made or a designation by the first user ,
The first condition is:
the first data includes data regarding an instruction to specify a position of the first avatar in response to the first user selecting a predetermined position provided in the first virtual venue;
the determination is performed in the first mode in which the display unit displays the first avatar,
the control data determined when the first condition is satisfied includes data for controlling a display unit of the first terminal to switch from the first mode to the second mode, and in the second mode, the second avatars and a message included in message data transmitted from a terminal operating the second avatars are displayed on the display unit, and the first avatar is not displayed on the display unit .
method. 1. A method executed by at least one processor, comprising:
receiving first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal via a communication line;
In a first mode in which at least the first avatar is displayed on a display unit of the first terminal,
determining whether a first condition is satisfied with respect to data included in the first data;
determining control data for controlling the display unit so that, when the first condition is satisfied, a first display area for displaying a predetermined content in a first virtual venue of the virtual space, a plurality of second avatars other than the first avatar, and a message included in message data transmitted from a terminal for operating the plurality of second avatars are displayed in a second mode different from the first mode;
transmitting the control data to the first terminal;
The plurality of second avatars include
Only avatars of users determined based on a priority order determined in advance before the determination is made or a designation by the first user ,
The first condition is:
the first data includes data regarding an instruction to specify a position of the first avatar in response to the first user selecting a predetermined position provided in the first virtual venue;
the determination is performed in the first mode in which the display unit displays the first avatar,
the control data determined when the first condition is satisfied includes data for controlling a display unit of the first terminal to switch from the first mode to the second mode, and in the second mode, the second avatars and a message included in message data transmitted from a terminal operating the second avatars are displayed on the display unit, and the first avatar is not displayed on the display unit .
method. The predetermined priority order is determined in consideration of commonality between the first user and the second avatar user in at least one of a past group viewing history, a past chat history, user attribute information, and avatar part information.
21. The method according to claim 19 or 20. At least two of the second avatars among the plurality of second avatars have different shapes and/or colors.
22. The method according to any one of claims 19 to 21. the display unit displays the message around the first display area, the plurality of second avatars, and an avatar operated by the terminal that transmitted the message data, without overlapping with the first display area, based on a location that is independent of the location in the first virtual venue where the position of the first avatar is specified.
23. The method according to any one of claims 19 to 22. The virtual space is a three-dimensional space.
24. The method according to any one of claims 19 to 23. The communication line includes the Internet.
25. A method according to claim 20 or any one of claims 21 to 24 dependent thereon. The at least one processor:
including a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU);
26. The method according to any one of claims 19 to 25. The at least one processor is installed in a server, a smartphone, a tablet, a mobile phone, or a personal computer.
27. The method of any one of claims 19 to 26. At least one processor;
receiving first data including motion data of a first avatar in a virtual space operated by a first user using a first terminal via a communication line;
In a first mode in which at least the first avatar is displayed on a display unit of the first terminal,
determining whether a first condition is satisfied with respect to data included in the first data;
When the first condition is satisfied, determine control data for controlling the display unit so as to display a first display area for displaying a predetermined content in a first virtual venue of the virtual space, a plurality of second avatars other than the first avatar, and a message included in message data transmitted from a terminal operating the plurality of second avatars, in a second mode different from the first mode;
Transmitting the control data to the first terminal;
The plurality of second avatars include
Only avatars of users determined based on a priority order determined in advance before the determination is made or a designation by the first user ,
The first condition is:
the first data includes data regarding an instruction to specify a position of the first avatar in response to the first user selecting a predetermined position provided in the first virtual venue;
the determination is performed in the first mode in which the display unit displays the first avatar,
the control data determined when the first condition is satisfied includes data for controlling a display unit of the first terminal to switch from the first mode to the second mode, and in the second mode, the second avatars and a message included in message data transmitted from a terminal operating the second avatars are displayed on the display unit, and the first avatar is not displayed on the display unit .
server. The predetermined priority order is determined in consideration of commonality between the first user and the second avatar user in at least one of a past group viewing history, a past chat history, user attribute information, and avatar part information.
29. The server of claim 28. At least two of the second avatars among the plurality of second avatars have different shapes and/or colors.
30. A server according to claim 28 or claim 29. the display unit displays the message around the first display area, the plurality of second avatars, and an avatar operated by the terminal that transmitted the message data, without overlapping with the first display area, based on a location that is independent of the location in the first virtual venue where the position of the first avatar is specified.
A server according to any one of claims 28 to 30. The virtual space is a three-dimensional space.
A server according to any one of claims 28 to 31. The communication line includes the Internet.
33. A server according to any one of claims 28 to 32. The at least one processor:
including a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU);
A server according to any one of claims 28 to 33.