JP7837522B2 - Computer programs, methods, and server devices - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Act 1. Facts of Publication (1) Date of publication on the website August 19, 2020 Website address https://reality.inc/news/000033/ Publisher Wright Flyer Live Entertainment Co., Ltd. Content of the published invention Wright Flyer Live Entertainment Co., Ltd. published the content of the invention related to the application on the website specified by the above address. (2) Date of publication on the website August 19, 2020 Website address https://reality.inc/news/20200819_01. HTML Publisher: Wright Flyer Live Entertainment Co., Ltd. Content of the disclosed invention: Wright Flyer Live Entertainment Co., Ltd. has published the content of the invention related to the application on the website specified by the above address. (3) Date of publication on the website: August 19, 2020 Website address: https://prtimes.jp/main/html/rd/p/000000151.000021973. HTML Publisher: Wright Flyer Live Entertainment Co., Ltd. Content of the disclosed invention: Wright Flyer Live Entertainment Co., Ltd. has disclosed the content of the invention related to the application on the website specified by the above address.

This disclosure relates to computer programs, methods, and server equipment.

Conventionally, when a user views content executed within a virtual space displayed on a terminal, it is known to display icons corresponding to other users viewing the same content within that virtual space (see Patent Document 1).

Japanese Patent Publication No. 2016-34087

However, in the technology described in Patent Document 1, when a terminal used by a user displays a virtual space, the user's icon is not displayed within that virtual space. Patent Document 1 is incorporated herein by reference in its entirety.

This disclosure provides a computer program, method, and server device that enable proper display of terminals and improve user experience without requiring more complex operations than before.

A computer program according to one embodiment is a computer program executed by at least one processor, which acquires first data relating to an avatar in a virtual space operated using a first terminal of a first user, displays a first display including the avatar on the display unit of the first terminal based on the first data, determines whether a first condition is met based on the first data, and, if it is determined that the first condition is met, controls the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, thereby causing the at least one processor to function in this manner.

A computer program according to one embodiment is a computer program executed by at least one processor, which receives first data relating to an avatar in a virtual space operated using a first terminal of a first user via a communication line, determines first control data to control a display unit to display a first display including the avatar on the display unit of the first terminal based on the first data, transmits the first control data to the first terminal via the communication line, determines whether a first condition is met based on the first data after transmitting the first control data to the first terminal, and if it is determined that the first condition is met, determines second control data to control the display unit to switch the display from the first display to the second display based on a first position in the virtual space where the avatar exists, and transmits the second control data to the first terminal via the communication line, thereby causing the at least one processor to function in this manner.

A method according to one embodiment includes the steps of: acquiring first data relating to an avatar in a virtual space operated using a first terminal of a first user; displaying a first display including the avatar on the display unit of the first terminal based on the first data; determining whether a first condition is met based on the first data; determining first control data to control the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, if the first condition is met; and controlling the display unit based on the first control data.

A method according to one embodiment includes the steps of: receiving first data relating to an avatar in a virtual space operated using a first terminal of a first user via a communication line; determining first control data for controlling a display unit to display a first display including the avatar on the display unit of the first terminal based on the first data; transmitting the first control data to the first terminal via the communication line; determining whether a first condition is met based on the first data after transmitting the first control data to the first terminal; determining first control data for controlling the display unit to switch the display from a first display to a second display based on a first position in the virtual space where the avatar exists, if the first condition is met; and transmitting the second control data to the first terminal via the communication line.

A server device according to one embodiment acquires first data relating to an avatar in a virtual space operated using a first terminal of a first user, displays a first display including the avatar on the display unit of the first terminal based on the first data, determines whether a first condition is met based on the first data, and if it is determined that the first condition is met, determines first control data to control the display unit to switch the display from the first display to the second display based on a first position in the virtual space where the avatar exists, and controls the display unit based on the first control data.

This "Summary of the Invention" section is written to introduce various selected concepts in a simplified form, which will be described later in the "Modes for Carrying Out the Invention" section. All trademarks used herein are the property of their respective owners. The description in this "Summary of the Invention" section is not intended to identify any important or essential features of the invention described in the claims, nor is it intended to limit the technical scope of the invention described in the claims. The above-mentioned or other purposes, features, and effects of the invention described in the claims will become clearer from the description in the "Modes for Carrying Out the Invention" section shown below with reference to the accompanying drawings.

Figure 1 is a block diagram showing an example of the configuration of system 1000 according to one embodiment. Figure 2 is a block diagram showing an example of the configuration of the terminal 10 and server device 20 shown in Figure 1. Figure 3 is a block diagram showing an example of the functions of terminal 10 shown in Figure 1. Figure 4 is a block diagram showing an example of the functions of the server device 20 shown in Figure 1. Figure 5 shows an example of a display shown on the display unit 140 of the terminal 10. Figure 6 shows an example of a display shown on the display unit 140 of the terminal 10. Figure 7 shows an example of a display shown on the display unit 140 of the terminal 10. Figure 8 shows an example of a display shown on the display unit 140 of the terminal 10. Figure 9 shows an example of a display shown on the display unit 140 of the terminal 10. Figure 10 is an example of a flowchart showing the process to be carried out in this embodiment. Figure 11 is an example of a flowchart showing the process to be carried out in this embodiment. Figure 12 shows an example of data transmitted from terminal 10. Figure 13 is a block diagram showing an example of the functions of the terminal 10 and the configuration connected to the terminal 10 shown in Figure 1. Figure 14 is a block diagram of the computing environment 1400.

This specification is described in the sense of representing various typical embodiments, and is not intended to limit it in any way. As used in this application, singular nouns such as “one,” “the said,” “above,” “the said,” “this,” and “it” may include plural nouns unless explicitly indicated otherwise. Furthermore, the term “includes” may mean “equipped with” or “possessed.” In addition, the terms “combined,” “joined,” “linked,” “connected,” or “connected” encompass, along with other methods, of combining, connecting, or linking objects to one another, and do not exclude the existence of intermediate elements between such combined, combined, linked, connected, or connected objects.

The various systems, methods, and apparatus described herein should not be construed as limiting in any way. In practice, this disclosure is directed toward all novel features and aspects of each of the various embodiments disclosed, combinations of these embodiments, and combinations of parts of these embodiments. The various systems, methods, and apparatus described herein are not limited to specific aspects, specific features, or combinations of such specific aspects and features, nor do the things and methods described herein require the existence of one or more specific effects or the resolution of a problem. Furthermore, various features or aspects of the various embodiments described herein, or parts of such features or aspects, may be used in combination with each other.

While the operation of some of the various methods disclosed herein is described in a specific order for convenience, this method of description should be understood to include the possibility of rearranging the order of the operations unless a specific order is required by the following specific sentences. For example, multiple operations described in order may, in some cases, be rearranged or performed simultaneously. Furthermore, for the sake of simplification, the accompanying drawings do not show various ways in which the various matters and methods described herein may be used in conjunction with other matters and methods. In addition, this specification may use terms such as “generate,” “generate,” “display,” “receive,” “evaluate,” and “deliver.” These terms are high-level descriptions of the various actual operations performed. The various actual operations corresponding to these terms may vary depending on the specific implementation and will be readily apparent to those skilled in the art who have an interest in the disclosure herein.

Any operating theories, scientific principles, or other theoretical descriptions presented herein in connection with the apparatus or method of this disclosure are provided for the purpose of better understanding and are not intended to limit the technical scope. The apparatus and method in the appended claims are not limited to those operating in the manner described by such operating theories.

Any of the various methods disclosed herein can be implemented using a plurality of computer-executable instructions stored on one or more computer-readable media (for example, one or more optical disks, a plurality of volatile memory components, or a plurality of non-volatile memory components, which are non-temporary computer-readable storage media), and can be executed on a computer. Here, the plurality of volatile memory components include, for example, DRAM or SRAM. The plurality of non-volatile memory components include, for example, hard drives and solid-state drives (SSDs). Furthermore, the computer includes any computer available on the market, for example, smartphones and other mobile devices having computing hardware.
Any of the multiple computer-executable instructions for implementing the technologies disclosed herein, together with any data generated and used during implementations of the various embodiments disclosed herein, may be stored in one or more computer-readable media (e.g., non-temporary computer-readable storage media). Such multiple computer-executable instructions may, for example, be part of a separate software application, or part of a software application accessed or downloaded via a web browser or other software application (such as a remote computing application). Such software may be executed, for example, on a single local computer (as an agent running on any suitable computer available on the market), or in a network environment (e.g., the Internet, a wide area network, a local area network, a client-server network (such as a cloud computing network), or other such network) using one or more network computers.

For clarity, only specific selected aspects of various software-based implementations are described. Other details well known in the art are omitted. For example, the technology disclosed herein is not limited to any particular computer language or program. For example, the technology disclosed herein may be executed by software written in C, C++, Java, or any other suitable programming language. Similarly, the technology disclosed herein is not limited to any particular computer or type of hardware. Specific details of suitable computers and hardware are well known and do not need to be described in detail herein.

Furthermore, any of the various embodiments based on such software (for example, including a number of computer-executable instructions for causing a computer to perform any of the various methods disclosed herein) may be uploaded, downloaded, or accessed remotely by preferred communication means. Such preferred communication means include, for example, the Internet, the World Wide Web, intranets, software applications, cables (including fiber optic cables), magnetic communications, electromagnetic communications (including RF communications, microwave communications, and infrared communications), electronic communications, or other such communication means.

The following describes various embodiments of the present invention with reference to the attached drawings. Note that common components are denoted by the same reference numerals in the drawings. Also, please note that components shown in one drawing may be omitted in another for the sake of clarity. Furthermore, please note that the attached drawings are not necessarily drawn to an exact scale.

1. Configuration of System 1000 Figure 1 is a block diagram showing an example of the configuration of System 1000 according to one embodiment. As shown in Figure 1, System 1000 includes, for example, a plurality of terminals 10 connected to a communication line (communication network) (not shown), and one or more server devices 20 connected to the communication line. The terminals 10 include a first terminal 11. The terminals 10 may further include a second terminal 12. The server devices 20 include, for example, a first server system 21 and a second server system 22.

Communication lines may include, but are not limited to, mobile phone networks, wireless networks (e.g., Bluetooth, Wi-Fi (such as IEEE 802.11a/b/n), WiMax, cellular, satellite, laser, infrared, RF connections), fixed telephone networks, the Internet, intranets, local area networks (LANs), wide area networks (WANs), and/or Ethernet networks.

1-1. Terminal 10
Terminal 10 is connected to one or more server devices 20, for example, via a communication line. Terminal 10 is, for example, a smartphone, a tablet device, and/or a personal computer. Terminal 10 is configured to run a predetermined application, for example, by installing a predetermined application on it. Terminal 10 can also receive web pages (for example, HTML documents, in some examples, HTML documents encoded with executable code such as JavaScript or PHP code) from the server device 20 (second server system 22).

Hereafter, the user operating terminal 10 will be simply referred to as "user," and the user operating the first terminal 11 will be referred to as "first user." Figure 1 shows an example where, for example, the first terminal 11 is provided as part of multiple terminals 10, but it is not limited to this. Multiple terminals 10 may include, for example, two or more terminals. Furthermore, in the following description, the first terminal 11 may be referred to as terminal 10.

1-2. Server device 20
The first server system 21 includes a distribution server device 21A1 and a server storage device 21A2. The distribution server device 21A1 receives data from terminal 10 that is requested for an application to be executed on terminal 10. The distribution server device 21A1 also transmits data to terminal 10 that is used in the application to be executed on terminal 10, in response to the request. The server storage device 21A2 stores data that is transmitted from the distribution server device 21A1 to terminal 10. The server storage device 21A2 also stores data that the distribution server device 21A1 has received from terminal 10. The first server system 21 also transmits data to terminal 10 that is used in an application executed by terminal 10. The first server system 21 also transmits data that has been received from terminal 10 to device 70.

The example described shows terminal 10 executing an application, but it is not limited to this. For example, a web browser installed on terminal 10 may be used to perform processing equivalent to executing the application. In this case, where a web browser installed on terminal 10 is used, the server device 20 may include a web server (not shown). If the server device 20 includes a web server (not shown), the web server transmits data related to an HTML document such as HTML5, terminal 10 displays the data related to the HTML document using the web browser, user instruction data is sent to terminal 10 (the web browser), and the server device 20 performs display control. By performing this display control, the server device 20 generates display data and transmits this display data to terminal 10 (the web browser). Note that the web browser may use a script such as JavaScript (registered trademark) to perform display control.

Furthermore, while Figure 1 illustrates an example where the first server system 21 includes a distribution server device 21A1 and a server storage device 21A2, the system is not limited to this. For example, the first server system 21 may include other components in addition to the distribution server device 21A1 and the server storage device 21A2. In this case, the other components may have at least one of the functions of the distribution server device 21A1 and the server storage device 21A2. Alternatively, for example, the first server system 21 may be configured as a single unit possessing the functions of both the distribution server device 21A1 and the server storage device 21A2.

The second server system 22 is a server that transmits content-related data to the terminal 10. Here, for example, we assume a scenario where a user operates the terminal 10 to run an application. In this case, if the second server system 22 receives a request for content-related data from the terminal 10 while the application is running, the second server system 22 transmits the content-related data to the terminal 10. The content-related data transmitted from the second server system 22 to the terminal 10 is, for example, video-related data.

1-3. equipment 70
Device 70 (third terminal) is, for example, a terminal operated by the operator or organization that manages the virtual venue. Device 70 transmits predetermined data to the first server system 21 and receives predetermined data transmitted from the first server system 21. The specific configuration of device 70 will be described later.

2. Hardware Configuration of Each Device Next, an example of the hardware configuration of each of the terminal 10 and the server device 20 will be described.

2-1. Hardware Configuration of Terminal 10 An example of the hardware configuration of each terminal 10 will be described with reference to Figure 2. Figure 2 is a block diagram showing an example of the hardware configuration of terminal 10 (server device 20) shown in Figure 1. In Figure 2, the reference numerals in parentheses are related to the server device 20, as will be described later.

As shown in Figure 2, each terminal 10 includes, for example, a central processing unit 14, a main memory 15, an input/output interface device 16, an input device 17, an auxiliary storage device 18, and an output device 19. The components shown in Figure 2 are connected by a data bus and/or a control bus.

The central processing unit 14, also known as the "CPU," performs calculations on the instructions and data stored in the main memory 15 and stores the results of those calculations back in the main memory 15. Furthermore, the central processing unit 14 can control the input device 17, auxiliary storage device 18, output device 19, etc., via the input/output interface device 16. The terminal 10 may include one or more such central processing units 14.

The main memory 15, also known as "memory," stores instructions and data received via the input/output interface device 16 from the input device 17, auxiliary storage device 18, and communication line 30 (server device 20, etc.), as well as the calculation results of the central processing unit 14. The main memory 15 may include, but are not limited to, computer-readable media such as volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), EEPROM, flash memory), and storage (e.g., hard disk drive (HDD), solid state drive (SSD), magnetic tape, optical media). For ease of understanding, the term "computer-readable recording medium" may include data storage media such as memory and storage, rather than transmission media such as modulated data signals, i.e., temporary signals.

The input device 17 is a device that acquires data from an external source and includes, but is not limited to, a touch panel, buttons, a keyboard, a mouse, and/or sensors. The sensors may include, but are not limited to, one or more cameras and/or one or more microphones, as described later.

The auxiliary storage device 18 is a storage device with a larger capacity than the main memory device 15. It can store instructions and data (computer programs) that constitute the specific applications mentioned above (video distribution applications, video viewing applications, etc.) and web browser applications. Furthermore, the auxiliary storage device 18, controlled by the central processing unit 14, can transmit these instructions and data (computer programs) to the main memory device 15 via the input/output interface device 16. The auxiliary storage device 18 may include, but is not limited to, magnetic disk drives and/or optical disk drives.

The output device 19 may include, but is not limited to, a display device, a touch panel, and/or a printer device.

In this hardware configuration, the central processing unit 14 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 18 into the main memory device 15. By performing calculations on the loaded instructions and data, it controls the output device 19 via the input/output interface device 16, or it can send and receive various types of data with other devices (e.g., a server device 20, another terminal 10) via the input/output interface device 16 and the communication line 2.

2-2. Hardware Configuration of Server Device 20 An example of the hardware configuration of each server device 20 will be described with reference to Figure 2. For each server device 20 (distribution server device 21A1 and server storage device 21A2), it is possible to use the same hardware configuration as the hardware configuration of each terminal 10 described above. Therefore, the reference numerals for the components of each server device 20 are shown in parentheses in Figure 2.

As shown in Figure 2, each server device 20 mainly includes a central processing unit 24, main memory 25, input/output interface device 26, input device 27, auxiliary storage device 28, and output device 29. These devices are connected to each other by a data bus and/or control bus.

The central processing unit 24, main memory 25, input/output interface device 26, input device 27, auxiliary storage device 28, and output device 29 can be substantially identical to the central processing unit 14, main memory 15, input/output interface device 16, input device 17, auxiliary storage device 18, and output device 19 included in each of the terminals 10 described above.

In this hardware configuration, the central processing unit 24 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 28 into the main memory device 25. By performing calculations on the loaded instructions and data, it can control the output device 29 via the input/output interface device 26, or it can send and receive various types of data with other devices (e.g., each terminal 10) via the input/output interface device 26 and the communication line 2.

Furthermore, the server device 20 may include one or more microprocessors and/or graphics processing units (GPUs) in place of, or together with, the central processing unit 24.

3. Functions of Each Device Next, examples of the functions of terminal 10 and server device 20 will be explained using Figures 3 and 4, respectively.

3-1. Functions of Terminal 10 Figure 3 is a block diagram showing an example of the functions of terminal 10 shown in Figure 1. As shown in Figure 3, terminal 10 includes, for example, a communication unit 110, an acquisition unit 120, a control unit 130, a display unit 140, a user interface unit 150, and a storage unit 160.

(1) Communications section 110
The communication unit 110 is used, for example, to transmit various data to the server device 20. The communication unit 210 is used, for example, to receive various data from the server device 20. The data received by the communication unit 210 is sent, for example, to the control unit 130.

(2) Acquisition unit 120
The acquisition unit 120 acquires, for example, operation data related to operations from the user. The acquisition unit 120 also acquires, for example, data detected by various sensors. The data acquired by the acquisition unit 120 is sent, for example, to the control unit 130. The acquisition unit 120 performs, for example, the processing shown in S121 of Figure 10 and S121 of Figure 11, which will be described later. For example, the operation data may include one or more of the following data.
Data showing how the streamer swiped the touchpad display; data showing which parts of the touchpad display the streamer touched; data showing which objects the streamer tapped or clicked; data showing how the streamer dragged the touchpad display; and other similar operation data.

Furthermore, the data acquired by the acquisition unit 120 may be data related to non-operation (data indicating that no operation was performed), for example, data indicating that the terminal 10 was not operated during a specific time (specific period), and/or data indicating that a specific location within the virtual space 300 was not entered.

(3) Control unit 130
The control unit 130 performs various controls based on data received by the communication unit 110, for example. The control unit 130 also performs various controls based on data acquired by the acquisition unit 120. The control unit 130 performs, for example, the processes shown in S125 and S141 of Figure 10 and S125 and S141 of Figure 11, which will be described later.

(4) Display section 140
The display unit 140 displays content based on control data output from the control unit 130, for example. The display unit 140 displays, for example, a screen for selecting a predetermined application. The display unit 140 also displays a screen related to the virtual space when a predetermined application is selected and executed.

(5) User interface unit 150
The user interface unit 150 is for inputting various data used to execute the application through user operations.

(6) Storage unit 160
The storage unit 160 can store various data used to execute the application. The storage unit 160 stores data used to control the display unit 140. For example, the storage unit 160 stores module data used to generate the first user's avatar. However, the storage unit 160 is not limited to storing module data used to generate the first user's avatar, but may also store module data used to generate other avatars.

Module data, for example, is data related to the parts used to generate an avatar. Here, the parts for generating an avatar include data for each part of the avatar (eyes, nose, mouth, eyebrows, skin color, hairstyle, hair color, clothing, body, etc.). The module data also includes data related to the ID assigned to each part used to generate the avatar. If the avatar part is the body, the data related to the parts for generating the avatar may include detailed data regarding body type, such as thin, slightly thin, standard, slightly overweight, overweight, etc.

Furthermore, when the display unit 140 displays an avatar 80 other than avatar 80A (another person's avatar), the server device 20 may transmit ID data used to generate the avatar 80 other than avatar 80A to the first terminal 11, and the first terminal 11 may construct the avatar 80 other than avatar 80A based on that ID data.

Furthermore, when the display unit 140 displays avatars 80 other than avatar 80A (another person's avatar), the display unit 140 may display avatars 80 other than avatar 80A in black, or it may display avatars 80 other than avatar 80A using parts and/or colors determined based on the gender of the user corresponding to the avatar 80 other than avatar 80A (e.g., male or female), offering a choice between male or female avatars 80 other than avatar 80A.

3-2. Functions of the Server Device 20 Figure 4 is a block diagram showing an example of the functions of the server device 20 shown in Figure 1. As shown in Figure 4, the server device 20 includes, for example, a communication unit 210, a storage unit 220, and a control unit 230.

(1) Communications Department 210
The communication unit 210 is used, for example, to transmit various data to the terminal 10. The communication unit 210 is also used, for example, to receive various data from the terminal 10. The data received by the communication unit 210 is sent to the control unit 230.

(2) Storage unit 220
The memory unit 220 stores various data used for the execution of the application. For example, the memory unit 220 stores first data transmitted from the first terminal 11. The first data transmitted from the first terminal 11 includes, for example, data relating to the avatar 80A. The first data may also include data relating to "behavior history". Details of the first data transmitted from the first terminal 11 and the data relating to "behavior history" will be described later.

(3) Control unit 230
The control unit 230 performs various controls based on the data received by the communication unit 210, for example. The control unit 230 performs the processes shown in S183, S193 in Figure 10, S131 in Figure 11, S183 in Figure 11, and S193 in Figure 11, which will be described later.

Figure 5 shows an example of the display shown on the display unit 140 of the first terminal 11 when the application is launched by operating the first terminal 11. As shown in Figure 5, the display unit 140 displays a virtual space 300. The virtual space 300 is, for example, a three-dimensional space. Within the virtual space 300, an avatar 80 and a virtual venue 310 are shown.

The avatar 80 is configured to perform at least one of the following actions through user input: walking, running, and jumping. Furthermore, the avatar 80 is configured to allow the user to, for example, examine virtual objects, push virtual objects, pull virtual objects, lift virtual objects, sit on virtual objects, purchase virtual objects, and give items to virtual objects. Here, virtual objects include, for example, avatars, doors, food items, admission tickets, chairs, and exhibits. When a user operates the avatar 80 using the terminal 10, data related to that operation is transmitted to the server device 20.

The operation described above, "examining a virtual object," displays a description of the virtual object on the display unit 140. The description of the virtual object includes, for example, at least one of the following: the name of the virtual object, its purpose, and its price. The description of the virtual object may include, for example, text, images, and videos.

The operations described above—"pushing the virtual object," "pulling the virtual object," and "lifting the virtual object"—can be used to change the position of the virtual object within the virtual space 300.

The operation described above, "taking a seat on a virtual object," causes avatar 80 to take a seat on the virtual object. Note that avatar 80 may be configured to take a seat on a specific location other than the virtual object. Furthermore, when avatar 80 takes a seat on the virtual object, or when avatar 80 takes a seat on a specific location other than the virtual object, the display unit 140 may display a different display screen than the one displayed before avatar 80 took a seat (for example, a display screen without the UI operation unit or chat screen), or it may hide the user interface that existed before avatar 80 took a seat. When the display unit 140 displays a different display screen than the one displayed before avatar 80 took a seat, the display unit 140 may display the target screen in full screen.

The above-mentioned "Purchase Virtual Object" operation allows you to purchase, for example, the virtual object in question. If the virtual object is wearable, Avatar 80 can change its appearance by wearing the purchased virtual object.

Furthermore, among the avatars displayed on the display unit 140, avatars 80 other than the avatar 80 being operated may be avatars operated by the user, or they may be avatars whose actions within the virtual space 300 are predetermined. Here, if an avatar 80's actions within the virtual space 300 are predetermined, it means that the avatar 80 operates as an NPC (Non-Player Character).

Furthermore, while the appearance of all avatars 80 shown in Figure 5 is identical, it is not limited to this. The appearance of the avatar 80 may be determined based on data concerning the user operating the avatar 80 or data concerning the ID associated with the parts of the avatar 80 selected by the user. For example, if the user operating the avatar 80 is male, the appearance of the avatar 80 may be male. Similarly, if the user operating the avatar 80 is female, the appearance of the avatar 80 may be female.

Furthermore, the actions of the avatar in the virtual space may change in conjunction with the user's actions. For example, if the user nods, the avatar in the virtual space may also nod. Here, the motion data can be acquired, for example, using a motion capture system. As will be readily understood by those skilled in the art who benefit from this disclosure, some examples of suitable motion capture systems that may be used with the apparatus and methods disclosed in this application include optical motion capture systems using passive or active markers, or without markers, and inertial and magnetic non-optical systems. The motion data can be acquired using an image capture device (such as a CCD (charge-coupled device) or CMOS (complementary metal-oxide-semiconductor) image sensor) coupled to a computer that converts the motion data into video or other image data.

When operating the avatar 80A shown in Figure 5, for example, the display unit 140 displays a screen like that shown in Figure 6.

Figure 6 shows an example of a display shown on the display unit 140 of terminal 10. Specifically, Figure 6 shows an example of a display shown on the display unit 140 of the first terminal 11 when the first user operates the avatar 80A using the first terminal 11. As shown in Figure 6, for example, the display unit 140 displays the avatar 80, the avatar 80A, and the virtual venue 310. Here, the display unit 140 displays the back of the avatar 80A, and the line of sight of the first user operating the first terminal 11 and the line of sight of the avatar 80A corresponding to the first user are in the same direction. The display unit 140 displays the area in the virtual space including the avatar 80A, based on a virtual viewpoint located in front of the page of Figure 6 relative to the avatar 80A. The display unit 140 displays the area in the virtual space that includes the direction of movement of the avatar 80A. Note that the area in the virtual space displayed by the display unit 140 can be changed by operating the avatar 80A using terminal 10. For example, by changing the direction of movement of the avatar 80A by 180 degrees using terminal 10, the area behind the avatar 80A in Figure 6 can be displayed. In this way, by operating the avatar 80A using terminal 10, the display unit 140 can display areas not shown in Figure 6. When a user operating the first terminal 11 operates the avatar 80A and the avatar 80A shown in Figure 6 is positioned inside the virtual venue 310, a display screen like that shown in Figure 7 will be displayed.

In Figure 6, when the first user operates the avatar 80A, the first terminal 11 acquires data, for example, regarding the avatar 80A's position within the virtual space 300. Furthermore, the data acquired by the first terminal 11 regarding the avatar 80A's position within the virtual space 300 is transmitted to the server device 20. The timing at which the first terminal 11 acquires the data regarding the avatar 80A's position within the virtual space 300 can be arbitrary. Similarly, the timing at which the data acquired by the first terminal 11 is transmitted to the server device 20 can also be arbitrary.

Furthermore, any area of the display unit 140 of the first terminal 11 may be accessible via touch. Additionally, the first terminal 11 may be equipped with an acceleration sensor (not shown), and when the first terminal 11 is operated, the display area and/or direction of the display unit 140 may be changed based on the acceleration sensor.

Here, the "arbitrary area" mentioned above includes, for example, the icon 301 (area 301) and/or display area 314 in Figure 6. The icon 301 and/or display area 314 are user interfaces for performing predetermined display controls through touch operations. Furthermore, "touch operation" refers to at least one of the following operations: tap, double tap, swipe, flick, pinch in, and pinch out. The icon 301 and/or display area 314 may be displayed in the same or different positions not only when displaying Figure 6, but also when displaying other drawings described later (for example, at least one of Figures 7 to 9).

Furthermore, as shown in Figure 6, there may be two icons 301, or one or more icons 301 may be provided. In the case where there are two or more icons 301, one icon 301 may correspond to an area used to make the avatar 80A walk, and another icon 301 may correspond to an area used to make the avatar 80A jump. In this way, the avatar 80A can be made to walk or jump by touching the icons 301.

Here, the touch operation to make the avatar 80A walk or jump is, for example, tapping or double-tapping the icon 301 of the avatar 80A. Furthermore, the area where the touch operation to make the avatar 80A walk or jump is performed may be an area other than the icon 301.

The display area 314 is an area that displays messages entered by the user corresponding to the avatar 80. When the display unit 140 displays the display area 314, at least one of the following messages is displayed: messages sent from the first terminal 11, and messages sent from terminals other than the first terminal. Here, the messages displayed in the display area 314 may be messages addressed to the first terminal, or messages exchanged between terminals other than the first terminal. Therefore, the display area 314 functions as an area viewable and/or chattable by a user corresponding to at least one avatar 80 existing in the virtual space 300, or an area viewable and/or chattable by a user corresponding to at least one avatar 80 existing in a specific location within the virtual space 300.

In this way, the first terminal 11 allows the first user to chat with a user corresponding to at least one of the avatars 80 from among all the avatars 80 via the display area 314 of the display unit 140. For example, the first terminal 11 allows the first user to chat with users corresponding to all avatars 80 present within a predetermined area (the same area) via the display area 314 of the display unit 140. Here, the users chatting with the first user are individual users or exhibiting companies. Furthermore, when displaying multiple messages in the display area 314, if it is not possible to display all messages within the display area 314, the messages not displayed within the display area 314 can be displayed by performing a touch operation. Here, the touch operation when it is not possible to display all messages within the display area 314 is, for example, a swipe.

Furthermore, the conditions under which the display area 314 is displayed on the display unit 140 are not limited to when the avatar 80 is located within the virtual venue 310. For example, if the avatar 80 is located within a predetermined area in the virtual space 300, the display area corresponding to that predetermined area may be displayed on the display unit 140. In other words, the display area to be displayed on the display unit 140 may be determined according to the location of the avatar 80. This allows the user to exchange messages with users corresponding to other avatars 80 located in the same area as their own avatar 80. Additionally, the user can chat with users who share specific attributes. Therefore, the user can easily communicate with other users who share common interests, concerns, and/or attributes.

Furthermore, the terminal from which the message displayed in the display area 314 originates is, for example, a terminal used by a user operating an avatar located within the virtual venue 310. However, the avatar corresponding to the terminal from which the message displayed in the display area 314 originates may or may not be displayed in the virtual venue 310.

Furthermore, the display area 314 may display purchasable products. These products, for example, are related to the operator or organization managing the virtual venue 310. The display area 314 may also display information about the products and content encouraging their purchase. Here, the content encouraging purchase is a selectable option such as "Add to Cart."

Furthermore, when a user uses terminal 10 to proceed with the purchase procedure for at least one product displayed in the display area 314, for example, a browser installed on terminal 10 is launched, and a page requesting input for purchasing that product is displayed on the display unit 140.

Furthermore, for example, as shown in Figure 6, when point 321 is tapped or double-tapped, the display unit 140 displays a line segment 322 connecting the avatar 80A and point 321, and the avatar 80A walks along the line segment 322 to point 321. Note that point 321 and line segment 322 may be any color. The touch operation to make the avatar 80A walk involves changing the direction of movement by flicking any area of the avatar 80A, and then tapping or double-tapping any point on the virtual straight line of the changed direction of movement.

Furthermore, as shown in Figure 6, for example, the display unit 140 may display an icon 323. The icon 323 is used to switch the display of the display area 314 between visible and hidden states when operated. When the display area 314 is displayed by operating the icon 323, the display unit 140 may choose not to display the icon 323, or it may continue to display the icon 323.

Figure 7 shows an example of a display screen in the virtual venue 310 displayed on the display unit 140 of terminal 10. In Figure 7, a user operating the first terminal 11 operates an avatar 80A, and when the avatar 80A shown in Figure 6 is located inside the virtual venue 310, the scene changes, and the display screen changes as a result. Note that the URL when displaying the screen when the avatar 80A is outside the virtual venue 310 (for example, Figure 6) using the web browser of the first terminal 11 is different from the URL when displaying the screen when the avatar 80A is inside the virtual venue 310 (for example, Figure 7) using the web browser of the first terminal 11. Therefore, when using the web browser of the first terminal 11, the URL will change when the avatar 80A shown in Figure 6 is located inside the virtual venue 310. As shown in Figure 7, avatars 80 and 80A, a chair 81, display area 311, display area 312, avatar 313, and a slider 330 are shown. Note that the slider 330 is not a mandatory component. Here, the virtual venue 310 is, for example, a booth at an exhibition or event venue. At least one chair 81 is provided. Avatars 80 and 80A are assumed to be located in the first area within the virtual venue 310.

Chair 81 is, for example, a virtual object on which avatar 80 can sit. For example, when a user operates avatar 80A to approach a specific chair among several chairs 81 and performs a predetermined operation, avatar 80 sits on chair 81. Alternatively, when a user operates avatar 80A to approach a specific chair among several chairs 81 and performs a predetermined operation, a message asking whether to sit on the specific chair is displayed on the display screen of the first terminal 11. When a message asking whether to sit on the specific chair is displayed on the display screen of the first terminal 11, and the user operates terminal 10 to perform a predetermined operation indicating their intention to sit on the specific chair in response to the message, avatar 80 sits on chair 81. In addition, a configuration may be adopted in which avatar 80 is seated when a specific location in the virtual space 300 is specified, either together with a seatable virtual object or in place of a seatable virtual object. In this case, when a user approaches a specific location in the virtual space 300 and performs a predetermined operation, a message asking whether to sit on the specific location may be displayed on the display screen of the first terminal 11. When a message asking whether the user wishes to sit in a specific location is displayed on the display screen of the first terminal 11, the avatar 80 may be configured to sit in that specific location if the user operates terminal 10 to perform a predetermined operation indicating their intention to sit in that location in response to the message.

Display area 311 displays, for example, explanatory materials and/or videos. Display area 312 displays the name of the organization operating the virtual venue 310, the theme of the briefing session, etc. Avatar 313 is, for example, an avatar modeled after the staff running the virtual venue 310. Avatar 313 may be an avatar operated by the user, or it may be an avatar whose actions within the virtual space 300 are predetermined. Here, if avatar 80 operates according to predetermined actions within the virtual space 300, it means that the avatar operates as an NPC as described above.

In the virtual venue 310, at a predetermined time, for example, a predetermined explanation begins. Here, the time used in the virtual space may be a time synchronized to match the real-world time, or it may be a time used separately within the virtual space 300. Note that the conditions for the predetermined explanation to begin in the virtual venue 310 do not necessarily relate to time. For example, the conditions for the predetermined explanation to begin in the virtual venue 310 may include, for instance, when the number of avatars present in the virtual venue 310 exceeds a predetermined number, or when a specific avatar is located within the virtual venue 310.

Furthermore, the system may be configured to allow multiple avatars to occupy the same seat simultaneously. For example, if avatar 80 is seated in the left-hand chair 81 in Figure 7, the user can use terminal 10 to operate avatar 80A and seat avatar 80A in the left-hand chair 81 in Figure 7. In this way, even if the total number of avatars located within the virtual venue 310 exceeds the total number of chairs 81, all avatars viewing the content displayed in the display area 311 can be seated within the virtual venue 310.

A predetermined explanation, which begins at a predetermined time, is provided by displaying predetermined content in the display area 311 and/or outputting audio. This explanation is, for example, a video. The video may be, for example, a predetermined explanatory video, a video of an event such as a concert, a video such as a movie, or a video reflecting the real-time movements and/or performance of a VTuber. If the explanation is a video, the terminal 10 requests video-related data from the second server system 22. The second server system 22 then responds to this request by transmitting video-related data to the terminal 10. As a result, the terminal 10 can receive video-related data from the second server system 22 and view the video.

In Figure 7, when the avatar 80A satisfies a predetermined condition (the first condition), the display unit 140 displays Figure 8 or Figure 9 instead of Figure 7. As a result, the display unit 140 displays a first-person perspective (FPS) view instead of a third-person perspective (TPS) view. In other words, the display unit 140 displays a view that does not include the avatar 80A instead of a view that includes the avatar 80A.

Here, the "first condition" mentioned above refers, for example, to the first data including operation data for selecting a part of a region including the first position, the first data including operation data for selecting an object to be displayed on the display unit 140, or the first data including data indicating that the avatar 80A is located within the first region. For example, if the first region is a predetermined region within the virtual venue 310, the "data indicating that the avatar 80A is located within the first region" mentioned above is data indicating that the position of the avatar 80A within the virtual venue 310 is located within that predetermined region.

Specifically, the "first condition" refers to, for example, being located at a predetermined position or in a predetermined area within the virtual venue 310. Here, the "predetermined area" refers to, for example, an area within a predetermined distance from the display area 311 within the virtual venue 310. Furthermore, the "first condition" may also refer to, for example, specifying the display area 311. Alternatively, the "first condition" may refer to, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81. Alternatively, the "first condition" may refer to, for example, being located at a predetermined position or in a predetermined area within the virtual venue 310 AND specifying the display area 311. Furthermore, the "first condition" may refer to, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81 AND specifying the display area 311.

As shown in Figure 8, the display unit 140 displays an enlarged portion of the virtual venue 310 shown in Figure 7. The display unit 140 may enlarge and display the display area 311 shown in Figure 7, or it may enlarge and display objects other than the display area 311 shown in Figure 7. Furthermore, in Figure 8, the display unit 140 does not display, for example, the avatar 80A. Also, in Figure 8, the icon 301 may or may not be displayed. Also, in Figure 8, the display area 314 may or may not be displayed. Also, in Figure 8, the icon 323 may or may not be displayed. Also, in Figure 8, the slider 330 may or may not be displayed.

As shown in Figure 9, the display unit 140 displays an enlarged portion of the virtual venue 310 shown in Figure 7. Specifically, the display unit 140 displays the display area 311 over approximately the entire display screen.

Furthermore, the display unit 140 displays, for example, an icon 301 (area 301). Icon 301 is an icon for switching from the screen shown in Figure 9 to another screen. Here, "another screen" refers to, for example, any of the screens shown in Figures 6 to 8. Icon 301 is, for example, identical to the icon 301 shown in Figure 6. The functions assigned to icon 301 in Figure 6 and icon 301 in Figure 9 are configured to differ, for example, depending on the screen displayed by the display unit 140.

For example, when the display unit 140 displays icon 301 on a third-person view (TPS) screen as shown in Figure 6 or Figure 7, operating icon 301 will cause the avatar 80A to walk or jump, as described above. Alternatively, when the display unit 140 displays icon 301 on a first-person view (FPS) screen as shown in Figure 9, operating icon 324 will cause the avatar 80A to leave its seat. Here, causing the avatar 80A to leave its seat means that the display unit 140 switches from the first-person view (FPS) shown in Figure 9 to displaying information related to the third-person view (TPS) shown in Figure 6 or Figure 7. Furthermore, when the display unit 140 displays icon 301 on a screen like the one shown in Figure 9, operating icon 324 may switch to a display screen like the one shown in Figure 8.

Furthermore, the display unit 140 may enlarge and display the display area 311 shown in Figure 7, or it may enlarge and display objects other than the display area 311 shown in Figure 7. Therefore, the magnification ratio of the display area 311 in Figure 9 is greater than the magnification ratio of the display area 311 in Figure 8. Also, in Figure 9, the display unit 140 does not display, for example, the avatar 80A. Also, in Figure 9, area 301 may or may not be displayed. Also, in Figure 9, display area 314 may or may not be displayed. Also, in Figure 9, icon 323 may or may not be displayed. Also, in Figure 9, slider 330 may or may not be displayed.

Here, by displaying the display area 314 in Figure 8 and/or Figure 9, users can communicate with other users through the display area 314 while viewing the content displayed in the display area 311. If the content of the other user's message displayed in the display area 314 relates to the content displayed in the display area 311, the first user can exchange messages with that user, giving the first user the feeling that they are viewing the content displayed in the display area 314 together with the other user, even if the first user is physically separated from the other user.

On the other hand, by hiding the display area 314 in Figure 8 and/or Figure 9, the first user can concentrate more on viewing the content displayed in the display area 311. Furthermore, by hiding the display area 314 in Figure 8, in cases where a message displayed in the display area 314 may contain information related to the content in the display area 311, the first user can reduce the possibility of unintentionally grasping information related to that content through the display area 314 before viewing the content.

Furthermore, by displaying the icon 323 in Figure 8 and/or Figure 9, the display and hiding of the display area 314 can be switched on and off without requiring complex operations while viewing content displayed in the display area 311. Also, by displaying the icon 323 in Figure 8 and/or Figure 9, before starting to view content displayed in the display area 311 or after finishing viewing, the first user can operate the icon 323 to display the display area 314 and communicate with other users, and while viewing content displayed in the display area 311, the first user can operate the icon 323 to hide the display area 314 and view the content displayed in the display area 311. Here, when the first user hides the display area 314 by operating the icon 323 and views the content displayed in the display area 311, as described above, the first user can concentrate more on viewing the content displayed in the display area 311. Furthermore, when the display area 314 is hidden by operating icon 323 and the first user views the content displayed in display area 311, as described above, if the message displayed in display area 314 may contain information related to the content in display area 311, the possibility of the first user unintentionally understanding the content through display area 314 before viewing the content can be reduced.

On the other hand, by hiding the icon 323 in Figure 8, when the display area 311 is enlarged by performing an operation such as pinch-in on the display unit 140 after displaying Figure 8, the possibility of the icon 323 overlapping with a part of the display area 311 can be reduced. Therefore, for example, when the first user is viewing content displayed in the display area 311 and enlarges the display area 311, and text appears in a part of the display area 311, the possibility of the text becoming illegible due to overlapping with the display position of the icon 323 can be reduced. Similarly, by hiding the icon 323 in Figure 9, the possibility of the icon 323 overlapping with a part of the display area 311 can be reduced. Therefore, for example, when the first user is viewing content displayed in the display area 311 and text appears in a part of the display area 311, the possibility of the text becoming illegible due to overlapping with the display position of the icon 323 can be reduced.

Furthermore, by displaying the slider 330 in Figure 8 and/or Figure 9, the magnification of the display area 311 can be intuitively adjusted. Therefore, for example, if the magnification of the display area 311 when transitioning from Figure 7 to Figure 8 or Figure 9 is predetermined, the first user can intuitively adjust it to the desired magnification.

On the other hand, by hiding the slider 330 in Figure 8, when the display area 311 is enlarged by performing an operation such as pinch-in on the display unit 140 after displaying Figure 8, the possibility of the slider 330 overlapping with a portion of the display area 311 can be reduced. Therefore, for example, when a first user is viewing content displayed in the display area 311 and enlarges the display area 311, and text appears in a portion of the display area 311, the possibility of the text becoming illegible due to overlapping with the display position of the slider 330 can be reduced. Similarly, by hiding the slider 330 in Figure 9, the possibility of the slider 330 overlapping with a portion of the display area 311 can be reduced. Therefore, for example, when a first user is viewing content displayed in the display area 311 and text appears in a portion of the display area 311, the possibility of the text becoming illegible due to overlapping with the display position of the slider 330 can be reduced.

Thus, when the first condition described above is met, the display unit 140 can display Figure 8 or Figure 9 instead of Figure 7. Therefore, the user can optimize the display (content) of the display area 311 and hide the user's avatar 80, allowing the user to immerse themselves in viewing the content displayed in the display area 311 without having to perform complex operations such as repeatedly pinching in to fine-tune the zoom level, or repeatedly pinching in to fine-tune the zoom level by pinching out if the display area 311 becomes excessively zoomed. Furthermore, even when running the application of this disclosure on a terminal 10 with a relatively small display screen, such as a smartphone, display switching can be performed easily and appropriately.

Furthermore, when changing from the representation in Figure 7 to the representation in Figure 8, the representation in Figure 7 corresponds to the "first representation" in this disclosure, and the representation in Figure 8 may correspond to the "second representation" in this disclosure. Similarly, when changing from the representation in Figure 7 to the representation in Figure 9, the representation in Figure 7 corresponds to the "first representation" in this disclosure, and the representation in Figure 9 may correspond to the "second representation" in this disclosure.

Furthermore, in the state shown in Figure 8 or Figure 9, the system may be configured to accept or reject the operation to move the avatar 80A. If the system is configured to reject the operation to move the avatar 80A in the state shown in Figure 8 or Figure 9, for example, when a video is displayed in the display area 311 and the user is watching the video, it is possible to prevent the avatar 80A from moving due to the user accidentally performing an operation to move the avatar 80A. In this way, even in the case of an accidental operation by the user to move the avatar 80A, it is possible to prevent the avatar 80A from moving and the display unit 140 from ceasing to display a portion of the display area 311.

Furthermore, at least one of the operations for changing the display from Figure 9 to Figure 7, for changing the display from Figure 9 to Figure 8, and for changing the display from Figure 8 to Figure 7 may, for example, be an operation to make the seated avatar 80A leave the chair 81.

Furthermore, at least one of the operations for changing the display from Figure 9 to Figure 7, from Figure 9 to Figure 8, and from Figure 8 to Figure 7 may be, for example, an operation in which the user taps, double-tap, swipe, flicks, pinches in, or pinches out of area 301, or an operation in which a specific icon such as icon 323 is specified (touched).

Furthermore, at least one of the operations for changing the display from Figure 9 to Figure 7, from Figure 9 to Figure 8, and from Figure 8 to Figure 7 may be, for example, an operation in which the user taps, double-tap, swipe, flicks, pinches in, or pinches out of the display area 311, or an operation in which a specific icon, such as icon 323, is specified (touched).

Furthermore, at least one of the operations to change from the display in Figure 9 to the display in Figure 7, the operation to change from the display in Figure 9 to the display in Figure 8, and the operation to change from the display in Figure 8 to the display in Figure 7 may be performed, for example, by the user operating the slider 330.

Furthermore, when at least one of the following operations is performed—changing the display from Figure 9 to Figure 7, changing the display from Figure 9 to Figure 8, or changing the display from Figure 8 to Figure 7—the display unit 140 may choose not to display the icon 323 instead of displaying the display area 314.

The following describes the case where the display unit 140 displays the slider 330 superimposed on the virtual venue 310. The slider 330 is, for example, an operating user interface including a first element 331 and a second element 332. The first element 331 is configured to slide on the second element 332. The display unit 140 displays the slider 330 in, for example, at least one of Figures 7 to 9.

As the first element 331 is displaced from left to right on the second element 332, the display unit 140 enlarges and displays a portion of the virtual venue 310. Conversely, as the first element 331 is displaced from right to left on the second element 332, the display unit 140 shrinks and displays a portion of the virtual venue 310. In this way, when the display unit 140 displays the display screens shown in Figures 7 to 9, the user can adjust the magnification of a portion of the virtual venue 310.

When the display unit 140 displays Figure 8 instead of Figure 7 due to satisfying the "first condition" described above, the display unit 140 may display Figure 8 such that, for example, the first element 331 is positioned approximately in the center of the second element 332. Furthermore, when the display unit 140 displays Figure 9 instead of Figure 7 due to satisfying the "first condition" described above, the display unit 140 may display Figure 9 such that, for example, the first element 331 is positioned at the rightmost edge of the second element 332.

4. Operation of System 1000 The operation of System 1000 will be described with reference to Figures 10 and 11. Figures 10 and 11 are flowcharts showing an example of an operation performed using System 1000 shown in Figure 1.

First, referring to Figure 10, steps S111 to S193 will be explained in order.

In S111, the first user operates the first terminal 11 to launch the application. Then, in S121, the first terminal 11 acquires the first data.

Here, the first data includes, for example, data relating to an avatar in a virtual space operated using the first user's terminal. The first data may also include user operation data and operation history data, such as, for example, data relating to the position of the first user's avatar. Furthermore, the first data may also include, for example, data relating to the avatar's activity history within the virtual space, operated using the first user's terminal.

In S125, the first terminal 11 performs the first display control processing. Here, the first display control processing refers to the process of displaying a screen like that shown in Figure 7 when, for example, a user operating the first terminal 11 operates an avatar 80A, and the avatar 80A shown in Figure 6 is located inside the virtual venue 310.

In S131, the first terminal 11 performs a first determination process. This first determination process determines whether the first data satisfies a predetermined condition (first condition). If the first terminal 11 determines in S131 that the first condition is met, it determines the control data to control the display unit 140 of the first terminal 11, and the process in S141 is executed. On the other hand, if the first terminal 11 determines in S131 that the first condition is not met, the process in S131 is repeated.

The first condition in S131 is, for example, being located at a predetermined position or in a predetermined area within the virtual venue 310. Here, "predetermined area" refers, for example, within a predetermined distance from the display area 311. Furthermore, "first condition" may also mean, for example, specifying the display area 311. Alternatively, "first condition" may mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81. Also, "first condition" may mean, for example, being located at a predetermined position or in a predetermined area within the virtual venue 310, and specifying the display area 311. Furthermore, "first condition" may mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81, and specifying the display area 311.

In S141, the first terminal 11 performs a process (second display control process) to control its display unit 140 based on the control data. As a result, the display unit 140 of the first terminal 11 displays Figure 8 or Figure 9 instead of Figure 7. After S141, the first terminal 11 transmits the first data to the server device 20. Note that the first terminal 11 may transmit the first data to the server device 20 before S141.

In S183, the server device 20 determines the analysis data based on the first data. The server device 20 then transmits the determined analysis data to the instrument 70. For example, the server device 20 determines the analysis data each time it receives the first data and transmits the determined analysis data to the instrument 70.

In S193, the server device 20 determines advertising data based on the first data. This advertising data includes data determined based on the first data and is intended for the first user operating the first terminal 11. In S193, the server device 20 transmits the determined advertising data for the first user to the first terminal 11.

Next, referring to Figure 11, steps S111 to S193 will be explained in order.

In S111, the first user launches the application by operating the first terminal 11. Then, in S121, the first terminal 11 acquires the first data.

Here, the first data includes, for example, data relating to an avatar in a virtual space operated using the first user's terminal. The first data may also include user operation data and operation history data, such as, for example, data relating to the position of the first user's avatar. Furthermore, the first data may also include, for example, data relating to the avatar's activity history within the virtual space, operated using the first user's terminal.

After S121, the first terminal 11 transmits the first data to the server device 20. In S122, the server device 20 receives the first data and generates first control data based on it. The server device 20 also transmits the first control data to the first terminal 11.

In S125, the first terminal 11 performs the first display control processing. Here, the first display control processing refers to the process of displaying a screen like that shown in Figure 7 when, for example, a user operating the first terminal 11 operates an avatar 80A, and the avatar 80A shown in Figure 6 is located inside the virtual venue 310.

In S131, the server device 20 performs a first determination process. This first determination process determines whether the first data satisfies a predetermined condition (first condition). If the server device 20 determines in S131 that the first condition is met, it determines the second control data for controlling the display unit 140 of the first terminal 11, transmits this second control data to the first terminal 11, and executes the process in S141. On the other hand, if the first terminal 11 determines in S131 that the first condition is not met, the process in S131 is repeated.

The first condition in S131 is, for example, being located at a predetermined position or in a predetermined area within the virtual venue 310. Here, "predetermined area" refers, for example, within a predetermined distance from the display area 311. Furthermore, "first condition" may also mean, for example, specifying the display area 311. Alternatively, "first condition" may mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81. Also, "first condition" may mean, for example, being located at a predetermined position or in a predetermined area within the virtual venue 310, and specifying the display area 311. Furthermore, "first condition" may mean, for example, the user operating the terminal 10 so that the avatar 80A sits in the chair 81, and specifying the display area 311.

In S141, the first terminal 11 performs a process (second display control process) to control its display unit 140 based on the second control data. As a result, the display unit 140 of the first terminal 11 displays Figure 8 or Figure 9 instead of Figure 7.

In S183, the server device 20 determines the analysis data based on the first data. The server device 20 then transmits the determined analysis data to the instrument 70. For example, the server device 20 determines the analysis data each time it receives the first data and transmits the determined analysis data to the instrument 70.

In S193, the server device 20 determines advertising data based on the first data. This advertising data includes data determined based on the first data and is intended for the first user operating the first terminal 11. In S193, the server device 20 transmits the determined advertising data for the first user to the first terminal 11.

Furthermore, regarding S193 in Figure 10 and S193 in Figure 11, if the avatar 80 has a history of entering a virtual venue 310 where an event is held by a predetermined operating organization and watching a video played in the virtual venue 310, the advertising data transmitted to the first terminal 11 may include, for example, data regarding information about future events to be held by the predetermined operating organization. This data includes at least one of text data, image data, and video data.

Furthermore, regarding S193 in Figure 10 and S193 in Figure 11, the aforementioned advertising data may, for example, include data containing a URL to access a database that stores second data related to advertisements determined based on the first data. Also, the aforementioned advertising data may already be downloaded into the application, for example, through batch processing. In this case, the server device 20 may send data relating to an ID corresponding to the data to be transmitted to the first terminal 11, and the first terminal 11 may display the advertising data based on that ID.

Figure 12 shows an example of data transmitted from terminal 10. Figure 12 describes the various data that the server device 20 receives from each terminal 10 when the first user, second user, and third user each operate their avatar using their own terminal 10. Here, the various data include, for example, data related to "age," "gender," "current location," "virtual object," "chat history," and "content viewing history," "part ID," and "simplified avatar." Here, "part ID" is, for example, data used to identify an avatar. "Simplified avatar" is, for example, data related to ID patterns corresponding to gender, including male and female.

Furthermore, the first data mentioned above may include, for example, at least one of the details relating to the first user in Figure 12.

Regarding the "age" mentioned above, Figure 12 shows an example where the first user is 21 years old, the second user is 31 years old, and the third user is 41 years old.

Furthermore, regarding the "gender" mentioned above, Figure 12 shows an example where the first user's avatar is male, the second user's avatar is female, and the third user's avatar is male.

Furthermore, regarding the "current location" mentioned above, Figure 12 shows an example where the avatar operated by the first user is located at location A01, the avatar operated by the second user is located at location B01, and the avatar operated by the third user is located at location C01.

Furthermore, regarding the "virtual object" mentioned above, Figure 12 shows an example where the avatar operated by the first user purchases virtual object A12 at price A13 at time A11, the avatar operated by the second user opens virtual object B12 at time B11, and the avatar operated by the third user acquires virtual object C12 at time C11. Virtual object B22 is, for example, a door.

Furthermore, regarding the "chat history" mentioned above, Figure 12 shows an example where the first user's terminal sends the message "Hello" to the third user's terminal at time A21 and location A22, the second user has no chat history with any other users, and the third user's terminal receives the message "Hello" from the first user's terminal at time C21 and location C22.

Furthermore, regarding the "content viewing history" mentioned above, Figure 12 shows an example where the first user's avatar stands up at position A32 at time A31 and begins viewing content, the second user's avatar views content for two hours at seat B33 at position B32 at time B31, and the third user's avatar finishes viewing content at position C32 at time C31 and leaves seat C33.

Regarding the "age" mentioned above, while examples of how to indicate a user's age have been described, the system is not limited to these examples. For example, the "age" mentioned above may indicate the age group to which the user belongs. For instance, if Category 1 is defined as 21 to 30 years old, the system may indicate that the first user belongs to Category 1. Similarly, if Category 2 is defined as 31 to 40 years old, the system may indicate that the second user belongs to Category 2. Furthermore, if Category 3 is defined as 41 to 50 years old, the system may indicate that the third user belongs to Category 3. In this way, for example, when analysis data is determined in S183 of Figure 9 or S183 of Figure 10 and transmitted to the device 70, the age-related data can be used for marketing purposes without transmitting the user's specific personal information to the device 70.

Furthermore, while the above-mentioned "current location" describes an example of showing the avatar's position at a specific time, it is not limited to this. For example, it may include data showing the trajectory of the avatar's movement within the virtual space 300 within a predetermined period.

Furthermore, regarding the "chat history" described above, an example was explained in which the first user sends the message "Hello" to the third user's terminal at time A21 and location A22. However, the content of the message is not limited to this example. Also, data sent from one user's terminal to another user's terminal may include at least one of the following: text, emojis, voice messages, images, and videos.

Furthermore, the first data shown in Figure 12 is not limited to the example described above and may also include data related to "behavioral history." Data related to "behavioral history" may include, for example, the time when avatar 80 entered the virtual venue 310, the time when avatar 80 left the virtual venue 310, the time avatar 80 stayed in the virtual venue 310, the time when avatar 80 started viewing the object displayed in the display area 311 in the virtual venue 310, the time (period) during which avatar 80 viewed the object displayed in the display area 311 in the virtual venue 310, the time when avatar 80 finished viewing the object displayed in the display area 311 in the virtual venue 310, the time when avatar 80 sat down in the chair 81, and so on. The data may include at least one of the following: the time when tar 80 left chair 81, the time from when avatar 80 sat down on chair 81 until it left, the location data of chair 81 when avatar 80 sat down on chair 81, a history of received data including messages received by a user operating one terminal 10 from a terminal 10 operated by a user operating another terminal 10, and a history of transmitted data including messages sent by a user operating one terminal 10 to a terminal 10 operated by a user operating another terminal 10.

Furthermore, the server device 20 may select which of the contents described in Figure 12 to transmit to the device 70. For example, if the data to be transmitted to the device 70 includes the chat history described in Figure 12, the server device 20 may transmit to the device 70 the data excluding the chat history from the contents described in Figure 12.

Furthermore, the server device 20 may transmit data to the device 70 that modifies at least a portion of the content shown in Figure 12. For example, instead of transmitting data to the device 70 indicating that the first user's avatar is located at location A01, the server device 20 may transmit data to the device 70 indicating that the first user's avatar is located near location A01.

Furthermore, when receiving data containing a message from either device 70 or the second terminal 12, it is not necessary to transmit the data containing the message to the other terminal 10. In this way, data exchanged between the second terminal 12 and device 70 is not transmitted to any terminal 10 other than the second terminal 12. Therefore, if the data transmitted and received between the second terminal 12 and device 70 includes data relating to the personal information of the user operating the second terminal 12, the possibility of such personal information being known to a user operating a terminal 10 other than the second terminal 12 can be reduced.

Furthermore, when the display unit 140 displays the display area 314 and users engage in chat, the user ID and avatar 80 in the chat may be linked to each other, or they may not be linked.

As described above, according to this disclosure, first data relating to an avatar in a virtual space operated using a first terminal of a first user is acquired, a first display including the avatar is displayed on the display unit of the first terminal based on the first data, a determination is made based on the first data as to whether or not a first condition is met, and if it is determined that the first condition is met, the display unit is controlled to switch the display from the first display to the second display based on the first position in the virtual space where the avatar exists. In this way, when the avatar 80A is moved in the virtual space 300, the display unit 140 displays the avatar 80A, so the first user can easily grasp the movement and/or position of the avatar 80A being operated. On the other hand, when viewing content in the virtual space 300, the user can optimize the display (content) in the display area 311 and hide the avatar 80 being operated by the user without performing complex operations, allowing the user to immerse themselves in viewing the content displayed in the display area 311, and even when running the application of this disclosure using a terminal 10 with a relatively small display screen such as a smartphone, display switching can be easily and appropriately performed.

5. Variations

In Figure 10, an example is shown in which the server device 20 performs the processes of S183 and S193 after S141, but the process is not limited to this. For example, the server device 20 may receive the first data from the first terminal 11 before S131. This allows the server device 20 to perform the process of S183 before S131 and transmit the analysis data to the device 70. Alternatively, for example, the server device 20 may perform the process of S193 before S131 and transmit the advertising data to the first terminal 11. In this way, the server device 20 can reduce the time between receiving the first data and transmitting the analysis data determined based on the received first data to the device 70. Furthermore, the processes of the first terminal 11, the server device 20, and the device 70 are not limited to being performed as a single flow on the same flowchart as shown in Figures 9 and 10, but the processes of the first terminal 11, the server device 20, and the device 70 may be performed simultaneously as separate steps. The processes in S183 and S193 in Figure 10 may be performed concurrently with other processes shown in Figure 10. Similarly, the processes in S183 and S193 in Figure 11 may be performed concurrently with other processes shown in Figure 11. For example, the processes in S183 and S193 in Figure 10 or Figure 11 do not necessarily have to be performed as a series of operations each time the first user moves the avatar 80A to display a target, nor do the processes in S183 and S193 in Figure 10 or Figure 11 necessarily have to be performed as a series of operations each time the first user moves the avatar 80A.

Furthermore, as shown in Figure 13, in addition to the terminal 10 shown in Figure 3, a first sensor 102a, a second sensor 102b, a camera 102c, and a microphone 102d may also be provided. Figure 13 is a block diagram showing an example of the configuration of the terminal 10 and its connection to the terminal 10 shown in Figure 3. Here, the terminal 10 and each of the first sensor 102a, second sensor 102b, camera 102c, and microphone 102d are connected, for example, by wire or wireless.

The first sensor 102a is connected to the camera 102c, for example, by wired or wireless connection. The camera 102c may include, for example, an RGB camera that images visible light and a near-infrared camera that images near-infrared light. The camera 102c can be, for example, one included in the True Depth camera of the iPhone X (registered trademark). The second sensor 102b is connected to the microphone 102d, for example, by wired or wireless connection. Note that the first sensor 102a and camera 102c may be provided as a single configuration. Also, the second sensor 102b and microphone 102d may be provided as a single configuration.

In this manner, terminal 10 may transmit images captured by camera 102c to server device 20. Furthermore, first terminal 11 may transmit audio data input to microphone 102d to server device 20. Also, first terminal 11 may transmit video data using camera 102c and microphone 102d to server device 20.

Figure 14 shows a generalized example of a suitable computing environment 1400 in which the embodiments, techniques, and technologies described herein may be implemented, including transmitting and using tokens to render video in the computing environment. For example, the computing environment 1400 may implement a terminal device (or broadcaster, or viewer), or a broadcast server system, as described herein.

Because the technology can be implemented in diverse general-purpose or dedicated computing environments, computing environment 1400 is not intended to imply any limitations on the scope of use or functionality of the technology. For example, the technology disclosed herein may be implemented in various other computer system configurations, including various portable devices, various multiprocessor systems, various microprocessor-based or programmable home appliances, various network PCs, various minicomputers, various mainframe computers, and so on. The technology disclosed herein may also be implemented in a distributed computing environment where tasks are performed by remote processing units linked via a communication network. In a distributed computing environment, program modules may reside in both local and remote memory storage devices.

Referring to Figure 14, the computing environment 1400 includes at least one central processing unit 1410 and memory 1420. In Figure 14, this most basic configuration 1430 is enclosed within the dashed line. The central processing unit 1410 executes instructions that can be executed by the computer, and the central processing unit 1410 may be a real processor or a virtual processor. In a multiprocessing system, multiple processors can operate simultaneously because multiple processing units execute instructions that can be executed by the computer to improve processing power. The memory 1420 may be volatile memory (e.g., registers, cache, RAM), non-volatile memory (e.g., ROM, EEPROM, flash memory, etc.), or several combinations of these two. The memory 1420 stores, for example, software 1480, various images, and videos, which can implement the technology described herein. The computing environment may have various additional functions. For example, the computing environment 1400 includes storage 1440, one or more input devices 1450, one or more output devices 1460, and one or more communication connections 1470. Interconnection mechanisms (not shown), such as buses, controllers, or networks, interconnect the various components of the computing environment 1400. Typically, operating system software (not shown) provides an operating environment for other software running on the computing environment 1400 and coordinates the various activities of the various components of the computing environment 1400.

The storage 1440 may or may not be removable and may include magnetic disks, magnetic tapes or cassettes, CD-ROMs, CD-RWs, DVDs, or any other media used to store information and accessible within the computing environment 1400. The storage 1440 stores instructions for software 1480, plug-in data, and messages, which may be used to implement the technology described herein.

One or more input devices 1450 may be a keyboard, keypad, mouse, touchscreen display, pen, or trackball, an audio input device, a scanning device, or another device that provides input to the computing environment 1400. In the case of audio, one or more input devices 1450 may be a sound card or similar device that accepts analog or digital audio input, or a CD-ROM reader that provides various audio samples to the computing environment 1400. One or more output devices 1460 may be a display, printer, speaker, CD writer, or another device that provides output from the computing environment 1400.

One or more communication connections 1470 enable communication to another computing entity via a communication medium (e.g., a connected network). The communication medium transmits information such as computer-executable instructions, compressed graphics information, video, or other data contained in modulated data signals. One or more communication connections 1470 are not limited to wired connections (e.g., megabit or gigabit Ethernet, InfiniBand, or Fibre Channel via electrical or optical fiber connections), but include wireless technologies (e.g., Bluetooth, Wi-Fi (IEEE 802.11a/b/n), WiMax, cellular, satellite, laser, infrared, and RF connections), as well as various other suitable communication connections for providing network connectivity to various agents, bridges, and data consumers of destination agents disclosed herein. In a virtual host environment, one or more communication connections may be virtualized network connections provided by a virtual host.

Various embodiments of the various methods disclosed herein may be executed in the compute cloud 1490 using a number of instructions executable by computers implementing all or part of the technologies disclosed herein. For example, various agents can perform various vulnerability scanning functions in the compute environment, while the agent platform (e.g., a bridge) and consumer services for destination agent data can be executed on various servers located within the compute cloud 1490.

Computer-readable media are any available media that can be accessed within the computing environment 1400. Without limitation, and as an example, with respect to the computing environment 1400, computer-readable media include memory 1420 and/or storage 1440. For ease of understanding, the term computer-readable media includes data storage media such as memory 1420 and storage 1440, but does not include transmission media such as modulated data signals.

The various embodiments described above can be used in combination with each other, provided that no contradictions or inconveniences arise. Considering the many possible embodiments to which the principles of the invention disclosed herein can be applied, it should be understood that the various embodiments described are merely preferred examples and should not be considered to limit the technical scope of the claimed invention to these preferred examples. In practice, the technical scope of the claimed invention is defined by the attached claims. Therefore, we request a patent for all aspects of the technical scope of the invention described in the claims, as our invention.

The computer program according to the first embodiment is "a computer program executed by at least one processor, which acquires first data relating to an avatar in a virtual space operated using a first terminal of a first user, displays a first display including the avatar on the display unit of the first terminal based on the first data, determines whether a first condition is met based on the first data, and, if it is determined that the first condition is met, controls the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, thereby causing the at least one processor to function in this manner."

The computer program according to the second embodiment is a computer program executed by at least one processor, which, via a communication line, receives first data relating to an avatar in a virtual space operated using a first terminal of a first user; determines first control data based on the first data to control a display unit to display a first display including the avatar on the display unit of the first terminal; transmits the first control data to the first terminal via the communication line; after transmitting the first control data to the first terminal, determines, based on the first data, whether or not a first condition is met; if it is determined that the first condition is met, determines second control data to control the display unit to switch the display from the first display to the second display based on a first position in the virtual space where the avatar exists; and transmits the second control data to the first terminal via the communication line, thereby causing the at least one processor to function in this manner.

The computer program according to the third embodiment is, in the first or second embodiment described above, characterized in that "the first condition is that the first data includes operation data for selecting a part of the region including the first position, the first data includes operation data for selecting an object to be displayed on the display unit, or the first data includes data indicating that the avatar is located within the first region."

The computer program according to the fourth embodiment is one in which, in any of the first to third embodiments described above, "the second display does not include the avatar."

The computer program according to the fifth embodiment is, in the third or fourth embodiment described above, wherein "the first condition includes operation data for selecting an object to be displayed on the display unit, and the object is a virtual object on which the avatar can sit."

The computer program according to the sixth embodiment is, in the third or fourth embodiment described above, characterized in that "the first condition includes operation data for selecting an object to be displayed on the display unit, and the object is a display displayed on the display unit separately from the first display."

The computer program according to the seventh embodiment is such that, in any of the first to sixth embodiments, "at least one virtual venue, which is a space where video is distributed, is provided within the virtual space."

The computer program according to the eighth aspect is, in either the seventh aspect dependent on the third aspect or the seventh aspect dependent on the fourth aspect described above, wherein "the first condition includes operation data for selecting an object to be displayed on the display unit, and the object is the video."

The computer program according to the ninth aspect is, in either the seventh aspect dependent on the third aspect or the seventh aspect dependent on the fourth aspect described above, wherein "the first condition is that the first data includes data indicating that the avatar is in the first area, and the first area is an area within one of the at least one virtual venues."

The computer program according to the tenth embodiment is, in any of the first to ninth embodiments described above, characterized in that "the second display is an enlarged portion of the first display such that the proportion of the first display that portion occupies the display area increases."

The computer program according to the eleventh embodiment is one that, in the first to ninth embodiments described above, "displays a representation corresponding to a virtual object existing in the virtual space across the entire area of the display unit when the first condition is met."

The computer program according to the twelfth embodiment is such that, in any of the first to eleventh embodiments described above, "when the first display shows an operable virtual object used to instruct the movement of the avatar, and it is determined that the first condition is met, the second display does not display the operable virtual object."

The computer program according to the thirteenth embodiment is such that, in any of the first to eleventh embodiments described above, "when the first display shows a display area for displaying a message transmitted from at least one terminal, including the first terminal, and it is determined that the first condition is met, the second display does not display the display area."

The computer program according to the 14th embodiment is such that, in any of the first to 11 embodiments described above, "when the first display displays a display area for displaying a message transmitted from at least one terminal, including the first terminal, and it is determined that the first condition is met, the second display does not display the display area and instead displays an icon used for displaying the display area, and the icon, when operated, causes the display area to be displayed."

The computer program according to the 15th embodiment, in any of the first to 14 embodiments described above, "does not accept operation input related to the movement of the avatar when the second display is displayed on the display unit."

The computer program according to the sixteenth embodiment, in any of the first or third to fourteenth embodiments subordinate to the first described above, "controls the display unit to switch the display from the second display to the first display when input related to the movement of the avatar is obtained while the second display is displayed on the display unit."

The computer program according to the 17th embodiment, in any of the second or third to 14th embodiments subordinate to the second described above, "determines a third control data to control the display unit so as to switch the display from the second display to the first display when, after transmitting the second control data via the communication line to the first terminal, input regarding the movement of the avatar is obtained from the first terminal, and then causes at least one processor to function such that it transmits the third control data via the communication line to the first terminal."

The computer program according to the 18th embodiment, in the 16th embodiment or the 17th embodiment dependent on the 12th embodiment described above, is characterized in that, when the second display is displayed on the display unit and input related to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the operable virtual object.

The computer program according to the 19th embodiment, in either the 16th embodiment subordinate to the 13th embodiment described above, or the 17th embodiment subordinate to the 13th embodiment described above, is characterized in that, when the second display is displayed on the display unit and input related to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the display area.

The computer program according to the 20th embodiment, in the 16th or 17th embodiment dependent on the 14th embodiment described above, is characterized in that, when the second display is displayed on the display unit and input related to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the display area but does not display the icon.

The computer program according to the 21st embodiment is, in any of the first to 20 embodiments described above, wherein "the first data includes at least one of the following: data relating to the avatar's activity history within the virtual space, and data relating to the user operating the avatar."

The computer program according to the 22nd aspect, in the 21st aspect dependent on the 7th aspect described above, includes at least one of the following data relating to the behavioral history: data relating to the viewing history of the avatar's viewing of the video; data relating to the viewing time of the avatar's viewing of the video; data relating to the avatar's entry history into the virtual venue; data relating to the avatar's stay time in the virtual venue; data relating to the avatar's exit history from the virtual venue; data relating to the history of actions taken by the avatar on virtual objects existing in the virtual space; data relating to the location of the first terminal to which a message is sent when one of the first terminal and a second terminal different from the first terminal sends the message to the other of the first terminal and the second terminal; data relating to the purchase history of the virtual object; and data relating to the location of the virtual object when the virtual object is seatable and the avatar is seated on the virtual object.

The computer program according to the 23rd embodiment is such that, in any of the first to 22 embodiments described above, "the first data is transmitted to a third terminal other than the first terminal and a second terminal different from the first terminal."

The computer program according to the 24th embodiment, as described in the 23rd embodiment above, "determines whether or not the first data has been received, and if the first data has been received, transmits the first data to the third terminal."

The computer program according to the 25th embodiment is such that, in either the 23rd or 24th embodiment described above, "the period for receiving the first data is shorter than the period for determining the control data."

The computer program according to the 26th aspect is such that, in either the 23rd or 24th aspect described above, "the third terminal is a first terminal operated by the operator or operating organization that operates the virtual venue."

The computer program according to the 27th embodiment is such that, in any of the first to 26 embodiments described above, "second data relating to an advertisement determined based on the first data is transmitted to the first terminal."

The computer program according to the 28th embodiment is such that, in any of the first to 26 embodiments, "data including a URL for accessing a database storing second data relating to an advertisement determined based on the first data is transmitted to the first terminal."

The computer program according to the 29th aspect is one in which, in any of the first to 28 aspects, "the virtual space is a three-dimensional space."

The computer program according to the 30th aspect is one in which, in any of the first to 29 aspects, "the communication line includes the Internet."

The computer program according to the 31st aspect is one in which, in any of the first to 30 aspects described above, "the at least one processor includes a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU)."

The computer program according to the 32nd embodiment is one in which, in any of the first to 31 embodiments, "at least one processor is installed in a server device, smartphone, tablet, mobile phone, or personal computer."

The method according to the 33rd aspect includes: "the steps of: acquiring first data relating to an avatar in a virtual space operated using a first terminal of a first user; displaying a first display including the avatar on the display unit of the first terminal based on the first data; determining whether a first condition is met based on the first data; determining first control data for controlling the display unit to switch the display from the first display to a second display based on a first position in the virtual space where the avatar exists, if the first condition is met; and controlling the display unit based on the first control data."

The method according to the 34th aspect includes: "receiving first data relating to an avatar in a virtual space operated using a first terminal of a first user via a communication line; determining first control data for controlling a display unit to display a first display including the avatar on the display unit of the first terminal based on the first data; transmitting the first control data to the first terminal via the communication line; determining whether a first condition is met based on the first data after transmitting the first control data to the first terminal; determining first control data for controlling the display unit to switch the display from a first display to a second display based on a first position in the virtual space where the avatar exists, if the first condition is met; and transmitting the second control data to the first terminal via the communication line."

The method according to the 35th aspect is one in which, in the 33rd or 34th aspect, "the communication line includes the Internet."

The method according to the 36th aspect is, in any of the 33rd to 35th aspects, characterized in that "at least one processor includes a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU)."

The server device according to the 37th embodiment "acquires first data relating to an avatar in a virtual space operated using a first terminal of a first user, displays a first display including the avatar on the display unit of the first terminal based on the first data, determines whether a first condition is met based on the first data, and if it is determined that the first condition is met, determines first control data to control the display unit to switch the display from the first display to the second display based on a first position in the virtual space where the avatar exists, and controls the display unit based on the first control data."

The server device according to the 38th embodiment is one in which "the communication line includes the Internet" as described in the 37th embodiment.

A server device according to the 39th embodiment is, in the 37th or 38th embodiment, one in which "at least one processor includes a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU)."

Thus, the technology of this disclosure can provide computer programs, methods, and server devices that do not impair user comfort compared to conventional methods.
[Additional Information] The original claims of the parent application of this application are listed below.
[Claim 1]
A computer program that is executed by at least one processor,
First data is obtained regarding the avatar in the virtual space operated using the first terminal of the first user.
Based on the first data, the first display including the avatar is displayed on the display unit of the first terminal.
Based on the aforementioned first data, it is determined whether or not the first condition is met.
If it is determined that the first condition is met, the display unit is controlled to switch the display from the first display to the second display based on the first position in the virtual space where the avatar is located, and the at least one processor is made to function in this manner.
The first condition is,
The first data includes operation data for operating on an object other than one object displayed on the display unit,
The second indication is,
The first display is enlarged in such a way that the proportion of the first object in the display area becomes larger.
Computer program.
[Claim 2]
A computer program executed by at least one processor, which receives first data relating to an avatar in a virtual space operated using a first terminal of a first user via a communication line,
Based on the first data, first control data is determined to control the display unit so that the first display including the avatar is displayed on the display unit of the first terminal.
The first control data is transmitted to the first terminal via the aforementioned communication line.
After transmitting the first control data to the first terminal, it is determined whether or not the first condition is met based on the first data.
If it is determined that the first condition is met, second control data is determined to control the display unit to switch the display from the first display to the second display based on the first position in the virtual space where the avatar is located.
The at least one processor is configured to transmit the second control data to the first terminal via the communication line.
The first condition is,
The first data includes operation data for operating on an object other than one object displayed on the display unit,
The second indication is,
The first display is enlarged so that the proportion of the first object in the display area is increased.
Computer program.
[Claim 3]
The second representation does not include the avatar.
The computer program according to claim 1 or claim 2.
[Claim 4]
Within the aforementioned virtual space, at least one virtual venue is provided, which is a space where videos are streamed.
A computer program according to any one of claims 1 to 3.
[Claim 5]
The subject of the first item is the aforementioned video.
The computer program according to claim 4.
[Claim 6]
The first condition is,
Furthermore, the first data includes data indicating that the avatar is located within the first region.
The first region is a region within one of the virtual venues,
A computer program according to any one of claims 1 to 5.
[Claim 7]
When the first display shows an operable virtual object used to instruct the movement of the avatar, if it is determined that the first condition is met, the second display does not show the operable virtual object.
A computer program according to any one of claims 1 to 6.
[Claim 8]
When the first display shows a display area for displaying a message transmitted from at least one terminal, including the first terminal, and it is determined that the first condition is met, the second display does not display the display area.
A computer program according to any one of claims 1 to 7.
[Claim 9]
When the first display shows a display area for displaying a message transmitted from at least one terminal, including the first terminal, and it is determined that the first condition is met, the second display does not display the display area but displays an icon used for displaying the display area, and the icon is operated to display the display area.
A computer program according to any one of claims 1 to 8.
[Claim 10]
When the second display is shown on the display unit, the system does not accept any input for operations related to the movement of the avatar.
A computer program according to any one of claims 1 to 9.
[Claim 11]
When the second display is displayed on the display unit, if input related to the movement of the avatar is obtained, the display unit is controlled to switch the display from the second display to the first display.
A computer program according to claim 1 or any one of claims 3 to 9 dependent on claim 1.
[Claim 12]
After transmitting the second control data to the first terminal via the communication line, if input regarding the movement of the avatar is obtained from the first terminal, a third control data is determined to control the display unit to switch the display from the second display to the first display.
The at least one processor is configured to transmit the third control data to the first terminal via the communication line.
A computer program according to claim 2 or any one of claims 3 to 9 dependent on claim 2.
[Claim 13]
When the second display is displayed on the display unit and input related to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the operable virtual object.
A computer program according to claim 11 dependent on claim 7, or claim 12 dependent on claim 7.
[Claim 14]
When the second display is displayed on the display unit and input related to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the display area.
A computer program according to claim 11 dependent on claim 8, or claim 12 dependent on claim 8.
[Claim 15]
When the second display is displayed on the display unit and input related to the movement of the avatar is obtained, the first display, which is switched from the second display to the display unit, displays the display area but does not display the icon.
A computer program according to claim 11 dependent on claim 9, or claim 12 dependent on claim 9.
[Claim 16]
The first data is,
This includes at least one of the following: data relating to the avatar's activity history within the virtual space, and data relating to the user operating the avatar.
A computer program according to any one of claims 1 to 15.
[Claim 17]
The data relating to the aforementioned behavioral history is,
The data includes at least one of the following: data relating to the avatar's viewing history of watching the video, data relating to the avatar's viewing time of the video, data relating to the avatar's entry history into the virtual venue, data relating to the avatar's stay time in the virtual venue, data relating to the avatar's exit history from the virtual venue, data relating to the avatar's interaction history with virtual objects existing in the virtual space, data relating to the location of the first terminal to which a message is sent when one of the first terminal and a second terminal different from the first terminal sends the message to the other of the first terminal and the second terminal, data relating to the purchase history of the virtual object, and data relating to the location of the virtual object when the virtual object is seatable and the avatar is seated on the virtual object.
A computer program according to claim 16, which is dependent on claim 4.
[Claim 18]
The first data is transmitted to a third terminal other than the first terminal and a second terminal different from the first terminal.
A computer program according to any one of claims 1 to 17.
[Claim 19]
Determine whether or not the first data has been received, and if the first data has been received, transmit the first data to the third terminal.
The computer program according to claim 18.
[Claim 20]
The third terminal is a first terminal operated by the operator or organization that manages the virtual venue.
A computer program according to claim 18 dependent on claim 4 or claim 18 dependent on claim 6.
[Claim 21]
Second data relating to an advertisement determined based on the first data is transmitted to the first terminal.
A computer program according to any one of claims 1 to 20.
[Claim 22]
Data including a URL for accessing a database that stores second data relating to an advertisement determined based on the first data is transmitted to the first terminal.
A computer program according to any one of claims 1 to 20.
[Claim 23]
The aforementioned virtual space is a three-dimensional space.
A computer program according to any one of claims 1 to 22.
[Claim 24]
The aforementioned communication line includes the Internet,
A computer program according to claim 2 or any one of claims 3 to 23 dependent on claim 2.
[Claim 25]
The aforementioned at least one processor,
Including a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU),
A computer program according to any one of claims 1 to 24.
[Claim 26]
The aforementioned at least one processor is installed in a server device, smartphone, tablet, mobile phone, or personal computer.
A computer program according to any one of claims 1 to 25.
[Claim 27]
A method performed by at least one processor that executes instructions readable by a computer,
A step of acquiring first data relating to an avatar in a virtual space operated using the first terminal of the first user,
A step of displaying the first display, including the avatar, on the display unit of the first terminal based on the first data,
A step of determining whether or not the first condition is met based on the first data,
If it is determined that the first condition is met, the process involves determining first control data for controlling the display unit to switch the display from the first display to the second display based on the first position in the virtual space where the avatar is located,
The process includes controlling the display unit based on the first control data,
The first condition is,
The first data includes operation data for operating on an object other than one object displayed on the display unit,
The second indication is,
The first display is enlarged so that the proportion of the first object in the display area is increased.
method.
[Claim 28]
A method performed by at least one processor that executes instructions readable by a computer,
The process of receiving first data relating to an avatar in a virtual space operated using the first terminal of the first user via a communication line,
A step of determining first control data that controls the display unit to display the first display including the avatar on the display unit of the first terminal, based on the first data,
The steps include transmitting the first control data to the first terminal via the communication line,
The process includes: transmitting the first control data to the first terminal, and then determining whether or not the first condition is met based on the first data;
If it is determined that the first condition is met, the process involves determining second control data for controlling the display unit to switch the display from the first display to the second display based on the first position in the virtual space where the avatar is located,
The process includes transmitting the second control data to the first terminal via the communication line,
The first condition is,
The first data includes operation data for operating on an object other than one object displayed on the display unit,
The second indication is,
The first display is enlarged so that the proportion of the first object in the display area is increased.
method.
[Claim 29]
The aforementioned communication line includes the Internet,
The method according to claim 28.
[Claim 30]
The aforementioned at least one processor,
Including a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU),
The method according to any one of claims 27 to 29.
[Claim 31]
It comprises at least one processor,
The system acquires first data regarding an avatar in a virtual space operated using the first terminal of the first user via a communication line.
Based on the first data, the first display including the avatar is displayed on the display unit of the first terminal, and it is determined whether or not the first condition is met based on the first data.
If it is determined that the first condition is met, first control data is determined to control the display unit to switch the display from the first display to the second display based on the first position in the virtual space where the avatar exists.
Based on the first control data, the display unit is controlled.
The first condition is,
The first data includes operation data for operating on an object other than one object displayed on the display unit,
The second indication is,
The first display is enlarged so that the proportion of the first object in the display area is increased.
Server device.
[Claim 32]
The aforementioned communication line includes the Internet,
The server device according to claim 31.
[Claim 33]
The aforementioned at least one processor,
Including a central processing unit (CPU), a microprocessor, and/or a graphics processing unit (GPU),
The server device according to claim 31 or claim 32.

2 Communication Network 10 Terminals 11 First Terminal 12 Second Terminal 14, 24 Central Processing Unit 15, 25 Main Memory 16, 26 Input/Output Interface 17, 27 Input Devices 18, 28 Auxiliary Storage Devices 19, 29 Output Devices 20 Server Devices 21 First Server System 21A1 Distribution Server Device 21A2 Server Storage Device 22 Second Server System 70 Equipment 80, 80A, 313 Avatar 81 Chair 102a First Sensor 102b Second Sensor 102c Camera 102d Microphone 104 Processing Unit 110 Communication Unit 120 Acquisition Unit 130 Control Unit 140 Display Unit 150 User Interface Unit 160 Storage Unit 210 Communication Unit 220 Storage Unit 230 Control Unit 300 Virtual Space 301 Icon (area)
310 Virtual venue 311, 312 Display area 314 Display area 321 Point 322 Line segment 323 Icon 330 Slider 331 First element 332 Second element 1000 System 1400 Computing environment 1410 Processing unit 1420 Memory 1430 Configuration 1440 Storage 1450 Input device 1460 Output device 1470 Communication connection 1480 Software instruction 1490 Computing cloud

Claims (23)

A computer program that runs on at least one processor,
First data is obtained regarding the avatar in the virtual space operated using the first terminal of the first user.
Based on the first data, a first display including the avatar and an object which is a display area for displaying predetermined content is displayed on the display unit of the first terminal.
If the number of avatars in the virtual space exceeds a predetermined number, or if a specific avatar is present in the virtual space, the system will activate the function to start playing the predetermined content on the target.
Computer program. A computer program that runs on at least one processor,
The system receives first data relating to an avatar in a virtual space, which is operated using the first terminal of the first user, via a communication line.
Based on the first data, first control data is determined to control the display unit of the first terminal so that it displays a first display including the avatar and a display area for displaying predetermined content.
The first control data is transmitted to the first terminal via the aforementioned communication line.
If the number of avatars in the virtual space exceeds a predetermined number, or if a specific avatar is present in the virtual space, the system will activate to start playing the predetermined content on the target.
Computer program. Based on the aforementioned first data, it is determined whether or not the first condition is met.
When it is determined that the first condition is met, the display unit is controlled to switch the display from the first display to the second display, and the at least one processor is made to function in this manner.
The computer program according to claim 1 or 2. The first condition is,
The first data includes data indicating that the first position where the avatar exists is located in a first region within the virtual space.
The computer program according to claim 3. The second indication is,
The first display is enlarged so that the proportion of the object that occupies the display area increases.
The computer program according to claim 3. The computer program according to claim 3, wherein, in the second display, the object, which has been magnified at a predetermined magnification ratio, is controlled to be adjustable to a magnification ratio adjusted by the operation of the first user. When the first display shows an operable virtual object used to instruct the movement of the avatar, if it is determined that the first condition is met, the second display does not show the operable virtual object.
The computer program according to claim 3. When the first display shows a display area for displaying a message transmitted from at least one terminal, including the first terminal, and it is determined that the first condition is met, the second display does not display the display area.
The computer program according to claim 3. When the first display shows a display area for displaying a message transmitted from at least one terminal, including the first terminal, and it is determined that the first condition is met, the second display does not display the display area but displays an icon used for displaying the display area, and the icon is operated to display the display area.
The computer program according to claim 3. When the second display is shown on the display unit, the system does not accept any input for operations related to the movement of the avatar.
The computer program according to claim 3. When the second display is displayed on the display unit, if input related to the movement of the avatar is obtained, the display unit is controlled to switch the display from the second display to the first display.
The computer program according to claim 3. When the second display is displayed on the display unit and input related to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the operable virtual object.
The computer program according to claim 7. When the second display is displayed on the display unit and input related to the movement of the avatar is obtained, the first display, which is switched from the second display and displayed on the display unit, displays the display area.
The computer program according to claim 8. When the second display is displayed on the display unit and input related to the movement of the avatar is obtained, the first display, which is switched from the second display to the display unit, displays the display area but does not display the icon.
The computer program according to claim 9. The first data is,
This includes at least one of the following: data relating to the avatar's activity history within the virtual space, and data relating to the user operating the avatar.
The computer program according to claim 1 or 2. The first data is transmitted to a third terminal other than the first terminal and a second terminal different from the first terminal.
The computer program according to claim 1 or 2. Within the aforementioned virtual space, at least one virtual venue is provided, which is a space where the predetermined content is distributed.
The third terminal is a first terminal operated by the operator or organization that manages the virtual venue.
The computer program according to claim 16. Second data relating to an advertisement determined based on the first data is transmitted to the first terminal.
The computer program according to claim 1 or 2. Data including a URL for accessing a database that stores second data relating to an advertisement determined based on the first data is transmitted to the first terminal.
The computer program according to claim 1 or 2. The first condition is,
Furthermore, the first data includes data indicating that the avatar is seated in a predetermined chair.
The chair is configured to allow multiple avatars to sit in it simultaneously.
The computer program according to claim 4. A method performed by at least one processor that executes instructions readable by a computer,
A step of acquiring first data relating to an avatar in a virtual space operated using the first terminal of the first user,
A step of displaying a first display, which includes the avatar and an object that is a display area for displaying predetermined content, on the display unit of the first terminal based on the first data,
If the number of avatars in the virtual space exceeds a predetermined number, or if a specific avatar is present in the virtual space, the system will activate the function to start playing the predetermined content on the target.
method. A method performed by at least one processor that executes instructions readable by a computer,
The process includes receiving first data relating to an avatar in a virtual space operated using the first terminal of the first user via a communication line from the first terminal,
A step of determining first control data that controls the display unit to display a first display including the avatar and a display area for displaying predetermined content on the display unit of the first terminal, based on the first data;
The steps include transmitting the first control data to the first terminal via the communication line,
If the number of avatars in the virtual space exceeds a predetermined number, or if a specific avatar is present in the virtual space, the system will activate the function to start playing the predetermined content on the target.
method. It comprises at least one processor,
The system obtains first data relating to an avatar in a virtual space operated by the first user's first terminal via a communication line from the first terminal,
Based on the first data, a first display including the avatar and an object which is a display area for displaying predetermined content is displayed on the display unit of the first terminal.
If the number of avatars in the virtual space exceeds a predetermined number, or if a specific avatar is present in the virtual space, the system will activate the function to start playing the predetermined content on the target.
Server device.