JP7745609B2 - Program, method, and system - Google Patents

Description

Article 30, Paragraph 2 of the Patent Act applies. COVER Corporation has published information on its website regarding the program, method, and system invented by Kohei Mori. Posting dates: July 16, July 19, September 14, and October 10, 2023. Posting addresses: https://holoearth.com/news/469/ https://holoearth.com/news/829/ https://holoearth.com/news/858/ https://shop.hololivepro.com/products/hololivealternative_yamatophantasia2023_re

Article 30, Paragraph 2 of the Patent Act applies. Cover Corporation published information on the SNS "X" (formerly Twitter) regarding the program, method, and system invented by Kohei Mori. Posting date: June 22, 2023 - October 18, 2023. Account address where the information was published: https://x.com/hololivetv?s=20 https://x.com/hololive_En?s=20 https://x.com/Holoearth_JP?s=20 https://x.com/Holoearth_EN?s=20 https://x.com/hololiveALT?s=20

Article 30, Paragraph 2 of the Patent Act applies. Cover Corporation has published information on the video sharing site "YouTube" regarding the program, method, and system invented by Kohei Mori. Posting dates: June 23, 2023, June 28, 2023, July 16, 2023, September 28, 2023, July 10, 2023. Posting address: https://www.youtube.com/live/uBLaRpT57PA?si=5MvK-70NIBcKvIh1 https://www.youtube.com/live/bXzrjFtaYug? si=Ycbt6W9PA6QQDuMq https://youtu. be/S1Ya6QYHY0s? si=plmCtt4iY1fzi71W https://www. youtube. com/live/fh4QPDiRIps? si=t-WvouPMiE8lqktx https://www. youtube. com/watch? v=-ytVjnX17IE

Article 30, Paragraph 2 of the Patent Act applies. Cover Corporation has released information about the program, method, and system invented by Mori Kohei through its official application "HoloPlus," which can be downloaded from the distribution platform of the website at the addresses below. Publication dates: October 4, 2023, September 25, 2023, September 30, 2023, October 16, 2023 Download addresses: iOS (Apple App Store) https://apps.apple. com/jp/app/%E3%83%9B%E3%83%AD%E3%83%97%E3%83%A9%E3%82%B9/id6443738572 ・Android (Google Play, Inc.) https://play. google. com/store/apps/details? id=com. cover_corp. holoplus

Article 30, Paragraph 2 of the Patent Act applies. Cover Corporation has released information about the program, method, and system invented by Kohei Mori through its official application "HoloEarth Lobby Beta Version," which can be downloaded from the website at the address below. Release date: July 8, 2023, July 15, 2023. Download address: https://holoearth.com/beta/

Article 30, Paragraph 2 of the Patent Act applies. Cover Corporation has published information about the program, method, and system invented by Kohei Mori on the website at the address below, and through videos available for purchase on said website. Publication date: July 15, 2023, September 14, 2023, September 21, 2023. Publication address: SPWN https://virtual.spwn.jp/events/23071501-jpprotolive2?utm_source=Balus&utm_medium=SPWN&utm_campaign=jpprotolive2_Twitter https://virtual.spwn.jp/events/23071501-jpprotolive2?utm_source=Balus&utm_medium=SPWN&utm_campaign=jpprotolive2_Twitter https://virtual.spwn.jp/events/23071501-jpprotolive2?utm_source=Balus&utm_medium=SPWN&utm_campaign=jpprotolive2_Twitter jp/events/23071502-engprotolive2 https://virtual. spwn. jp/events/23102201-jpprotolive2replay https://spwn. jp/events/23102202-engprotolive2replay ・Streaming+ https://eplus. jp/sf/detail/3896010002-P0030003? P6=001&P1=0402&P59=1

The present invention relates to a program, a method, and a system.

A system is known that provides users with a virtual space via a network, allowing them to interact with other users in the virtual space (see, for example, Patent Document 1).

In such systems, desired data is distributed from a server in response to a request from a user terminal, and a virtual space is generated and displayed on the user terminal based on that data.

JP 2011-092240 A

However, with conventional systems, if there is a surge of access to a server, the load on the server increases, making it impossible to deliver the desired data to the user device from which the access originates, and as a result, the virtual space may not be displayed. Furthermore, when an event is held in the virtual space on a predetermined date and time, there may be a situation where users are unable to log in at all due to a surge of logins as the time approaches.

The present invention was conceived in light of this situation, and provides a program, method, and system that allows users to enter and view a virtual space even when access to the server is concentrated.

(1) A program according to an aspect of the present invention (e.g., a virtual space generation program 120, a viewer program) is a program executed by a computer (e.g., a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user,
The computer
functioning as a display means for performing processing to display the image of the virtual space (for example, a virtual space update data distribution process, a viewer's viewpoint video output process, etc.);
The virtual space includes a predetermined space (e.g., space ER5) in which a plurality of types of objects can be displayed, including a first type of object (e.g., an object essential for generating the virtual space, such as a building or a virtual stage G which is a stage object) and a second type of object (e.g., an object that adds excitement to the virtual space, such as a flower stand FS),
The display means
When first object information for displaying the first type of object can be identified, a process for displaying the predetermined space is performed (for example, see steps S215 to S245 in FIG. 33 and the modified example (regarding cluster switching process 2)), regardless of whether second object information for displaying the second type of object can be identified.
A program that, when displaying the specified space, displays the second type of object in a display mode based on the second object information if the second object information can be identified within a specified period of time (for example, if all of the cluster placement information has been read out in step S225 of Figure 33, it is transmitted to the user in step S205), and performs processing to display an alternative object corresponding to the second type of object if the second object information cannot be identified within the specified period of time (for example, identifies an alternative cluster in step S245 of Figure 33; see the modified example (regarding cluster switching processing 2)).

With this configuration, the virtual space can be displayed when the first object information is identified, regardless of whether the second object information can be identified, and when the second object information cannot be identified within a predetermined period of time , a substitute object can be displayed. Therefore, even when the second object information cannot be identified due to a heavy load on the server caused by concentrated access, the user can be allowed to enter the virtual space and the virtual space can be displayed.

(2) In the above (1), the computer is a user terminal (e.g., a viewer terminal 300) that displays the provided virtual space,
The display means displays an alternative object when the first object information can be identified, but when the second object information cannot be identified within the specified period at the time of requesting object information and receiving the second object information (see, for example, the modified example (regarding cluster switching process 2)).

According to this configuration, even when a request for object information is made from the user terminal and second object information cannot be identified within a predetermined period of time , a substitute object can be placed and the virtual space can be displayed.

(3) In the above (1), the computer is a distribution device (e.g., a distribution server computer 100) that distributes information for providing the virtual space to a user terminal,
When the display means receives a request for object information from the user terminal and identifies and delivers object information including the second object information, if the second object information cannot be identified (for example, when cluster placement information cannot be identified even after a predetermined time has elapsed, such as steps S225 to S235 in Figure 33), the display means delivers substitute object information for displaying the substitute object (for example, steps S245 to S205 in Figure 33).

With this configuration, even if the distribution device that receives a request for object information from a user terminal is unable to identify second object information, it can still display the virtual space on the user terminal by distributing substitute object information for displaying a substitute object.

(4) In (1) above, the specified space is a space for providing event content (e.g., a live event in spatial area ER5 in Figure 24) on a scheduled date.

With this configuration, because the virtual space is for providing event content on the scheduled date, even if there is a surge of access to a distribution device such as a server on that scheduled date, the virtual space can be displayed when the first object information is identified, regardless of whether the second object information can be identified or not.

(5) In the above (1), the second type of object is an object whose display mode can be changed (for example, a cluster FS in Figures 29 and 30), and when the second object information cannot be specified, this includes when display mode information corresponding to the current display mode of the second type of object (for example, cluster arrangement information updated in step S203 in Figure 32 or step S213 in Figure 33) cannot be specified.
When displaying the specified space, the display means displays the second type of object in a display mode based on the display mode information if the display mode information can be identified (for example, if all the cluster placement information can be read and entered in step S225, it transmits it to the user in step S205), and when the display mode information cannot be identified, it performs processing to display the second type of object as the substitute object in a specified display mode (for example, it identifies a substitute cluster in steps S225 to S245 of Figure 33 and transmits it to the user in step S205).

With this configuration, the second type of object can be displayed in a predetermined display mode even when the display mode information cannot be identified. Therefore, even when the display mode information corresponding to the current display mode of the second type of object cannot be identified, such as when there is concentrated access to a distribution device such as a server, the user can enter the virtual space and the virtual space can be displayed.

(6) In (1) above, the second type of object is an object whose display mode can be changed depending on the user's actions in the virtual space (for example, a flower stand FS that the user can display in the exhibition area through the purchase process of FIG. 28, etc.).

With this configuration, it is possible to display a second type of object whose display mode can change depending on the user's actions, thereby drawing the user's attention to how the display mode of the second type of object displayed in the virtual space changes depending on the user's actions.

(7) In (6) above, the user's actions include the user's operation of placing the second type of object in the specified space, and the user's operation of generating the display format of the second type of object when placing it (for example, a flower stand FS that the user can display in the display area through the purchase process in FIG. 28, and in which text can be input through step S104 in FIG. 28, etc.).

This configuration allows users to enjoy the fun of changing the placement position and display mode of the second type of object in response to user operations.

(8) A computer control method according to an aspect of the present invention is a method for controlling a computer (e.g., a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user, the method comprising:
a step of performing processing for displaying the image of the virtual space (for example, a virtual space update data distribution process, a viewer's viewpoint video output process, etc.);
The virtual space includes a predetermined space (e.g., space ER5) in which a plurality of types of objects can be displayed, including a first type of object (e.g., an object essential for generating the virtual space, such as a building or a virtual stage G which is a stage object) and a second type of object (e.g., an object that adds excitement to the virtual space, such as a flower stand FS),
The step of performing processing to display an image of the virtual space includes:
When first object information for displaying the first type of object can be identified, a process for displaying the predetermined space is performed (for example, see steps S215 to S245 in FIG. 33 and the modified example (regarding cluster switching process 2)), regardless of whether second object information for displaying the second type of object can be identified.
When displaying the specified space, if the second object information can be identified within a specified period , the second type of object is displayed in a display mode based on the second object information (for example, if all of the cluster arrangement information has been read out in step S225 of Figure 33, it is transmitted to the user in step S205), and if the second object information cannot be identified within the specified period, processing is performed to display a substitute object corresponding to the second type of object.

With this configuration, the virtual space can be displayed when the first object information is identified, regardless of whether the second object information can be identified, and when the second object information cannot be identified within a predetermined period of time , a substitute object can be displayed. Therefore, even when the second object information cannot be identified due to a heavy load on the server caused by concentrated access, the user can be allowed to enter the virtual space and the virtual space can be displayed.

(9) A system according to an aspect of the present invention is a system (virtual space content distribution system) including a computer (e.g., a distribution server computer 100, a viewer terminal 300, etc.) for providing a virtual space to a user,
a display means for performing processing to display the image of the virtual space (for example, a virtual space update data distribution process, a viewer viewpoint video output process, etc.);
The virtual space includes a predetermined space (e.g., space ER5) in which a plurality of types of objects can be displayed, including a first type of object (e.g., an object essential for generating the virtual space, such as a building or a virtual stage G which is a stage object) and a second type of object (e.g., an object that adds excitement to the virtual space, such as a flower stand FS),
The display means
When first object information for displaying the first type of object can be identified, a process for displaying the predetermined space is performed (for example, see steps S215 to S245 in FIG. 33 and the modified example (regarding cluster switching process 2)), regardless of whether second object information for displaying the second type of object can be identified.
When displaying the specified space, if the second object information can be identified within a specified period , the second type of object is displayed in a display mode based on the second object information (for example, if all of the cluster placement information has been read out in step S225 of Figure 33, it is transmitted to the user in step S205), and if the second object information cannot be identified within the specified period, processing is performed to display an alternative object corresponding to the second type of object (for example, an alternative cluster is identified in step S245 of Figure 33; see the modified example (regarding cluster switching processing 2)).

With this configuration, the virtual space can be displayed when the first object information is identified, regardless of whether the second object information can be identified, and when the second object information cannot be identified within a predetermined period of time , a substitute object can be displayed. Therefore, even when the second object information cannot be identified due to a heavy load on the server caused by concentrated access, the user can be allowed to enter the virtual space and the virtual space can be displayed.

1 is a block diagram illustrating an example of a system configuration of a virtual space content distribution system according to an embodiment of the present invention. 1 is a diagram illustrating an example of the configuration of a delivery server computer in a virtual space content delivery system according to an embodiment of the present invention. FIG. 2 is a diagram showing various data stored in a storage device of a delivery server computer according to an embodiment of the present invention. 1 is a diagram illustrating an example of the configuration of a performer terminal in a virtual space content distribution system according to an embodiment of the present invention. FIG. 2 is a diagram illustrating an example of the configuration of a viewer terminal in the virtual space content distribution system according to the embodiment of the present invention. FIG. 2 is a diagram illustrating an example of the configuration of an administrator terminal in the virtual space content distribution system according to the embodiment of the present invention. 3 is a diagram illustrating an example of the configuration of event data in the virtual space content distribution system according to the embodiment of the present invention. FIG. 3 is a diagram showing an example of the configuration of performer user data in the virtual space content distribution system according to the embodiment of the present invention. FIG. FIG. 2 is a diagram showing an example of the configuration of viewer user data in the virtual space content distribution system according to the embodiment of the present invention. 3 is an explanatory diagram showing data exchanged between each terminal and a server computer that constitutes the virtual space content distribution system according to the embodiment of the present invention; FIG. 1 is a schematic diagram showing studio equipment used by performer users in a virtual space content distribution system according to an embodiment of the present invention. FIG. FIG. 1 is a diagram showing an overall image of a virtual space according to an embodiment of the present invention. 1 is a diagram showing a virtual live concert venue, which is a virtual space used in a virtual space content distribution system according to an embodiment of the present invention. 10A and 10B are diagrams illustrating examples of displays on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. 10A and 10B are diagrams illustrating examples of displays on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. 10A and 10B are diagrams illustrating examples of displays on a performer terminal constituting a virtual space content distribution system according to an embodiment of the present invention. 10A and 10B are diagrams illustrating examples of display by zooming operation on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. 10A and 10B are diagrams illustrating examples of display by zooming operation on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. 10A and 10B are diagrams illustrating examples of displays on a viewer terminal constituting the virtual space content distribution system according to the embodiment of the present invention. 10A and 10B are diagrams showing examples of display of a flying effect period on a viewer terminal constituting a virtual space content distribution system according to an embodiment of the present invention. 10 is a flowchart showing an example of a viewer viewpoint video control process executed in a viewer terminal constituting the virtual space content distribution system according to an embodiment of the present invention. FIG. FIG. 10 is a diagram showing a virtual live concert venue in a modified example. FIG. 10 is a diagram showing a participation position selection screen for a virtual live concert venue in a modified example. FIG. 2 is a diagram showing an example of an overhead view of a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a diagram showing an example of a display mode of a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a diagram showing an example of a display mode during a purchase process for an object displayed in a virtual space according to an embodiment of the present invention. 10 is a table showing an example of object types and user-related information used in a purchase process for an object displayed in a virtual space according to an embodiment of the present invention. FIG. 10 is a flowchart showing an example of a purchasing process for an object displayed in a virtual space according to an embodiment of the present invention. 10A to 10C are diagrams illustrating an example of a transition of a display mode of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a diagram showing another example of a transition of the display mode of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. 10 is a table showing an example of associations between objects displayed in a predetermined type of virtual space and predetermined areas according to an embodiment of the present invention. FIG. 10 is a flowchart showing an example of a process for switching objects displayed in a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a flowchart showing an example of a process for switching objects displayed in a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a diagram showing another example of a transition of the display mode of an object displayed in a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a diagram showing an example of event content provided in a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a diagram showing an example of a table relating to objects displayed in event content provided in a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a diagram illustrating an example of a process for determining an object to be displayed in event content provided in a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a diagram showing an example of a table used in processing related to event content provided in a predetermined type of virtual space according to an embodiment of the present invention. FIG. 10 is a flow diagram showing an example of processing related to event content provided in a predetermined type of virtual space according to an embodiment of the present invention. 10A and 10B are diagrams illustrating a period before the scheduled date and re-provision of event content according to an embodiment of the present invention. FIG. 10 is a flowchart showing an example of a special switching process according to the present invention. FIG. 10 is a flow chart showing an example of room entry exception processing of the present invention. FIG. 10 is a flowchart illustrating an example of a component reset process according to the embodiment of the present invention. FIG. 10 is a diagram showing an example of a screen on which an action is performed on an object displayed in a predetermined type of virtual space according to an embodiment of the present invention.

The following describes, based on examples and with reference to the drawings, embodiments of a virtual space content distribution system for distributing various types of content within a virtual space according to the present invention. Note that identical or similar components in multiple drawings will be designated by the same reference numerals, and redundant explanations will be omitted. Furthermore, the distribution program executed in the virtual space content distribution system according to the present invention may be a program used by the entire system, consisting of the server computer and each terminal described below that constitute the virtual space content distribution system, or it may operate only on a portion of the devices that constitute the virtual space content distribution system, such as the server computer or each terminal.

Figure 1 is a block diagram showing an example of the system configuration of a virtual space content distribution system in an embodiment that is one embodiment of the present invention. In the system of this embodiment shown in Figure 1, a performer avatar 1 corresponding to a performer user is distributed as virtual space content in which events such as live performances, games, social gatherings, and movie nights take place within the virtual space.

As shown in FIG. 1, the virtual space content distribution system of this embodiment is primarily composed of a distribution server computer 100 capable of executing various processes related to the virtual space and various processes related to the provision and distribution of the virtual space; an administrator terminal 150 used by an event manager K of an event management organization that operates and manages events in the virtual space to manage the distribution of events in the virtual space; a performer terminal 200 used by performer users; and a viewer terminal 300 used by viewer users who enter and participate in the virtual space (e.g., log in to the virtual space) and view event content in the virtual space. The distribution server computer 100, administrator terminal 150, performer terminal 200, and viewer terminal 300 are connected to each other via the Internet N, an open computer network, to enable data communication.

In this embodiment, the administrator terminal 150 and performer terminal 200 are also shown connected to the distribution server computer 100 via the Internet network N, but the present invention is not limited to this. For example, in cases where an event management organization provides studios to performer users and the distribution server computer 100 is installed in these studios, the administrator terminal 150 and performer terminal 200 may be locally connected to the distribution server computer 100 via data communication, or may be connected via a local area network LAN within the studio facility.

Furthermore, as shown in FIG. 1, there are multiple viewer users, such as viewer user A, viewer user B, viewer user C, etc., and viewer terminals 300 include viewer terminals 300a, 300b, 300c, etc. that can be used by individual viewer users A, B, C, etc. Note that while there are typically multiple viewer users, there may be one or four or more, and the number can be determined appropriately depending on the type of event content provided in the virtual space, etc. Hereinafter, viewer user A, viewer user B, viewer user C, etc. may be collectively referred to as viewer users, and viewer terminals 300a, 300b, 300c, etc. may be collectively referred to as viewer terminals 300.

Furthermore, while this embodiment illustrates a form in which there is one performer user, the present invention is not limited to this. The event content provided in the virtual space may be a joint event involving the participation of multiple performer users who are working independently, or a group event involving the participation of a group of multiple people working together. In this way, when multiple performers appear, performer terminal 200a, performer terminal 200b, performer terminal 200c, etc. may be provided for each performer user, or when a group of multiple people appear, one performer terminal 200 may be used by multiple people. Note that performer users (also referred to as talent users) are users who act as speakers, emcees/facilitators, starring roles, etc. within the event content. The event content is advanced by avatars that act as facilitators, such as performer avatars that correspond to the actions of the performer users and operator avatars that correspond to the operations of the event operator (also referred to as operator users).

In addition, while Figure 1 illustrates the distribution server computer 100 as a single unit, the present invention is not limited to this. These distribution server computers 100 may be configured with multiple server computers, such as a first server computer that primarily performs virtual space processing and a second server computer that primarily performs distribution processing, or may be configured as a cloud server, etc., allowing the number of server computers to be changed appropriately depending on the scale of the event, the number of participating viewer users, etc.

Similarly, while the administrator terminal 150 is shown as a single unit in Figure 1, the present invention is not limited to this, and it goes without saying that there may be multiple administrator terminals 150 depending on the number of performer users and viewer users participating in event content such as a live performance.

<Distribution server computer>
Figure 2 is a diagram showing the configuration of the distribution server computer 100 used in this embodiment. As described above, the distribution server computer 100 used in this embodiment is a normal server computer with relatively high processing power installed in a studio operated by an event management organization, and as shown in Figure 2, has a processor (CPU) 101 connected to a data bus 108, memory (RAM) 102, storage 103 such as a hard disk, a communication interface (I/F) 104 capable of two-way communication using the TCP/IP protocol via the Internet, which is an open computer network, and an input/output interface (I/F) 105 to which an input device such as a keyboard can be connected.

In this embodiment, an input/output interface (I/F) 105 is provided to enable local operation, but if remote operation is possible via a communication interface (I/F) 104, the input/output interface (I/F) 105 may not be provided.

In addition to an operating system (server OS) for providing server functions (not shown), the storage 103 of the distribution server computer 100 also stores various data and programs, as shown in FIG. 3. Specifically, the storage 103 mainly stores an event management program 110 for providing an event management function for managing various events, a virtual space generation program 120 for providing a virtual space for the event venue, a performer user management program 130 for providing a performer user management function for managing performer users, and a viewer user management program 132 for providing a viewer user management function for managing viewer users.

The event management program 110 is a program for managing events held at an event venue in cooperation with the administrator terminal 150, and is capable of managing the progress of the event using event data 111 (see Figure 7), time schedule data (TS data) 112, music data 113, and the like stored in storage 103 together with the event management program 110.

An example of the event data 111 used in this embodiment is shown in Figure 7. The event data 111 stores information such as the event name, the file name of the time schedule (TS) data, the performer IDs uniquely assigned to the performers, the file names of song lists, etc., the file name of a participating viewer list in which information about special viewer users permitted to participate virtually is registered in the third area of the virtual audience area described below, and the file name of a participating viewer list in which information about viewer users who have reserved virtual participation is registered in the fourth area of the virtual audience area described below. The event data also includes information for specifying the date and time when the event will be held, and the event content will be distributed at that date and time. The event data also includes information for specifying the date and time when the virtual space in which the event will be held will be released, for content that users can enter by releasing the virtual space in which the event will be held from the scheduled date of the event.

The time schedule data (TS data) 112 is data that describes the order of events and the programs, such as songs, of the virtual space live event being held in chronological order, and the virtual space live event is managed so that it progresses based on the time schedule described in the time schedule data (TS data) 112. The time schedule data (TS data) 112, event data 111, etc. can be changed, updated, or added by event manager K operating the manager terminal 150.

In addition, the song data 113 is data for the performance parts (so-called karaoke) of each song sung by the performer user, and is played by the audio control program 124 (described below) based on the time schedule data (TS data) 112 by the event management program 110, and transmitted to the performer terminal 200 and the viewer terminal 300 (see Figure 11).

The virtual space generation program 120 is a program for providing an event venue, which is a virtual space, and has the function of providing an event venue in which performer avatars and viewer avatars are virtually participating, using virtual space data 121 describing the structure of the event venue, which is stored in storage 103 together with the virtual space generation program 120; object data 122 for placing various objects to be placed in the event venue (including star decorations 43 on the stage and star objects 50-52 in the sky) within the virtual space; and performer avatar data included in performer user data 131 (described below) and viewer avatar data included in viewer user data 133.

The viewpoint image control program 123 provides the function of generating viewpoint images from virtual cameras C1-C4 virtually set up at the event venue and an airborne virtual camera (not shown), as shown in FIG. 13, and also provides the function of working with the viewer terminal 300 to display on the performer terminal 200 images from the viewpoints of viewer avatars 11-14 virtually participating in the third area of the event venue and viewer avatars 21-32 virtually participating in the fourth area. Virtual camera C2 is a virtual camera set up to display images from the viewpoint of performer avatar 1 on the stage at the event venue, and the viewpoint image from virtual camera C2 is projected onto a screen S set up in the studio by a projector 211 (described later) connected to the viewer terminal 300.

The audio control program 124 is a program for controlling the audio (including music) distributed during events in virtual space. Specifically, it provides functions for playing music data 113 and for synthesizing audio produced by performer users with the played music and distributing the resulting audio to the administrator terminal 150 and viewer terminal 300.

The comment control program 125 cooperates with the viewer comment control program stored in the viewer terminal 300 (described below) to provide a function for displaying, in chronological order, various comments entered by each viewer user on the viewer terminal 300 during an event in virtual space on the performer terminal 200 and the viewer terminal 300.

The gift control program 126 is a program that cooperates with the viewer program stored in the viewer terminal 300 (described below) to control gifts given by viewer users to performer users. Specifically, it provides functions such as allowing viewer users to purchase gifts (e.g., purchase of objects, etc.) based on purchase price information set for various gifts stored in the gift data 134, processing functions that allow viewer users to give gifts purchased using gift object data included in the gift data 134 to performer users (including processing for presentation effects when giving gifts), and processing functions for changing the owner of a given gift from the viewer user to the performer user.

The performer user management program 130 provides functions such as management of information about performer users and authentication functions based on the performer user data 131 shown in Figure 8, which is stored in storage 103 together with the performer user management program 130.

An example of the performer user data 131 used in this embodiment is shown in Figure 8. The performer user data 131 stores various information, such as the performer user's account (email address), name, authentication information, the file name of the avatar data for the avatar used in the virtual space, and the file name of the item list in which the performer user's owned items are registered, in association with the performer user ID uniquely assigned to the performer user. Although not shown in Figure 8, information on virtual value such as points owned by each performer user may also be stored as performer user data 131.

Performer users can be authenticated by matching their performer user ID, account, and authentication information, and items (gifts) that each performer user has received from viewers can be identified from an item list.

The viewer user management program 132 provides functions such as management of information about viewer users and authentication functions based on the viewer user data 133 shown in Figure 9, which is stored in storage 103 along with the program.

An example of the viewer user data 133 used in this embodiment is shown in Figure 9. The viewer user data 133 stores various information associated with a viewer user ID uniquely assigned to the viewer user, such as the viewer user's account (email address), authentication information, the file name of the avatar data for the avatar used in the virtual space, owned points, which are the number of points owned that can be used in the virtual space, the file name of the item list in which items (gifts) purchased using points are registered, and personal information such as name, date of birth, and telephone number. Although not shown in Figure 9, the nickname (comment name) displayed along with the comment is also registered in the viewer user data 133, and this nickname (comment name) is displayed along with the comment. Points can also be increased by purchasing them, for example, from a specified operating company.

<Performer terminal>
Fig. 4 is a diagram showing an example of the configuration of a performer terminal 200 in the virtual space content distribution system of this embodiment. In this embodiment, as shown in Fig. 11, the performer terminal 200 is installed in a control room adjacent to a studio where performers perform their actions, and uses a normal computer with relatively high processing power. As shown in Fig. 4, the performer terminal 200 has a processor (CPU) 201 connected to a data bus 208, memory (RAM) 202, storage 203 such as a hard disk, a communication interface (I/F) 204 capable of two-way communication using the TCP/IP protocol via the Internet, which is an open computer network, an image processing unit 206 including a graphics processing unit (GPU) to which display devices A 210 to C 212 are connected, and an input/output interface (I/F) 205 to which various input/output devices are connected.

The input/output interface (I/F) 205 is connected to input devices such as a motion sensor 220 including multiple wearable sensors 220C1-220C5 (see Figure 11) worn by the performer user on the left and right limbs and waist, an expression input device 221 consisting of an imaging camera for inputting the performer's facial expressions, a voice input device 222 consisting of a sound-collecting microphone worn on the performer user's head, and an operation input device 224 such as a keyboard or touch panel that can be operated by an assistant operator O assisting the performer user. These input devices may also be provided with controllers that the performer user can hold to perform various operations, allowing the performer to perform various operations themselves without the assistance of the assistant operator O.

In this embodiment, the performer user performs performance actions (musical actions) in sync with the music, and an assistant operator O assists with operations during the performance. However, it is also possible to have multiple assistant operators O, or to set the operation content in advance in the performer terminal 200, for example, in a sequence program, thereby eliminating the need for an assistant operator O.

The input/output interface (I/F) 205 is connected to an audio output device 223, which includes high-performance earphones (ear monitors) worn by the performer user as output devices and speakers located in the control room. This allows the sound of the music being played sent from the distribution server computer 100 to be output to the performer user via the high-performance earphones (ear monitors), and the music audio is output from the speakers along with the performer's voice, allowing an assistant operator O or the like to check the status of the music, including the voice produced by the performer user, in the control room.

In this embodiment, high-performance earphones (in-ear monitors) are used to avoid the inconvenience of the reproduced music audio being input from the sound-collecting microphone worn by the performer user, but the present invention is not limited to this, and the music audio may be output from speakers in the studio, etc., as long as the inconvenience of inputting the music audio can be avoided.

In this embodiment, the sound collection microphones are shown as being worn by the performers, but these sound collection microphones may also be installed on the floor, walls, or ceiling of the studio.

Here, we will explain the motion sensor 220 used in the performer terminal 300 of this embodiment. Any motion sensor 220 can be used as long as it can properly detect (measure) the body movements (movements) of the performer user. In this embodiment, in order to detect the performer's movements more accurately and in a shorter cycle, multiple wearable sensors 220C1 to 220C5 are used that are worn by the performer user on their body. Note that the motion sensor 220 may also be a type that does not require the performer to wear any equipment, such as a LiDAR that uses laser light, etc.

In this embodiment, in order to reduce the burden on the performer user's head, particularly the burden on the performer user's head, caused by wearing sensors when performing movements, as described below, the performer user's head movements are detected by image recognition using images captured by the imaging camera that constitutes the facial expression input device 221, and movements other than those of the head are detected using five wearable sensors 220C1 to 220C5. However, for example, wearable sensors may also be provided on the performer user's head, or even more wearable sensors (seven or more) may be worn to detect more detailed movements.

As shown in Figure 11, the wearing sensors 220C1 to 220C5 detect their own position and orientation in cooperation with base station 220a and base station 220b, which are installed in a studio room separated from the adjacent control room by a glass window.

Base station 220a and base station 220b can use, for example, multi-axis laser emitters. Base station 220a emits a flashing light for synchronization and then scans the laser light around, for example, a vertical axis. Base station 220b scans the laser light around, for example, a horizontal axis.

Each of the mounting sensors 220C1 to 220C5 may include multiple optical sensors that detect the incidence of flashing light and laser light from base station 220a and base station 220b.

Each of the wearing sensors 220C1 to 220C5 is capable of detecting its own position and orientation based on the time difference between the incidence of the flashing light and the incidence of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and other information as needed. For example, ViveTracker or a base station provided by HTC CORPORATION can be suitably used.

Base station 220a and base station 220b emit flashing lights and perform laser light scanning at regular intervals, so the detection information of each wearable sensor 220C1-220C5 is updated at each interval. The detection information indicating the position and orientation of each motion sensor calculated by each of these wearable sensors 220C1-220C5 is input to the performer terminal 200 via short-range wireless communication and transmitted to the distribution server computer 100 as performer avatar information along with facial motion information (see Figure 10).

Note that while this embodiment illustrates a configuration using two base stations, base station 220a and base station 220b, the present invention is not limited to this, and three or more base stations may be used.

Motion sensor 220 may also be configured such that multiple motion sensors worn by performer users are each equipped with multiple infrared or visible light LEDs, and the position and orientation of each motion sensor can be detected by detecting the light from these LEDs with an infrared camera installed on the floor or wall of the studio.

Furthermore, in order to reduce the burden on the performer user, the motion sensor 220 may be replaced with a motion sensor using lighter reflective markers instead of the wearable sensors 220C1-220C5. In other words, the motion sensor may detect the performer user's movements by photographing reflective markers attached to various parts of the performer user's body with adhesive tape or the like to generate image data, and then processing this image data to detect the position and orientation of the reflective markers. In this case, a cameraman may be positioned in the studio to photograph the performer user, and the cameraman may photograph the performer user from a direction suitable for detection, allowing the performer user's movements to be detected effectively.

The motion sensor 220 may also be a suit with a built-in inertial sensor, such as the inertial sensor suit for the MVN motion capture system marketed by Xsens.com, and the movements of the performer user may be detected by analyzing the sensor signal output from the inertial sensor.

Any facial expression input device 221 can be used as long as it can properly detect the head movements, including the face, of the performer user. In this embodiment, it is specifically configured as an imaging camera (digital camera) positioned so that it can continuously capture head images, including the face, of the performer user. The head movements and facial movements (facial expressions) of the performer user captured by the imaging camera are detected using image recognition, and facial motion information, which is the detected head movements and facial movements (facial expressions), is sent to the distribution server computer 100 as performer avatar information along with body motion information, as shown in FIG. 10.

Note that the facial expression input device 221 is not limited to the imaging camera (digital camera) used in this embodiment. For example, the facial expression input device 221 may be a 3D camera capable of detecting the depth of a person's face, or a mobile terminal such as a smartphone equipped with a LiDER device. In this case, the performer user may wear such a mobile terminal.

As described above, the performer terminal 200 of this embodiment has three display devices A210 to C212. Display device A210 is an LCD monitor or the like installed in the control room, as shown in FIG. 11. Display device B211 is a projector that projects images onto a screen S installed in the studio. Display device C212 is a large vertical display installed adjacent to the screen S in the studio.

Display device A210, located in the studio's control room, displays images from each of the viewpoints of virtual cameras C1 to C4, as well as viewpoint images from a virtual camera moving in the air during the flying performance period described below, as well as the content of comments and a message input window where assistant operator O can input any message he or she wishes to convey to the performer user.

Meanwhile, a screen S projected from a projector, which is a display device B211 installed in the studio, displays an image from the viewpoint of the performer, virtual camera C2 (see Figure 13), including the avatars of viewers virtually participating in the live performance in the third and fourth areas, as shown in Figure 16, for example, allowing the performer user to check the status of the viewer users virtually participating in the virtual space live performance through the image.

In addition, comments from viewer users, as well as comments and messages entered by assistant operator O, are displayed on display device C212 installed in the studio, allowing performer users to check comments from viewer users and messages from assistant operator O even during the performance.

In addition to the operating system (OS) for running the computer that is the performer terminal 200, the storage 203 also stores a performer program that, when executed by the processor (CPU) 201 and the like, works in cooperation with the distribution server computer 100 to provide various functions, including the ability for the performer user to control the movement of the performer avatar 1 in the virtual space live, which is virtual space content.

As shown in Figure 4, the performer programs include a performer avatar control program, a performer viewpoint image control program, a performer viewpoint image control program, a performer audio control program, a performer comment control program, performer authentication data, etc.

The performer avatar control program is a program that primarily provides the function of scanning the performer user's body motion using the motion sensor 220 and scanning the performer user's facial motion (facial expression) using the facial expression input device 221, generating performer avatar information for operating the performer avatar, and transmitting this information to the distribution server computer 100.

The performer's viewpoint video control program is a program that provides the function of generating and outputting viewpoint video from virtual camera C2, which is the performer's viewpoint, based on the virtual space update data distributed from the distribution server computer 100.

The performer audio control program is a program that provides the function of outputting the playback sound of a song based on the playback music data distributed from the distribution server computer 100 via the audio output device 223, converting the audio input from the audio input device 222 into data and sending it to the distribution server computer 100 as performer audio data, and generating and outputting monitor audio consisting of the playback sound of the song and the performer's audio.

The performer comment control program is a program that provides the function of displaying comments by viewer users that are distributed from the distribution server computer 100.

Performer authentication data is data used to authenticate the identity of the performer user when connecting to the distribution server computer 100 for communication.

The performer avatar control program also includes a motion parameter generation program capable of generating parameter information for the positions and rotation angles of the bones that make up the rig data (sometimes called "skeleton data") that indicates the skeleton of the performer avatar included in the performer avatar data, as well as an image recognition processing program for image recognition of the performer user's head position and facial expression from images captured by the imaging camera.

In addition, in this embodiment, the performer terminal 200 is illustrated as a computer installed in a studio run by an event management organization that is used jointly by multiple performer users to serve as the performer terminal 200 for a live event, and each performer user can enter performer authentication data to use the computer as their own performer terminal 200. However, the present invention is not limited to this. For example, when a performer user appears in a virtual space live event from their home, etc., the performer terminal 200 may be a personal computer installed in the performer's home that is used only by the performer user who owns it. In such cases, it is not necessarily necessary to store performer authentication data.

In this way, by having a performer user or the like use the performer terminal 200 that constitutes the virtual space content distribution system of this embodiment, the performer user can move the performer avatar 1 placed on the virtual stage G at the event venue in conjunction with their own movements, can reflect their own facial expressions in the facial expressions of the performer avatar 1, and can distribute their own voice as the voice of the performer avatar 1 to viewers via the distribution server computer 100.

<Viewer terminal>
Fig. 5 is a diagram showing an example of the configuration of a viewer terminal 300 in the virtual space content distribution system of this embodiment. In this embodiment, the viewer terminal 300 is a smartphone P carried by a viewer user or a typical desktop computer (PC) installed in the viewer user's home or the like, and as shown in Fig. 5, has a processor (CPU) 301 connected to a data bus 308, memory (RAM) 302, storage 303 such as a hard disk or non-volatile memory, a communication interface (I/F) 304 capable of two-way communication using the TCP/IP protocol via the Internet, which is an open computer network, an image processing unit 306 including a graphics processing unit (GPU) to which a display device 310 is connected, and an input/output interface (I/F) 305 to which various input/output devices are connected.

The display device 310 is only required to be capable of displaying various viewpoint images generated based on virtual space data of the event venue, which is a virtual space updated by virtual space update data (see FIG. 10) distributed from the distribution server computer 100, using a viewer viewpoint image control program included in the viewer program stored in storage 303, as described below, and flying viewpoint images distributed from the distribution server computer 100 during the flying performance period described below. If the viewer terminal 300 is a smartphone P, the display device 310 corresponds to the display of the smartphone P. If the viewer terminal 300 is a conventional computer (PC), the display device 310 corresponds to a stationary display that constitutes the computer (PC). Note that these displays are not limited to those that display planar images (2D images), and may also be capable of displaying stereoscopic images (3D images) by displaying right-eye and left-eye images, such as a head-mounted display (HMD) that can be worn by the viewer.

The input/output interface (I/F) 305 is connected to an operation input device 321, which consists of one or more devices that allow the viewer to perform various operations, as input devices, and an audio output device 322, such as earphones or speakers, that can output live audio, etc., distributed from the distribution server computer 100.

It goes without saying that the audio output device 322 need not be a standalone device, but may be integrated with the display device 310, like the head-mounted display (HMD) described above.

The operation input device 321 can be any device that allows the viewer to perform various operations such as movement operations including moving the viewer avatar, zoom operations, operations related to comments, operations related to gifts, etc. For example, it may be composed of at least one of a transparent touch panel formed on the surface of a smartphone display, a keyboard that constitutes a computer, a game controller, etc.

In this embodiment, as will be described later, the virtual audience area at the event venue is divided into a third area near the virtual stage G, in which only viewer users specially permitted by the performer user can virtually participate, and a fourth area around the third area in which general viewer users can virtually participate, as shown in FIG. 13, for example. Viewer users who virtually participate in the fourth area may use an operation input device 321 such as a touch panel, keyboard, or game controller, as described above, but viewer users who virtually participate in the third area may use an operation input device 321 such as an MVN motion capture suit equipped with the inertial sensor described above, and, like the performer users, they are viewer users who can precisely control the viewer avatar with their own movements.

However, even viewer users who are permitted to virtually participate in the third area cannot change the facial expressions of their viewer avatars, but the present invention is not limited to this. For example, as described above, viewer users may be able to change the facial expressions of these viewer avatars, even if it is at a different level from the performer user's level of change, by having the viewer user's facial expression recognized using the camera function on their smartphone or a camera connected to a computer.

The various input/output devices connected to these input/output interfaces (I/F) 305 may be internal or external, and in the case of external devices, they may be connected via either a wired or wireless connection.

In addition to an operating system (OS) for operating the viewer terminal 300, such as a smartphone or computer, the storage 303 also stores a viewer program as a viewing app that, when executed by the processor (CPU) 301 or the like, works in cooperation with the distribution server computer 100 to provide various functions, including a live viewing function for viewer users in the virtual space live content.

As shown in FIG. 5, the viewer programs include a viewer viewpoint image control program that provides the function of generating each viewpoint image of the live virtual space to be displayed on the display device 310, a viewer audio control program that provides the function of outputting live audio from the audio output device 322 based on the live audio (data) of the live virtual space distributed from the distribution server computer 100, a viewer comment control program that displays comments based on comment data distributed from the distribution server computer 100 and provides comment-related functions such as comments entered by the viewer and sending them to the distribution server computer 100, and viewer authentication data for authenticating the identity of the viewer user when communicating with the distribution server computer 100.

In addition to the above-mentioned programs, although not shown in Figure 5, other programs may be included, such as a gift control program that controls gifts and the placement of objects in the virtual space, a program for purchasing tickets for viewer avatars to virtually participate in an event, and, as shown in Figures 22 and 23, an area designation program for reserving an area (position) at the event venue where a viewer avatar will virtually participate in the event in advance before the event begins.

In this embodiment, the comments entered by the viewer are short messages in text format, but they are not limited to these short messages in text format and may be, for example, messages in the form of still images, messages in the form of video, or any other electronic message format. The comments are displayed superimposed on each viewpoint video on the display device 310.

In this way, by using the viewer terminal 300 that constitutes the virtual space content distribution system of this embodiment, a viewer user can move and operate the viewer avatar virtually participating in the event venue, and by changing the viewpoint of the viewer avatar, change the viewpoint image displayed on the display device 310. The zoom state (viewpoint state) can also be changed, and the viewer avatar can be operated to cheer on the performer avatar 1.

Note that a viewer avatar virtually participating in the third area is only allowed to move within the third area and cannot move to the fourth area. On the other hand, a viewer avatar virtually participating in the fourth area is only allowed to move within the fourth area and cannot move to the third area. However, the present invention is not limited to this, and a viewer avatar virtually participating in three areas may be allowed to move to the fourth area. Note that viewer avatars naturally cannot move onto virtual stage G, etc., so the visibility of performer avatar 1 is not obstructed by the viewer avatar moving onto virtual stage G.

In addition, by displaying viewpoint images on these display devices 310 and outputting live audio, you can enjoy the virtual space live event as if you were actually present at the event venue.

In addition, although a detailed explanation will be omitted, the comment function provided by the viewer comment control program allows viewers to enjoy the virtual space live show while checking comments entered by themselves and other viewer users, and the gift function provided by the gift control program allows viewers to liven up the virtual space live show by gifting items they own to performer avatar 1.

<Administrator terminal>
6 is a diagram showing an example of the configuration of an administrator terminal 150 in the virtual space content distribution system of this embodiment. In this embodiment, the administrator terminal 150, together with the performer terminals 200, uses a normal computer installed in a control room adjacent to the studio, and as shown in FIG. 6, has a processor (CPU) 151 connected to a data bus 158, memory (RAM) 152, storage 153 such as a hard disk, a communication interface (I/F) 154 capable of two-way communication using the TCP/IP protocol via the Internet, which is an open computer network, an image processing unit 156 including a graphics processing unit (GPU) to which a display device 160 is connected, and an input/output interface (I/F) 155 to which various input/output devices are connected.

The display device 150 is configured as one or more stationary displays, and is capable of individually displaying the viewpoint images of each of the virtual cameras C1 to C4 (described below) and the virtual camera moving in the air during the flying performance period, which are generated based on the virtual space data of the event venue, which is a virtual space updated by the virtual space update data (see Figure 10) distributed from the distribution server computer 100, using an administrator viewpoint video control program included in the administrator program stored in storage 153, as described below, and also capable of displaying comments based on the comment data distributed from the distribution server computer 100.

The input/output interface (I/F) 155 is connected to an operation input device 161 consisting of one or more devices that allow the administrator K to perform various operations as input devices, and an audio output device 162 such as earphones, headphones, or speakers that can output live audio, etc., distributed from the distribution server computer 100.

The operation input device 161 can be any device that allows the administrator K to perform various operations such as input and settings related to the virtual space live event, and may be composed of, for example, at least one of a keyboard that constitutes a computer, a transparent touch panel formed on the surface of a display, a viewpoint switching controller, etc.

The various input/output devices connected to the input/output interface (I/F) 155 may be connected either wired or wirelessly.

In addition to the operating system (OS) for running the computer that is the administrator terminal 150, the storage 153 also stores an administrator program that, when executed by the processor (CPU) 151, etc., works in cooperation with the distribution server computer 100 to provide various functions, including distribution management functions related to the distribution of virtual space live content, which is virtual space content.

As shown in Figure 6, the administrator programs include an administrator viewpoint video control program, an administrator audio control program, an administrator comment control program, an audience management program, a performer management program, etc.

The administrator viewpoint image control program is a program that provides the function of generating viewpoint images from each virtual camera to be displayed on the display device 160, as well as the function of changing and switching between each viewpoint.

The administrator audio control program is a program that provides the function of outputting live audio from the audio output device 162 based on the virtual space live audio data distributed from the distribution server computer 100.

The administrator comment control program is a program that displays comments based on comment data distributed from the distribution server computer 100, and provides comment-related functions such as prohibiting comments from being distributed and selecting viewers to prevent them from being distributed.

The viewer management program is a program for managing viewer users who virtually participate in a virtual space live event, and the performer management program is a program for managing performer users who virtually participate in a virtual space live event.

Note that although not shown in Figure 6, the system includes an authentication program for verifying whether the administrator who is the operator is the actual person, and a schedule program for editing the time schedule and song order of the virtual space live performance, but other programs may also be included.

In this way, by operating the administrator terminal 150 that constitutes the virtual space content distribution system of this embodiment, administrator K can make various settings for executing the event, such as settings related to the program, song order, performance, time schedule, and the trajectory of the aerial moving virtual camera during the flying performance period, and the virtual space live performance is managed based on the settings made in this way.

<Overall image of virtual space>
As an example of content, the following describes content in which performers hold a live event in a virtual live venue. FIG. 12 shows an overall view of the virtual space provided by the system of this embodiment. The virtual space ER of this embodiment includes multiple spatial areas ER (spatial area ER1, spatial area ER2, etc.). Each spatial area ER can provide content of different genres and types. The multiple spatial areas ER include, for example, an entrance that functions as a lobby when a user logs into the virtual space ER, and areas corresponding to various content such as a live venue, game content, and exhibition hall. Note that various areas may be selectable from a title screen displayed when a user logs into the virtual space ER. The event venue, described below using FIGS. 13, 24, and 25, is constructed in the entirety of a specified spatial area ER or in a portion of a specified spatial area ER.

Each spatial area ER has multiple rooms providing the same content. Each room has a set maximum number of users that can enter, up to 200 people, for example. Each room is managed, for example, by a real-time synchronization server. Users in the same room can see each other's user avatars and communicate with each other. For example, they can play games together or chat. For example, if spatial area ER1 is a space modeled after a city, the rooms ER1a, ER1b, etc. corresponding to spatial area ER1 provide users with the same city-like space, but the only avatars that can be displayed in the space are user avatars corresponding to users associated with the same room. For example, user avatar 1 of a user associated with room ER1a is not displayed on the user screen of a user associated with room ER1b. However, in exceptional cases, the user avatar of a special user (e.g., a celebrity) can be displayed not only in the room they are actually in, but also in other rooms (this is also known as mirroring).

When moving between spatial areas ER, a user may be required to pass through a spatial area ER designated as an area providing specific content (e.g., an entrance) after logging in to the virtual space before moving to another spatial area ER. Alternatively, users may be able to move between spatial areas ER. For example, users may be required to pass through spatial area ER1 before moving from spatial area ER2 to spatial area ER3, or users may be able to move directly between spatial areas ER2 and ER3 without passing through spatial area ER1. Furthermore, when moving between spatial areas ER, a switching effect may be implemented. For example, when moving to another spatial area ER, the display screen may go dark (e.g., a black screen with a message such as "Loading...") before switching. Furthermore, users may first enter an entrance area after logging in to access each spatial area ER, or they may be able to select and enter their preferred spatial area ER without passing through the entrance area, or they may transition to a spatial area ER randomly determined by lottery. For each room, users can choose to enter a room of their choice, or they can enter a room selected randomly by lottery.

<Virtual live venue>
A virtual live venue, which is the virtual space used in this example, is shown in Fig. 13. The virtual live venue shown in Fig. 13 is constructed in a predetermined spatial area ER out of the spatial area ER shown in Fig. 12. As shown in Fig. 13, the virtual live venue, like a live venue in real space, is a virtual space that has a virtual stage G where performer users appear as performer avatars 1 and a virtual audience area where viewer users who will become audience members virtually participate as viewer avatars.

As shown in Figure 13, virtual stage G has a trapezoidal floor with a relatively large area, and performer avatar 1 can move around on virtual stage G in the same way as in a live venue in real space. On the side of virtual stage G opposite the virtual audience seats, as shown in Figure 13, a virtual stage wall is formed that is divided into three sections: a central section, a right section, and a left section. Virtual displays 40, 41, and 42 are provided in front of these virtual stage walls, and images and videos for performance purposes are virtually displayed on these virtual displays 40, 41, and 42.

A virtual star-shaped object 43 related to the performer user is placed between the virtual displays 40, 41, and 42, and large virtual star-shaped aerial objects 50-52 are placed in a second area on the virtual stage G, which is an area above the first area surrounded by the virtual stage walls, as shown in FIG. 13. The virtual aerial objects 50-52 are movable within the second area.

A virtual audience area is provided in front of the virtual stage G, where viewer users can virtually participate in the virtual live venue as viewer avatars. As shown in Figure 13, this virtual audience area is divided into a third area, which is a special area near the center of the virtual stage G where performer avatar 1 appears, and a fourth area, which is formed to surround the third area and is located at a greater distance from the center of the virtual stage G than the third area.

In these third areas, special viewer users who are permitted to participate virtually can participate virtually, up to a predetermined upper limit. In this embodiment, as shown in FIG. 13, for example, viewer avatars 11 to 14 of four viewer users who have met a predetermined virtual participation record and have been permitted to participate virtually by the performer user are placed.

In addition, the fourth area contains viewer avatars 21-32 of general viewer users who have reserved virtual participation before the start of the virtual space live event. Note that in Figure 13, viewer avatars 21-32 are shown in a simplified manner for convenience, but are the same avatars as viewer avatars 11-14.

In addition, each viewer avatar 11-14 placed in the third area can be moved within the third area by the viewer user operating the viewer terminal, and each viewer avatar 21-32 placed in the fourth area can also be moved within the fourth area by the viewer user operating the viewer terminal.

As shown in Figure 13, four virtual cameras C1 to C4 are virtually positioned (set) in the virtual live performance venue. Virtual camera C1 is virtually positioned in front of performer avatar 1 so as to face performer avatar 1, and the viewpoint image captured by virtual camera C1 is a viewpoint image viewed from a position close to the front of performer avatar 1, as shown in Figure 14(a).

Virtual camera C2 is a camera virtually placed (set) above the head of performer avatar 1, and the viewpoint image captured by virtual camera C2 is a performer viewpoint image looking at the virtual audience area from performer avatar 1, as shown in Figure 16.

Virtual camera C3 is a virtual camera virtually placed on the virtual display 41 diagonally behind the performer avatar 1, and the viewpoint image from virtual camera C3 is a viewpoint image looking at the virtual audience area from diagonally behind the performer avatar 1, as shown in Figure 14(c).

Virtual camera C4 is a virtual camera virtually placed on the virtual display 42 diagonally behind the performer avatar 1, and the viewpoint image from virtual camera C4 is a viewpoint image looking at the virtual audience area from diagonally behind the performer avatar 1, as shown in Figure 14(b).

In addition to the fixedly positioned (set) virtual cameras C1 to C4, in this embodiment, aerial moving virtual cameras (not shown) are virtually positioned so that they can move through the air within the virtual space of the virtual live venue. The aerial trajectories along which these aerial moving virtual cameras move and the viewpoint directions (angles) at each position on the aerial trajectory are set in advance by the administrator terminal 150, and during the flying performance period described below, performer avatar 1 virtually flies so as to follow the aerial trajectory of the aerial moving virtual camera, thereby generating a viewpoint image of the virtually flying performer avatar 1 captured by the aerial moving virtual camera.

In this embodiment, as shown in FIG. 13, an example is shown in which four virtual cameras C1 to C4 are virtually arranged as fixedly arranged (set) virtual cameras, but the present invention is not limited to this. Five or more virtual cameras may be arranged as fixedly arranged (set). Conversely, without providing fixedly arranged (set) virtual cameras, only viewpoint images seen from viewpoints corresponding to each avatar virtually participating in the virtual live venue may be displayed on the performer terminal 200 and the viewer terminal 300.

Furthermore, while this embodiment illustrates a configuration in which there is one virtual camera moving in the air, the present invention is not limited to this, and a configuration in which there are multiple virtual cameras moving in the air, or conversely, a configuration in which there is no virtual placement of a virtual camera moving in the air, may also be used.

<Studio>
11 is a diagram showing the studio used in this example, with the control room adjacent to the studio separated by a glass window as described above, in which the performer user performs various movements corresponding to singing in the studio, while an assistant operator O assists with the operation of performer terminal 300 installed in the control room. Base stations 220a and 220b are mounted on stands around the performer user wearing wearable sensors 220C1 to 220C5, and an imaging camera constituting facial expression input device 221 is mounted on a stand and positioned approximately in front of the performer user.

A screen S is installed on the wall facing the performer user in the studio, and a projector (display device B211) located on the ceiling of the studio projects a viewpoint image from virtual camera C2 onto screen S, so that a viewpoint image looking into the virtual audience area from performer avatar 1 is displayed on screen S, as shown in Figure 16. This allows the performer user to proceed with the live performance while constantly keeping track of the behavior of the viewer avatars virtually participating in the virtual audience area (the audience's reactions to the live performance).

In addition, a large vertical display serving as display device C212 is placed to the side of screen S, and this large display is configured to display comments from viewers and messages that the assistant operator O wishes to convey to the performer users. Furthermore, display device C212 may also be configured to display information (performer support information) such as the lyrics and lines of the songs sung by the performers during the live performance.

<Operation of virtual space content distribution system>
FIG. 10 is an explanatory diagram illustrating the operation of the virtual space content distribution system of this embodiment, specifically, the flow of distribution of video and audio of a virtual live performance.

First, we will explain the video system. As mentioned above, the distribution server computer 100 is capable of providing a virtual space of a virtual live venue based on the virtual space generation program 120 and avatar data of performer users and viewer users. The movements of each avatar of these performer users and viewer users are reflected in the movements of the performer avatar 1, and the movements (operations) of the viewer users are reflected in the movements of the viewer avatar.

Although not shown in Figure 10, when the performer terminal 200 and the viewer terminal 300 connect to the distribution server computer 100 to virtually participate in the virtual space live performance, virtual space data of the virtual live performance venue is delivered and stored in advance from the distribution server computer 100. As described below, this pre-stored virtual space data is sequentially updated by virtual space update data delivered successively from the distribution server computer 100, allowing the performer terminal 200 and the viewer terminal 300 to identify the latest state of the virtual live performance venue.

Specifically, the movements and facial expressions of the performer user in the studio are scanned at predetermined time intervals using the body motion scan and face motion scan functions of the performer avatar control program, and performer avatar information is generated and sent to the distribution server computer 100.

On the other hand, viewer users who are permitted to virtually participate in the third area use motion sensors, just like performers, and are scanned at predetermined time intervals using the body motion scan and face motion scan functions, and viewer avatar information is generated and sent to the distribution server computer 100.

In addition, viewer users who are permitted to virtually participate in the fourth area can use the touch panel, keyboard, or controller of the viewer terminal 300 to perform various operations such as movement, changing the viewpoint direction, changing the viewpoint (zoom), raising their hands, clapping their hands, and jumping, thereby causing the viewer avatar to perform the corresponding action. Viewer avatar information is then generated based on those operations related to the viewer avatar's actions and transmitted to the distribution server computer 100.

In this way, based on the performer avatar information sent from the performer terminal 200 and the viewer avatar information sent from the viewer terminal 300, the distribution server computer 100 executes a virtual space update process that updates the virtual space data, thereby reflecting the actions (operations) of the performer user and the viewer user in each avatar virtually participating in the virtual live venue.

Then, a virtual space update data generation process is executed to generate virtual space update data based on the pre-update virtual space data and the post-update virtual space data, and the generated virtual space update data is distributed to the performer terminal 200 and the viewer terminal 300.

As shown in FIG. 10, at the performer terminal 200 and viewer terminal 300 to which the virtual space update data has been distributed, the pre-stored virtual space data is updated based on the distributed virtual space update data, and a performer perspective video generation process and a viewer perspective video generation process are executed using the updated virtual space data, thereby generating performer perspective video and viewer perspective video based on the updated virtual space data, and the generated performer perspective video and viewer perspective video are displayed on the performer terminal 200 and viewer terminal 300 (viewer perspective video output process).

In this way, in this embodiment, the viewpoint video of each viewer user virtually participating in the virtual live venue using a viewer avatar is generated and displayed on the viewer terminal 300 of each viewer user. By generating the viewer avatar viewpoint video of each viewer user on the distribution server computer 100, it is possible to avoid a situation in which the processing load on the distribution server computer 100 becomes significantly large, preventing many viewer users from being able to participate in the virtual space live performance, and it is also possible to avoid a situation in which an increased processing load makes distribution difficult.

In this embodiment, a viewpoint image is generated and displayed on the display device 310 of the viewer terminal 300 of the viewer user of viewer avatar 13, who is virtually participating in the third area on virtual stage G near performer avatar 1, in which a nearly frontal view of performer avatar 1 is enlarged, as shown in FIG. 14(d). On the other hand, a viewpoint image is generated and displayed on the display device 310 of the viewer terminal 300 of the viewer user of viewer avatar 28, who is virtually participating in the fourth area on virtual stage G farther from performer avatar 1, for example, at a position behind viewer avatar 13, in which a viewpoint image of nearly the front of performer avatar 1 appears relatively small through the viewer avatars 13 and 14 who are virtually participating in the third area, as shown in FIG. 14(e).

Furthermore, the display device 310 of the viewer terminal 300 of the viewer user of the viewer avatar 32 who is virtually participating at the edge of the virtual stage G in the fourth area, which is set to be U-shaped when viewed from above, displays a viewpoint image as seen from the viewer avatar 32 positioned diagonally forward of the performer avatar 1, as shown in Figure 14 (f), in which the performer avatar 1 appears relatively small over the viewer avatar 14 who is virtually participating in the third area.

Note that the display examples shown in Figure 14 all illustrate cases where the viewer terminal 300 is a stationary computer (PC) and the display device 310 is a stationary display. However, if the viewer terminal 300 is a smartphone P, tablet, etc., the viewpoint video of virtual camera C1 will be displayed as shown in Figure 15(a), and if the viewer terminal 300 is the viewer terminal 300 of viewer avatar 13, it will be displayed as shown in Figure 15(b).

Next, regarding the audio system, music data 113 is played by the audio control program 124 on the distribution server computer 100 based on time schedule data (TS data) 112, and is transmitted to the performer terminal 200 as the played music (data) (music playback processing).

On the performer terminal 200, the music audio from the playback music (data) sent from the distribution server computer 100 is output to the performer user through high-performance earphones (ear monitors) worn by the performer user (playback music output process), and when the performer user sings along with the output playback music, the performer voice input from the sound collection microphone (audio input device 222) is digitized and sent to the distribution server computer 100 as the performer voice (data).

The distribution server computer 100 generates distribution audio (data) from the performer audio (data) received from the performer terminal 200 and the music played in the music playback process described above (distribution audio generation process), and distributes the generated distribution audio (data) to the viewer terminal 300 (generated audio distribution process).

On the viewer terminal 300, the distribution audio (data) distributed from the distribution server computer 100 is output from an audio output device 322 such as earphones or speakers, allowing the viewer to hear the live audio as if the performer avatar 1 were singing in a virtual live venue.

As described above, the performer terminal 200 transmits the performer's voice (data) to the distribution server computer 100, and as shown in FIG. 10, executes a monitor voice generation process and a monitor voice output process, which outputs the music voice of the played music and the performer's voice from speakers located in the control room, allowing an assistant operator O or the like to check the performer's singing status, etc., in the control room.

<Viewer viewpoint video control processing>
Next, a viewer's viewpoint video control process executed in the viewer terminal 300 based on a viewer's viewpoint video control program included in the viewer's program will be described with reference to FIG.

In the viewer viewpoint video control process, first, it is determined whether or not the performer avatar 1 is currently in a flying performance period, in which the performer avatar 1 is virtually flying, as shown in FIG. 20 (step S1). Whether or not the performance period is currently in a flying performance period can be determined from performance status data indicating that the performance period is currently in a flying performance period, sent from the distribution server computer 100. Furthermore, when the flying performance period begins based on the time schedule data, the distribution server computer 100 transmits performance status data indicating that the performance period is currently in a flying performance period to the viewer terminal 300.

If the flying effect is in progress (Y in step S1), the process proceeds to step S21. If the flying effect is not in progress (N in step S1), the process determines whether viewpoint-related operations, including viewpoint movement operations (including viewpoint changes due to avatar movement operations and motion operations) and zoom operations, have been disabled (step S2).

If viewpoint-related operations are disabled (Y in step S2), proceed to step S7. If viewpoint-related operations are not disabled (N in step S2), determine whether there is an operation that changes the viewpoint, such as an operation to move or move the avatar (step S3). If there is an operation (Y in step S3), change the viewer viewpoint according to the operation. If there is no operation (N in step S3), proceed to step S5 and determine whether there is a zoom operation (step S5).

If a zoom operation is performed (Y in step S5), the image area displayed on the display device 310 is changed to an image area corresponding to the operation; if a zoom operation is not performed (N in step S5), it is determined whether or not motion tracking is set (step S7).

This motion tracking setting can be set by the viewer user at their discretion on the viewer terminal 300, for example, before the start of a live performance or during a live performance, depending on the type of device they use for operation and their level of familiarity with the operation. Specifically, this setting is set when, for example, they are unfamiliar with operating the operation input device 321, such as a touch panel, keyboard, or game controller, or when they are unfamiliar with changing the viewpoint by moving or moving the avatar; or, as described below, when the virtual participation position of their own viewer avatar is far from the performer avatar 1 and the display is zoomed in, causing even the slightest movement of the performer avatar 1 to be displayed incorrectly, making it difficult to change the viewpoint in response to the movement or movement of the performer avatar 1.

If there is no motion tracking setting (N in step S7), proceed to step S11. If there is motion tracking setting (Y in step S7), it is further determined whether the motion tracking condition is met (step S8).

In this embodiment, the movement tracking condition is a condition under which it is almost certain that the performer avatar 1 will no longer be displayed clearly on the display device 310. Specifically, if the head (or face) of the performer avatar 1 is within a specified range around the display area of the display device 310, it is highly likely that the movement or motion of the performer avatar 1 will cause the head (face) to move outside the display area, causing the performer avatar 1 to no longer be displayed clearly. Therefore, the movement tracking condition is determined to be met.

In this way, in this embodiment, by determining that the movement tracking condition is met before the head (face) of performer avatar 1 disappears from the display area, it is possible to significantly reduce the occurrence of the head (face) of performer avatar 1 disappearing from the display area. However, the present invention is not limited to this, and these movement tracking conditions may be the head (face) moving outside the display area, or other conditions may be used as the movement tracking conditions. In other words, any conditions can be used as these movement tracking conditions as long as they can prevent the performer avatar 1 from disappearing clearly from the display area.

If the action tracking condition is met (Y in step S8), after disabling viewpoint-related operations (step S12), the viewpoint image displayed in the display area of the display device 310 is automatically changed to an action tracking viewpoint in which the head (face) of the performer avatar 1 is within a non-establishment range surrounded by a predetermined range around the display area, and the viewpoint image seen from the action tracking viewpoint is displayed in the display area of the display device 310 (step S13).

On the other hand, if the motion tracking condition is not met (N in step S8), it is further determined whether the viewpoint-related operation is disabled (step S9). If the viewpoint-related operation is disabled (Y in step S9), the disabled viewpoint-related operation is enabled (step S10) and the process proceeds to step S11. If the viewpoint-related operation is not disabled (N in step S9), the process proceeds to step S11 without going through step S10.

In step 11, because the motion tracking setting is not set or the motion tracking conditions are not met, the viewer avatar's viewpoint image continues to be displayed in the display area of the display device 310 (step S11).

Also, as mentioned above, if the flying performance period in which performer avatar 1 virtually flies during a live performance has begun, step S1 will be judged as Y, and the process will proceed to step S21, where it will be determined whether it is time to start the flying performance period (step S21).

If it is time to start the flying effect period (Y in step S21), the flying viewpoint video delivered from the delivery server computer 100 is displayed in place of the viewer avatar viewpoint video or action-tracking viewpoint video that was displayed in the display area of the display device 310 before the start of the flying effect period (step S22), and then viewpoint-related operations are disabled (step S23), and the process returns to step S1.

In this embodiment, during the flying performance period, the same flying viewpoint video is displayed on the viewer terminals 300 of all viewer users. Therefore, rather than generating the flying viewpoint video on each viewer terminal 300 side, as is the case with viewer avatar viewpoint videos that differ for each viewer user, the flying viewpoint video is generated on the distribution server computer 100 side and distributed to the viewer terminals 300. This allows the flying viewpoint video, which involves movement of the viewpoint through the air and therefore places a heavy load on the viewer terminal 300 to be displayed well even on viewer terminals 300 with low processing power. However, the present invention is not limited to this, and these flying viewpoint videos may also be generated on each viewer terminal 300 side, just like viewer avatar viewpoint videos.

On the other hand, if it is not the start timing of the flying effect period (N in step S21), it is further determined whether it is the end timing of the flying effect period (step S24).

Whether or not it is the end timing of the flying performance period may be determined based on data indicating the end included in the flying viewpoint video data transmitted from the distribution server computer 100, or may be determined based on the aforementioned performance status data that is different from the flying viewpoint video.

If it is not the end of the flying effect period (N in step S24), that is, if it is during the flying effect period, proceed to step S26, update the flying viewpoint video, and then return to step 1. If it is the end of the flying effect period (Y in step S24), enable viewpoint-related operations (step S25), proceed to step S11, and display the viewer avatar's viewpoint video in the display area of display device 310 in place of the flying viewpoint video that was displayed in the display area of display device 310 during the flying effect period, and then return to step S1.

In this way, the viewer viewpoint video control process shown in Figure 21 is executed in the viewer terminal 300 of this embodiment, and the various viewpoint videos displayed on the viewer terminal 300 are explained using Figures 17 to 20.

Figure 17 shows the display content of the display device 310 when a zoom operation is performed on the viewer terminal 300 of this embodiment. In the default state where no zoom operation is performed, a viewpoint video of the video area centered on the upper body of performer avatar 1 is displayed, as shown in Figure 17(a). In this default state, if the viewer user performs a zoom-in operation, for example, by touching the "+" display (not shown) if the viewer terminal 300 is a smartphone P, or by operating the "+" key on the keyboard if the viewer terminal 300 is a computer (PC), a viewpoint video of the video area centered on the head (face) of performer avatar 1 is displayed, as shown in Figure 17(b).

On the other hand, if the viewer user performs a zoom-down operation, for example, by touching the "-" sign (not shown) if the viewer terminal 300 is a smartphone P, or by operating the "-" key on the keyboard if the viewer terminal 300 is a computer (PC), a viewpoint video of the video area including the entire body of the performer avatar 1 will be displayed, as shown in Figure 17(c), for example.

Note that in Figure 17, to make the zoom function easier to understand, the explanation was given using the viewpoint image of virtual camera C1 rather than the viewpoint of the viewer avatar, but as shown in Figure 18, zooming up and down can also be performed on the viewpoint of the viewer avatar in the same way.

In addition, although not described in detail in the viewer viewpoint video control process of Figure 21, for example, when performer avatar 1 appears on virtual stage G for the first time at the start of a live performance, the viewpoint of the viewer avatar will not be directed toward performer avatar 1, and there is a possibility that the appearing performer avatar 1 will not be displayed on the viewer terminal 300 for a long period of time. Therefore, the period when performer avatar 1 first appears may be set as an appearance performance period, and during this performance period, the viewpoint video displayed on the viewer terminal 300 may be automatically switched from the viewer avatar's viewpoint video to the viewpoint video of virtual camera C1, etc., and individual viewer users may also be able to perform zooming in on these virtual camera C1 viewpoint videos, etc.

Figure 18 shows the viewpoint image of viewer avatar 28, who is virtually participating in the fourth area, as an example of a viewpoint image of a viewer avatar. As shown in Figure 18, the viewpoint image of viewer avatar 28 includes the heads of viewer avatar 13 and viewer avatar 14, who are virtually participating in the third area, and the image shows performer avatar 1 seen through the heads of viewer avatar 13 and viewer avatar 14.

For this reason, the viewer user of viewer avatar 28 can, for example, perform a zoom-in operation to change the image area so that the upper body of performer avatar 1 is displayed in the center, as shown in Figure 18 (b), thereby preventing viewer avatar 13 and viewer avatar 14 from being displayed and allowing them to enjoy the live performance.

However, in the zoomed-in state shown in Figure 18(b), for example, as the live performance progresses and the performer avatar 1 begins to move and make large movements, if the viewer user is unable to properly change the viewpoint of the viewer avatar 28 in accordance with the movements of the performer avatar 1, the performer avatar 1 may not be displayed properly, as shown in Figures 19(d) to (f). Therefore, paying attention to changing the viewpoint may make it difficult to concentrate on the live performance, and the viewer may not be able to fully enjoy the live performance.

However, in this embodiment, when the viewer user sets the action tracking setting as described above, as shown in Figures 19(a) to (c), the action tracking condition is met when the head of the performer avatar 1 enters a specified peripheral area of the display area, the viewpoint is automatically changed to the action tracking viewpoint, and viewpoint video of the action tracking viewpoint is displayed. This means that the viewer user does not need to pay attention to operating the viewpoint, and can concentrate on the live performance and enjoy it to the fullest.

As the live performance progresses and the flying performance period begins, as shown in Figure 20, the viewpoint images of individual viewer avatars are automatically changed to flying viewpoint images seen from a virtual camera moving in the air, without any operation by the viewer user.

Specifically, before performer avatar 1 takes to the air in virtual flight, an image of a wing object growing on the back of performer avatar 1 is displayed. Then, as performer avatar 1 looks up at a virtual star object 50 in the air that is virtually placed in the second area of the virtual live venue, the viewpoint of the viewer avatar also moves in a similar manner. At this time, a light effect 61 appears around performer avatar 1.

After that, when the performer avatar 1 begins virtual flight, the viewpoint image displayed on the display device 310 automatically switches from the viewpoint image of the viewer avatar up to Figure 20(b) to a flying viewpoint image seen from a virtual camera moving in the air, as shown in Figure 20(c).

During the flying performance period, the aerial moving virtual camera moves through the air within the second area based on a predetermined aerial trajectory, as described above, and flying viewpoint images seen from these aerial moving virtual cameras moving through the air are displayed on the display device 310 as shown in Figure 20(d).

The specific configuration is not limited to the above-described embodiment, and modifications and additions that do not deviate from the spirit of the present invention are also included in the present invention.

For example, in the above embodiment, a viewer avatar is shown to be able to move freely within the third or fourth area in which they are virtually participating. However, this could lead to problems such as errors in the virtual space data due to different viewer avatars participating in the fourth area colliding with each other virtually or overlapping in the same virtual location.

In order to solve this problem, for example, the modified examples shown in Figures 22 and 23 may be used. Specifically, the third and fourth areas are divided into smaller areas as shown in Figure 22, and viewer users are asked in advance before the start of the live performance which of these areas they will be participating in the virtual live performance in, as shown in Figure 23. When viewer users virtually participate using viewer avatars, they can only participate in the areas they have selected in advance, and movement is restricted to within the selected areas. This prevents viewer avatars from colliding with each other virtually or overlapping in the same virtual location, which could result in errors in the virtual space data.

In addition, when each viewer user is allowed to select the virtual participation position of the viewer avatar in advance as described above, for example, for a viewer user who selects areas A1 to C6 on the right side as facing virtual stage G in the fourth area, a viewpoint image from the front right position of the virtually flying performer avatar 1 is generated and displayed as the viewpoint image during the flying performance period; for a viewer user who selects areas D4 to H6 on the center as facing virtual stage G in the fourth area, a viewpoint image from the front center position of the virtually flying performer avatar 1 is generated and displayed as the viewpoint image during the flying performance period; and for a viewer user who selects areas I1 to K6 on the left side as facing virtual stage G in the fourth area, a viewpoint image from the front left position of the virtually flying performer avatar 1 is generated and displayed as the viewpoint image during the flying performance period. In this way, the viewpoint image during the virtual flight, which is a special action, may be a viewpoint image corresponding to the position (area) selected by each viewer user depending on the position selected by the viewer user.

In addition, while the above embodiment illustrates a form in which viewpoint video from a viewer avatar is generated and displayed on the viewer terminal 200 side, the present invention is not limited to this. For example, in the case of a live event with a small number of virtual participants, viewpoint video from the viewer avatar may also be generated and distributed on the distribution server computer 100 side. Furthermore, the viewer user may be able to select whether to generate the video on the viewer terminal 200 side or the distribution server computer 100 side depending on the processing power of the terminal they own and the data communication environment, or the distribution server computer 100 may identify the processing power of the viewer terminal 200 with which it is connected for communication, and based on the identified processing power, decide whether to generate the video on the viewer terminal 200 side or the distribution server computer 100 side.

In addition, while the above embodiment illustrates a configuration in which the distribution server computer 100 is installed in a studio operated by the event management organization hosting the virtual space live event, the present invention is not limited to this. These distribution server computers 100 may be server computers owned by a company that rents out server computers in a data center, etc., or, as mentioned above, server computers provided by a cloud service. These server computers may be installed in any configuration that provides the functionality of the distribution server computer 100.

In addition, while the above embodiment illustrates a form in which a single performer user sings and performs, the present invention is not limited to this. These performer users may be a group of multiple people. When a group of multiple people performs a virtual space live performance, the multiple people may share one performer terminal 200, or a performer terminal 200 may be provided for each member of the group. Furthermore, when the performer users are a group of multiple members, for example, the viewer user may be able to select the member to follow the viewer's viewpoint by executing a viewpoint follower designation process on at least one of the distribution server computer 100 and the viewer terminal 300.

Furthermore, in the above-described embodiment, the singer who sings and the actor who performs the performance may be separate persons. In this case, the singer's performer terminal and the actor's performer terminal may be separate, and the singer may sing in a location other than the studio where the actor performs the performance.

In addition, in the above embodiment, the Internet network is used as an example of the computer communication network connecting the distribution server computer 100, administrator terminal 150, performer terminal 200, and viewer terminal 300, but the present invention is not limited to this. These communication networks may be configured as local area networks that allow data communication only within a specific area, or may include local area networks and local data communication as part of them.

In addition, in the above embodiment, the performer user sings or performs singing actions (performance actions) in real time during the distribution of the virtual space live performance, allowing the performer user to proceed with the live performance while checking the reactions of the viewer users who are virtually participating in the virtual space live performance. However, the present invention is not limited to this, and the performer user's singing or singing actions (performance actions) may not be performed in real time, but may be performed in advance, and this singing audio and singing actions (performance actions) may be recorded on the distribution server computer 100 as performer avatar information. The virtual space live performance may then be held by playing back the recorded singing audio and singing actions (performance actions) as the live performance progresses.

In addition, instead of the performer user's singing or singing actions (performance), the singing or singing actions (performance actions) of a virtual performer created using computer graphics, etc., can be recorded as performer avatar information on a distribution server computer, and the recorded singing voice and singing actions (performance actions) can be played back as the live performance progresses, thereby creating a virtual space live performance.

In this way, when singing or singing actions (performance actions) are performed in advance and performer avatar information is recorded on the distribution server computer 100, and then played back to distribute a virtual space live performance, the virtual space content distribution system at the time of distribution will be configured to include the distribution server computer 100, administrator terminal 150, and viewer terminal 200, and will not include the performer terminal 200, which is a performer user terminal available to perform operations to move the performer avatar 1 in the virtual space.

Furthermore, in the above embodiment, the viewer terminal 300 is exemplified as a smartphone P or a computer (PC), but the present invention is not limited to this. These computers may be portable laptops, tablet devices, e-book readers, wearable computers, game consoles, or any other information processing device capable of outputting at least 2D video and audio.

Furthermore, while the above embodiment illustrates a form in which a performer user performs in a studio, including singing, the present invention is not limited to this. For example, a performer user may use a performer terminal 200 installed in their home or the like to perform in a virtual space live performance from their home or the like.

In the above-described embodiment, a virtual space live performance was used as an example of virtual space content, but the present invention is not limited to this. Such virtual space content can be any content that is beneficial to viewer users, such as a fan meeting where performer users gather with their fans or a talk session, and that is related to a virtual space in which performer avatar 1 and viewer avatars virtually participate.

In the above-described embodiment, the general action (first action) is an action in which the performer avatar 1 stands without moving to the virtual stage G, the special action (second action) is an action in which the performer avatar 1 performs a virtual flight, and the specific action (third action) is an action in which the performer avatar 1 makes a sudden sideways movement. However, the present invention is not limited to this and may be an action that corresponds to the content to be distributed. For example, the general action (first action) may be an action (normal action) that the performer avatar performs for the longest period of time in the distributed content, the special action (second action) may be an action that is performed in the shortest special period of time in the distributed content or the action that is performed least frequently, and the specific action (third action) may be an action that is performed for a shorter period of time than the general action (first action) but a longer period of time than the special action, or an operation that is performed less frequently than the general action (first action) but more frequently than the special action. It is also possible for the special action (second action) to include the specific action (third action).

In the above-described embodiment, an example was given of a configuration having both a function for switching to a viewpoint corresponding to a special action (second action) and a function for following a specific action (third action), but the present invention is not limited to this, and a virtual space content distribution system having only one of these functions may also be used.

In the above-described embodiment, an example is given in which viewpoint switching between four virtual cameras C1 to C4 as fixedly positioned (set) virtual cameras and aerial moving virtual camera can be performed in advance by setting and operating the administrator terminal 150, but the present invention is not limited to this. For example, these viewpoint switching operations may be performed in real time by administrator K on the administrator terminal 150 using a viewpoint switching controller or the like that constitutes the operation input device 161.

In the above-described embodiment, virtual cameras C1 to C4 are fixedly positioned (set) within the virtual space as virtual cameras, but the present invention is not limited to this. For example, in addition to or instead of virtual cameras C1 to C4, a movable virtual moving camera may be placed within the virtual live venue, and the position and imaging direction of the virtual moving camera within the virtual space may be controlled by an administrator K or a cameraman via operation of the administrator terminal 150, to produce an image from the viewpoint of the virtual moving camera.

In the above-described embodiment, an example is given in which a viewpoint image from virtual camera C2 is displayed on screen S so that the performer user's facial expressions can be detected and reflected in the facial expressions of the performer avatar. However, the present invention is not limited to this. For example, if the performer user has a high-performance head-mounted display with a sensor function that detects the performer user's facial expressions, the performer user may wear this high-performance head-mounted display while performing the performance, which may improve the performer user's sense of immersion in the virtual live performance. Furthermore, if the performer avatar's facial expressions do not need to be reflected in detail, the performer user may wear a normal head-mounted display while performing the performance.

In the above-described embodiment, the viewpoint of the viewer user is changed and followed in accordance with the movements of the performer avatar, but the present invention is not limited to this. For example, the viewpoint may be changed and followed in accordance with specific effects on stage G, such as smoke or fireworks (pillars of fire), special lighting, or deformations of stage G.

<Event content related>
(Event content overview)
13 to 23 , an example of content has been described, in which event content is a live event featuring performers at a virtual live venue. The event content is distributed, for example, at a predetermined date and time (scheduled time on a scheduled date) according to event data. Furthermore, a spatial area ER in which the event content is to be provided may be provided (distribution begins, opened) before the event begins, allowing viewer users to enter and participate in the virtual space in which the event is to be held. In this case, the event data may include information for specifying the date and time when the spatial area ER in which the event content is to be provided will be provided (distribution begins, opened) before the scheduled date.

The following describes an example in which, before the start of the event content of a virtual live performance such as that shown in Figure 13, a virtual space in which the virtual live venue (event venue) shown in Figure 13 is constructed is opened as a predetermined type of virtual space, allowing viewer users to enter and participate, thereby gradually increasing viewer users' interest in the event even before the event begins. The predetermined type of virtual space is, for example, one of the virtual spaces in space area ER in Figure 12. The following description uses space area ER5 shown in Figure 24 as an example of a predetermined type of virtual space.

Figure 24 is an overall bird's-eye view of an event venue constructed in spatial area ER5. In spatial area ER5 in this embodiment, a virtual space is provided in which objects such as buildings modeled after a shrine and the town in front of the shrine are placed, as an example. Note that the objects placed in spatial area ER5 are not limited to buildings modeled after shrines, and can be objects based on various themes such as the sea, lakes, mountains, and schools. Furthermore, spatial area ER5 is made up of multiple areas. For example, as shown in Figure 24(A), spatial area ER5 is made up of area ER51 corresponding to the town area, area ER52 corresponding to the temple grounds area, and area ER53 corresponding to the worship hall area.

In the town area, for example, multiple house objects modeled after private homes are placed, and multiple exhibition areas are provided along the approach to the shrine grounds area to display (set up) lantern objects purchased by viewer users, etc. Lantern objects can be purchased, for example, in a lantern shop area within the town area. The shrine grounds area also has multiple objects equivalent to the torii gates, gates, and ornaments found in the grounds of a shrine, a game area where predetermined games can be played, a fortune-telling area where fortune-telling can be done, and multiple exhibition areas. In the worship hall area, for example, multiple objects equivalent to the worship hall of a shrine and a stage object that serves as a virtual live venue (event venue) are placed, as well as an offering area for offerings, and multiple exhibition areas.

The exhibition area is filled with lantern objects purchased by users, lantern objects associated with the operator (administrator) (including lantern objects that are initially set), and lantern objects associated with special users. Special users include performer users, operator users, sponsor users who are sponsoring the event, and other celebrities who have been authenticated as special users by the operator (administrator). Information on these sponsor users and other celebrities is stored in event data 111.

In addition, as described below, the lantern objects displayed in the exhibition areas are determined in advance by random drawing or the like each time a switching condition is met on the distribution server computer 100 side as default lantern objects to be displayed to all users, and are transmitted and placed on the viewer terminals 300 of users who have entered the spatial area ER5. By bringing a viewer avatar close to one of the exhibition areas, the lantern object displayed in that exhibition area can be displayed on the viewer terminal 300.

Various processes related to this spatial area ER5 (a specific type of virtual space) and various processes related to the provision and distribution of this spatial area ER5 are performed by the distribution server computer 100, and viewer users can use their viewer terminals 300 to enter and participate in the spatial area ER5 and move their viewer avatars, causing images within this spatial area ER5 to be displayed on the viewer terminals 300. Hereinafter, viewer users and viewer avatars (also known as performer avatars, etc.) will also be referred to simply as users and user avatars (also known as performer avatars, etc.).

Figure 25 is an example of an image of spatial area ER5 displayed on the display unit 310 of the viewer terminal 300. Figure 25(A) is an example of a display image when area ER52 (temple grounds area) of Figure 24 is viewed obliquely from within area ER51 (town area). Figure 25(B) is an example of a display image when viewed from behind the user avatar U, showing a state in which the user is moving the user-operated user avatar U within area ER52 of Figure 24 near the boundary of area ER53, and a daimon object 53c corresponding to the daimon gate leading from area ER52 to area ER53 is shown. Figure 25(C) is an example of a display image when viewed from behind the user avatar U, showing a state in which the user is moving the user avatar U below a large torii object 52t corresponding to a large torii gate within area ER52 of Figure 24, and showing the feet of the large torii object 52t and the daimon object 53c. Figure 25(D) is an example of a display image viewed from behind the user avatar U as the user avatar U is moved backward from the position shown in Figure 25(C), and shows a large torii gate object 52a and a private house object 51d corresponding to a private home. In this way, by entering and participating in spatial area ER5, the user can move around spatial area ER5 in accordance with user operations and view the objects and scenery within spatial area ER5, as well as purchase objects, make offerings, and participate in a live event held in the worship hall area on a scheduled date.

Note that the overhead image of the virtual space as shown in Figure 25(A) may be one that can be displayed on the display device 310 by user operation, or may be an image corresponding to the line of sight of the user avatar U as shown in Figures 25(B) to (D). Furthermore, even if the overhead image of the user avatar U as shown in Figures 25(B) to (D) is produced by user operation, the user avatar U operated by the user may not be displayed, but an image seen from the viewpoint of the user avatar U may be displayed.

In this embodiment, even during the pre-scheduled period, which is the period before the scheduled date on which the event content will be provided within spatial area ER5, users can enter and participate (also simply referred to as entering) within spatial area ER5. For example, even during the pre-scheduled period, when a user logs in to virtual space ER and enters and participates in spatial area ER5, the virtual space generation program 120 transmits data to the viewer terminal 300 for displaying an image of the generated spatial area ER5 on the display device 310 of the viewer terminal 300. The pre-scheduled period refers to the days before the scheduled date on which the event content will be provided, and may be a specified period (e.g., one week) before the scheduled date, or all days before the scheduled date. In this embodiment, users are allowed to enter spatial area ER5 from one week before the scheduled date.

Only users who have the right (e.g., a ticket) to participate in the event content provided on the scheduled date are permitted to enter and participate in spatial area ER5 during the period before the scheduled date and on the scheduled date. The right to participate is granted to users, for example, by purchasing a ticket to participate for a fee, or by completing a specified game or mission.

The spatial area ER5, which is a predetermined type of virtual space, includes, for example, a first virtual space formed by connecting multiple areas, allowing viewer users to seamlessly move and enter from one area to another within the multiple areas, and a second virtual space consisting only of areas that share the same display format as the other areas. The virtual space corresponding to the spatial area ER5 in this embodiment includes, as shown in Figure 24(A), a first virtual space formed by connecting areas ER51 to ER53, allowing users to seamlessly move and enter between areas ER51 and ER52 and between areas ER52 and ER53, and a second virtual space consisting only of area ER53' that shares the same display format as area ER53, as shown on the right side of Figure 24(B).

Furthermore, for example, the first virtual space shown in FIG. 24(A) is provided until a specific period (e.g., the day before) before the scheduled date of the event content, and after the specific period before the scheduled date of the event content and the release conditions are met, the second virtual space shown in FIG. 24(B) is provided in addition to the first virtual space, and movement from some of the multiple areas (areas ER51 to ER53) in the first virtual space (areas ER51, ER52) to other areas (area ER53) is disabled (e.g., the gate of the gate object 53c leading to area ER53 is closed), and a portal P is provided at a predetermined position in some of the areas (a position in front of the gate object 53c in area ER52), and by moving the user avatar U to the portal P, it becomes possible to transition to the second virtual space consisting of only area ER53', for example, via the display of a specific screen (e.g., a black screen).

In this embodiment, event content is provided in area ER53', which has the same display format as area ER53. Area ER53' is an area that cannot be entered until, for example, the release conditions are met. A venue similar to the virtual live venue shown in FIG. 13 is constructed in area ER53', with objects corresponding to a virtual stage for a live event and audience seats placed inside. During the live event, performer avatars operate on the virtual stage, and the user watches from the audience seats via user avatar U.

On the other hand, a specific period before the scheduled date, for example, objects corresponding to audience seats for the live event are gradually placed in area ER53 in the first virtual space, and objects under construction are placed on the virtual stage, reflecting the gradual construction of the virtual live venue, which the user can confirm through the user avatar U. For example, every predetermined time (e.g., every 24 hours), a virtual space update data distribution process is performed to update the displayed objects. This can inform the user that the event is approaching and increase the sense of realism and interest.

In addition, a user who was within area ER53 when the release condition was met is expelled from area ER53. For example, the user avatar U is forcibly moved to a predetermined position outside area ER53 (for example, in front of the gate object 53c in area ER52). After that, while it becomes impossible to enter area ER53, the user avatar U can enter area ER53' via the aforementioned portal P.

Area ER53 and area ER53' share the same display format, but there are restrictions on the space in which the user avatar U can move. For example, in area ER53, the user avatar U can move freely within the area, whereas in area ER53', he or she can only move within the audience area 53'k. This allows the burden on the server to be minimized to the minimum processing required to provide event content. Furthermore, area ER53 and area ER53' can be managed by different servers (rooms) that perform the processing to build and generate each area. This allows, for example, the area to be managed by a server (room) that can handle the heavy load when providing event content. Note that users who can enter area ER53' may be limited to users who meet certain conditions for providing event content.

(Changes in display mode in virtual space)
In this embodiment, the display mode within the spatial area ER5 may change depending on events occurring within the spatial area ER5 during the period before the scheduled date. Events occurring within the spatial area ER5 during the period before the scheduled date include, for example, the user's actions during the period before the scheduled date, the actions of other users, a lottery within the spatial area ER5, changes to settings in the virtual space performed by an administrator, and the like. User actions (or the actions of other users) include, for example, purchasing and placing a specific object (e.g., an item, a lantern object, etc.), playing a game such as completing a specific mission, and the like. Display modes within the spatial area ER5 that may change depending on events occurring within the spatial area ER5 during the period before the scheduled date include, for example, changes in the display mode of specific objects (e.g., lantern objects, exhibition areas in which lantern objects are placed, etc.) placed within the spatial area ER5, and changes in the display mode of presentations during the provision of event content.

(Changes in display mode during the period before the scheduled date due to the placement of specific objects)
26 to 32 , examples will be described in which the display mode within spatial area ER5 during the period before the scheduled date can be changed in response to an event in which a user purchases and places a lantern object within spatial area ER5 during the period before the scheduled date, such as by placing a lantern object purchased within spatial area ER5 in the exhibition area, or by switching a lantern object purchased by another user and placed in the exhibition area to another lantern object when a switching condition is met. Note that because the lantern object can also be a type of tipping item (e.g., a flower stand) from a user when providing event content, it will also be referred to as a flower stand FS below.

Flower stand FS can be purchased, for example, at lantern shops 51s located along the approach to the shrine within area ER51 shown in Figure 24. The user can move user avatar U to lantern shop 51s or select lantern shop 51s, and the image displayed on the viewer terminal 300 will switch from a screen displaying the image within area ER51 to a screen for purchasing a flower stand FS. Figure 26 (A) shows an example of the screen displayed when purchasing a flower stand FS.

There are multiple types of flower stands FS available for purchase, as shown in Figures 27(A) and (B). Figure 27(A) shows a table of flower stand FS attributes (motifs). Attributes (motifs) include "plain," "cherry blossom," "demon," "white fox," "black fox," and "gorgeous." Each attribute has a designated motif color, and the flower stand FS for each attribute uses the corresponding color and features a design related to the attribute. Of the attributes, "cherry blossom," "demon," "white fox," and "black fox" are the attributes and colors associated with the performer avatars that appear as progression characters when event content is provided. In other words, the flower stand FS available for purchase will match the image motif and image color designated for the performer avatars that appear when event content is provided.

FLOWER STAMP FS are also available in multiple sizes. The sizes and prices available for Flower Stand FS vary depending on the attribute. For example, for the attribute "plain," only the "small" size is available, priced at 500 coins. For the attribute "cherry blossom," two sizes, "large" and "small," are available, with the "large" size priced at 2,500 coins and the "small" size priced at 500 coins. Users can select one of the motifs and sizes to purchase the desired Flower Stand FS. For example, users can enjoy purchasing a Flower Stand FS that matches the attribute/color, image motif, and image color associated with the performer avatar they are supporting (endorsing) from among the performer avatars that appear in the event content provided.

Figure 27 (B) is a table of flower stand FS sizes. Users can decorate their flower stand FS (generate the display style of the flower stand FS), for example, by adding text. Font types and font colors are determined for each flower stand FS size, and users can select them at the time of purchase. In addition, an upper limit on the number of characters that can be displayed is determined for each flower stand FS size. For example, for the "large" size, characters can be entered in two columns, with a limit of 15 characters for each. For the "small" size, there is a limit of 10 characters.

Each size of flower stand FS has a designated area in which it can be displayed (placed). When displaying a purchased flower stand FS within spatial area ER5, the user can select (designate) and place it in one of the multiple display areas within spatial area ER5 in which the flower stand FS can be displayed. For example, for the "large" size, the display area can be selected from the main street (west) area 51a, the main street (east) area 51b, or the large torii area 52a (the area where the large torii object 52t is located). For the "small" size, the display area can be selected from the temple grounds (west) area 52b, the temple grounds (east) area 52c, the front of the worship hall (west) area 53a, or the front of the worship hall (east) area 53b.

The purchase screen shown in Figure 26 (A) displays an image 411 of the flower stand FS selected by the user. Below the flower stand FS image 411, detailed information 412 about the selected flower stand FS is displayed. The detailed information 412 includes information about the size and attributes (motif). The user can also add text to the flower stand FS they are purchasing to customize it to their preferred design. In the text input area 413, the user can enter the text to be displayed on the flower stand FS. The entered text is reflected in the flower stand FS image 411, allowing the user to confirm the image when arranged. In addition, prohibited words that are restricted from being entered are specified for the text that can be displayed on the flower stand FS. Prohibited words include, for example, violent language or language that violates public order and morals. If a prohibited word is entered, the purchase icon 417 is grayed out, and the purchase operation cannot be performed.

As shown in the example purchase screen in Figure 26 (A), the user selects the display area for the Flower Stand FS by operating the placement selection area 414. The coin-related area 415 also displays the number of coins the user has, the number of coins consumed as the purchase price of the Flower Stand FS, and the number of coins remaining after the purchase. The user confirms the purchase and begins the billing process by operating the purchase icon 417. To cancel the purchase, the user operates the close icon 416.

After purchasing a flower stand FS, the display of the flower stand FS is presented as shown in Figure 26(B). For example, in Figure 26(A), if a user purchases a flower stand FS1 with the attributes "cherry blossom," a size of "small," and the text "best" (the best), FS1 will be displayed in the display area where the flower stand FS1 is placed, and the flower stand FS1 will be surrounded by light (displayed and highlighted in a specific manner different from other flower stands). When a user purchases a flower stand FS and specifies the display area on the viewer terminal 300, the distribution server computer 100 may, for example, determine a display location within the specified display area by lottery or other means, store information including the display location of the flower stand FS, and transmit information identifying the display location to the viewer terminal 300 of the user who specified the display location. The viewer terminal 300 then replaces the flower stand displayed in the display location identified from the received information with the flower stand purchased by the user. This allows users who enter or participate in spatial area ER5 to move to the display area for the flower stand FS they placed themselves, encouraging them to go and see their own flower stand FS. It also provides an added fun element, allowing users to check out the text on other users' flower stands FS. Furthermore, as shown in Figure 24(A), display areas are provided in all of areas ER51 to ER53 that make up spatial area ER5. This allows users who enter or participate in spatial area ER5 to be encouraged to move to all of areas ER51 to ER53, allowing users to enjoy the entirety of spatial area ER5.

Next, the flower purchase process for flower FS executed by the distribution server computer 100 will be explained using the flow in Figure 28.

In step S101, it is determined whether or not the purchase period before the scheduled date is currently in effect. The purchase period before the scheduled date may be a period that coincides with the period before the scheduled date, or may be a portion of the period before the scheduled date. If it is not determined that the purchase period before the scheduled date is currently in effect, the process ends because the purchase is not possible. For example, on the scheduled date itself, the determination in step S101 is NO, and the flower stand FS cannot be purchased. For this reason, it is possible to motivate the user to purchase the flower stand FS by having them enter spatial area ER5 at least once before the day of the event.

If it is determined in step S101 that the purchase period is before the scheduled date, it is determined in step S102 whether a shop selection operation has been performed. A shop selection operation is, for example, an operation (such as approaching a store clerk character or selecting a specific shop icon) for a flower shop in spatial area ER5 (e.g., lantern shops 51s, 53s in Figure 24). Specifically, in step S102, it is determined whether information transmitted when a shop selection operation is performed on the viewer terminal 300 has been received.

If it is determined in step S102 that a shop selection operation has been performed, information for displaying a shop screen on the display device 310 is sent to the viewer terminal 300 that originated the shop selection operation in step S103. A shop screen is, for example, a screen that displays a product list for selecting the flower stand FS to purchase, or a flower stand FS purchase screen such as that shown in Figure 26 (A). This allows the viewer terminal 300 to display the shop screen and select the desired flower stand FS. After the information for displaying the shop screen is output in step S103, processing ends. Note that the flower stand FS purchase operation is not limited to within spatial area ER5, but may also be performed from a shop displayed in another space within virtual space ER, or the purchase operation may be performed on a website separate from the virtual space so that it is reflected (available for use and display) in the virtual space.

On the other hand, if it is determined in step S102 that a shop selection operation has not been performed, then in step S104 it is determined whether a content editing operation has been performed. A content editing operation is a decorative operation such as adding text to the flower star FS. Specifically, in step S104, after the flower star FS to be purchased is selected on the viewer terminal 300, it is determined whether information for identifying the characters entered into the flower star FS through a decorative operation performed on a screen such as that shown in FIG. 26(A) is received from the viewer terminal 300. If it is determined that a content editing operation has been performed, then in step S105 it is determined whether or not the flower star FS contains prohibited words. If it is not determined that the flower star FS contains prohibited words, processing ends. On the other hand, if it is determined in step S105 that the flower star FS contains prohibited words, then in step S106 information informing the viewer terminal 300 of this fact (that the flower star FS contains prohibited words) and that the flower star FS cannot be purchased is transmitted to the viewer terminal 300 that performed the content editing operation, and processing ends. As a result, the viewer terminal 300 may display a pop-up message stating "Prohibited words are included" or may perform processing to prevent the purchase icon 417 from being selected.

If it is not determined in step S104 that a content editing operation has been performed, then it is determined in step 107 whether a purchase confirmation operation has been performed. A purchase confirmation operation is, for example, an operation on the purchase icon 417 shown in Figure 26 (A). Specifically, in step 107, it is determined whether information transmitted when an operation on the purchase icon 417 is performed on the viewer terminal 300, which information identifies the type of flower stand FS purchased, the characters entered, the selected display area, etc., has been received. If it is not determined that a purchase confirmation operation has been performed, processing ends.

On the other hand, if it is determined in step S107 that a purchase confirmation operation has been performed, purchase processing (billing processing) is performed in step S108. After the purchase processing has been performed, a flower stand display and presentation process is performed in step S109, and the process ends. For example, based on the information received when the purchase confirmation operation is performed, the display position within the selected display area is determined by lottery or other means, and the user-related information (contained in viewer user data 133) for the flower stand FS is updated. Information for specifying the display position is sent to the viewer terminal 300 of the purchasing user, and processing is performed to cause the viewer terminal 300 of the purchasing user to perform the display presentation illustrated in Figure 26 (B). Note that the display position within the display area does not have to be determined by lottery; the purchasing user may be able to select the display position and display the flower stand in a preferred location.

Figure 27 (C) is an example of a table storing information about a flower stand FS purchased by a user, among the user-related information stored in the viewer user data 133. For example, each user ID is associated with information identifying the purchased flower stand FS and information about the display location of the flower stand FS within the display area designated by the user. For example, information stored includes a "flower stand ID" for individually identifying the flower stand FS, "purchased flower stand" which is information about the attributes and size of the purchased flower stand FS, "character" which is information about the decoration (inputted character) performed by the user, a "user-designated area" which is information about the display area designated by the user, "position" which is information about the display location within the display area, and "purchase date and time" which is the date and time the user purchased the flower stand. During the flower stand display and presentation process in step S109, new information about the purchased flower stand FS is stored corresponding to the purchasing user. Furthermore, information about the purchased flower stand FS is transmitted to the viewer terminal 300 of the purchasing user, and the viewer terminal 300 performs a display and presentation process to display (display) the purchased flower stand FS in place of the flower stand FS already displayed in the display location. Furthermore, when a flower stand FS is purchased, it is not limited to an exhibition display being carried out; instead, or in addition, you may simply be notified that the purchased flower stand FS has been displayed in the selected exhibition area.

Furthermore, when a user purchases a flower stand FS, the flower stand FS already on display in the display area will be replaced with the purchased flower stand FS on that user's viewer terminal 300, as described above. However, the purchase does not affect the flower stand FS in the display area of other users' viewer terminals 300, and the same flower stand FS as before the purchase will continue to be displayed. Therefore, the flower stand FS displayed in the display area of the user who purchased the flower stand FS can be different from that of other users.

In step S101, a determination is made as to whether or not the purchase period is before the scheduled date, but the purchase period may be any time, not just before the scheduled date. For example, depending on the timing of when the event content related to the flower stand FS to be purchased is provided, the purchase may be possible on the scheduled date on which the event content is provided or after the scheduled date. However, if the purchase period is not before the scheduled date in step S101, the event content may not be used in the presentation when provided.

In addition, editing operations for the display mode of the Flower Star FS (such as inserting text and editing content) may be possible not only at the time of purchase, but also after purchase. For example, after purchase, the Flower Star FS may be saved in the user's item box, allowing the user to remove it from the item box and display or edit it at a time of their choosing. Furthermore, font type and color may also be possible after purchase, not just at the time of purchase. It may also be possible to edit not only text, but also colors, and to add decorations, for example, to add optional extras to create a more luxurious display mode.

In the above example, the display position (for example, display positions "A1," "A2," etc. in display area A described below) within the display area selected by the user is determined by lottery or other method based on the information received when the purchase confirmation operation is performed in step S107 of Figure 28. However, this is not limiting, and for example, the flower stand FS may be displayed at a time separate from the time of purchase, with the display position being determined at the time of display.

(Changes in display format during the period before the scheduled date due to the fulfillment of switching conditions)
Next, transitions in the lantern objects arranged in the exhibition areas (display modes of the exhibition areas) will be described with reference to Figures 29 to 32. In this embodiment, lantern objects are displayed in a plurality of exhibition areas provided within area ER5 (for example, main street (west) area 51a, main street (east) area 51b, large torii gate area 52a, etc.). An upper limit on the number of lantern objects that can be displayed in each exhibition area is set.

As mentioned above, the display area will display not only flower arrangement FS purchased by the user himself (associated with the user himself) as described above with reference to Figures 26 to 28, but also flower arrangement FS purchased by other users (associated with other users), flower arrangement FS associated with the operator (administrator), and flower arrangement FS associated with special users.

In this embodiment, display area A corresponds to, for example, the shrine grounds (west) area 52b of region ER52 in Figure 24, which corresponds to the shrine grounds area, and is an area in which, for example, a "small" size flower stand FS, which is a lantern object, as shown in Figure 27(B), can be displayed. Figure 29(A) shows a portion of display area A, which corresponds to the shrine grounds (west) area 52b. As shown in Figure 29(A), multiple flower stands FS, which are lantern objects, are displayed in a row and column in display area A. Figure 31(A) is a table included in object data 122, and is an example of a data table relating to information for identifying the flower stand FS and its display position within display area A. In Figure 31(A), each display position (A1, A2, A3, etc.) within display area A is associated with information for identifying the flower stand FS, such as a flower stand ID and displayed text information. Display position A1, for example, corresponds to the upper left of Figure 29 (A) and is associated with a flower stand FS with a flower stand ID of "a1", an attribute of "cherry blossom", and displaying the letter "A". Display position A2 corresponds to the position immediately to the right of display position A1 in the same row and is associated with a flower stand FS with a flower stand ID of "b1", an attribute of "demon", and displaying the letter "B".

Figure 31(B) is a table included in object data 122, and is an example of a data table related to information for identifying the flower stand FS to be placed in exhibition area B and the display position. Exhibition area B is an area in which a "large" flower stand FS as shown in Figure 27(B) can be displayed, and corresponds, for example, to the location of the large torii object 52t in region ER52 (large torii area 52a). In Figure 31(B), as in Figure 31(A), each display position (B1, B2, B3, etc.) within exhibition area B is associated with information for identifying the flower stand FS, such as a flower stand ID and displayed text information. For example, a flower stand FS with a flower stand ID of "a1" and displaying the letter "A" is associated with the position corresponding to exhibition position B1. A flower stand FS with a flower stand ID of "b1" and displaying the letter "B" is associated with the position corresponding to exhibition position B2.

As shown in Figures 31(A) and 31(B), the information on the flower stand FS associated with each exhibition area is switched to the information on another flower stand FS determined by random lottery or the like whenever a switching condition is met. The switching conditions for the flower stand FS information for each exhibition area may include conditions that are met, for example, when a predetermined time has passed (e.g., every 30 minutes or every two hours), when a user enters or leaves the virtual space (e.g., logging in or re-logging in), or when the user reloads the display data (e.g., a reload operation, or when the user avatar U's viewpoint leaves a predetermined exhibition area and then returns to that exhibition area). The probability of winning an exhibition through random lottery is uniformly set for each flower stand FS, but is not limited to this and may vary depending on the characteristics of each flower stand FS, as described below.

Each time the switching conditions are met, the distribution server computer 100 determines the flower stand FS to be displayed in each exhibition area, updates the table for each exhibition area (see Figures 31 (A) and (B), etc.) stored as object data 122 (setting it as the default common to all users), and transmits information for identifying the flower stand FS for each exhibition area to the viewer terminal 300 of the user who has entered the spatial area ER5. This allows the viewer terminal 300 to switch and display the flower stand FS for each exhibition area (flower stand FS of other users, etc., excluding the user's own flower stand FS) with another flower stand FS. Note that the switching of flower stand FS is performed up to the maximum number that can be displayed in each exhibition area. For example, if the maximum number of flower stands FS that can be displayed in exhibition area A is 100, the information on flower stand FS for exhibition area A stored as object data 122 shown in FIG. 31(A) is updated by randomly selecting 100 flower stands FS each time a switching condition is met, and switching to the data for the selected flower stands FS. Also, for example, when the exhibition area is released, 10 flower stands FS may be initially placed in exhibition area A, which can display 100 flower stands FS, and this number may gradually increase to 100 as users purchase and display more. When the exhibition area is released, this may be, for example, when users are able to purchase flower stands FS and display them in the exhibition area. In this case, the random selection may be performed after the maximum number has been reached.

As mentioned above, the information about the flower stand FS placed in the virtual space changes each time a switching condition is met, but a flower stand FS purchased by a user himself can continue to be displayed in the exhibition area within the virtual space based on the information managed in FIG. 27(C). For example, FIG. 29 shows an example of the transition in the display mode of the flower stand FS in exhibition area A displayed on user 1's display device 310 when user 1 purchases a new flower stand FS. FIG. 30 shows an example of the transition in the display mode of the flower stand FS in exhibition area A (the same display position as shown in FIG. 29) displayed on user 2's display device 310 when user 1 purchases a new flower stand FS. FIGS. 29(A) and 30(A) show display examples in which a flower stand FS determined as the default for exhibition area A and identified from the flower stand placement information in FIG. 31(A) is placed. Note that at the timings shown in Figures 29(A) and 30(A), the explanation will be given assuming that the flower stand FS purchased by neither User 1 nor User 2 is on display in Display Area A.

Figures 29 (B) and 30 (B) are examples of the display when user 1 newly purchases flower stand FS1. The flower stand FS1 purchased by user 1 has the attribute "cherry blossoms" of flower stand ID "a3" shown in Figure 27 (C), the size is "small", and the entered characters are "best". Furthermore, user 1 selected "A" as the display area when purchasing, and the location "A1" within the display area is assumed to be associated with the flower stand.

When user 1 purchases flower stand FS1, information about the purchased flower stand is distributed to user 1, and user 1's viewer terminal 300 switches the display of the flower stand FS placed in display position A1 in display area A to the flower stand FS1 purchased by user 1. Meanwhile, user 2's display device 301 continues to display the same flower stand FS as in FIG. 30(A), as shown in FIG. 30(B).

Figures 29(C) and 30(C) are examples of the display when the switching conditions are met a predetermined time after the previous switching. On user 1's display device 301, as shown in Figure 29(C), the flower stand FS1 purchased by user 1 himself and displayed in exhibition area A1 continues to be displayed in the same position as in Figure 29(B), but the other flower stands FS have been switched to flower stands FS determined by lottery when the switching conditions are met. The other flower stands FS are not associated with user 1, but are associated with other users, etc. Note that the other flower stands FS may also include flower stands FS prepared by the management that are not associated with any other users.

On the other hand, as shown in Figure 30(C), user 2's display device 310 has switched to the flower star FS determined by lottery in response to the fulfillment of the switching condition. Figure 30(C) differs from user 1's Figure 29(C) in that a flower star FS different from the flower star FS1 associated with user 1 is displayed at display position A1 in exhibition area A, and a common flower star FS based on the default data stored in object data 122 is displayed at all display positions within exhibition area A, including display position A1.

Figures 29(D) and 30(D) show examples of the display when the switching conditions are met again after a predetermined time has passed and the flower stand FS in display area A is switched. At this switching timing, the object data 122 for display area A determined by lottery and stored happens to include the flower stand FS1 purchased by user 1, and its display position is A6 (the second position from the left on the bottom row in Figures 29(D) and 30(D)). In this case, for user 2, user 1's flower stand FS1 is displayed in A6 based on the default data, as shown in Figure 30(D).

On the other hand, as shown in FIG. 29(D), on user 1's display device 310, the flower stand FS1 continues to be displayed in location A1 based on FIG. 27(C). In other words, even if the object data 122 for the same display area includes the flower stand FS1 purchased by user 1, user 1's viewer terminal 300 switches to place the flower stand FS1 purchased by user 1 in the display position based on FIG. 27(C). Furthermore, user 1's viewer terminal 300 performs a process to replace the flower stand FS (default flower stand FS) based on object data 122 that was placed in the display position (A1) of the flower stand FS1 purchased by user 1 with the flower stand FS1 purchased by user 1 based on object data 122. As a result, in place of flower stand FS1, the flower stand FS associated with A1 by the default data (flower stand FS with the letter "O") is displayed in A6 for user 1. This prevents multiple identical flower stands from being placed in the same display area.

Even if the object data 122 for the same display area includes a flower stand FS purchased by user 1, only the switching process is performed to place the flower stand FS purchased by user 1 in the display position based on Figure 27 (C), and the flower stand FS purchased by user 1 based on the object data 122 may also be displayed as is. In this case, multiple identical flower stands FSs for user 1 are displayed, giving the user a sense of exclusivity.

Furthermore, in Figure 29, an example was described in which the flower stand FS1 purchased by user 1 is displayed fixedly at position A1 within display area A. However, this is not limited to this, and the display position of the purchased flower stand FS within display area A placed by the user may be switched each time a switching condition is met. For example, at the timing shown in Figure 29(C), the flower stand FS1 purchased by user 1 is displayed at position A1, but at the next switching timing, it may be displayed at position A4, which corresponds to the upper right of display area A, and default data (data for the flower stand FS associated with A1 in Figure 31(A)) may be displayed at A1.

Next, the process of switching the flower FS displayed in the exhibition area within the virtual space executed by the virtual space generation program 120 will be explained with reference to Figure 32.

In step S201, a determination is made as to whether or not the displayable period is before the scheduled date. The displayable period may be a period that matches the period before the scheduled date, or may be a portion of the period before the scheduled date. If it is not determined that the displayable period is before the scheduled date, the switching process is terminated.

On the other hand, if step S201 determines that the display period is before the scheduled date, step S202 determines whether the switching condition is met. An example of the switching condition in step S202 is when a predetermined time has elapsed (e.g., 30 minutes or 2 hours). If step S202 determines that the switching condition is met, step S203 randomly selects a flower stand FS to display in each exhibition area from among all the flower stand FSs eligible for the lottery, updates the flower stand placement information for each exhibition area (e.g., Figures 31(A) and (B)), and transmits the updated flower stand placement information (including information identifying the flower stand FS (e.g., information identifying the display mode of the flower stand to be displayed on the viewer terminal)) to the viewer terminal 300 of the user who has entered and participated in spatial area ER5. For example, in the case of exhibition area A, the flower stand placement information for exhibition area A shown in Figure 31(A) is updated to the information of the randomly selected flower stand FS, and the updated information is stored in the database that stores object data 122. Updated flower arrangement information is sent from the database storing object data 122 to the user's viewer terminal 300. This updates the information for the flower arrangement FS for each default exhibition area, and makes it possible to switch between displaying flower arrangements for each exhibition area on the viewer terminal 300 of users who have entered and are participating in spatial area ER5.

The flower stand FS that is the subject of the lottery may be all flower stands FS stored as object data 122, excluding NG flower stands (for example, flower stands that have been set to be hidden by the administrator due to being reported), or the flower stand FS may be divided into predetermined groups, and the flower stand FS may be drawn from within the predetermined groups. For example, the groups may be divided by the time of purchase, the type of flower stand, etc.

On the other hand, if it is not determined in step S202 that the switching condition is met, it is determined in step S204 whether a new user has entered spatial area ER5.

If it is not determined in step S204 that a new user has entered the room, processing ends. On the other hand, if it is determined in step S204 that a new user has entered the room, in step S205, flower stand placement information for each exhibition area is sent to the viewer terminal 300 of that user. This allows the user to receive information for identifying the default flower stand FS determined for each exhibition area. For example, flower stand placement information for a predetermined range of exhibition areas, including exhibition area A, updated in step S203, is sent.

29(C)の展示設定は、 ...高そに、でも、でも、でも、でも、でも、でも、というメッセージのリリースされました。 English: In step S206, based on the information related to purchased flower stands shown in Figure 27 (C), it is determined whether the newly entering user has purchased a flower stand FS. If it is determined that a purchased flower stand FS has been purchased, in step S207, purchased flower stand information for identifying the purchased flower stand FS, as well as information on the display location determined at the time of purchase, is transmitted to the viewer terminal 300 of that user. Purchased flower stand information is information on the flower stand FS purchased by each user, as shown in Figure 27 (C). For example, when processing user 1, if the timing for display area A is as shown in Figure 29 (C), the default data for display area A at the time of Figure 29 (C) is transmitted in step S205. In addition, in step S207, the purchased flower stand information for user 1 shown in Figure 27 (C) (flower stand ID "a3") and the display location information determined at the time of purchase ("A1", which is the placement information for "a3") are transmitted. As a result, as shown in Figure 29 (C), flower stand FS1 with flower stand ID "a3" will be displayed at display position A1, and the default flower stand FS will be displayed at other display positions within display area A.

Note that in step S201, an example has been described in which a determination is made as to whether or not the display period is before the scheduled date, but this is not limiting, and it is also possible not to determine whether or not the display period is before the scheduled date. For example, this may be applied to a spatial area ER in which specific objects can be placed, regardless of the date on which the event content is provided (e.g., the date of a live performance).

In addition, in step S203, an example has been described in which the flower arrangement information is updated when the switching condition is met, and the updated flower arrangement information is sent to users who have entered and participated in spatial area ER5. However, step S203 is not limited to this. It is also possible to only update the flower arrangement information when the switching condition is met, and not send the updated flower arrangement information to users who have entered and participated in spatial area ER5. In other words, the flower arrangement may not be switched in response to the switching condition being met on the viewer terminal 300 of a user who has already entered and participated. In addition, in step S203, the flower arrangement information may be updated when the switching condition is met, and the updated flower arrangement information may be sent only to users who have entered and participated in spatial area ER5 and who meet certain requirements. The certain requirements may be met, for example, when a longer period of time has passed since the user entered and participated than the time required for the switching condition to be met, or when the user's individual settings allow switching when the switching condition is met. Note that even if a user does not receive updated flower arrangement information in step S203, when they re-enter the room, the processing from step S205 onwards will be carried out and the latest flower arrangement information (updated in step S203) will be sent.

In the examples shown in Figures 29 to 32, even if the switching condition is met, the flower arrangement FS purchased by the user himself continues to be displayed, while the flower arrangement FS associated with another user is switched and displayed. However, even if the flower arrangement FS is associated with another user, if the other user is a special user, the flower arrangement FS associated with the special user may continue to be displayed. As mentioned above, special users include performer users, sponsor users who sponsor events, and other celebrities, and users who have been authenticated as special users by the management (administrator) side.

Next, we will explain switching process 2 of the flower FS displayed in the exhibition area within the virtual space, which is executed by the virtual space generation program 120, with reference to Figure 33.

Figure 33 shows an example of the above-described flower arrangement switching process, which adds processing to be performed when the desired flower arrangement FS information cannot be read from the database storing the flower arrangement FS information (the flower arrangement FS information cannot be identified). In this embodiment, a large number of flower arrangements are displayed, and each may have a different display format. In the flower arrangement switching process, information read from a database (e.g., a database server) storing information on many flower arrangement FSs is transmitted (distributed) to each user who enters the room. For this reason, when many users enter the room at once, the load on the distribution server computer 100 increases as the flower arrangement switching process is performed for all of the users. For example, if access to the database server storing the flower arrangement FS information is concentrated, the database server may become overloaded, making it impossible to read the flower arrangement information. This could prevent the information necessary to display the virtual space from being transmitted (distributed) to the login source (the viewer terminal of the user who has entered or participated in the virtual space), resulting in problems such as an inability to enter the room at all.

On the other hand, while the flower stands in the exhibition area are objects that enhance the virtual space, they are not essential objects for generating the virtual space (for example, objects that may cause a user to feel uncomfortable if they are missing depending on the content provided, such as the buildings and stage objects shown in Figure 24, or objects that form the basis of the virtual space). If the data of an essential object cannot be read and transmitted (delivered), the virtual space itself cannot be generated and displayed (the content provided in the virtual space cannot be realized). However, even if the flower stands in the exhibition area cannot be displayed accurately, the virtual space itself can still be generated and displayed. In other words, when data of objects essential for generating the virtual space (first type of objects) can be identified (read and transmitted and received), the virtual space can be generated and displayed regardless of whether data of objects such as flower stands that are not essential for generating the virtual space (second type of objects) has been identified. Furthermore, as explained in steps S202 to S205 of Figure 32, the flower stands in the exhibition area are updated and displayed with an accurate flower stand each time the switching condition is met. In other words, if users are able to enter the virtual space, the flower designs in the exhibition area can be updated regularly, so the impact of a malfunction on both users and operators is greater if they are unable to enter the space due to this than if the flower designs in the exhibition area cannot be displayed correctly temporarily.

In this embodiment, therefore, in cluster switching process 2, steps S225 to S245 are performed following step S215. Note that in Figure 33, the process within the dotted line box has been added to the process in Figure 32 described above. The same step numbers are used to describe processes similar to those in Figure 32, and descriptions will be simplified (or omitted). Steps S213 and S223 in Figure 33 provide a more specific description of the process in step S203 in Figure 32, and steps S215 to S245 in Figure 33 provide a more specific description of the process up to sending cluster placement information to the user in step S205 in Figures 32 and 33.

If it is determined in step S202 that the switching conditions are met, then in step S213, a flower stand to be displayed in each exhibition area is randomly selected from all the flower stand FS eligible for the lottery, and the flower stand placement information for each exhibition area in the object data 122 (e.g., Figures 31(A) and (B)) is updated and stored. For example, in the case of exhibition area A, the flower stand placement information for exhibition area A shown in Figure 31(A) is updated to the information for the randomly selected flower stand FS and stored in the database that stores object data 122.

In step S214, the updated flower stand arrangement information (including information specifying the flower stand FS (such as information specifying the display format of the flower stand to be displayed on the viewer terminal)) is read from the database that stores the updated flower stand arrangement information and sent to the viewer terminal 300 of the user who has entered/participated in spatial area ER5. This updates the information for the flower stand FS for each default exhibition area, and makes it possible to switch between displaying flower stands for each exhibition area on the viewer terminal 300 of the user who has entered/participated in spatial area ER5.

In step S204, it is determined whether a new user has entered the room. If it is not determined that a new user has entered the room, processing ends as in Figure 32. On the other hand, if it is determined in step S204 that a new user has entered the room, in step S215, the updated flower arrangement information for each exhibition area (including information specifying the flower arrangement FS (such as information specifying the display mode of the flower arrangement to be displayed on the viewer terminal)) is read. For example, the distribution server computer 100 performs processing to read the flower arrangement information updated in step S213 and sent to the user who has entered and participated in step S223 from a database in which the updated information on the arrangement flower arrangement FS is stored as object data 122.

The range of flower FS information that the distribution server computer 100 reads from the database storing flower FS information (including placement information) as object data 122 in steps S223 and S215 may be, for example, flower placement information that can be displayed in all exhibition areas of the virtual space the user has entered (e.g., within spatial area ER5), or flower placement information that can be displayed in a portion of the exhibition area of the virtual space the user has entered. "A portion" may be, for example, flower placement information for the exhibition area within the section in which the user avatar U is located within the area of the virtual space the user has entered (e.g., the exhibition area within sections such as area ER51 and area ER52 in Figure 24), or flower placement information for the range that can be displayed on the user screen as the user avatar U moves (e.g., the exhibition area within a predetermined 360-degree distance from the position of the user avatar U).

In step S225, it is determined whether all of the flower stand placement information has been read. A state in which all of the flower stand placement information has been read includes, for example, a state in which information specifying the flower stand FS to be read from the database has been accurately returned from the database. If it is determined in step S225 that all of the flower stand placement information has been read, the flower stand placement information for each exhibition area read in step S205 is sent to the viewer terminal 300 of the user.

In contrast, if it is not determined in step S225 that all of the cluster placement information has been read, then in step S235 it is determined whether a predetermined time (e.g., 100 ms) has elapsed since reading in step S215 began. If it is not determined in step S235 that the predetermined time has elapsed, processing proceeds to step S215, where reading of the cluster placement information that has not been read (clusters to be placed in missing locations) continues, and processing proceeds again to step S215. The determination of whether the predetermined time has elapsed may be made, for example, by the AP server starting the process of reading cluster FS information from the database server and waiting for a response from the database server to determine whether a predetermined time has elapsed, or by the database server starting the process of identifying the cluster FS information to be returned as cluster placement information, and returning information for which the predetermined time has elapsed (e.g., information that could not be identified) to the AP server.

On the other hand, if it is determined in step S235 that a predetermined time has elapsed, a predetermined replacement flower stand to be placed in the missing location that could not be read in step S245 is identified. Once a flower stand to be placed in the missing location has been identified in step S245, the process proceeds to step S205, where flower stand placement information for each exhibition area is sent to the viewer terminal 300 of that user. A replacement flower stand is information that requires a lighter processing load to be identified by the distribution server computer 100 than reading the flower stand placement information updated in step S213. For example, in a memory area (or previously updated flower arrangement information temporarily stored as a cache) in storage 103 of distribution server computer 100 different from the database from which flower arrangement FSs are read in steps S223, S215, etc., the flower arrangement FS may be a flower arrangement FS that is not updated (displayed) when a switching condition is met, such as a simple (e.g., plain) flower arrangement FS or a flower arrangement FS predetermined by the administrator. However, the flower arrangement FS may be a predetermined flower arrangement FS that can be updated (displayed) when a switching condition is met, or a flower arrangement FS included in the flower arrangement information that has already been read. In step S235, if the desired flower arrangement information cannot be read (identified) due to a load on the database, for example, information for displaying an alternative flower arrangement FS that requires less processing to identify in place of the data that could not be read is distributed to viewer terminal 300.

Furthermore, if only a portion of the information in the flower star FS read in step S215 was successfully read, steps S245 and S205 will supplement the missing portions excluding the portion that was successfully read. For example, if information for exhibition areas A and B was read, but only the information for exhibition area A was successfully read, processing will be performed to supplement the information for exhibition area B. Note that even if only a portion of the information in the flower star FS read in step S225 was successfully read, all of it may be replaced with the information from an alternative flower star FS in step S245.

This allows the user to receive information on a flower FS that replaces the information on the flower FS of the default flower that could not be read due to a load on the database. This avoids problems such as being unable to enter a room because information to display the virtual space cannot be received. In other words, a display priority is set for objects that can be displayed, and as long as high-priority objects that are essential for the creation of content provided by the virtual space are received, the virtual space is displayed regardless of whether non-essential, low-priority objects are received correctly. Also, when data for a non-essential, low-priority object can be identified, the object is displayed in a display mode based on that data, while when data cannot be identified, a substitute object corresponding to the object is displayed.

Figure 34 shows an example of the display example of user 1's display screen 310 in Figure 29, with a flower stand FST associated with a special user placed in exhibition area A. The flower stand FST is a flower stand FS associated with a talent user related to the attribute "black fox," and is, for example, a special flower stand FST prepared or purchased by the special user. At the time shown in Figure 34 (A), the special user's flower stand FST is displayed by default in exhibition position A4 in the upper right corner of exhibition area A. The flower stand FST prepared or purchased by the special user is displayed in the exhibition area, and even if the switching condition is met, the flower stand placement information for that flower stand FST will not be switched to another flower stand.

Next, in Figure 34 (B), when user 1 purchases flower stand FS1, the flower stand FS1 purchased by user 1 is displayed in display position A1 in display area A. When a user purchases a flower stand FS, as described above, an exhibition area is selected and the display position within that exhibition area is determined, but display positions where flower stands of special users are displayed, as described above, are excluded from the display positions to be determined. This prevents a flower stand from being determined as a display position for a special user's flower stand, even if the user purchases one.

Even after the switching timing when the switching condition in Figure 34 (C) is met, in addition to the flower stand FS1 purchased by user 1 himself, the flower stand FST of the special user continues to be displayed in display position A4. Similarly, at the next switching timing in Figure 34 (D), flower stand FS1 and flower stand FST continue to be displayed.

In addition, within spatial area ER5, there may be an exhibition area (special exhibition area) where all the flower stands FS displayed are those of special users, or there may be a single area where special users' flower stands FS are displayed individually as objects or photo spots. Furthermore, the flower stands displayed in the special exhibition area or single area may be switched from among the flower stands FS associated with a special user to a flower stand FS associated with another special user when a switching condition is met.

In this embodiment, each user can purchase and own multiple flower stands FS (specific objects). Therefore, the more flower stands FS a user purchases, the higher the probability that one will be selected as the default flower stand FS when the switching conditions are met, and the higher the possibility that it will be displayed in the spatial area ER5 of another user's viewer terminal 300. For example, in the example shown in Figure 27 (C), user 1 owns three flower stands FS, while user 2 owns one. Therefore, if the lottery is drawn at a uniform probability, the probability that one of user 1's flower stands FS will be selected as the default flower stand FS is three times higher than the probability that user 2's flower stand FS will be selected. This can motivate users to purchase more flower stands FS in order to appeal to other users.

On the other hand, even if a user owns a huge number of flower stands FS (e.g., 10,000), if the greater the number owned, the more likely it is to be selected as the default flower stand FS, as described above, the probability that the flower stand FS of that user will be selected as the default flower stand FS and displayed will be extremely high, which could result in the display of flower stands FSs displayed in the display areas of other users becoming less appealing, or being misused, or causing discomfort to other users. To prevent these issues, in this embodiment, for users who have purchased and owned a predetermined number of flower stands FS (e.g., 100), the number of flower stands FS they have purchased and owned is considered to be the predetermined number, regardless of whether the user exceeds the predetermined number, and the default flower stand FS is selected at the same rate (probability) as users who have purchased and owned the predetermined number of flower stands FS. For example, if the predetermined number is 100, the percentage of a user who has purchased and owned 100 or more flowers that will be determined to be the default flower FS will be the same as the percentage of a user who has purchased and owned 100 flowers that will be determined to be the default flower FS, even if the actual number owned is 1,000 or 10,000. This prevents a particular user's flower FS from being displayed too frequently in the display area of another user's display device 300.

(Changes in display mode during event content provision)
In this embodiment, while the event content is being provided on the scheduled date, the flower stand FS purchased by the user during the period before the scheduled date is displayed in the virtual space. Furthermore, the image (display mode) within the live event area ER53', which is the event content, changes depending on events that occur within the spatial area ER5 during the period before the scheduled date. An example of an event that occurs within the spatial area ER5 during the period before the scheduled date is when a user purchases a flower stand FS and displays and places it in the display area within the spatial area ER5. Below, we will explain the changes in the display mode of the virtual space while the event content is being provided, with reference to Figures 35 to 37.

Figure 35 shows an example scene from a performance of event content (for example, a live performance in which the same types of performances as those in Figures 13 to 24 are performed) provided in the worship hall in area ER53' in Figure 24, which functions as virtual stage G. Hereinafter, virtual stage G in Figure 35 will be referred to as virtual stage G2. Performer avatars 1a to 1d appear on virtual stage G2. Performer avatars 1a to 1d are associated with the attributes "cherry blossom," "demon," "white fox," and "black fox," respectively. These attributes correspond to the attributes associated with the flower stage FS shown in Figure 27 (A).

While the event content is being provided, as shown in Figure 35, performer avatars 1a to 1d are shown holding and introducing a flower stand FS. In this embodiment, if the viewing user purchased a flower stand FS during the period before the scheduled date, performer avatars 1a to 1d are shown holding the flower stand FS purchased by that user. Figure 36 is an example data table for identifying the flower stand FS used in the presentation of the event content in Figure 35. Figure 36 (A) shows default event flower stand information common to all users, managed in the distribution server computer 100 (e.g., gift data 134, etc.). The flower stand FS displayed on each user's display device 310 while the event content is being provided is identified based on the event flower stand information in Figure 36 (A) and the purchased flower stand-related information for each user in Figure 27 (C).

In this embodiment, a total of nine flower stands FS are used to produce the event content: flower stand FSs with the attributes "cherry blossom," "demon," "white fox," and "black fox" in sizes "large" and "small," as well as a flower stand FS with the attribute "gorgeous." The default flower stand FS in Figure 36(A) is determined by random drawing for each attribute and size from among the flower stand FSs purchased by any user during the pre-scheduled period, from the end of the pre-scheduled period until the start of the event content. As shown in Figure 36(A), information specifying the default flower stand FS to be used in the production is associated with each attribute and size of the flower stand FS. For example, a flower stand FS with the attribute "cherry blossom" and a size "large" is associated with a flower stand FS with a flower stand ID of "a4" and characters displaying "letter A4." Note that not all types of flower stand FSs available for purchase before the pre-scheduled date, as illustrated in Figure 27(A), may be used in the production of the event content; only some of them may be used. For example, in this embodiment, the attribute "plain" is not used in the presentation of event content.

The distribution server computer 100 transmits the event flower star information shown in Figure 36 (A) and purchased flower star related information for each user shown in Figure 27 (C) to the viewer terminals 300 of participating users at the start of the event content (when they log in) or at a specified timing during the content provision.

In each user's viewer terminal 300, among the flowers identified from the received event flower information, those with the same attributes and size as the flowers identified from the user's purchased flower information are replaced with the flowers identified from the user's purchased flower information, and the event flower data shown in Figure 36 (B) is updated. In this embodiment, if a user has purchased and owns multiple flower FSs with the same attributes and size, the last (most recently purchased) flower FS is set as the event flower information (associated with the table). As shown in Figure 27 (C), User 1 owns one flower FS with the attribute "Cherry Blossom" and size "Small," which is flower ID "a3." Therefore, while the default flower FS with the attribute "Cherry Blossom" and size "Small" in Figure 36 (A) is associated with flower ID "b4," as shown in Figure 36 (B), "a3" is associated with User 1's event flower information. Additionally, as shown in Figure 27 (C), User 1 owns two flower stand FSs with the attribute "Gorgeous," with flower stand IDs "b3" and "c3." Because "c3" was purchased later than "b3" and "c3," "c3" is associated with the attribute "Gorgeous" in Figure 36 (B). As a result, for users who did not purchase a flower stand in the period before the scheduled date, the default event flower stand information is maintained, while for users who did purchase a flower stand in the period before the scheduled date, the default event flower stand information is updated to include a flower stand with the same attributes and size as the purchased flower stand.

At each user's viewer terminal 300, a presentation is performed during the provision of event content, as shown in Figure 35, based on the set event flower arrangement information. Figure 35 is an example of a display mode displayed on user 1's display device 310, and is displayed based on the event flower arrangement information stored in Figure 36(B). Figure 35(A) shows an example in which performer avatars 1a to 1d each have a flower arrangement FS of size "small" with an attribute corresponding to their respective attributes. The flower arrangement FS held by performer avatar 1a is flower arrangement FS1 with flower arrangement ID "a3" purchased by user 1. Also, in the center of Figure 35(A), a flower arrangement FS with the attribute "gorgeous" is displayed, along with flower arrangement FS2 with flower arrangement ID "c3" that user 1 last purchased. Also, in Figure 35(B), performer avatars 1b and 1c each have a flower arrangement FS of size "large" with the attribute "demon." Because user 1 has not purchased a flower stand FS with the attribute "demon" and a size of "large," the flower stand FS with the default flower stand ID "g4" shown in Figure 36 (A) is displayed. Note that the display format of the virtual live venue is not limited to the set shown in Figure 35, and various objects may be displayed.

The effect shown in Figure 35 is achieved by transmitting from the distribution server computer 100 performance information including, for example, information for controlling the display behavior of performer avatars 1a-1d and information for specifying the attributes and size of a flower stand to be held in each of the performer avatars 1a-1d's hands or displayed in a predetermined location in the virtual space (hanging from the ceiling). Each user's viewer terminal 300 controls the display mode in the virtual space including performer avatars 1a-1d based on the performance information, and by placing a flower stand FS identified from the event flower stand information (see Figure 36(B)) updated on each viewer terminal 300 that matches the information for specifying the flower stand's attributes and size, thereby achieving the performance shown in Figure 35.

Next, with reference to Figure 37 (A), the event flower arrangement determination process executed in the distribution server computer 100 will be described. In step S301, the flower arrangement to be used in the presentation of the event content is determined by random drawing for each of the flower arrangement attributes and sizes described above. In step S302, event display flower arrangement information (see Figure 36 (A)) that can identify the determination result is transmitted to the viewer terminal 300. For example, as shown in Figure 36 (A), event flower arrangement information that associates and stores information that identifies the flower arrangement FS determined by lottery for each attribute and size is transmitted to the viewer terminal 300 of a user who plans to participate or is currently participating in the event content.

In step S303, for users who have purchased flower stands, the purchased flower stand related information for each user shown in Figure 27 (C) is sent to each user's viewer terminal 300, and the event flower stand determination process is terminated.

Next, with reference to Figure 37 (B), we will explain the event flag identification process executed on the viewer terminal 300.

In step S311, the event flower star information (see FIG. 36(A)) sent and received from the delivery server computer 100 in step S302 of FIG. 37(A) is stored as default data for identifying the default flower star FS to be used in the performance. In step S312, it is determined whether purchased flower star related information (information about the user in FIG. 27(C) sent from the delivery server computer 100 in step S303 of FIG. 37(A)) has been received. If it is not determined in step S312 that purchased flower star related information has been received, the event flower star determination process is terminated.

On the other hand, if it is determined in step S312 that purchased flower arrangement related information has been received, then in step S313, information for identifying the flower arrangement FS purchased by the user for each attribute and size is stored as update data based on the received purchased flower arrangement related information. At this time, if multiple flowers with the same attribute and size are identified, the most recently purchased flower arrangement with that attribute and size is identified and stored based on the purchase date and time.

In step S314, for any of the flower arrangements identified from the default data that have the same attributes and size as the flower arrangements identified from the update data, the information on the flower arrangements used for the performance is rewritten to the flower arrangements identified from the update data.

As described above, for users who have already purchased a flower stand FS, the flower stand they themselves have purchased can be displayed in association with the performer avatar for the event display flower stand. Furthermore, in this embodiment, if there are multiple flower stands with the same attributes and size as the purchased flower stand, the most recently purchased flower stand FS is displayed, making it possible to display a more elaborate flower stand FS created by the scheduled date for the event content to be provided. Note that the flower stand FS that is used for the presentation is not limited to replacing the most recently purchased flower stand FS; it may also be possible to select a flower stand with the same attributes and size by lottery.

In addition, the event flower arrangement determination process in Figure 37 (A) has been described as an example in which the event flower arrangement information is determined and stored in advance before the event content is provided, but this is not limited to this. The process may be performed, for example, every predetermined time (e.g., every 10 minutes) while the event content is being provided to update the event flower arrangement information. Alternatively, if a singing part and an MC part are repeated while the event content is being provided, the event flower arrangement information for each part may be updated before the next part begins. While the event content is being provided, the display mode of the presentation may be changed based on the event flower arrangement information updated while the event content is being provided.

Note that the flower stand FS to be selected by lottery as determined as the event flower stand information shown in the example of Figure 36 (A) may exclude flower stand FS associated with special users. This allows the flower stand FS to be selected by lottery from among flower stand FS associated with fan users (general users) of the performer avatar, for example, and increases the consistency of the displayed flower stand FS in the presentation of event content, such as messages to fans, such as "Thank you for your support flower stand!"

(Regarding processing related to event content)
The above describes an example in which the display mode within the spatial area ER5 can change depending on an event that occurs within the spatial area ER5 during the period before the scheduled date on which the event content is to be provided. However, instead of or in addition to this, in this embodiment, processing related to the event content may be performed depending on the degree to which an image within the spatial area ER5 is displayed on the display device 310 of the viewer terminal 300 by entering or participating in the spatial area ER5 during the period before the scheduled date on which the event content is to be provided in the virtual space ER.

Processing related to event content includes, for example, processing to change the display mode of the effects while the event content is being provided, and processing to grant the user objects that the user can use while the event content is being provided. The degree of display is, for example, the number of times the user entered spatial area ER5 during the period before the scheduled date. The number of times the user entered spatial area ER5 may be counted as one entry if multiple entries are made on the same day, or may be counted as one entry when the user remains in the space for a specified period of time (e.g., 10 minutes). The degree of display is not limited to this, and may also be the length of time spent in spatial area ER5 during the period before the scheduled date, or the degree to which a specific area within spatial area ER5 is displayed (such as the number of times it is displayed or the length of time it is displayed). A specific area may be, for example, a predetermined area within spatial area ER5, such as an exhibition area or an offering area.

The following describes an example in which the "degree" of displaying an image within spatial area ER5 is "the number of times entered spatial area ER5 where event content may be held on the scheduled date (hereinafter simply referred to as the number of entries)," and the "processing related to event content" is "processing to change the presentation content while the event content is being provided" and "processing to grant the user an object that the user can use while the event content is being provided."

The distribution server computer 100 (e.g., event data 111 and gift data 134) counts and stores the number of times each user enters the room during the period before the scheduled date. Figure 38 shows an example data table for specifying the "items" granted according to the number of times each user enters the room and the "performance content" that changes during the provision of the event content according to the number of times each user enters the room.

The "items" granted (made available) according to the number of times a user enters the room are objects that can be used by the user while the event content is being provided. For example, they may be limited items that can only be used in event content (such as a live performance) held after the end of the pre-scheduled period, or they may be items that can be used not only in event content held after the end of the pre-scheduled period but also in content other than the event content. Note that when used in content other than the event content held after the end of the pre-scheduled period, certain limitations may be placed on the item's functionality, effectiveness, and other performance aspects (for example, certain functions may be unavailable or effects may be reduced). Alternatively, or in addition to these, the item may be a limited item related to, for example, the image theme of the event content held after the end of the pre-scheduled period.

As shown in FIG. 38, "items" are items that can be used during the provision of event content to liven up the event, for example. For example, if the user enters the room once during the period before the scheduled date, they will be awarded limited edition cracker A that can be used in the event content; if they enter twice, they will be awarded limited edition cracker B; if they enter three times, they will be awarded limited edition cracker C. If they enter four times, they will be awarded limited edition fireworks; if they enter five times, they will be awarded limited edition glow sticks; if they enter six times, they will be awarded limited edition stamps; and if they enter seven times, they will be awarded limited edition item sets. Stamps are stamps that can be used for chatting and sending and receiving messages within the virtual space. An item set is a set containing multiple items. Note that the items shown in FIG. 38 are not limited to items that can be used during the provision of event content and that liven up the event, and may also be so-called tipping items. Furthermore, in addition to items corresponding to the actual number of times the user enters the room, items corresponding to a number of times less than the actual number of times the user enters the room may also be awarded.

As shown in Figure 38, for example, if the number of times a user enters the room during the period before the scheduled date is between one and three times, the "presentation content" will be normal and the presentation content will not change. If the number of times a user enters the room is four or more times, the presentation content can change, with special room A being provided after four entries, special room B after five entries, and special room S after six entries. Providing a special room means obtaining the right to participate in event content in a virtual live venue animation (display mode) that is different from normal presentation. For example, an area ER53' can be prepared that can only be accessed by target users who have obtained the right to participate in a live performance in a special room, and event content can be provided within the special room. Alternatively, the image of the live venue set that is distributed when the event content is provided can be replaced with an image that is distributed to target users.

In addition, the seventh time, a performance featuring a secret costume will be provided. The secret costume is a costume (costume object) for the performer avatar that is displayed in correspondence with the performer avatar when the event content is provided. Target users who have earned the right to be featured in the performance featuring the secret costume will be distributed data that replaces the costume data for the performer avatar that is normally distributed to other users.

An example of event content-related processing executed in the distribution server computer 100 according to the number of entries shown in FIG. 38 will be described with reference to FIG. 39. The event content-related processing is executed, for example, for each user scheduled to participate in the event content (e.g., in ascending order of user ID), from the end of the period before the scheduled date until the start of the event content.

In step S401, it is determined whether the user has entered the room one or more times during the period before the scheduled date. If it is not determined that the user has entered the room one or more times during the period before the scheduled date, the processing ends. For users determined in step S401 not to have entered the room one or more times during the period before the scheduled date, event content is delivered based on the data stored by default in event data 111.

On the other hand, if it is determined in step S401 that the user has entered the room one or more times during the period before the scheduled date, then in step S402, an item is granted according to the number of entries. This causes the granted item to be displayed, for example, in an item box owned by the user in the virtual space ER. The item may be placed in the box in advance before the start time of the event content, or it may be grayed out and unavailable until the start time, or it may be usable at the virtual live venue that is open from the start time.

In step S403, the effect content corresponding to the number of times the user has entered the room is set for the user, and the process ends. For example, if the user has entered the room four times, limited edition fireworks will be displayed in the item box, and information for designing the virtual live venue as Special Room A will be stored in association with the target user.

(Regarding re-provision of content for the period before the scheduled date and for events)
Examples of event content provided in the period before the scheduled date and on the scheduled date have been described with reference to Figures 24 to 39. However, content provided to users by the distribution server computer 100 may be re-provided (re-performed). While Figures 13 to 39 illustrate an example of content, such as a live event with performers at a virtual live venue on the scheduled date, in Figure 40, the live event provided on the scheduled date and content provided in the period before the scheduled date before the live event (e.g., areas and activities available for a limited time in connection with the live event) are collectively referred to as event content. Content provided in the period before the scheduled date includes, for example, content related to the live event, including the spatial area ER5 that is opened in the period before the scheduled date before the live event described in Figures 24 to 39. Hereinafter, the spatial area ER5 that is opened in the period before the scheduled date and the live event provided in the spatial area ER5 on the scheduled date will be collectively referred to as event content. The content for the period before the scheduled date may include activities (such as game content) that the user can use in the spatial area ER5 that is open during the period before the scheduled date, objects that can be displayed, and the like.

Figure 40 is a diagram illustrating the period before the scheduled date and the re-provision of event content. For example, as shown in Figure 40(a), a first scheduled period and a second scheduled period are set as "scheduled periods" that include the scheduled date on which live event content will be provided and the period before the scheduled date. The content for the period before the scheduled date described above is provided before the first scheduled date in the first scheduled period, and the live event content described above is provided on the first scheduled date. The second scheduled period for re-provision of the event content provided during the first scheduled period can be initiated a predetermined period (e.g., two months) after the end of the first scheduled period. The provision of the event content ends once the first scheduled period ends, but the distribution server computer 100 stores and retains information (re-provision data) for taking over and re-provisioning the content data at the end of the first scheduled period. The stored re-provision data is re-provisioned to users during the second scheduled period. The re-provision data includes, for example, information for generating a virtual space (e.g., Figures 24 and 25, etc.), information corresponding to user actions (e.g., user-related information (related to purchased flower stands) in Figure 27, flower stand placement information for each exhibition area shown in Figure 31, etc.), performer information such as animation data and audio data including motion data for performer avatars in live events (e.g., performer avatar information and performer audio distributed in Figure 10), information on event flower stands used by performers in the live events exemplified in Figures 35 to 37, and data on games played during the first scheduled period (e.g., previous save data, ranking data, user level). Note that spatial area ER5 may be opened for several days after the first scheduled date to set up a period after the first scheduled date, so that the content data at the end of the first scheduled period, including the period after the first scheduled date, is carried over.

At the start of the first scheduled period, the flower stands FS in the virtual space are displayed in their initial state (e.g., initially arranged with the initial settings for the flower stands FS), and are updated in accordance with user behavior (e.g., purchases, etc.) during the period before the first scheduled date, as described above. At the start of the second scheduled period (e.g., when spatial area ER5 is reopened), as illustrated in Figure 40(a), information based on user behavior during the first scheduled period is carried over and reflected in the virtual space, so that the flower stands FS for each exhibition area are arranged based on the flower stand arrangement information at the end of the first scheduled period. As a result, when a user who purchased a flower stand FS during the first scheduled period enters the second scheduled period, the flower stand FS purchased by that user will be arranged in the same position and in the same display format as it was during the first scheduled period. Note that while the flower stand arrangement information is used as of the end of the first scheduled period, it may also be as of the end of the first scheduled date or the end of the period after the first scheduled date.

Furthermore, during the second pre-scheduled period in the second scheduled period, as in the first pre-scheduled period, the display mode within the virtual space can be changed and varied between users in response to user actions, and the processes shown in Figures 32 to 39 are also executed. For example, if a user who enters during the second pre-scheduled period purchases a flower stand FS, the flower stand will be displayed in the virtual space displayed on the user's viewer terminal 300 in a specified area designated by the user, as shown in Figures 29 and 30. However, the purchased flower stand FS may not be reflected in the virtual spaces of other users, resulting in different flower stands FS being displayed between users. Furthermore, each time a switching condition is met, the flower stands FS displayed other than the flower stand FS purchased and placed by the user (including both purchases during the first scheduled period and the second scheduled period) can be changed or updated. Additionally, data from games played during the first scheduled period will be carried over to display rankings, and data such as the games each user has completed will also be carried over, allowing users to continue playing games from where they left off in the first scheduled period.

The re-provision data does not include location information and movement information (information for displaying the user avatars U of other users) of the user avatars U who entered the room during the first scheduled period. Therefore, during the second scheduled period, the user avatars U of the users who actually entered the room during the second scheduled period are displayed. However, this is not limited to this. The re-provision data carried over for re-enactment may include location information and movement information of the user avatars U of the users who entered the room during the first scheduled period, and virtual avatars may be displayed based on the location information and movement information of the carried-over user avatars U depending on the number of users who entered the spatial area ER5 during the second scheduled period (for example, when the number is less than a predetermined number).

Furthermore, on the second scheduled date in the second scheduled period, a live event featuring performers will be held, just as on the first scheduled date, and users who enter spatial area ER5 will be able to view the event from a viewpoint that corresponds to the user's operation. Furthermore, for the event on the second scheduled date, the most recent flower stand (last purchased flower stand) for each user can be displayed in association with the performer avatar, just as in the examples in Figures 35 to 37. Note that the default flower stand information in Figure 36 (A) may be the same as the flower stand FS for the first scheduled period, but may also be different from the default for the first scheduled period based on the information on the flower stand FS purchased by the user for the second scheduled period.

Figure 40(a) shows an example in which the flower stand-related information from the first scheduled period is carried over to the second scheduled period, but this is not limiting. As shown in Figure 40(b), the flower stand-related information from the first scheduled period may not be carried over to the second scheduled period. In the case shown in Figure 40(b), the flower stand FS in the virtual space at the start of the second scheduled period begins to be displayed in the same initial state as at the start of the first scheduled period, and is then updated according to the user's behavior during the period before the second scheduled date. Note that the initial state of the flower stand (displayed flower stand and display mode) at the start of the second scheduled period may be the same as the initial state of the flower stand at the start of the first scheduled period, or may be partially or entirely different (for example, the display mode of the flower stand FS in a predetermined initial position may be changed to a design for the second scheduled period).

Furthermore, on the second scheduled date in the second scheduled period, a live event featuring performers will be held, just like on the first scheduled date, and users who enter spatial area ER5 will be able to watch the event from a viewpoint that corresponds to the user's operation. However, the default flower stand information in Figure 36 (A) may be different from the default for the first scheduled period, based on the information on the flower stand FS purchased by the user during the second scheduled period.

Note that the re-provision data for a re-provisioned live event will be identical to the previously provided motion and audio data for the movements and sounds of the performer avatars, but the display mode other than the movements of the performer avatars does not have to be the same as the previously provided data, and may be different between the previously provided data and the re-provision data. For example, the costume of the performer avatar for the live event on the first scheduled date may be different from the costume of the performer avatar for the live event on the second scheduled date.

(Regarding special audio/viewpoint switching processing)
Next, we will explain the performers when the event content is re-provisioned. During the period before the first scheduled date of the first scheduled period, performers from the live event on the first scheduled date (e.g., a talent who performed a live stream) are generally not allowed to enter (will not enter) the space area ER5. However, during the second scheduled period, performers from the live event on the second scheduled date (i.e., the same live event as the first scheduled date) can also enter the space area ER5 as participants, both during the period before the second scheduled date and on the second scheduled date. Performer avatars who enter as participants during the second scheduled period are displayed in a different display mode from the performer avatars for the live event on the first scheduled date. For example, performer avatars who are currently performing at an event are displayed as different three-dimensional humanoid models (e.g., performer avatar 1 in FIG. 13 ), whereas performer avatars who are participating as participants during the second scheduled period are displayed as the same user avatars as other general users. However, the performer's name is displayed in association with the user avatars of the other general users (e.g., a user name and an official mark that identifies the performer together with the user name), allowing other users to recognize that the performer is an avatar. Furthermore, user avatars for general users may be simplified avatars rather than humanoid. For example, a three-dimensional humanoid model would require a large amount of rendering information to display in the virtual space, whereas a simplified avatar may be a three-dimensional model that can be displayed with a small amount of rendering information, such as a simple shape consisting of a circle, square, triangle, or the like (e.g., a triangular pyramid or a plain animal shape).

Furthermore, when a performer is taking part as a participant in a live event on the second scheduled date, a performer avatar (an avatar that moves and is displayed based on motion data and audio data stored in advance as re-provision data) as the performer conducting the live event and an avatar as the participant may be displayed. This allows other users participating in the event to simultaneously view (display) both avatars in a single virtual space, enhancing the enjoyment of the event. For example, a user may be provided with a way to enjoy the event by watching an avatar as the performer conducting the live event while listening to the voice of the performer as the participant talking about his or her feelings during the event. To facilitate this type of enjoyment, in this embodiment, processing is performed to switch the audio output from the viewer terminal 300 and the viewpoint displayed on the viewer terminal 300.

In principle, only the user avatars of users who are in the same room are displayed on viewer terminals 300. Therefore, if a performer is in the virtual space as a participant, the performer's avatar as a participant will not be displayed on viewer terminals 300 of users other than those in the same room as the performer. However, as an exception, for user avatars of special user accounts, even if the user has entered the room as a participant, it is possible to mirror the user avatar's appearance and voice in other rooms (for example, duplicated rooms with the same content provided). This allows the performer's avatar to be displayed as a participant in the virtual space displayed on viewer terminals 300 of users who are not in the same room as the performer.

Figure 41 is a flow diagram showing an example of special audio/viewpoint switching processing for switching audio and viewpoint. The special audio/viewpoint switching processing is executed by each viewer terminal 300. The viewer terminal 300 displays an image in the virtual space along with an icon for selecting settings for that virtual space, and executes the special audio/viewpoint switching processing when it receives an operation on the icon for switching audio or viewpoint.

In step S411, it is determined whether an audio switching operation has been performed. If it is not determined that an audio switching operation has been performed, the process proceeds to step S413. On the other hand, if it is determined in step S411 that an audio switching operation has been performed, the process proceeds to step S412. If the current audio setting is normal audio, the process switches to special audio, which enables output of special user audio. Alternatively, if the current audio setting is special audio, the process switches to normal audio. Special audio refers to audio output from the virtual space that is extracted (or extracted in a way that makes it easier to hear) only the audio of special users (e.g., accounts of talents, celebrities, etc., including performers) and output from the viewer terminal 300. This allows the user to easily switch to the audio of the performers as participants. Note that normal audio refers to audio corresponding to the location of the user's user avatar in the virtual space, and is audio occurring within a predetermined radius of that location. For example, if the user is located near the event stage, the voice of the performer proceeding with the event will be output at a louder volume than other voices, and if the user is located far away from the event stage, the voices of other users who are near the user's user avatar will be output at a louder volume than the voice of the performer proceeding with the event. Note that if there are multiple performers participating, the user may be able to select which performer's voice to use. For example, the user may be able to select one particular performer of their choice, or multiple performers.

Note that switching to special audio does not necessarily mean that normal audio will no longer be output, but may also mean that the audio of a special user will be heard in addition to normal audio. For example, in addition to audio emitted from user avatars located in the vicinity of the user avatar operated by the user, audio emitted from the user avatar of a special user may be output, even if the user avatar is located at a distance from which audio would normally not be heard.

In addition, since the sound on stage is output from the sound data distributed to the viewer terminal 300 by the generated sound distribution process (Figure 10), it may be possible for either normal sound or special sound to be output from the viewer terminal 300 regardless of whether it is selected. During live content distribution, normal sound cannot be selected in the first place (sounds such as other users' voice chat cannot be heard), but special sound may be output as secondary sound. Furthermore, special sound may be selectable and output only by users who meet certain conditions (for example, paying or clearing a game). In this way, during live content distribution, while watching the live performance (main sound), the sound of the performer avatar as a participant may be output as secondary sound (narration).

Furthermore, the device is not limited to switching between audio sounds, and may also be, for example, a device that switches between loud and soft volumes. For example, when the current audio setting is normal audio, the normal audio may be output at a louder volume than the special audio, and when the current audio setting is special audio, the special audio may be output at a louder volume than the normal audio.

Next, in step S413, it is determined whether a viewpoint switching operation has been performed. If it is not determined that a viewpoint switching operation has been performed, the special audio/viewpoint switching process is terminated. On the other hand, if it is determined in step S413 that a viewpoint switching operation has been performed, the process proceeds to step S414, and if the current viewpoint setting is the normal viewpoint, the viewpoint is switched to a special viewpoint that focuses on the user avatar of a special user (for example, the avatar of an actor who has entered the virtual space as a participant), whereas if the current viewpoint setting is the special viewpoint, processing is performed to switch to the normal viewpoint. This allows the user to easily switch to a viewpoint that focuses on the avatar of an actor who is a participant.

The normal viewpoint is the viewpoint that the user's user avatar U faces in the virtual space, and an image of the virtual space that can be seen from that viewpoint is displayed. For example, if the user faces the event stage, an image including the avatars of the performers conducting the event is displayed, and if the user faces the opposite side of the event stage, an image of the virtual space on the opposite side of the event stage is displayed.

On the other hand, a special viewpoint is an image taken by a virtual camera positioned in the virtual space, capturing the user avatar of a special user from an angle that may differ from the normal viewpoint. For example, if the image is from a virtual camera that is fixedly positioned in advance, an image obtained from the virtual camera capturing the user avatar of the special user (for example, the image may be selected by the administrator, or the virtual camera may be selected based on the special user's location information) may be distributed to the viewer terminal 300. Alternatively, an image capturing the avatar of a performer as a participant, captured by an operator (for example, an administrator account) of a virtual camera (for example, drone photography in the virtual space), may be distributed to the viewer terminal 300. For example, the viewpoint may be a bird's-eye view of the avatar from diagonally above. Note that if multiple performers are present as participants, it may be possible to select which performer's avatar to use. For example, it may be possible to select one specific favorite performer, or multiple performers.

Note that the operation to switch to special audio/special viewpoint in the special audio/viewpoint switching process may be available only to users who meet certain conditions, such as payment. Also, either special audio or special viewpoint may be available only to users who meet certain conditions.

(Special room entry procedures)
In this embodiment, the virtual space is provided using multiple rooms to simultaneously provide the same content to multiple users. As a result, content such as the spatial area ER5 that constitutes the virtual live venue where event content for the period before the scheduled date and the scheduled date is provided, as described above with reference to FIG. 40, is provided using multiple rooms, making it possible to simultaneously distribute the content to many users. Note that, for example, one room can be defined per server, but multiple rooms may also be defined per server.

Figure 42(a) is a diagram illustrating multiple rooms that make up the spatial area ER where specified content is provided (for example, rooms corresponding to areas ER51-53 of spatial area ER5 that constitute a virtual live venue, or a room corresponding to area ER53' in Figure 24 where a live event is held on a scheduled date with the same features as area ER53). The multiple rooms include a main room where the virtual space is constructed and into which, for example, performers enter (are associated) for an event, and multiple other rooms (Room 1, Room 2, Room 3, etc.) into which the virtual space within the main room (including the performers' avatars) is mirrored. A user wishing to enter the virtual live venue is either assigned (associated) to a room designated by the user from among the multiple rooms, or, if no room is designated, is randomly assigned (associated) by the load balancing system to one of the rooms, allowing the same virtual live venue image to be displayed. For example, this may be when logging in to a virtual space and entering, and after logging in, a screen may be displayed that allows the user to select the content (e.g., area) they wish to enter. When the user selects the area they wish to enter rather than specifying a room ID, they may be randomly assigned to one of the rooms as if no room had been specified.

On the other hand, user actions within a virtual space (voice, actions, comments, etc.) can be shared with users in the same room, but not with users in other rooms. For this reason, it is desirable for users to enter the same room in situations such as when multiple entertainers or celebrities wish to enter the same room to liven up the atmosphere of an event in the virtual space, or when a user wishes to enter the same virtual space because another user with whom they are friends is already in the room.

However, each room has a preset upper limit (e.g., 200 users) on the number of users who can enter the room, taking into account factors such as server processing capacity and load concentration. For this reason, if rooms are assigned based strictly on this upper limit, it may be impossible to allow users to enter the same room under the circumstances described above, and users' requests may not be met. On the other hand, the upper limit is generally set to a value that allows for some leeway, taking into account server processing capacity, so that even when the server is under heavy load, delivery is not affected (such as an inability to deliver).

For this reason, in this embodiment, if certain conditions are met, special processing is performed that allows users to enter the same room even if the maximum number of users would be exceeded if they were allowed to enter. Figure 42 (b) is a flow diagram showing an example of the special room entry processing. The special room entry processing is executed by the distribution server computer 100. The distribution server computer 100 executes the special room entry processing when it receives a request from a user to enter a room where certain content is provided (for example, a spatial area ER that constitutes a virtual live venue). The request to enter the room may be made at the time of logging in to the virtual space (a room ID may be specified at this time), or may be made when a screen for selecting the content (such as an area) to enter is displayed on a title screen after logging in, and the content is selected (a room ID may be specified at this time). Examples of specified conditions include, but are not limited to, when a special user specifies a room to enter the virtual space, or when a user related to the user attempting to enter the room is already in one of the rooms.

Special users include accounts of performers appearing as performers at live events (e.g., performer user IDs and accounts in Figure 8), as well as talents and celebrities (all of which may also be performers). For example, they may be the accounts of users designated as special users by the administrator in advance, and may be assigned attribute numbers that can identify talents, celebrities, etc. in addition to the user IDs and accounts of viewer user data stored in storage 103. Furthermore, special users in the room entry exception processing may include administrators who operate the virtual space and people related to talents, etc. (e.g., managers, etc.). Administrators include, for example, accounts of users with permission to operate virtual cameras. This makes it possible to use virtual cameras to capture video of a room entered by a talent and display it on the viewer screens of other users, or to send the video data to other computers (e.g., external servers for live streaming).

Examples of cases where a user has a relationship with another user include when a follow function such as a friend function is provided in the virtual space provided by the distribution server computer 100, where there is a mutual follow relationship, or when the intimacy level is above a predetermined value. Intimacy is calculated based on the user's behavioral history within the virtual space. For example, it may increase based on the number of chats, the number of cooperative games played, or the number of times the user has been within a predetermined range of location information. Furthermore, between special users, special users with an intimacy level above a predetermined value, or special users who need to be in the same room to progress in content created by the operator, such as special users scheduled to appear at the same live event, are considered to be related users.

In step S421, it is determined whether a special user has entered the room. If it is determined in step S421 that a special user has entered the room, it is then determined in step S422 whether a room has been specified. For example, when a room ID is entered on the terminal of the account of a talent who is a special user, a request to enter the room and a request to specify the room ID are sent to the distribution server computer 100. If it is determined in step S422 that a room has been specified, in step S423, processing is performed to associate the user with the specified room and allow the user to enter the room, regardless of the number of users currently in the specified room and the maximum number of users. The distribution server computer 100 determines whether the user who made the entry request is a special user based on the ID of the user, and if a room ID has been specified, allows the user to enter the room with the specified room ID. For example, processing is performed to associate the user ID of the special user who has entered the room with the specified room ID.

Note that room IDs that allow entry regardless of the maximum number of users may be predetermined by the administrator. In other words, when a room ID other than a room ID that allows entry regardless of the predetermined maximum number of users is specified, if the number of users in the specified room has already reached the maximum number, entry to that room may be denied. Also, a special user who entered in step S421 and has an association with the special user may be allowed to enter a room that is already in the room.

On the other hand, if it is not determined that the user is a special user, or if a special user is entering a room but no room is specified, step S424 determines whether a user who is related to the user attempting to enter (for example, a friend relationship, or a relationship where the intimacy level is equal to or greater than a predetermined value) has already entered any room. If step S424 determines that a related user has already entered a room, step S425 performs processing to associate the user with the room they have entered and allow them to enter the room, regardless of the number of users currently in the room and the maximum number of users allowed in the room. Note that if related users are spread across multiple rooms, the user may be allowed to enter the room with the most related users. Alternatively, priority may be given to rooms with the least crowded level among the rooms with related users.

On the other hand, if it is determined in step S424 that the associated user is not in any of the rooms, then in step S426, the process of associating the user with one of the rooms that has not reached the upper limit and allowing the user to enter that room is performed. For example, a process of allocating the user using normal load balancing processing is performed.

(Regarding component reset of the performer's humanoid avatar)
Next, referring to FIG. 43 , a process for resetting abnormal display of an object that sways in conjunction with a character object will be described. As shown in FIGS. 13 and 20 , the performer's humanoid avatar is a human-shaped character object (a three-dimensional model including bones (skeleton)) associated with a costume object corresponding to the costume worn by the character object. Furthermore, by associating components (functional parameters) with objects displayed in the virtual space, various objects can be displayed and operated within the virtual space. Each character object and costume object is preset with various components (e.g., various parameters such as so-called colliders and rigid bodies) used for physical calculations (calculation processes such as collision detection, gravity, and movement). Object data associated with various components is included in the virtual space update data of FIG. 10 and distributed to the viewer terminal 300. Furthermore, the viewer terminal 300 performs processing for displaying the character object in motion based on the performer's motion data (performer avatar information included in the virtual space update data of FIG. 10 ) distributed by the distribution server computer 100. On the other hand, the clothing object is an object that displays a swaying motion (for example, cloth such as clothes or hair), and is displayed as moving by performing physical calculations in conjunction with the motion of the character object (for example, calculation processing based on a component that performs calculations for swaying objects such as cloth that functions in conjunction with a skin mesh associated with the character object). In this way, the viewer terminal 300 performs physical calculations and processes to display the clothing object as moving (for example, swaying, bouncing, bending, etc.) in the same way as in real space in accordance with the motion of the character object.

In this way, the computational processing for displaying the movement of character objects and costume objects is performed by the viewer terminal 300 based on virtual space update data streamed at predetermined intervals from the distribution server computer 100. Once the movement display processing based on the previously received virtual space update data is completed, the movement display processing is performed based on the next received data.

Even if the data being delivered is the same, differences between users may occur depending on the processing power of the viewer terminal 300 and the communication environment (e.g., a lower frame rate). In particular, when the viewer terminal 300 has low processing power or the communication speed is below a certain level, calculations using physics calculations take time (slow drawing speed), and there is a greater risk that abnormal display modes for clothing objects may be calculated and displayed if the character's movement speed and range are large. For example, there may be a large discrepancy between the final movement position of a character object based on the previously received streaming data and the starting movement position of the next received streaming data. As a result, objects that should naturally move smoothly, such as skirts that are calculated to follow the character object, will not move smoothly but will instead move in extremely large, sweeping motions. As an example, as a result of an actor moving vigorously, the movement of the colliders of various objects may cause the hem of a skirt object to be calculated as sinking into the top of the skirt or the character object's leg, resulting in the skirt being displayed as if it is rolled up, or the tip of a wing object may be calculated as sinking into the middle of the wing, resulting in the wing being bent and unable to flap. In this embodiment, to prevent such abnormal display from continuing, the distribution server computer 100 performs a component reset process to reset the display state of the object to neutral.

Figure 43 is a flow diagram showing an example of component reset processing. The component reset processing is executed by the distribution server computer 100. The distribution server computer 100 executes the component reset processing every time a predetermined time (e.g., 2 ms) has elapsed while distributing virtual space update data that includes data for operating a humanoid avatar. As an example, the following describes a case where the aforementioned live event is currently being provided (distributed).

In step S431, it is determined whether a series of actions by the performer avatar has ended. The timing when a series of actions has ended is when the performer avatar's continuous actions have ceased, and the performer avatar's movement speed and range have decreased, resulting in a more settled movement. For example, in content in which a performer sings while dancing, this would include the timing when the performer finishes singing one song, the interval between songs before the start of the next song, and the start of the second song. Alternatively, in content in which a performer performs an attraction, this would include the timing when an attraction has ended, the interval before the start of the next second attraction, and the start of the second attraction. In this embodiment, any of these timings can be used as the timing when a series of actions has ended. The distribution server computer 100 determines whether the movement speed or range of movement has fallen below a predetermined amount. Whether the movement speed or range of movement has fallen below a predetermined amount can be determined when the acceleration falls below a predetermined value (or continues for a predetermined number of seconds).

If it is not determined in step S431 that the series of actions by the performer avatar has ended, the component reset process ends. On the other hand, if it is determined in step S431 that the series of actions by the performer avatar has ended, a component reset signal is delivered to the viewer terminal 300 in step S432, and the component reset process ends. The component reset signal is a signal that causes physical calculations for an object (e.g., a costume object) displayed corresponding to a character object to be performed from a predetermined initial state. In other words, this signal causes calculations that would normally be performed following the results of calculations based on the previously received streaming data to be performed from the initial state rather than based on the results of the previous calculation. As a result, even if the display state of the costume object is abnormal, the display state is reset to neutral and physical calculations are performed.

In this way, the viewer terminal 300 performs physics calculations to display the clothing object moving in the same way as in real space in response to the character object's movements. For example, in physics calculations, the current acceleration is calculated taking into account the acceleration of each part of the clothing object at the previous calculation timing. However, when a component reset signal is received, the current acceleration is calculated from a predetermined initial state (e.g., zero acceleration) without taking into account the acceleration of each part at the previous calculation timing. This allows the clothing object to be returned to the state calculated from the initial state (neutral state) even if an abnormal clothing object state is calculated and displayed during a series of actions. For example, this can eliminate situations where the skirt hem is rolled up or wings are bent and unable to flap. As a result, there is a risk that an abnormal clothing object state may be calculated, causing the clothing object to be displayed in an abnormal manner for the character, and this abnormal state can be eliminated even if the possibility is increased when the character's movement speed and range are large.

The component reset signal may be any command that starts physics calculations from the initial parameters of the costume object (parameters for the state in which the character object is wearing the garment when in its initial posture, i.e., a neutral display state such as when no acceleration is applied), and may also set the costume object's components (parameters such as acceleration and gravity) to the same parameters as those in their initial positions (when the character object is in its initial posture).

<Examples of specific configurations and effects>

(1-1) In the above-described embodiment, as explained with reference to Figures 1 to 25, etc., the delivery server computer 100 performs processing to generate a virtual space ER and transmit information for displaying an image within the virtual space ER in response to a user operation, based on a stored program and a method of controlling a computer using the program (hereinafter simply referred to as the program), and the viewer terminal 300 performs processing to display an image in response to a user operation in response to information from the delivery server computer 100, based on the stored program. Also, as explained with reference to Figures 26 to 28, etc., the delivery server computer 100 performs processing to update the placement of objects such as a flower FS purchased in response to a user purchase operation within the virtual space ER, based on the stored program, and the viewer terminal 300 performs processing to update the placement in the delivery server computer 100 and update the placement of objects purchased in response to a user purchase operation within the virtual space ER, based on the stored program. Furthermore, as explained with reference to Figures 13 to 23 and 35, the distribution server computer 100 performs processing to create a space in the spatial area ER5 within the virtual space ER for providing the event content on the scheduled date based on the stored program, and the viewer terminal 300 is able to provide the event content on the scheduled date in the spatial area ER5 created by the distribution server computer 100 based on the stored program.

Furthermore, in this embodiment, even during the period leading up to the scheduled event date, the distribution server computer 100 and the viewer terminal 300 each perform processing based on their stored programs to enter the spatial area ER5 in response to a user operation and enable the display of images within the spatial area ER5, and to enable the placement and display of purchased objects within the spatial area ER5 in response to a purchase operation. Furthermore, as shown in Figures 26, 29, 30, 34, and 35, the distribution server computer 100 and the viewer terminal 300 each perform processing based on their stored programs to change the display mode within the spatial area ER5 in response to the placement and display of objects such as a flower stand FS within the spatial area ER5 during the period leading up to the scheduled event. This allows the spatial area ER5 in which the event content will be provided and events that can change the display mode within the spatial area ER5 to be shared and provided to users during the period leading up to the scheduled event, thereby gradually increasing interest in the event content even before the event content is provided.

(1-2) Based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode of each display area within the spatial area ER5 from the time of purchase to the end of the pre-scheduled period, as shown in Figures 26, 28, and 29, depending on the user's purchase status of flower stand FS during the period before the scheduled date, as shown in Figure 27(C) and other figures. This allows the user to focus on whether a flower stand FS will be purchased by the user during the period before the scheduled date, what attributes the purchased flower stand FS will have, how it will be decorated, where it will be displayed, and how the display mode of each display area within the spatial area ER5 will change as a result.

(1-3) The display mode of each display area within spatial area ER5 that may change during the period before the scheduled date, for example, as explained by comparing Figures 29 and 30, may differ from the display mode displayed to other users depending on whether the user purchases and places a flower stand FS during the period before the scheduled date. This makes it possible to customize the display mode of each display area within spatial area ER5 during the period before the scheduled date for each user, giving each user a sense of exclusivity.

(1-4) As shown in Figure 35 and elsewhere, the distribution server computer 100 and the viewer terminal 300 each perform processing based on the programs stored therein to change the display mode of the presentation of the live event taking place within the spatial area ER5 while the event content is being provided, in response to the user purchasing and placing a flower stand FS during the period before the scheduled date. This allows the user to focus on whether the user will purchase a flower stand FS during the period before the scheduled date, what attributes and decorations the purchased flower stand FS will have, and how the display mode of the presentation of the live event taking place within the spatial area ER5 while the event content is being provided will change as a result.

(1-5) The presentation of a live event taking place within spatial area ER5, which can change while the event content is being provided, may take on a display style that differs from that displayed to other users, depending on whether the user purchased and placed a flower stand FS during the period before the scheduled date, as explained in Figures 27(C), 35, and 36, for example. This allows the display style of the presentation of a live event taking place within spatial area ER5 while the event content is being provided to be customized for each user, giving each user a sense of exclusivity.

(1-6) An example of an event that changes the display mode within spatial area ER5 is an action in response to a user's purchase of a flower stand FS, which reflects the purchased flower stand FS by displaying and placing it in an exhibition area within spatial area ER5. For example, an example of an action in which a user purchases a flower stand FS in step S107 of Figure 28 and the flower stand FS is then placed in a specified exhibition area A within spatial area ER5 in step S109. This makes it possible to cause an event that changes the display mode within spatial area ER5 through the user's own operation, thereby encouraging the user to operate the flower stand and increasing the user's sense of participation.

(1-7) An example of an event that changes the display mode within spatial area ER5 is the purchase of a flower stand FS, which is an action in response to an operation from another user (e.g., user 1, who is another user to user 2 in Figures 29 and 30), and is reflected by displaying and placing it in the exhibition area within spatial area ER5, such as the action of another user 1 purchasing a flower stand FS. That is, as shown in an example in Figure 30(D), on user 2's display device 310, a flower stand FS1 that would not be displayed unless purchased by other user 1 can be randomly selected as the default flower stand FS to be displayed and placed in the specified exhibition area A due to the purchase by other user 1. In this way, because operations and actions from other users can also be events that change the display mode within spatial area ER5, the changes in display mode can be made more interesting and the enjoyment can be enhanced.

(1-8) The fulfillment of a switching condition is given as an example of an event that changes the display mode within spatial area ER5. Furthermore, based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each perform processing to maintain the display of the flower stand FS associated with the special user within spatial area ER5, even if an event that changes the display mode within spatial area ER5 occurs. For example, the display position of the flower stand FS purchased by the user is determined by lottery from positions other than the display position of the special user's flower stand FS. Furthermore, even when the switching condition is fulfilled, the display and display of the flower stand FST associated with the special user continues, as shown in FIG. 34. This allows the display mode associated with the special user to continue without change, thereby maintaining and improving the convenience and advantages of the special user. Furthermore, because objects such as the special user's flower stand can be used for advertising and PR, for example, the operator can more easily solicit investments from sponsors who could be examples of special users.

(1-9) As shown in Figure 24, within the spatial area ER5, there are provided an area ER53' of the second virtual space used to provide event content on the scheduled date, and an area ER53 which is part of the first virtual space and has a display mode in common with area ER53' (the same, similar, etc.). Based on the programs stored therein, the distribution server computer 100 and the viewer terminal 300 each perform processing so that during the period before the scheduled date, for example, until the day before the scheduled event date, the portal P is not displayed and entry into area ER53' is restricted, while entry into area ER53 is permitted and an image of area ER53 can be displayed in response to user operation. After the day before the scheduled event date arrives and the release conditions are met, the gate of the gate object 53c leading to area ER53 is closed, thereby restricting entry into area ER53, while the portal P is displayed and entry into area ER53' of the second virtual space is permitted and an image of area ER53' can be displayed in response to user operation. This allows the area used to be switched depending on whether the release conditions are met, so that before the release conditions are met, the virtual space can be provided using an area that is appropriate for the user's behavior before the event content is provided, and after the release conditions are met, the virtual space can be provided using an area that is appropriate for providing the event content.

(1-10) As shown in Figure 24, areas ER51 and ER52, which are part of the first virtual space, are provided within spatial area ER5, and it is possible to move seamlessly between areas ER51, ER52, and ER53 in Figure 24 (A), which is the first virtual space (movement is possible by moving the user avatar from one area to the other by user operation), while area ER53' in the second virtual space and areas ER51 and ER52, which are part of the first virtual space, are formed separately, and as shown in Figure 24 (B), it is possible to move between the first virtual space and the second virtual space via portals P in areas ER53' and ER52, which are displayed in a blackout. This improves the convenience of moving between areas ER51, ER52, and ER53 in Figure 24(A), which is the first virtual space, before the release conditions are met, and after the release conditions are met, the display goes dark when moving to area ER53' in the second virtual space, giving the user a sense of exclusivity and tension, and increasing interest.

(1-11) The release condition can be met the day before the event content is scheduled to be provided. This allows for a period before the release condition is met, a period after the release condition is met but before the event content is provided, and a period during which the event content is being provided, allowing for more gradual increases in interest.

(1-12) The display mode within spatial area ER5 that can be changed includes the flower stand FS displayed in the display area within spatial area ER5, and events that change the display mode within spatial area ER5 include an event in which a user purchases a flower stand FS during the period before the scheduled date, associates the flower stand FS with the user, and places the flower stand FS in a display area selected by the user within spatial area ER5. In this way, by placing the flower stand FS purchased by the user in a display area selected by the user during the period before the scheduled date, the display mode of the display area can be changed, thereby increasing the user's interest.

(1-13) Events that change the display mode within spatial area ER5 include events that generate the display mode (decorations such as text) of a flower star FS in response to user operations when placing the flower star FS. This allows each user to customize the display mode of the flower star FS they are placing, thereby increasing user interest.

(1-14) As shown in FIG. 35, the display modes within spatial area ER5 that can change include a flower star FS held by a performer avatar that is displayed and operates within spatial area ER5 while the event content is being provided and that can progress through the event content. This allows the flower star FS that can be displayed corresponding to the performer avatar to change depending on events that occur during the period before the scheduled date, thereby increasing interest in events that occur during the period before the scheduled date.

(1-15) As shown in FIG. 39, the distribution server computer 100 and the viewer terminal 300 each perform processing based on a stored program to change the display mode within the spatial area ER5 depending on the number of times the user has entered the spatial area ER5, which is an example of the degree to which the image within the spatial area ER5 was displayed during the period before the scheduled date. This allows the display mode within the spatial area ER5 to change depending on the number of times the user has entered the spatial area ER5 during the period before the scheduled date, thereby increasing and encouraging the user's motivation to enter the spatial area ER5 during the period before the scheduled date.

(1-16) Based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each perform processing to make the event content available on the scheduled date to users who satisfy certain conditions, such as by purchasing a ticket to participate in the event content, and to allow users who satisfy the certain conditions to enter the spatial area ER5 during the period before the scheduled date and to display images within the spatial area ER5. This increases and encourages users to satisfy the certain conditions.

(2-1) In this embodiment, even during the period before the scheduled event date, the distribution server computer 100 and the viewer terminal 300 each perform processing based on their stored programs to enter the spatial area ER5 in response to user operations and display images within the spatial area ER5. Furthermore, as shown in Figures 38 and 39, the distribution server computer 100 and the viewer terminal 300 each perform processing related to the event content during the period before the scheduled date based on the number of entries (this does not include the number of entries into spatial areas ER other than spatial area ER5 within the virtual space ER, even if the user is logged in to the virtual space ER) which is an example of the degree to which the user entered the spatial area ER5 in which the event content is provided on the scheduled date and displayed images within the spatial area ER5, based on the stored programs. This allows the spatial area ER5 in which the event content is provided to be shared and provided to users during the period before the scheduled date, and processing related to the event content is performed based on the number of entries into the spatial area ER5 during the period before the scheduled date. This increases the user's motivation to enter spatial area ER5 rather than other spatial areas within the virtual space ER and view images within spatial area ER5, gradually increasing interest in the event content even before the event content is provided.

(2-2) As shown in the presentation content in Figure 38, the processing related to the event content includes processing that changes the display mode within the spatial area ER5 while the event content is being provided depending on the number of times the user enters the space during the period before the scheduled date. This increases the user's motivation to enter the spatial area ER5 during the period before the scheduled date, and also draws the user's attention to how the display mode within the spatial area ER5 changes.

(2-3) The display mode within spatial area ER5 during the provision of event content, which changes depending on the number of times a user enters the room due to processing related to the event content, can be different from the display mode displayed to other users depending on the number of times a user enters the room, as shown in the display content in FIG. 38. This makes it possible to customize the display mode within spatial area ER5 during the provision of event content for each user, giving each user a sense of exclusivity.

(2-4) The changing display modes within spatial area ER5 while the event content is being provided include secret costumes, which are costumes for the performer avatars that are displayed in correspondence with the performer avatars that are displayed and move within spatial area ER5 while the event content is being provided and that can progress through the event content. In other words, the costumes of the performer avatars while the event content is being provided can change depending on the number of times the user enters spatial area ER5 during the period before the scheduled date. This can increase the user's motivation to enter spatial area ER5 during the period before the scheduled date, thereby increasing the user's interest.

(2-5) As shown in step S402 of FIG. 39, the processing related to the event content includes processing for granting items, which are examples of objects that can be used while the event content is being provided, to the user according to the number of times the user has entered the space. This increases the user's motivation to enter the spatial area ER5 during the period before the scheduled date, and also draws the user's attention to the granted items.

(2-6) The items granted to a user through processing related to event content may differ depending on the number of times the user enters the room, as shown in the items in Figure 38, and may therefore be different from the items granted to other users. This allows a variety of items to be used during the provision of event content, thereby increasing the interest in the event content.

(3-1) In this embodiment, the distribution server computer 100 and the viewer terminal 300 each use stored programs to place in the display area within spatial area ER5 the flower arrangement FS associated with a user through purchase. Among the flower arrangements FS shown in FIG. 29(A), those associated with other users (e.g., other than user 1) and placed in the display area within spatial area ER5 are switched to other flower arrangements FS in step S203 of FIG. 32 when the switching condition is met. Meanwhile, as described with reference to FIG. 27(C), processing is performed to allow the flower arrangement FS associated with the user himself (e.g., user 1) to continue to be displayed in the same display area even when the switching condition is met. This allows the flower arrangements FS to be appropriately displayed within spatial area ER5 even when there are many flower arrangements FS to be displayed and the number of display positions available in the display area is limited. Additionally, flower stems FS associated with other users can be exhibited and displayed relatively evenly within spatial area ER5, and the display mode of the display area within spatial area ER5 can be changed to increase interest, while the user can also check the flower stems FS associated with themselves, increasing satisfaction.

(3-2) The switching condition may be met when a predetermined time has passed, or when a user logs in or enters or leaves spatial area ER5. This allows a flower FS associated with another user to be switched to another flower FS without the user needing prior knowledge (e.g., a switching method), thereby increasing the interest of all users in the flower FS that may be exhibited and displayed in the exhibition area within spatial area ER5.

(3-3) As shown in Figure 27, multiple types of flower stands FS are provided with different attributes and sizes, and the display areas in which they can be placed and displayed within the spatial area ER5 are determined according to their type. This allows the appropriate type of flower stand FS to be placed in each display area to match the design, taste, and worldview of the spatial area ER5. It also allows for a sense of unity in the types of flower stands FS placed in each display area.

(3-4) Flower stands FS can be exhibited and displayed up to the maximum number set in the exhibition area within spatial area ER5, and the distribution server computer 100 and the viewer terminal 300 can, based on the programs stored therein, maintain the number of displayed flower stands FS within the displayable maximum number, as shown in Figures 29(C) to 29(D), etc., and can switch to displaying a flower stand FS associated with another user when a switching condition is met. This allows flower stands FS associated with other users to be evenly displayed in the exhibition area within the maximum number, and can increase interest by changing the display mode of the exhibition area and spatial area ER5.

(3-5) As shown in FIG. 24, multiple display areas are provided within spatial area ER5 where flower stands FS can be arranged and displayed. Based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each perform processing to arrange and display the user's flower stand FS in an area of the multiple display areas designated by the user in response to operation by the user, as shown in FIG. 26. This allows the user to arrange and display their own flower stand FS in the display area of their choice, increasing interest.

(3-6) Based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each perform processing to change the display mode of the flower star FS to be displayed by adding decorations such as text in response to user operations, as shown in FIG. 26. This allows the display mode of the displayed flower star FS to be customized to suit the user's preferences, increasing the user's interest.

(3-7) Based on the programs stored in them, the distribution server computer 100 and the viewer terminal 300 each display and display a higher proportion of default flower stands FS for users who have purchased a larger number of flower stands FS (e.g., 11 rather than 10, 40 rather than 30) than for users who have purchased fewer. However, for users who have reached a predetermined number, the default flower stands FS can be selected by lottery and displayed and displayed at the same proportion (e.g., the same proportion as for a predetermined number of users) regardless of whether they have purchased more than the predetermined number of flower stands. This encourages users to purchase a reasonable number of flower stands FS (less than the predetermined number), while preventing the proportion of default flower stands FS made up of flower stands owned by users who have purchased the predetermined number from increasing uncontrollably.

(4-1) The virtual space in this embodiment includes a space ER5 in which multiple types of objects can be displayed, including first-type objects such as a virtual stage G, which is a building or stage object and is an object essential for generating the virtual space, and second-type objects such as a flower stand FS, which is an example of an object that adds to the virtual space and is not essential for creating content. When information for displaying the essential objects can be identified, in steps S215 to S245 of Figure 33, processing is performed to display the specified space regardless of whether information for displaying a flower stand FS, which is not essential and whose display mode changes, can be identified. If all the flower stand arrangement information has been read in step S225 of Figure 33, the latest flower stand arrangement information is sent to the user in step S205. If a predetermined time has passed without all the flower stand arrangement information being read in step S235 of Figure 33, an alternative flower stand is identified and sent to the user in step S245. With this configuration, regardless of whether or not the cluster placement information can be identified, space ER5 can be displayed when information on essential objects has been identified, and when the cluster placement information cannot be identified, alternative objects can be displayed. Therefore, even when some objects cannot be identified, such as when the server is overloaded due to concentrated access, the user can enter the virtual space and the virtual space can be displayed.

(4-2) When the viewer terminal 300 displays a space for providing a live event or the like on a scheduled date in the spatial area ER5 in FIG. 24, the spatial area ER5 can be displayed even if the flower arrangement information has not been specified. As a result, because the spatial area ER5 is a virtual space for providing event content on a scheduled date, it is possible that access to a distribution device such as a server will be concentrated on that scheduled date. However, regardless of whether the flower arrangement information can be specified, the virtual space can be displayed if the required object information has been specified.

(4-3) As illustrated in Figures 29 and 30, a flower star FS is an object whose display mode changes depending on the user's actions, such as purchases. Even if it is not possible to identify flower star placement information that corresponds to the current display mode updated in step S203 of Figure 32 or step S213 of Figure 33, an alternative flower star is identified in steps S225 to S245 of Figure 33, and information identifying the flower star FS is sent to the user in step S205. This allows the user to enter spatial area ER5 and display the image of spatial area ER5 when there is a surge in access to a distribution device, such as the server of the latest updated flower star FS.

(4-4) Furthermore, the object that is replaced with an alternative object if it cannot be read in Figure 33 is a flower stand FS that the user can display in the display area by purchasing it in Figure 28 or by entering text in step S104. Because there are many variations in display formats, the information identifying the flower stand FS can easily become heavy, and it may become impossible to read the flower stand placement information. However, in step S245 of Figure 33, for example, it can be replaced with an alternative object that places a lighter processing load.

(5-1) In this embodiment, objects placed in the virtual space include character objects such as performer avatars that move based on motion data, and costume objects such as skirts that are placed to correspond to the character objects. By performing viewer perspective video generation processing and viewer perspective video output processing based on virtual space update data, it is possible to perform processing to display the costume objects in a manner that corresponds to the movement of the character objects that move based on the motion data. Furthermore, at the end of a series of actions in step S431 of FIG. 43, between songs, etc., processing is performed to send a component reset signal in step S432 of FIG. 43 to reset the display state of the costume objects to neutral. This resets the display state of the costume objects to neutral at specific times when the amount of movement of the performer avatar may fall below a predetermined amount, allowing the reset to be performed at a time that does not cause the viewer to feel extremely uncomfortable.

(5-2) In this embodiment, resetting the display state of a clothing object to neutral includes performing physical calculations associated with the clothing object (e.g., calculations of collision detection, acceleration, etc.) from a predetermined initial state, such as by performing calculations from an initial state rather than based on the results of previous calculations. This allows physical calculations associated with linked objects to be performed from a predetermined initial state at a timing that does not cause the viewer to feel extremely uncomfortable.

(5-3) In this embodiment, the process of resetting the display state of the clothing object to neutral in step S432 in FIG. 43 is performed when the series of actions in step S431 ends. In a live event in which performer avatar 1 appears, such as in FIG. 13, this process can be performed at any timing between the end of the first song, which is the first part sung by the performer avatar, the start of the second song, which is the second part, or between the end of the first song and the start of the second song. As a result, the component reset process is performed between the first and second parts during the event, at a timing when the amount of movement of the character object, which is the performer avatar, may be less than a predetermined amount, so the viewer does not feel extremely uncomfortable even if the component is reset.

(6-1) In this embodiment, as described with reference to FIG. 40, event content (including a live event provided on the scheduled date and content provided in the period before the scheduled date before the live event) is provided within spatial area ER5 during a first scheduled period, and the event content can be provided again within spatial area ER5 during a second scheduled period after the first scheduled period has elapsed. Furthermore, as described with reference to FIG. 40(a), the display mode of the flower stand FS and other items within spatial area ER5 at the start of the second scheduled period is determined by inheriting the flower stand-related information from the first scheduled period and setting a display mode according to the flower stand placement information for the first scheduled period (e.g., at the end of the scheduled period, the end of the scheduled date, or the end before the scheduled date). Furthermore, the display mode of the flower stand FS displayed within spatial area ER5 and the flower stand FS used in the production of the live event in FIG. 35 can be changed depending on user purchases during the second scheduled period. This can increase the interest of users who participated in the first scheduled period in the event content during the second scheduled period. Furthermore, the display mode of the flower FS displayed in the spatial area ER5 during the second scheduled period can be changed and shared among users, thereby increasing interest in the event content during the second scheduled period, regardless of whether the user participated in the first scheduled period.

(6-2) In this embodiment, with regard to the re-provision of the event content described with reference to FIG. 40, as described in FIG. 40(b), the display mode of the flower stand FS and the like in the spatial area ER5 at the start of the second scheduled period is set to a predetermined display mode, such as the initial state, without carrying over the flower stand arrangement information from the first scheduled period. It is possible to change the display mode of the flower stand FS displayed in the spatial area ER5 and the flower stand FS used in the production of the live event in FIG. 35, depending on user purchases during the second scheduled period, etc. In this way, by setting the display mode within a predetermined type of virtual space at the start of the second scheduled period to a predetermined display mode, even users who participated in the first scheduled period can participate in the event content in the second scheduled period with a fresh feeling, thereby increasing interest in the event content.

(6-3) In this embodiment, performers (such as performer avatars 1a-1d in FIG. 35, etc.) who are conducting the live event on the first and second scheduled dates can participate as participant avatars in the event content for the second scheduled period described with reference to FIG. 40. Furthermore, since the performers can also participate in the live event on the second scheduled date, performer avatars on the virtual live stage, such as in FIG. 35, and avatars participating as performer participants can be displayed in the virtual space during the live event. This makes it possible to provide a live event with a different atmosphere and style from that of the first scheduled period, thereby increasing interest in the live event.

(6-4) Furthermore, the performer avatars displayed as participants on the second scheduled date are displayed as the same simplified avatars as general users, and are displayed in a different manner from the performer avatars at the live event. This allows the performer's avatar object as a participant to be distinguished from the performer's avatar object, preventing confusion among users.

(6-5) In this embodiment, as explained in steps S411 to S412 of the audio/viewpoint special switching process in FIG. 41, if a performer in a live event during the second scheduled period is also participating as a participant, it is possible to switch to special audio coming from the performer as a participant in response to an operation on the viewer terminal 300. This allows the user to switch to listening to audio coming from the performer as a participant in response to their wishes, thereby increasing interest in event content such as live content and increasing the variety of ways to enjoy it.

(6-6) In this embodiment, steps S413 to S414 of the audio/viewpoint special switching process in FIG. 41 make it possible to switch the image displayed in the virtual space to an image of the performer's avatar object as a participant, viewed from a predetermined viewpoint, in response to an operation on the viewer terminal 300, when a performer is also participating as a participant in a live event during the second scheduled period. This allows the user to switch to viewing the performer's avatar object as a participant from a predetermined viewpoint, depending on their wishes, thereby increasing interest in event content such as a live event and increasing the variety of ways to enjoy it.

(6-7) In this embodiment, the display mode of performer avatars on the virtual live stage at a live event in which the event content in FIG. 40 is re-provisioned is displayed in the same display mode during the first scheduled period and the second scheduled period, based on virtual space update data including information for displaying motion data and performer costumes on the first scheduled date. Meanwhile, the flower stand FS used in the production of the live event, as exemplified in FIG. 35 and other figures, can be updated to the latest version based on user purchases during the second scheduled period. This allows the quality of the live event during the second scheduled period to be similar to that of the live event during the first scheduled period, while the display mode of objects such as the flower stand FS used for production is displayed in the display mode for the second scheduled period, thereby increasing interest in the live event during the second scheduled period.

(7-1) In this embodiment, as described in steps S423, S425, and S426 of the room entry exception processing in FIG. 42(b), by accepting a request to enter a virtual space by logging in from a user, entering a room by selecting content, or specifying a room to enter, it is possible to perform processing to associate the user with one of multiple virtual space providing units. Furthermore, each room has a predetermined upper limit on the number of users that can be associated with it, such as 200. If the user who has requested entry is a non-specific user who does not meet certain conditions, such as a general user or a user who is not associated with other users, the non-specific user is not associated with a room whose number of associated users has reached the upper limit, and is not allowed to enter the room, and in step S426, the non-specific user is allowed to enter a room whose number of associated users has not reached the upper limit. On the other hand, when the entry request is from a specific user who meets certain conditions, such as a special user such as a celebrity account or an administrator account, or a user who has a relationship with other users, steps S421-S423 and steps S424-425 in FIG. 42(b) make it possible to associate the specific user with a specific room regardless of whether the number of associated users has reached the upper limit. As a result, when the entry request is from a specific user, the restriction on entry to the virtual space based on the upper limit is lifted as an exception, and the specific user is allowed to be associated with the specific room, improving convenience for the specific user.

(7-2) In this embodiment, in step S423 of FIG. 42(b), the rooms to which a user can enter, regardless of the upper limit on the number of rooms, are rooms with room IDs predetermined by the administrator. This allows a specific user to be associated with a specific room designated by the administrator, making it easier to change the settings of a room designated by the administrator, for example, and reducing the processing load on the distribution server computer 100.

(7-3) In this embodiment, if a room ID is specified, as described in step S422 of FIG. 42(b), the entry request includes information about the specified room ID. This associates the request with the room specified by the user, thereby reducing the processing burden for assigning users to a room and further improving user convenience.

(7-4) In this embodiment, special users and users who have relationships with other users can enter rooms that are already associated with other users who appear in the same live content, or with other users who have relationships such as friendships or relationships where the intimacy level is equal to or greater than a predetermined value. This allows users to be associated with a specific room taking into account the relationships between users, making it easier for users to act and communicate within the same virtual space provided by the same room and making it easier to improve the atmosphere within that virtual space.

(7-5) In this embodiment, special users in the processing of steps S421 to S423 in FIG. 42(b) include performers appearing as performers at live events such as those shown in FIG. 35, and such performers can enter specified rooms regardless of the room limit. This improves convenience for performers.

(7-6) In this embodiment, in the processing of steps S421 to S423 in FIG. 42(b), special users who are allowed to enter a specified room regardless of the upper limit on the number of rooms include users who have the authority to operate a virtual camera and are authorized to output images taken within the virtual space so that they can be displayed on other computers. This improves convenience for users who have the authority to output images.

<Modification>
Modifications of the embodiments (including modifications and additions) described above with reference to FIGS. 1 to 43 are listed below.

(Regarding re-provision of content for the period before the scheduled date and for events)
In the above-described embodiment, an example in which event content is provided again in a second scheduled period has been described with reference to FIG. 40 . FIG. 40( a) illustrates an example in which the flower star-related information in the first scheduled period is carried over to the second scheduled period, and FIG. 40( b) illustrates an example in which the flower star-related information in the first scheduled period is not carried over to the second scheduled period. However, this is not limiting, and the information carried over to the second scheduled period may differ depending on whether or not a user participated in the event content during the first scheduled period. For example, depending on whether or not a user participated in a live event of the event content during the first scheduled period or entered a virtual space such as the spatial area ER5 in which the event content is provided during the first scheduled period, the flower star-related information in the first scheduled period may not be carried over for users who participated or entered the virtual space, and the second scheduled period may start from an initial state different from that at the start of the first scheduled period. On the other hand, for users who did not participate in or enter the virtual space during the first scheduled period, the second scheduled period may start from the same initial state as the first scheduled period. In this case, for users who have purchased a flower star FS during the first scheduled period, the information on the flower star FS they purchased may be carried over.

(Replay data related)
In the above embodiment, with reference to FIG. 40 , a case where the event content is provided again (replayed) during the second scheduled period has been described. However, the replay of the event content is not limited to a predetermined scheduled period, and may be provided in response to a request from a user at any time. For example, the distribution server computer 100 may store the event content data (event data 111) provided in this embodiment so that it can be provided again to the user, and may also perform processing to enable the replay of the event content in response to a user request (e.g., an operation to purchase replay data, an operation to view the event content for a second time, etc.) even after the event content has been provided. For example, while the distribution server computer 100 is providing the event content on the scheduled date, the distribution server computer 100 stores in the storage 103 information for displaying images in the area ER53' that include performer information such as animation data and audio data including motion data of the performer avatar (the performer avatar information, performer audio, etc. distributed in Figure 10), in response to operations by the user, event flag information exemplified in Figure 36, and item and performance content information that can be set in Figure 39, as re-enactment data of the event data, and transmits it to the viewer terminal 300 of the requesting user.

The event flower stand information includes the default information shown in Figure 36 (A) drawn by lottery for each event content, and information on the flower stand FS purchased by the user who requested re-provision, based on the user-related information shown in Figure 27 (C). The item and presentation content information also includes information for specifying the items to be granted and the presentation content to be set by the event content-related processing shown in Figure 39, depending on the number of times the user who requested re-provision entered the room during the period before the scheduled date.

The viewer terminal 300 that received the replay data plays the event content provided on the scheduled date based on the replay data at a timing selected by the user. Furthermore, when playing the event content, in order to adapt the display mode to an event that occurred during the period before the scheduled date, for example, a flower stand identified from the received event flower stand information and with the same attributes and size as a flower stand purchased by the user is switched to the flower stand purchased by the user, thereby providing the presentation of the event content. In other words, the display mode of the flower stand FS that can be displayed based on the replay data can differ for each user depending on the flower stand FS purchased during the period before the scheduled date. This allows the event content to be provided in a display mode that corresponds to an event that occurred during the period before the scheduled date, even after the event content is provided on the scheduled date, thereby improving user convenience and interest. Specifically, a user who was unable to participate in the event content on the scheduled date can still participate in the event content even after the scheduled date, and if they purchased a flower stand FS during the period before the scheduled date, a presentation that corresponds to that flower stand FS can be provided.

Furthermore, when playing back event content, processing related to the event content is performed according to the number of entries, which is an example of the degree to which images within spatial area ER5 were displayed during the period before the scheduled date. For example, the event content's production content is set to the production content specified from the received item/production content information, and items specified from the received item/production content information are assigned and made available for use during the replay. In other words, the display mode of the event content based on the replay data can be made different for each user depending on the number of times the user entered the room during the period before the scheduled date. This allows the event content to be provided in a display mode that corresponds to the number of entries during the period before the scheduled date, even after the event content is provided on the scheduled date, thereby improving user convenience and interest. Furthermore, processing is performed to allow the user to use items that correspond to the number of times the user entered the room during the period before the scheduled date from among the items available in the event content based on the replay data. This improves user convenience and interest.

(Right to enter spatial area ER5)
In the above embodiment, an example was described in which only users who have the right (e.g., a ticket) to participate in the event content to be provided on the scheduled date are permitted to enter and participate in the spatial area ER5 during the period before the scheduled date. However, this is not limited to this. Even if a user does not have the right to participate in the event content to be provided on the scheduled date, they may be permitted to enter the spatial area ER5 during the period before the scheduled date and be able to freely act within the spatial area ER5, such as purchasing a flower stand FS or viewing the exhibition area. While participation in the event content itself is not possible without the right to participate (e.g., entry to the area ER53′ is restricted), entry into the spatial area ER5 during the period before the scheduled date allows users to stroll around and experience the spatial area ER5, thereby increasing their interest in the event content to be provided on the scheduled date and motivating them to acquire the right to participate in the event content. Note that a user who does not have the right to participate in the event content but is able to participate in the virtual space ER may be able to participate in the event content on the scheduled date and enter the spatial area ER5 during the period before the scheduled date.

(Regarding the display balance of flower stand attributes within the exhibition area)
In the above embodiment, an example was described in which the flower stand FS to be switched when the switching condition is met in step S302 of FIG. 32 is determined by random lottery. However, this is not limited to this. Alternatively, the flower stand FS to be displayed within the spatial area ER5 may be determined by lottery so that the number of attributes associated with the flower stands FS is approximately equal for each attribute. As described above, the attributes "cherry blossom,""demon,""whitefox," and "black fox" are attributes and colors associated with the performer avatars that appear as progression characters when providing event content. Furthermore, for example, if 80,000 positions are provided within the spatial area ER5 in which flower stands with the attributes "cherry blossom,""demon,""whitefox," and "black fox" can be displayed, the number of positions available for each attribute is calculated to be 20,000. Therefore, the flower stand FS to be switched when the switching condition is met may be determined by lottery, with 20,000 flower stands for each attribute. That is, as shown in FIG. 27 , each flower stand FS is associated with one of several motifs (attributes), and the distribution server computer 100 and the viewer terminal 300 each perform a process based on a stored program to draw and determine a default flower stand FS so that the number of attributes associated with the displayed flower stands FS is approximately equal among the attributes, thereby ensuring that the flower stands of the four attributes are approximately equal throughout the entire spatial area ER5. This allows the attributes of the flower stands displayed within the spatial area ER5 to be displayed in a balanced manner, preventing bias toward any one attribute. Furthermore, even when focusing on each exhibition area, the number of attributes associated with the flower stands FS displayed within one exhibition area may be approximately equal among the attributes. In other words, the flower stands of the four attributes may be approximately equal in each exhibition area.

Also, a predetermined number of display areas, each with a set upper limit, could be provided for each attribute, and an attribute could be associated with each display area. For example, the first display area could be selected by lottery from only flower stands with the "cherry blossom" attribute, the second display area could be selected by lottery from only flower stands with the "demon" attribute, the third display area could be selected by lottery from only flower stands with the "white fox" attribute, and the fourth display area could be selected by lottery from only flower stands with the "black fox" attribute. This would allow flower stands FS associated with each attribute (especially the attributes of performer avatars appearing when providing event content) to be displayed in a balanced manner within the spatial area ER5. Furthermore, by viewing the display area for flower stands related to the attribute of a favorite performer avatar, flower stands related to the attribute of the favorite performer avatar can be easily and efficiently viewed. While the above example shows an example in which only certain attributes (the attributes "cherry blossom," "demon," "white fox," and "black fox") are approximately evenly distributed, the present invention is not limited to this; all attributes, including solid colors and gorgeous designs, could also be approximately evenly distributed. By placing a flower stand FS purchased by a user, the number of attributes associated with the flower stand FS purchased by the user may increase in the virtual space. However, taking into consideration the attributes of the flower stand FS purchased by the user, a lottery may be held for each user to determine the display balance between attributes so that it is roughly even within the upper limit of the number of flower stands FS that can be displayed in the exhibition area (or spatial area ER).

The ratio at which each attribute is selected by lottery and displayed may be predetermined. For example, the ratio at which the attribute "plain" shown in FIG. 27(A) is displayed within spatial area ER5 may be 5%, while the ratios for "gorgeous" may be 15%, and the ratios for "cherry blossom," "demon," "white fox," and "black fox" may each be 20%, etc.

(Regarding the probability of being selected as the default flower stand)
In the above embodiment, when the switching condition is met, the probability of a randomly selected default flower arrangement FS in step S203 of FIG. 32 is uniform across all flower arrangements. However, the probability of a default flower arrangement FS being selected is not limited to this. It may be varied depending on parameters specific to the flower arrangement FS, or may not be selected as the default flower arrangement FS when the switching condition is met (e.g., it may be excluded from the selection process). Below, with reference to FIG. 44, an example of varying the probability of a default flower arrangement FS being selected for each flower arrangement FS is described. Each user may be able to perform a favorable impression action or a report action on a flower arrangement FS associated with another user displayed in the spatial area ER5. A favorable impression action is an action to express a favorable impression, such as operating an icon such as a "like" (heart mark) to indicate a favorable impression of another user's flower arrangement FS. A reporting action is an action to express the opinion that it is inappropriate to display something within the spatial area ER5, and is an action to report to the management, for example, when offensive characters (comments) are displayed on another user's flower star FS.

Figure 44 shows an example of a close-up image 510 of a flower stand FS. The close-up image 510 is displayed on the display device 310 based on information transmitted from the distribution server computer 100, triggered, for example, by the viewer terminal 300 approaching or interacting with a flower stand FS displayed in the display area. It can display details of each flower stand FS. The close-up image 510 in Figure 44 displays one of the flower stands FS placed in the display area. Operating the left and right buttons 511 (511L, 511R) allows users to view other flower stands FS in the display area. The close-up image 510 also displays a Like button 513 for performing a Like action, a Report button 514 for performing a Report action, and a Close button 516 for closing the close-up image 510. The close-up image 510 also displays creator information 512 (user information) as detailed information. This can motivate users to perform a Like action, for example, if the flower stand FS was purchased or created using the account of a celebrity or friend. It can also motivate users to take positive actions towards Flower Star FSs that have funny or interesting messages.

When the like button 513 is operated, the viewer terminal 300 transmits like impression information to the distribution server computer 100, which also identifies the flower star FS that has been liked. When the like impression information is received, the distribution server computer 100 updates and stores the number of likes (like impression history) for the flower star FS that has been liked, among the flower star FSs stored in the object data 122. Furthermore, when the number of likes is updated, the number of likes corresponding to the flower star FS displayed in the close-up image 510 is displayed in a manner that adds one to the updated number.

Furthermore, when the distribution server computer 100 holds a lottery to select the default flower stand FS to be displayed when the switching conditions are met, it may refer to the number of likes for each flower stand FS and vary the probability of that flower stand FS winning the lottery depending on the number of likes. For example, if there are 1 million flower stand FSs to be selected for the lottery, the probability of winning would normally be 1 in 1 million, but the probability may be increased in stages depending on the number of likes. For example, the probability may be increased to 10 in 1 million if the number of likes is between 100 and 999, and to 100 in 1 million if the number of likes is between 1,000 and 2,999. In other words, the higher the number of likes, the higher the probability of winning.

In other words, the distribution server computer 100 and the viewer terminal 300 each receive, based on the stored programs, likeness information for identifying like actions for a flower stand FS from users, thereby updating the like history for that flower stand FS, and performing processes such as adding 1 to the number of likes displayed when displaying that flower stand FS based on the like history for that flower stand FS, and making it easier to display it as a default flower stand. This allows users to enjoy the fun of having the display of their flower stand controlled based on their like history. Furthermore, not only can users enjoy the fun of earning like actions, but they can also experience reactions from other users, which increases user interest.

The distribution server computer 100 may also exclude a flower stand FS for which the restriction conditions are met from the lottery of step S203 in FIG. 32, thereby restricting it from being selected and displayed as a default flower stand FS (i.e., restricting it from being displayed to users other than the user who owns the flower stand FS). The restriction conditions are met, for example, when the administrator checks the number of reporting actions or the text on the flower stand to be reported and determines that it should be hidden, causing it to be set as hidden. When the report button 514 is operated, the viewer terminal 300 sends report information to the distribution server computer 100 that also identifies the flower stand FS that was the subject of the report. When the distribution server computer 100 receives the report information, it updates and stores the number of reports (report history) for the flower stand FS that was the subject of the report among the flower stand FSs stored in the object data 122. The restriction condition may be met by the operator setting the display to hidden in response to the updated number of reports, or by the distribution server computer 100 determining whether the number of reports has reached a predetermined number and automatically setting the display to hidden if the predetermined number has been reached. This prevents the display of a flower stand FS associated with another user for whom the restriction condition is met from being determined as the default flower stand, preventing it from being displayed in the exhibition area and providing a comfortable space area ER5 for users.

In this case, even if the flower stand FS satisfies the restriction conditions, it may continue to be displayed in the display area within spatial area ER5 on the display device 310 of the user who purchased and owns the flower stand FS (a so-called "shadow ban"). This prevents the interest of the user who purchased the flower stand FS from being diminished, while making it difficult for the user to identify that the restriction conditions have been met. In addition to or instead of reporting, the viewer terminal 300 of the user who reported the message may "hide" the flower stand even before the restriction conditions are met. Even if the action is to hide the flower stand, the distribution server computer 100 may accumulate the number of times it has been hidden, and once the number of times it has been hidden reaches a predetermined number, it may be hidden from all users. Furthermore, when the action to hide the flower stand is taken, the distribution server computer 100 and the viewer terminal 300 may each determine by lottery, based on the programs stored in their respective programs, which flower stand to display instead.

Note that the flower stand FS that are the subject of the lottery in step S203 of FIG. 32 may be limited to those that pass the screening for whether they contain NG comments or inappropriate comments, as described above, and flower stand FS that are determined to contain them may be excluded from the lottery. The screening may be carried out visually by an administrator, and a NG flag or the like may be set on flower stand FS that are determined to contain them, excluding them from the lottery, or text may be extracted and the screening may be carried out automatically, and a NG flag or the like may be set on flower stand FS that are determined to be NG. Furthermore, not only in the lottery when the switching condition is met, but also in the lottery in step S301 of FIG. 37(A), the probability of being selected as the default flower stand may be varied depending on parameters specific to the flower stand FS (for example, the number of likes), or the default flower stand FS may not be selected if a restrictive condition is met.

(Regarding cluster switching process 2)
In the above-described embodiment, the processing in steps S225 to S245 of FIG. 33 is described as being executed by the distribution server computer 100. However, this is not limiting and the processing may be executed by the viewer terminal 300. The viewer terminal 300, for example, may request information for displaying a flower rack FS (e.g., information specifying a display mode) in an exhibition area from the distribution server computer 100. If the information for identifying the requested flower rack FS is not received within a predetermined time, the viewer terminal 300 may display a virtual space in which a predetermined substitute flower rack FS is placed in each exhibition area, or a virtual space in which a predetermined substitute object different from the flower rack FS is placed in each exhibition area. For example, information for displaying a substitute object may be received in advance along with the virtual space update data, or information for displaying a substitute object may be requested from the distribution server computer 100 when the information for identifying the updated flower rack FS is not received.

In the above-described embodiment, when it is determined in step S235 that a predetermined time has elapsed, a replacement flower FS to be placed in the missing portion is identified in step S245 and transmitted to the viewer terminal 300 in step S205. However, this is not limited to this. If the flower FS information cannot be received (identified) correctly even after a predetermined time has elapsed since the flower FS information was read from the database, a flower FS to replace the missing portion may be randomly selected, and information for displaying the flower FS selected by the selection may be transmitted to the viewer terminal 300. For example, this may be applied in cases where, depending on the database management method, the processing load on the distribution server computer 100 is reduced by performing a random selection by referring to a database that stores the object data 122 to be selected when the flower arrangement information is updated in step S213 (step S203 in FIG. 32), rather than reading the flower arrangement information from a database that stores the updated flower arrangement information.

In the above-described embodiment, an example has been described in which a substitute flower stand is identified as an object to replace the flower stand FS read in step S215 of Figure 33. However, this is not a limitation, and the substitute object does not have to be of the same type as the flower stand FS, but can also be an object other than a flower stand FS. For example, if the flower stand FS is a lantern object, a simple, plain, round, three-dimensional model can be displayed in place of the lantern, and not only the flower stand FS itself as shown in Figure 29, etc., but also the base object, such as a frame for displaying the flower stand FS, can be replaced with a simple wooden object, etc.

Alternatively, instead of displaying substitute objects, when a predetermined time has elapsed in step S235, information for displaying the spatial area ER may be sent (distributed) to the viewer terminal 300 as a virtual space in which essential objects (for example, a stage object such as the virtual stage G) are displayed but no flower star FS is displayed. For example, the underlying object, such as a framework for displaying the flower star FS, may not be displayed at all. Note that this virtual space in which no flower star FS is displayed may continue until the next switching condition (step S202 in Figures 32 and 33) is met, or may continue for a predetermined time, or until the load on the distribution server computer 100 has remained below a predetermined threshold for a predetermined time. When the switching condition is met or the load has fallen below the threshold, an updated flower star FS may be displayed in the virtual space that can be displayed on the viewer terminal 300.

In the above-described embodiment, an example has been described in which an alternative flower arrangement is identified in step S245 when it is determined in step S235 that a predetermined time has elapsed since the flower arrangement information was read. However, when it is determined in step S235 that a predetermined time has elapsed since the flower arrangement information was read, a further determination may be made as to whether or not a required object has been read. If it is determined that a required object has been read, information for displaying the virtual space may be sent to the viewer terminal 300 even if information for displaying the flower arrangement FS has not been received successfully (either an alternative object is identified or neither an alternative object nor anything else may be displayed). Furthermore, if a required object has not been read (or identified), the virtual space itself may not be displayed on the viewer terminal 300.

In the above-described embodiment, an example was described in which the processing of steps S225 to S245 in Figure 33 is applied when reading out cluster placement information, but it may also be applied to reading out other information, not just cluster placement information, as long as a large amount of information is read out from a database. Also, while an example was described in which it is applied when a user enters a room, it may alternatively or additionally be applied when a switching condition is met, and processing similar to the processing of steps S225 to S245 may be performed following step S202 in Figures 32 and 33. That is, when it is determined in step S202 that the switching condition is met, the flower arrangement information to be displayed in each exhibition area is randomly selected from the flower arrangement FS that are subject to the lottery, and the flower arrangement information for each exhibition area in the object data 122 is updated (part of step S203, step S213), after which it is determined whether the flower arrangement information has been updated normally (e.g., information identifying all the read-out flower arrangement FS that can be displayed) (corresponding to step S225), and if it has been updated normally, the updated flower arrangement information is sent to the viewer terminal 300 of the user who has entered and is participating in the spatial area ER5 (part of step S203, step S223). On the other hand, if it is determined that all updates have not been completed, a determination is made as to whether a predetermined time has elapsed (corresponding to step S235). If the predetermined time has not elapsed, the process returns to the step of determining whether the flower arrangement information was updated successfully. If the predetermined time has elapsed, the flower arrangement information may be updated to place a predetermined flower in the location that could not be updated (corresponding to step S245), and the updated flower arrangement information may be sent to the viewer terminals 300 of users who have entered and participated in spatial area ER5 (part of step S203, step S223). Note that because the flower arrangement information for all users who have entered the room is updated when the switching condition is met, there is almost no risk of the load on distribution server computer 100 increasing and the process being unable to be completed. However, by performing the same processing as steps S225 to S245 following step S202, unforeseen circumstances can be handled.

(Events that change the display mode in the virtual space)
In the above embodiment, an example of an event that changes the display mode within the spatial area ER5 (a flower stand FS in the exhibition area during the pre-scheduled period, and a flower stand FS held by a performer avatar during the provision of event content) is when a flower stand FS is purchased and placed in response to a user operation. However, the specific object that causes an event that changes the display mode within the virtual space is not limited to a flower stand FS. It may also be an object that resembles a glow stick or a fan that emits light, or an object that can be placed (installed) within the spatial area ER5, such as an object that resembles flowers, a clock, a hedge, a tamagaki fence, a signboard, or a signboard found within a shrine. Note that while the specific object is an object that the performer avatar can hold in their hand during the provision of event content, it is not limited to this. The specific object may also be an object that a user avatar (viewer avatar) can use, or an object that can be placed (installed) within the spatial area (region ER53′) where the event content is provided.

Furthermore, events that change the display mode in the virtual space are not limited to those that can be caused by the placement of specific objects, etc. Alternatively, or in addition, various activities may be prepared within the spatial area ER5, and may occur depending on the results of activities played by the user during the period before the scheduled date. Such activities may be playable only for a limited period before the scheduled date (or until the start time of the event content). Examples of activities include games, missions, and trials of luck executed within the spatial area ER5. For example, in the game area of FIG. 24, these include games that can be played in a short time, such as lottery games, search missions to find specified items, and trials of luck such as fortune-telling and offerings. Depending on the results of games, search missions, and trials of luck during the period before the scheduled date, certain rights (benefits), such as the granting of the above-mentioned flower star FS or the items shown in FIG. 38, or changes to the presentation of event content, may be associated with the user who experienced the activity. Furthermore, items obtained based on the results of activities may be saved in an item box, etc. For example, the data may not be limited to objects, but may also include voice data of performer avatars. Furthermore, the display mode within the spatial area ER5 on the viewer terminal 300 of the user who experienced the activity may be changed depending on the results of the game, exploration mission, or test of luck during the period before the scheduled date. In this way, by preparing the experience of various activities in a specific type of virtual space where event content is provided during the period before the scheduled date, it is possible to generate events in the virtual space during the period before the scheduled date and to raise the user's mood until the scheduled date when the event content is provided.

Furthermore, events that change the display mode within the virtual space are not limited to those that can occur in response to user operation. Alternatively, or in addition, they may occur when a user is in the virtual space and the conditions for occurrence are met, regardless of user operation. For example, an event may occur when a user who has entered spatial area ER5 is given a specific object and placed within spatial area ER5 after a predetermined time has passed since entering, or the event may occur when a user who has entered spatial area ER5 is selected by a random lottery or other method at predetermined intervals from among the users who have entered (users who do not win are not considered to have had an event occur).

(Subject to changes in display format during the period before the scheduled date due to events that occurred)
In the above embodiment, an example was shown in which the display mode of the flower stand FS placed in the exhibition area within the spatial area ER5 during the pre-scheduled period was changed in response to an event that occurred during the pre-scheduled period. However, the object to be changed is not limited to this, as long as it is within the spatial area ER5. The object to be changed in response to an event that occurred during the pre-scheduled period may be, for example, the type and number of objects, such as buildings and ornaments, placed within the spatial area ER5 during the pre-scheduled period, the placement positions of buildings and ornaments within the spatial area ER5 during the pre-scheduled period, or the number of areas included in the spatial area ER5 during the pre-scheduled period (e.g., adding an area ER54 connected to area ER51, making it possible to enter area ER54). In this case, it is possible that only areas ER51 and ER52 within the spatial area ER5 are changed, and the display mode of area ER53, which is associated with the area where the event content is provided, is not changed in response to the event. Even when configured in this manner, the only thing that will be changed in response to an event that occurred during the period before the scheduled date is the viewer terminal 300 of the user in whose hands the event occurred, and therefore, depending on the event that occurred during the period before the scheduled date, the display mode may be different from the display mode displayed to other users.

(Regarding items whose display mode changes during an event)
In the above embodiment, an example was shown in which the display mode of the flower stand FS (an object associated with the performer avatar) held by the performer avatar during the presentation of the event content was changed in response to an event that occurred during the pre-scheduled period. However, the object to be changed is not limited to this as long as it is within the spatial area ER5. The object to be changed in response to an event that occurred during the pre-scheduled period may be, for example, a costume object of the performer avatar, as illustrated in the example of the "secret costume" effect set upon the seventh entry in FIG. 38 . Furthermore, the object to be changed in response to an event that occurred during the pre-scheduled period may be the user names of users who purchased flower stands FS during the pre-scheduled period displayed in the ending credits at the end of the event content. In this case, for example, the names may be displayed in descending order of purchase amount or number of purchases, or the size of the user names displayed in the ending credits may vary depending on the purchase amount or number of purchases (the larger the purchase amount or number of purchases, the larger the display size). Furthermore, the target of change in response to an event occurring during the period before the scheduled date may be a display of a large number of flower stands FS in the virtual live venue, or, for example, a display of a large number of floating flower stands FS, such as jet balloons, doubling all the flower stands FS purchased by users during the period before the scheduled date (default flower stands FS for users who have not purchased any), thereby creating a more exciting display of the event content. Even in this configuration, the target of change in response to an event occurring during the period before the scheduled date is only the viewer terminal 300 of the user in whose possession the event occurred, and therefore the display mode displayed to other users may differ depending on the event occurring during the period before the scheduled date.

(Regarding the degree to which images in a specified type of virtual space were displayed during the period before the scheduled date)
In the above embodiment, the number of entries into spatial area ER5 where event content may be held on the scheduled date was shown as an example of the degree to which event content-related processing is to be performed. However, it is not limited to this, and may also be the length of time spent in spatial area ER5, the proportion of the number of days spent in spatial area ER5 to the number of days in the period before the scheduled date, the proportion of the time spent in spatial area ER5 to the total time in the period before the scheduled date, the number of entries or length of time spent in spatial area ER5 out of the number of entries or length of time spent in virtual space ER in the period before the scheduled date, and even the proportion of the number of entries or length of time spent in spatial area ER5, the length of time taken from the last entry to the current entry during the period before the scheduled date, etc.

(Event content related processing depending on the degree of display)
In the above embodiment, as shown in the effect content of FIG. 38 , examples of the processing for changing the display mode within the spatial area ER5 according to the degree include effects such as images of the live venue set and the costumes of performer avatars. However, the processing for changing the display mode within the spatial area ER5 according to the degree is not limited to this. It may also be the case that the user names of users who entered the event during the period before the scheduled date are displayed in the ending credits at the end of the event content. In this case, for example, the names may be displayed in descending order of the number of times the event content has been entered, or the size of the user name displayed in the ending credits may vary depending on the number of times the event content has been entered (the larger the purchase amount or number of purchases, the larger the size). Furthermore, the effect may be to display a large number of flower stands FS in the virtual live venue, for example, by floating flower stands FS in a number corresponding to the number of times the event content has been entered (purchased flower stands FS for users who have purchased flower stands, and default flower stands FS for users who have not purchased flower stands). In addition, when the display mode of the performance content or jet balloons, etc. is changed, the display mode may differ for each user's viewer terminal 300 depending on the degree, and therefore the display mode may differ from the display mode displayed to other users depending on the degree. In addition, as the performance content, for example, rooms with different display modes may be associated with each entry count, and different types of rooms may be set depending on the entry count (e.g., event content may be provided in a special room corresponding to the entry count out of multiple types of special rooms with different display modes), or different display modes of costumes for the performer avatar may be associated with each entry count, and different types of costumes (display modes) may be set depending on the entry count.

In the above embodiment, as shown in the items in FIG. 38, the process of assigning an item usable as an object during event content according to the degree was exemplified as the target of the process of changing the display mode within spatial area ER5 according to the degree. However, the target of the object to be assigned according to the degree is not limited to this, and may be an object resembling a glow stick or a fan that emits light, or an object that can be placed within spatial area ER5, such as an object resembling flowers, a clock, a hedge, a stone fence, a signboard, or a signpost found within a shrine. Note that the object may be an object that can be held by a performer avatar while the event content is being provided, an object that can be used by a user avatar or a viewer avatar, or an object that can be placed within the spatial area (region ER53') where the event content is being provided.

(Regarding the transition of display modes of specific objects in virtual space)
In the above embodiment, the flower chart switching process illustrated in FIGS. 29 to 33 is not limited to being performed during a period related to event content provided on a scheduled date. It may also be applied to cases where specific objects associated with a user or specific objects associated with other users can be placed in a virtual space regardless of whether or not event content is provided on the scheduled date. For example, a virtual space may be provided in which users can share and exhibit their own creative content (e.g., art, derivative works, in-game works, links to original virtual spaces (e.g., buildings created by the user)) and other users' creative content. By performing the flower chart switching process illustrated in FIGS. 29 to 33 in the virtual space, creative content created by other users may be displayed (exhibited or placed in the virtual space) upon satisfaction of a switching condition. This allows users to view and experience various users' creative content without prior knowledge, enhancing the enjoyment of the virtual space. Note that objects placed in the exhibition area by operations on the user's viewer terminal 300 may include objects with predetermined designs that cannot be edited by the user (content editing). This allows a user to view his or her own specific objects at any time, even if there is a limit to the number of specific objects that can be placed and displayed in the virtual space, thereby increasing satisfaction, while specific objects associated with other users can be displayed evenly within the virtual space, and the display mode of the virtual space can be changed to increase interest, allowing a large number of specific objects to be appropriately reflected.

(Regarding the placement area of specific objects)
In the above embodiment, Fig. 27 shows an example in which different placement areas are defined depending on the size of a cluster FS, which is an example of a specific object. However, in addition to the size, multiple types of attributes are also defined for cluster FS. Therefore, instead of or in addition to the size of the cluster FS, different placement areas may be defined for each attribute of the cluster FS. This further enhances the sense of unity among the placement areas.

(Regarding other forms of data sent to viewer terminals)
In the above embodiment, in the flower cluster switching process of FIG. 32 and the event flower cluster determination process of FIG. 37, default flower cluster information (step S205 of FIG. 32, step S302 of FIG. 37A) and information for identifying a flower cluster FS associated with each user based on the user-related information of FIG. 27C (step S207 of FIG. 32, step S303 of FIG. 37A) are transmitted to the user, and the information on the flower cluster used in the presentation of the exhibition area and event content is rewritten at the viewer terminal 300. However, this is not limiting, and the distribution server computer 100 may transmit, for each user, information updated from the default flower cluster information based on FIG. 27C. That is, the distribution server computer 100 may generate and transmit different information for each user according to the user's flower cluster FS, and the viewer terminal 300 may display a flower cluster FS appropriate for that user based on this information.

(Items that can be used during the event content)
In the above embodiment, as illustrated in FIG. 38, crackers, fireworks, glow sticks, stamps, and the like are given as examples of items (objects) that can be used during the provision of event content. These items may be displayed in the virtual space ER, for example, in a room of a house built by the user, regardless of whether they have been used or not. Alternatively, they may be displayed as souvenirs in an item box displayed in the virtual space ER, even after use. This allows limited items corresponding to the event content being provided (held) to be kept as mementos, increasing the user's attachment to the event content.

(Other impacts of events occurring during the pre-scheduled period on the Event Content)
In the above embodiment, the change in the display mode of a specific object was described as an example of the display mode in the virtual space when event content is provided, which changes depending on events that occur in a specific type of virtual space during the period before the scheduled date. However, this is not limited to this. For example, a user who purchases a flower stand FS during the period before the scheduled date and places it in the spatial area ER5 may be granted a specific right (benefit) depending on, for example, the purchase amount or the number of purchases (number of placements). The specific right (benefit) may be, for example, the right to extend the duration of the provided event content (e.g., the right to participate in an after-talk), the right to watch the event content live from a dedicated virtual camera that the user can operate, or the right to participate from a special area.

(Example of due date)
In the above embodiment, an example has been described in which event content is distributed (provided) at a scheduled time (predetermined date and time) on a scheduled date in accordance with event data. The scheduled date may be, for example, the entire date on which a live event or the like is scheduled to be held (e.g., from midnight to 11:59 PM on April 5th), or a period of several days (e.g., from 9:00 AM on May 1st to 9:00 PM on May 5th). Furthermore, if the scheduled date of the event content is a comprehensive event content in which multiple content items (e.g., a live event, a talk show, etc.) are provided (e.g., a festival event spanning several days), the display mode of each of the multiple content items provided in the comprehensive event content may be changed in accordance with events occurring during the period leading up to the scheduled date for each of the multiple content items provided in the comprehensive event content.

(Pre-scheduled period)
In the above embodiment, the period before the scheduled date is described as a period extending up to the day before the scheduled date on which the event content is to be provided. However, the period before the scheduled date is not limited to this, as long as it is a period until the event content is to be provided. For example, the period before the scheduled date may be a period extending up to two days or a specified number of days before the scheduled date. It may also be a period within the scheduled date on which the event content is to be provided, such as up to one hour, ten minutes, or one minute before the scheduled time. For example, the display mode within a specified type of virtual space may be changed in response to an event occurring within the specified type of virtual space several hours before the event content is to be provided. For example, a flower stand FS purchased by a user up to two hours before the start time of a live event in the spatial area ER5 (e.g., 7:00 p.m.) may be displayed within the spatial area ER5, and the purchased flower stand FS may be used in the event presentation shown in FIG. 35 .

(About Portal P)
In the above embodiment, an example has been described in which transition to area ER53′ is possible via portal P in FIG. 24(B) when a specific period before the scheduled date of the event content is reached and the release condition is met. For example, the portal P may appear in front of the gate object 53c in area ER52 when the specific period (the day before the scheduled date period) is reached (when the release condition is met). Alternatively, the portal P may exist before the specific period but not function as a portal P for transitioning to another area until the specific period is reached. Furthermore, when returning to area ER52 after transitioning to area ER53′, the user avatar U may be able to transition to area ER52 via portal P on the side of area ER53′ in FIG. 24(B), for example, so that the first virtual space and the second virtual space can be mutually accessed.

In this embodiment, an example has been described in which a user who has been in area ER53 is moved out of area ER53 a specific period before the scheduled date (the day before the scheduled date) (for example, user avatar U is forcibly moved out of area ER53). However, it is not limited to being moved out of area ER53 uniformly just before the specific period. Users who are in a predetermined state may be moved out of area ER53 after an end condition is met (an image of the virtual space other than area ER53 is displayed). For example, a user who is displaying a flower star FS in the exhibition area within area ER53 (for example, while displaying the screen of Figure 44) may be considered to be in a predetermined state, and when the display of a screen such as Figure 44 ends, the end condition may be met and the user may be moved out of area ER53.

(Regarding release conditions and specific periods)
In this embodiment, the release condition is met when a specific period of time passes before the scheduled date on which the event content is provided, and the specific period is the day before the scheduled event date. However, the specific period of time before the scheduled date on which the release condition is met is not limited to this, and may be a period of two days or a specified number of days before the scheduled date. Furthermore, the specified period is not limited to a period related to the number of days or time, and may be, for example, a period after the time when the number of users entering the spatial area ER5 reaches a specified number, or a period after a time set by the management in consideration of the situation, etc.

(Regarding the second virtual space after the event content ends)
In the above embodiment, an example was described in which the event content is provided in an area ER53' that shares a display mode with the area ER53. The area ER53' may be set to be inaccessible to the user avatar U after the event content has ended or after a predetermined time has elapsed since its end. For example, if a live event is held in the area ER53', 30 minutes after the live event ends, the user avatar U still in the area ER53' may be forcibly moved out of the area ER53' (e.g., moved to in front of the gate object 53c in the area ER52 along with a blackout effect). This can prevent the server from being overused, reducing costs, for example, if the area ER53' is managed by a server that handles the heavy load of providing the event content. Furthermore, by waiting a predetermined time (e.g., 30 minutes or an hour) after the end of the event content, the user avatar U can be moved, allowing the user to savor the afterglow of the event.

Regarding area ER53, which has been inaccessible since a specific period prior to the scheduled date on which the event content is to be provided, access becomes possible again after the event content has ended. For example, when area ER53' becomes inaccessible (e.g., 30 minutes after the end of a live event), the portal P leading to area ER53' may disappear, making it impossible to move to area ER53', and the virtual space (areas ER51, ER52, and ER53) may return to a state in which seamless movement is possible (the gate of the gate object 53c leading to area ER53 may be open) as it was before the specific period. Furthermore, even if a specific amount of time has elapsed since the end of the event content, for a user who has once left area ER53', the portal P may not be displayed in area ER52, and, for example, the gate of the gate object 53c leading to area ER53 may be open.

(Event venue after the event content has ended)
In the above embodiment, an example was described in which area ER53 displays a stage (e.g., virtual stage G, G2) of the same form as the virtual live venue of FIG. 13 or FIG. 35 constructed in area ER53', thereby reflecting the gradual construction of the virtual live venue a specific period before the scheduled date. Additionally or alternatively, after the event content ends, the virtual live venue in area ER53 may display the completed stage after the event content has been provided. For example, before the event content is provided, the stage may be in an unfinished state, but after the event content ends, the venue objects from when the live event, such as those in FIG. 35, were displayed as they were when the event was held. This allows the user to linger in the afterglow of the event content even after the event content has ended. In addition, virtual live venue objects are not displayed in area ER53 during the period before the scheduled date, and data showing a gradual increase in venue objects in area ER53' from a specific period before the event start time may be delivered to the user at predetermined time intervals (i.e., venue objects are not placed (displayed) in area ER53, and venue objects are placed (displayed) only in area ER53').

(Example of switching for specific objects within the exhibition area)
In the above embodiment, as illustrated in Figures 29(D) and 30(D), if the default flower stand FS for display area A, which is determined by lottery and stored when the switching condition is met, happens to include a flower stand FS1 purchased by user 1 at position A6 in display area A, then, on user 1's display device 310, as shown in Figure 29(D), priority is given to the user-related information in Figure 27(C), and the flower stand FS at position A6 is switched to the flower stand FS determined by default for position A1. However, this is not limited to this. If the default flower stand FS includes the flower stand FS1 purchased by user 1, the default flower stand FS may be displayed (i.e., the flower stand FS1 purchased by user 1 may be displayed at the default position A6). Alternatively, while the flower stand FS1 continues to be displayed at position A1, the flower stand FS1 may also be displayed at the default position A6. This allows a plurality of flower stands FS purchased by the user to be displayed, thereby improving the user's satisfaction.

In addition, in step S203 of Figure 32, a default flower stand FS for each display area is determined by random drawing from among all the flower stand FSs eligible for the drawing. This drawing includes the flower stand FS that was determined as the default flower stand FS and was on display before the switch. Therefore, as shown in Figure 29(C), an example has been described in which a flower stand FS identical to the flower stand FS of the letter G that was included before the switch may coincidentally be included after the switch. However, if the same flower stand FS is drawn by chance before and after the switch in this way, a new drawing may be conducted for only the relevant flower stand FS, and the default flower stand information table in the object data 122 of Figures 31(A) and (B) may be updated to prevent the same flower stand FS from being displayed before and after the switch. Furthermore, all flower stand FSs eligible for the drawing, except for the flower stand FS that was determined as the default flower stand FS and was on display before the switch, may be changed to different flower stand FSs after the switch.

In the above embodiment, an example was described in which step S101 in FIG. 28 determines whether the flower stand FS is available for purchase before the scheduled date when it is purchased, and step S201 in FIG. 32 determines whether the flower stand FS is available for display before the scheduled date. These available for purchase and display periods may or may not coincide. For example, the available for purchase period may be set to seven to four days before the scheduled date, and a flower stand FS purchased during the available for purchase period may be available for display from three days before the scheduled date to the day before.

(Avatar display style for each content)
In the above-described embodiment, examples have been described in which the performer avatars (e.g., humanoid avatars in FIG. 13 ) who are conducting a live event are different from the avatars of general users (e.g., simple shapes such as circles, squares, and triangles, as illustrated in the (special audio/viewpoint switching process) in FIG. 41 ), and in which performers who enter the virtual space as participants like other general users have the same avatars as the avatars of general users. The display modes of these avatars may differ depending on the content and areas provided in the virtual space (e.g., display modes for the avatars of general users, performers as participants, and performers as facilitators may be set for each content and area). For example, the avatars of general users may be simplified avatars only in specific areas of the virtual space, and in other spaces, even general users may have humanoid avatars similar to the performer avatars during the live event. As a specific area, for example, in a space where a live event or the like is held, such as area ER53' in Fig. 24 , where the processing load is heavy due to the large number of effects used for the performance, general users other than the performer avatars appearing on the virtual stage G may be used as simple avatars. In the case of live content, the focus is on the performance of the live show rather than the display mode of the general user avatars. Therefore, by using simple avatars for the general users' avatars, more computer resources can be used for the performance of the live show, thereby entertaining users.

On the other hand, in virtual spaces (rooms, etc.) or private spaces where content with a low processing load, such as chat, is provided, even general users may be displayed as humanoid avatars. This means that, for example, when a fan meeting with a performer avatar is held, both the performer and the general user are displayed as humanoids, which can create a sense of closeness and make it easier for them to become more comfortable with each other.

Also, even in an area (room) where a live event is being provided and general users are displayed with simple avatars, the display may be switched to a humanoid avatar that is the same as the performer's when a certain condition is met. The condition may be met when an authorized user (for example, an authorized user such as the creator of the room, or a performer) or an administrator gives permission to display as a humanoid avatar (authorized user), or when moving to a specified area (for example, moving from the virtual audience area (audience seats) to the virtual stage G, etc.). Moving to a specified area may also be possible when permission is given by an authorized user or an administrator.

(Special room entry procedures)
In the above-described embodiment, FIG. 42 illustrates an example in which, when a user enters a room in the virtual space without specifying a room, the user is automatically admitted to a room identified in step S425 or step S426. However, this is not limiting, and the user may be able to enter any room by specifying it. For example, when a selection screen for a room to enter after logging in to the virtual space is displayed, the room's congestion status (e.g., words such as comfortable, crowded, or full) may be displayed according to the number of occupants in each room, and the user may be able to identify rooms in which related users or special users are present. This allows the user to identify rooms in which related users are present, and even if the maximum number of occupants has been reached (full), the user may be allowed to enter a room in which a related user is present, even if the maximum number of occupants has been reached. Note that a second maximum number of people may be set for entering the same room as a related user. For example, while the original maximum number of people is 200, the maximum number of people allowed may be increased to 220 if related users are allowed to enter the room.

Furthermore, even if a user who has already exceeded the upper limit of the number of users entered through the processing in steps S424 to S425 subsequently determines in step S424 that a related user has entered the room, the user may not be able to enter the room and may instead be associated with another room and enter the room. The other room may be a room with a related user other than a room that has already exceeded the upper limit of the number of users entered through the processing in steps S424 to S425 and has no users in it.

In the above-described embodiment, an example was described in which, when it is determined in step S421 of FIG. 42(b) that entry is from a special user, if a room is specified in step S422, entry to the specified room is permitted regardless of the room's maximum number of members. However, this is not limited to this. Even if it is determined in step S422 that no room is specified, if the user who made the entry request is a special user, for example, entry to a room predetermined by the administrator may be permitted regardless of the room's maximum number of members.

In the above-described embodiment, FIG. 42(b) illustrates an example in which a user may be allowed to enter a room in which a related user has already entered in step S425 or the like, regardless of the upper limit on the number of users in the room. When this related user has already entered the room, if multiple related users specify the same room and request entry within a predetermined period of time (e.g., within 5 or 10 minutes after the first user enters the room), these related users may be allowed to enter the same room regardless of the upper limit. Also, if multiple special users, such as celebrities, specify the same room and request entry within a predetermined period of time, they may be allowed to enter the same room regardless of the upper limit. For example, it may be possible to intentionally time the entry time to meet up and hold an event or activity in the same room.

(Regarding component reset of the performer's humanoid avatar)
In the above embodiment, an example has been described in which components of swinging objects, such as clothing objects, that are displayed in motion in correspondence with character objects are reset in the component reset process of Fig. 43. However, the present invention is not limited to this, and it is also possible to reset not only components (parameters) that display clothing objects in motion, but also components that display corresponding character objects in motion.

In the above-described embodiment, Figure 43 shows an example in which the distribution server computer 100 determines whether a series of actions by the performer avatar has ended. However, this is not limiting. The viewer terminal 300 may determine, based on a viewer program, whether a series of actions by the performer avatar has ended (for example, whether the amount of movement of the performer avatar has fallen below a predetermined amount, or whether the volume generated in the virtual space, including the volume from the performer avatar, has fallen below a predetermined amount), and then perform the process of resetting the component.

In the above embodiment, an example has been described in which, in step S431 of FIG. 43, it is determined whether or not a series of actions has ended, and then a component reset signal is sent in step S432. However, this is not limited to this, and the virtual space update data delivered to the viewer terminal 300 may include a component reset signal in advance in accordance with the timing between songs in the played music.

In the above-described embodiment, an example has been described in which the component reset process of FIG. 43 determines whether a series of actions has ended based on the movements of the performer avatar. However, this is not limited to this, and any timing may be used when it is likely that the performer avatar is not making any major movements (not singing or dancing). For example, the determination of a time such as between songs may be made based on the state (e.g., volume and rhythm) of the waveform of the sound delivered by the generated audio delivery process of FIG. 10.

[Software implementation example]
The various control blocks of the control unit of a computer such as a server or terminal in the above-described embodiments may be implemented by logic circuits (hardware) formed on an integrated circuit (IC chip) or by software using a CPU (Central Processing Unit). When implemented by software using a CPU, the computer equipped with the control unit includes a CPU that executes instructions from a program, which is software that implements each function; a ROM (Read Only Memory) or storage device (collectively referred to as a "recording medium") in which the program and various data are recorded so as to be readable by the computer (or CPU); and a RAM (Random Access Memory) in which the program is deployed. The object of the present invention is achieved when the computer (or CPU) reads and executes the program from the recording medium. The recording medium may be a "non-transitory tangible medium," such as a tape, disk, card, semiconductor memory, or programmable logic circuit. The program may also be supplied to the computer via any transmission medium capable of transmitting the program (such as a communication network or broadcast waves). Note that one aspect of the present invention may also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

The embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of the present invention is indicated by the claims, not the above description, and is intended to include all modifications that are equivalent in meaning to and within the scope of the claims.

1 Performer avatar 100 Distribution server computer 150 Administrator terminal 200 Performer terminal 300 Viewer terminal

Claims (9)

A program executed by a computer to provide a virtual space to a user,
The computer
functioning as a display means for performing processing to display an image of the virtual space;
the virtual space includes a predetermined space in which a plurality of types of objects including a first type of object and a second type of object can be displayed;
The display means
when first object information for displaying the first type of object can be identified, performing a process for displaying the predetermined space regardless of whether second object information for displaying the second type of object can be identified;
when displaying the predetermined space, if the second object information can be identified within a predetermined period of time, the second type of object is displayed in a display mode based on the second object information, and if the second object information cannot be identified within the predetermined period of time, a process is performed to display a substitute object corresponding to the second type of object;
The process for displaying the substitute object is executed when the predetermined space is displayed in response to a user newly entering the virtual space . the computer is a user terminal that displays the provided virtual space;
The program according to claim 1, wherein the display means displays a substitute object when the first object information can be identified, but when the second object information cannot be identified within the predetermined period at the time of requesting object information and receiving the second object information. the computer is a distribution device that distributes information for providing the virtual space to a user terminal,
2. The program according to claim 1, wherein the display means, upon receiving a request for object information from the user terminal, identifies and distributes object information including the second object information, and distributes substitute object information for displaying the substitute object when the second object information cannot be identified. The program described in claim 1, wherein the specified space is a space for providing event content in the specified space on a scheduled date. the second type of object is an object whose display mode can be changed, and when the second object information cannot be identified, the second type of object may be displayed in a different manner from the second type of object, and when the second type of object is displayed in a different manner from the second type of object, the second type of object may be displayed in a different manner from the second type of object.
2. The program according to claim 1, wherein the display means, when displaying the specified space, performs processing to display the second type of object in a display mode based on the display mode information when the display mode information can be identified, and to display the second type of object as the substitute object in a specified display mode when the display mode information cannot be identified. The program described in claim 1, wherein the second type of object is an object whose display mode can be changed in response to the user's actions in the virtual space. The program described in claim 6, wherein the user's actions include an operation by the user to place the second type of object in the specified space, and a user operation to generate a display mode for the second type of object when placing it. 1. A method for controlling a computer to provide a virtual space to a user, comprising:
a step of performing processing for displaying an image of the virtual space,
the virtual space includes a predetermined space in which a plurality of types of objects including a first type of object and a second type of object can be displayed;
The step of performing processing to display an image of the virtual space includes:
when first object information for displaying the first type of object can be identified, performing a process for displaying the predetermined space regardless of whether second object information for displaying the second type of object can be identified;
when displaying the predetermined space, if the second object information can be identified within a predetermined period of time, the second type of object is displayed in a display mode based on the second object information, and if the second object information cannot be identified within the predetermined period of time, a process is performed to display a substitute object corresponding to the second type of object;
The method , wherein the process for displaying the substitute object is executed when the predetermined space is displayed in response to a user newly entering a virtual space . A system including a computer for providing a virtual space to a user,
a display means for performing processing to display an image of the virtual space,
the virtual space includes a predetermined space in which a plurality of types of objects including a first type of object and a second type of object can be displayed;
The display means
when first object information for displaying the first type of object can be identified, performing a process for displaying the predetermined space regardless of whether second object information for displaying the second type of object can be identified;
when displaying the predetermined space, if the second object information can be identified within a predetermined period of time, the second type of object is displayed in a display mode based on the second object information, and if the second object information cannot be identified within the predetermined period of time, a process is performed to display a substitute object corresponding to the second type of object;
The system wherein the process for displaying the substitute object is executed when the predetermined space is displayed in response to a user newly entering the virtual space .