JP7706914B2 - Entertainment viewing management system and program - Google Patents

Description

The present invention relates to an entertainment viewing management system and program.

With the development of wearable image display devices such as head-mounted displays (hereinafter referred to as "HMDs") that are worn by users to display images, and the advancement of networks and communications, viewing environments are beginning to be developed that include content such as games and simulation systems that provide a more immersive and realistic experience of virtual worlds.

In addition, some of this content detects the viewer's gaze and reflects that gaze in a virtual space, allowing the viewer to communicate with a target character in the virtual space while watching the content.

In particular, recently known examples of this type of content include simulation games in which special effects are controlled for a target character in a game run by a player based on the player's action history (e.g., Patent Document 1), or content that introduces elements of a competitive game between multiple players (e.g., Patent Document 2).

JP 2018-94326 A JP 2018-77738 A

However, in systems that manage virtual events to be viewed in a virtual space, including those described in patent documents like this, there is basically nothing that controls the viewing position in the virtual space for any viewer (specifically, any player) to control the viewing environment for each viewer, and it is not possible to motivate viewers to improve or maintain their viewing environment by concentrating on watching entertainment such as games.

The present invention has been made to solve the above problems, and one of its objectives is to provide an entertainment viewing management system and program that can increase motivation to concentrate on watching entertainment and, as a result, encourage active engagement with the entertainment being viewed.

Another objective of the present invention is to provide an entertainment viewing management system and program that can realize new viewing behaviors using a virtual space that is different from real space, while increasing the viewer's interest in entertainment in the virtual space.

(1) In order to solve the above problems, the present invention provides
An entertainment viewing management system that allows viewers to view entertainment executed in a virtual space, comprising:
an execution control means for executing the entertainment;
a setting means for setting a position of a virtual camera that functions as a viewpoint of a viewer for viewing the entertainment from among a plurality of viewing positions that are provided in the virtual space and that are ranked according to viewing environment;
an image generating means for generating an image of the virtual space formed from the position of the virtual camera in the viewing direction of the viewer;
providing means for providing the generated image to the viewer;
Equipped with
The setting means:
The system is configured to execute a position control process that controls the position of the virtual camera of the viewer during viewing of the entertainment in accordance with at least one of viewer-related information indicating information about the viewer and the execution status of the entertainment, and a ranking of each viewing position.

With this configuration, the present invention can change the position of the virtual camera of a viewer who does not meet, during or before viewing, a given condition such as the viewer's entertainment viewing level, charge amount, number of comments, attributes, or conditions related to relationships with other viewers, or who does meet the given condition, to a lower or higher ranking position relative to the viewing environment, or can maintain the position of the virtual camera.

Therefore, the present invention uses a virtual space to provide a sense of realism similar to that of entertainment in a real space, while allowing the viewer to control the viewing environment through their own actions, such as improving the viewing environment (i.e., changing the viewing position to a better viewing environment) or maintaining the viewing environment, and can also worsen the viewing environment depending on the viewer's attitude toward entertainment (i.e., the viewing situation).

In other words, the present invention can increase the viewer's motivation to watch entertainment by allowing them to concentrate on watching the entertainment and maintain a good viewing environment, thereby encouraging active engagement with the entertainment being viewed.

In addition, the present invention enables new viewing behavior through a mechanism that is difficult to achieve in real space (changing the viewing position while watching), while increasing the viewer's interest in entertainment in a virtual space as a viewing environment different from real space.

In addition, "entertainment" includes, for example, games that are executed within a virtual space serving as a game space, performances by moving characters (specifically, idol-like character objects, etc.) or static objects (specifically, characters that only emit sound, etc.) that are placed within the virtual space and perform actions, and performances by actors that are executed within an imaged real space.

And "viewers" does not just mean users who watch entertainment as a performance, but also includes players who play the game if the entertainment is a game.

In addition, the "viewing position" may refer to, for example, a seat in the virtual space where entertainment is viewed, or a position in the virtual space that is determined when playing a game.

Furthermore, the "viewing environment" refers, for example, to the environment relative to the viewing position from which the viewer watches, and indicates the distance and direction in virtual space from the position where the entertainment is being performed (hereinafter referred to as the "execution position"), the presence or absence of obstacles and the condition of the equipment between the execution position and the viewing position, and the associated listening and viewing environments (including influences based on the viewing conditions of other viewers).

The "ranking" in "ranking of viewing positions" refers to a ranking determined, for example, according to the quality of the listening environment or viewing environment.

In addition to the above, "viewer-related information" includes information regarding the viewer's entertainment-related behavior (hereinafter referred to as "viewer behavior"), which changes while the virtual event is being carried out (hereinafter referred to as "viewer behavior information"), and information that identifies the viewer, including the viewer's attributes, etc. (hereinafter referred to as "viewer identification information"). However, it is preferable that the viewer identification information is also information that is input while watching entertainment or information that changes while watching.

For example, viewer behavior information may include input information (including current viewing and past viewing) input by the viewer to the entertainment,
(A1) Entertainment-related charges (including direct charges such as tips and indirect charges such as the purchase of items used in entertainment);
(A2) The type and number of comments entered about other viewers or comments entered by such other viewers (including those based on plug-in button inputs (buttons provided on the entertainment screen) that indicate the viewer's intention, such as "Like");
(A3) Use or consumption of items used in entertainment;
(A4) Whether or not you have participated in various events, and the number of times you have participated,
(A5) Viewers' entertainment viewing status,
It includes various information such as:

For example, the viewer identification information may include
(B1) Viewer attributes (age, generation, sex, game level, membership grade, and other viewer level, if any),
(B2) Attributes such as the type, level (character level), or characteristics of the character (e.g., the player character used in a game) used by the viewer for entertainment;
(B3) Friend relationships (for example, this refers to a relationship between "following" which allows easy access to information about other participants and following which allows easy access to information about one's own participant, including a relationship between "following and following"), or relationships with registered users, such as a viewer having an account on a specific network service and registering that account (for example, registering it as a "favorite" account) (hereinafter also referred to as "registered user relationships"), or the number of registered users,
(B4) In the case where the entertainment is available for group viewing (e.g., in the case of a game), attributes such as the team or group type or level (team level) of the group, and
(B5) Various information is included, such as the number of times the entertainment being viewed or entertainment related to the entertainment has been viewed, or the number of times the user has logged in to view (perform) the entertainment, etc. In particular, the viewer identification information includes information that is quantified based on information such as the relationship between registered users and the number of registered users (for example, a value (intimacy) that is predetermined for each registration type such as friends, etc.).

In addition, the "Entertainment Execution Status" includes, for example,
(C1) Execution of events that occur during the execution of entertainment, such as gaming events or other events;
(C2) The time elapsed from a predetermined timing such as the start of entertainment execution,
(C3) The progress of entertainment (in the case of a singing event, the degree of progress against a set list (song order list), or in the case of a game, the progress of task completion or item acquisition), and
(C4) the number of viewers watching entertainment;
etc.

Furthermore, "position control processing" includes, for example, not only changing the position of the virtual camera, but also maintaining the position of the virtual camera.

(2) The present invention also provides
The setting means:
The position control process is configured to execute, during viewing of the entertainment, (a) a change control process for changing the position of the virtual camera of the viewer to another viewing position, or (b) a maintenance control process for maintaining the viewing position of the viewer, depending on at least one of the viewer-related information and the execution status of the entertainment, and the ranking of each viewing position.

With this configuration, the present invention can change and maintain the viewing position of a viewer watching entertainment in a virtual space based on viewer-related information during or before viewing, allowing the viewer to get a sense of realism similar to that of entertainment in a real space using a virtual space, while also being able to control the viewing environment through the viewer's own actions, such as improving the viewing environment (i.e., changing the viewing position to a better viewing environment) or maintaining the viewing environment.

The present invention therefore increases the viewer's motivation to watch entertainment by allowing them to concentrate on watching the entertainment and maintain a good viewing environment.

(3) The present invention also provides
The setting means:
a determination process for determining whether or not a given determination condition is met with respect to at least one of the viewer-related information and an execution status of the entertainment during viewing of the entertainment; and
If it is determined by the determination process that the determination condition is met, the change control process for changing the position of the viewer's virtual camera in accordance with the ranking of each viewing position, or the maintenance control process for maintaining the position of the viewer's virtual camera, is executed as the position control process.

With this configuration, the present invention can automatically change the position of the viewer's virtual camera, i.e., the viewer's viewing position, to a position farther or closer to the entertainment playback position when a determination condition is met, such as when a certain period of time has passed since a given timing, when a certain amount of charge has been made (including tips and item purchases), or when both are met.

In addition, the present invention can maintain the position of the virtual camera when the above-mentioned judgment conditions are met, and can change the position of the virtual camera to a position farther away from the entertainment execution position when the judgment conditions are not met.

The present invention therefore increases the viewer's motivation to watch entertainment by allowing them to concentrate on watching the entertainment and maintain a good viewing environment.

In addition, the "judgment conditions" as viewer-related information include, for example,
(D1) Conditions regarding the type and number (amount) of items to be consumed (tipping items such as tips) and conditions regarding viewer behavior information such as viewer operation inputs,
(D2) conditions related to viewer identification information that changes during viewing, such as the viewer's level, the level of the team to which the viewer belongs, the number of viewers belonging to the team, or the number of registered friends, and (D3) a combination of (D1) and (D2),
etc.

In particular, conditions related to viewer behavior information include, for example:
(D1-1) Conditions for item consumption, such as the type and number (amount) of items to be consumed;
(D1-2) Conditions for entertainment charges, and
(D1-3) Conditions for the viewer's operation input information, such as whether or not a predetermined operation input or an input related to line of sight is performed, or the number of times such input is performed;
Includes:

Conditions regarding viewer identification information include, for example,
(D2-1) Conditions regarding the attributes of the viewer (game level or membership grade, if any),
(D2-2) Attributes such as the type, level (character level), or characteristics of the character (e.g., the player character used in a game) used by the viewer for entertainment;
(D2-3) Friend relationships or relationships with registered users who have registered accounts in a specific network service (hereinafter also referred to as “registered user relationships” or “degree of intimacy”), or the number of registered users;
(D2-4) In the case where the entertainment is available for group viewing, attributes such as the type and level (team level) of the team or group to which the entertainment belongs, and
(D2-5) The number of times the entertainment being viewed or entertainment related to the entertainment being viewed is viewed, or the number of times the entertainment is viewed or the number of times the entertainment is logged in to view (perform) the entertainment;
However, it is preferable that the viewer specific information varies during the entertainment.

In addition, the "judgment conditions" for the entertainment execution status include, for example,
(E1) Predetermined timing conditions, such as the timing of occurrence of an event occurring during the execution of entertainment, such as a game event or other event;
(E2) A condition regarding elapsed time, such as a time when a predetermined period of time has elapsed since a predetermined time, such as the start of entertainment execution,
(E3) Conditions for the progress of entertainment (in the case of a singing event, the degree of progress against a set list (song order list), or in the case of a game, the progress of task completion or item acquisition);
(E4) Conditions relating to viewers, such as the number of viewers watching the entertainment, and (E5) combinations of (E1) to (E4) are included.

Furthermore, the "determination conditions" as both the viewer-related information and the entertainment execution status include, for example, a combination of any of the conditions (D1) to (D4) and any of the conditions (E1) to (E5).

(4) The present invention also provides
The setting means:
The position control process is configured such that, when the position of the virtual camera for a first viewer is changed from a first position to a second position different from the first position, the position of the virtual camera for a second viewer that was set to the second position is changed to a position different from the second position.

With this configuration, the present invention can, for example, replace the viewing position of a viewer who meets a certain condition with the viewing position of a viewer who does not meet that condition.

In other words, the present invention can introduce a competitive principle to secure the best viewing position among each viewer, thus not only encouraging active participation in the entertainment being viewed, but also incorporating a gamification element into the viewing of that entertainment.

The present invention therefore provides a mechanism that is difficult to realize in real space, and new viewing behaviors that accompany it, thereby increasing viewers' interest in entertainment.

Note that "a position different from the second position" refers not only to the first position but also to other positions.

(5) The present invention also provides
The system further comprises an object control means for controlling objects including a viewer character that is an operation target of each viewer placed in the virtual space and is placed at the viewing position of each viewer.

With this configuration, the present invention can provide each viewer with a sense of realism that makes them feel as if they are actually in a virtual space.

Note that the "position control process" when placing a viewer character at a viewing position refers to a process of changing the position of the viewer character, which is the avatar of the viewer, placed at the viewing position in the virtual space.

(6) The present invention also provides
a comparison means for performing a comparison process for comparing the viewer-related information of each viewer during the entertainment;
The setting means:
The position control process includes controlling the position of a virtual camera for each viewer in accordance with a comparison result of the viewer-related information and the ranking of the viewing positions.

With this configuration, the present invention can set the position of the viewer's virtual camera relative to the other viewer, introducing a competitive principle to ensure the best viewing position among each viewer, while also ensuring that each viewer is set to a position that is reliably ranked.

(7) The present invention also provides
The viewer-related information includes:
viewer behavior information relating to the viewer's behavior with respect to the entertainment, the viewer behavior information varying during the performance of the entertainment; and
Viewer identification information for identifying the viewer;
The present invention has a configuration including at least one of the above.

With this configuration, the present invention can control the improvement of the viewing environment (i.e., changing the viewing position to a better viewing environment) or the maintenance of the viewing environment based on the viewer's behavior while viewing or before viewing, or viewer-specific information (including information that changes while viewing).

(8) The present invention also provides
The viewer behavior information is
The behavioral information input during viewing of the entertainment is item consumption behavioral information relating to consumption of items used in the entertainment.

With this configuration, the present invention allows viewers who are more active and who have a higher opinion of entertainment, such as those who give tips while watching, to have a better viewing environment, thereby increasing the viewer's motivation to concentrate on watching the entertainment and maintain a good viewing environment.

Note that an "item" refers to something that can be used in a virtual space while watching entertainment, for example.

In addition, "consuming an item" indicates that the item disappears as soon as it is provided, assuming that a specific process is carried out.

(9) The present invention also provides a method for producing a semiconductor device comprising the steps of:
The setting means:
When executing the position control process, a viewing situation of the viewer is detected;
changing a parameter determined by the item consumption behavior information as the viewer-related information based on the detected viewing status of the viewer;
The position control process is executed in accordance with the changed parameters of the item consumption behavior information.

With this configuration, the present invention can affect the viewer's viewing conditions when improving the viewing environment (i.e., changing the viewing position to a better viewing environment) or maintaining the viewing environment.

For example, in the present invention, when the viewing positions of viewers ranked according to item consumption behavior involving charges are controlled to be changed to good or bad viewing positions, even if the same amount of items are consumed, a viewer in a good viewing situation (e.g., a viewer who is judged to be contributing to the performance of the entertainment) can be changed to a position with a better viewing environment (i.e., a position with a higher ranking, a position with a larger range of jump up in ranking) than a viewer in a bad viewing situation (e.g., a viewer who is judged not to be contributing to the performance of the entertainment).

The present invention therefore increases the viewer's motivation to watch entertainment by allowing them to concentrate on watching the entertainment and maintain a good viewing environment.

In addition, the "viewer situation" includes, for example,
(F1) The type and attributes of the avatar or character you are using,
(F2) The value of a parameter set by the viewer, such as a level (in the case of a game, points, experience points, amount of life energy, etc.),
(F3) Length of viewing time;
(F4) Number of position changes, and
(F5) current viewing position,
etc.

In particular, the "viewer's situation" basically includes the situations of other viewers, and uses the difference between the above-mentioned situations (F1) to (F5) of other viewers (for example, the difference in viewing time or the difference in the number of position changes), but it is also possible to use the situation of other viewers by adding the situation of other viewers to one's own viewer's situation. However, it is preferable for the viewer situation to change while the entertainment is being played.

In addition, "changing the parameters to be advantageous to the viewer" refers to changing the parameters determined by the item consumption behavior information in a direction that is advantageous to the viewer's viewing environment when performing the viewer's position control process.

(10) The present invention also provides a method for producing a semiconductor device comprising the steps of:
The system further comprises a criterion changing means for changing a criterion value set for the item consumption behavior information when the position control process is executed, based on the viewing status of the viewer.

With this configuration, the present invention can change the reference value at which a change process occurs when executing the position control process, or the value of a parameter determined by item consumption behavior information, depending on the viewing status of the viewer who is the target of the position control process, the viewing status of other viewers (viewers who are competitors or allies of the target), or the viewing status of both.

For example, when an item consumption action involving a charge is performed, the present invention can change the charge amount for performing the item consumption action, change the reference value based on the item consumption action for performing the position control process (i.e., the above-mentioned judgment condition), or change the reference value of the item consumption action for determining the order of the viewing position to which the change is made when performing the position control process.

The present invention therefore increases the viewer's motivation to watch entertainment by allowing them to concentrate on watching the entertainment and maintain a good viewing environment.

The "reference value" may refer to, for example, the amount of money required to purchase an item for executing the position control process, a reference value for initiating the position control process (i.e., the value that defines the above-mentioned judgment condition), or a reference value for the amount of change when changing the ranking of the corresponding viewing position to another viewing position in the position control process.

(11) The present invention also provides a method for producing a semiconductor device comprising the steps of:
The setting means:
The present invention provides a position control process for a first viewer belonging to a group consisting of one or more viewers, and when input of item consumption behavior information as viewer-related information of a second viewer who belongs to the same group as the first viewer and is different from the first viewer satisfies given input conditions, the position control process for the first viewer is executed according to the item consumption behavior information of the second viewer, as well as the item consumption behavior information as viewing-related information of the first viewer and a ranking of each viewing position.

With this configuration, the present invention can provide special effects, such as an improved viewing environment, when entertainment is viewed by a team or group made up of multiple viewers, for example, when viewers belonging to a team cooperate to consume items.

The present invention therefore encourages the creation of groups and communication between viewers, thereby stimulating entertainment viewing.

The "input condition" includes, for example, that the item consumption behavior information of the second viewer is input before the item consumption behavior information of the first viewer is input, and that a predetermined amount of the item indicated by the item consumption behavior information is input by the first viewer, the second viewer, or both (i.e., a predetermined amount (number) of items is consumed). However, the input condition may also include an additional condition that the item consumption behavior information of the first viewer is input before the item consumption behavior information of the second viewer, or that the item consumption behavior information of the first viewer, the second viewer, or both is input within a certain period of time.

(12) The present invention also provides a method for producing a semiconductor device comprising the steps of:
The setting means:
Setting the viewing position of each viewer in a group consisting of one or more grouped viewers to the same viewing position;
aggregating viewer-related information of each of the viewers grouped and set to the same viewing position when performing the position control process;
The position control process is executed for the viewing positions of the group in accordance with the collected viewer-related information and the ranking of each viewing position.

With this configuration, the present invention can realize viewing management of entertainment even when entertainment is viewed by a team of multiple viewers (for example, when a team plays a game as entertainment).

Note that the "groups" may be pre-grouped before the entertainment is performed, or may be grouped during the entertainment.

Furthermore, "groups" may be generated by the will of each viewer, or may be automatically grouped based on attributes associated with each viewer (such as the attributes of the viewer or their character, as described above).

Furthermore, "collecting viewer-related information for each viewer" refers to compiling viewer behavior information for each viewer or viewer-specific information including viewer attributes, and indicates that when numerical values are used, they are to be added together, and that the presence or absence and number of each type of viewer-specific information are to be collected.

(13) The present invention also provides a method for producing a semiconductor device comprising the steps of:
The system further includes a reception processing means for receiving an operation input from an operation manager,
The setting means:
The position control process for changing the position of the viewer's virtual camera is executed in response to the accepted operation input from the operation manager.

With this configuration, the present invention allows an administrator or operator to directly control the viewing environment of viewers in order to control characters performing as entertainment, as well as to take special measures such as providing bonuses, imposing penalties, or correcting various errors.

The "operator" may be, for example, an actor who plays the gazed-at character, an administrator who controls the gazed-at character, or an operator who operates the entertainment.

"Gaze characters" also include characters that are gazed upon by the viewer and are generally controlled by a computer, such as moving characters who perform in a virtual space, such as idols, or characters (including not only dynamic but also static objects) that confront the viewer (the player in the case of a game) according to a pre-set scenario (RPG or mystery game).

(14) The present invention also provides a method for producing a semiconductor device comprising the steps of:
The system is configured to display an image relating to the gaze character generated by the image generation means on a display means for the operator, and further includes a display control means for displaying viewer-related information for each viewer in correspondence with the viewing position of the viewer.

With this configuration, the present invention can easily provide the operator with viewer-related information for each viewer, thereby reducing the complexity involved when an administrator or manager directly controls the viewing environment of a viewer.

(15) The present invention also provides a method for producing a semiconductor device comprising the steps of:
The setting means:
When the viewer-related information is information regarding the consumption of an item and the location control process is executed by consuming the item, and when the operator approves the use of the item to be consumed in the location control process, the location control process of the viewer is executed.

With this configuration, the present invention allows the operator to organize the information even when there are a large number of viewers and it becomes difficult to identify the provider of the tip item provided as viewer-related information and the amount provided, so that even in such cases, the viewing position of each viewer can be accurately controlled.

(16) The present invention also provides a method for producing a semiconductor device comprising the steps of:
detection means for detecting a position of the viewer's virtual camera and a dwell time of the viewer's virtual camera position during viewing of the entertainment;
a viewing record management means for managing information indicating the viewing record of the viewer as viewing record information based on the detected position of the virtual camera of the viewer and the stay time of the virtual camera at the position of the viewer;
Further comprising:
The providing means comprises:
The managed viewing record information is provided to the relevant viewer.

With this configuration, the present invention provides or stores each viewer's viewing history as information, and allows each viewer to recognize the viewer's objective situation regarding the viewing of the entertainment, thereby increasing the viewer's motivation to watch the entertainment.

It is preferable that the "viewing record information" provided to the viewer is information for visualizing the transition when the position of the virtual camera is changed.

For example, the "viewing history information" may be information that assigns points (benefits) or ranks the above transitions (information that can be compared with other viewers), or it may be information that visualizes the history on an overall map of the spectator seats and indicates the superiority or inferiority of the viewer compared to other viewers.

(17) In order to solve the above problems, the present invention provides a method for producing a liquid crystal display comprising the steps of:
A program for managing entertainment viewing that allows a viewer to view entertainment executed in a virtual space, comprising:
an execution control means for executing said entertainment;
a setting means for setting a position of a virtual camera that functions as a viewer's viewpoint for viewing the entertainment from among a plurality of viewing positions that are provided in the virtual space and that are ranked according to viewing environment;
an image generating means for generating an image of the virtual space formed in a viewing direction of the viewer from the position of the virtual camera; and
providing means for providing the generated image to the viewer;
The computer functions as
The setting means:
The system is configured to execute a position control process that controls the position of the virtual camera of the viewer during viewing of the entertainment in accordance with at least one of viewer-related information indicating information about the viewer and the execution status of the entertainment, and a ranking of each viewing position.

With this configuration, the present invention can increase the viewer's motivation to watch the entertainment by allowing them to concentrate on watching the entertainment and maintain a good viewing environment, thereby encouraging active engagement with the entertainment being viewed.

In addition, the present invention enables new viewing behavior through a mechanism that is difficult to achieve in real space (changing the viewing position while watching), while increasing the viewer's interest in entertainment in a virtual space as a viewing environment different from real space.

1 is a configuration diagram showing a schematic configuration of an embodiment of a virtual space event management system according to the present invention; FIG. 1 is a diagram for explaining an overview of a game according to an embodiment. FIG. 2 is a functional block diagram illustrating a configuration of a server device according to an embodiment. FIG. 2 is a functional block diagram illustrating a configuration of a terminal device according to an embodiment. FIG. 2 is a diagram illustrating an example of an external configuration of a terminal device according to an embodiment. FIG. 11 is a diagram (part 1) for explaining a position control process during a virtual event executed by a server device of an embodiment. FIG. 2 is a diagram (part 2) for explaining the position control process during a virtual event executed by the server device of an embodiment. FIG. 13 is a diagram for explaining a modified example (position control process based on the viewing status of a viewer) of an embodiment. FIG. 13 is a diagram for explaining a modified example of an embodiment (position control process based on the same viewing position of multiple viewers). 11 is a flowchart showing the operation of a vent execution process specialized for a position control process executed by a server device according to an embodiment;

The following describes an embodiment of the present invention, which is an embodiment in which an entertainment viewing management system according to the present invention is applied to an event management system in a virtual space that allows a plurality of viewers to wear HMDs (head mounted displays) as wearable image display devices and to perform entertainment such as games and performances (acting and singing) in a virtual space (virtual three-dimensional space).

Note that the embodiment described below does not unduly limit the content of the present invention described in the claims. Furthermore, not all of the configurations described in this embodiment are necessarily essential components of the present invention.

[1] Virtual Space Event Management System [1.1] Overview First, an overview and a general configuration of a virtual space event management system 1 according to the present embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of a system configuration showing the configuration of a virtual space event management system 1 according to the present embodiment.

The virtual space event management system 1 of this embodiment is a system that provides a VR experience (virtual reality experience) as an event (hereinafter referred to as a "virtual event") in which a participant character (i.e., a viewer character, hereinafter referred to as an "avatar") appears for each participant (i.e., a viewer watching a virtual event, hereinafter referred to as a "viewer") in a virtual space, and the viewer is made to feel as if the character is present around the viewer.

In particular, the virtual space event management system 1 of this embodiment is configured to provide a three-dimensional, stereoscopically visible simulation as a virtual event, with the theme of the viewer watching a live stage (hereinafter also referred to as a "stage") where a virtual acting performance (specifically, a singing live performance) is being performed as one of the fans of a virtual three-dimensional idol (so-called a character object that is gazed upon by the viewer and which performs a predetermined performance in a virtual three-dimensional space (hereinafter referred to as an "acting character")).

In other words, the virtual space event management system 1 of this embodiment is configured to provide an event that includes gazing at an acting character that performs an action of directing its gaze toward a viewer in the virtual three-dimensional space (i.e., toward the position of the virtual camera) or an action that is provided specifically for the viewer (a fan service action toward the viewer when the acting character and the viewer have a relationship of idol and fan, hereinafter referred to as "fan service").

In addition, the virtual space event management system 1 includes:
(A1) A 3D display of the generated virtual three-dimensional space is performed on an HMD (a wearable image display device) that has a structure that covers the viewer's field of vision and allows the viewer to view an image of the virtual three-dimensional space,
(A2) controlling a virtual camera that functions as a viewpoint for each viewer based on the posture of the HMD;
(A3) accepting input from a viewer wearing the HMD, including the viewing direction (i.e., the line of sight direction) of the viewer, and executing various controls;
It has a structure that progresses the event.

Specifically, as shown in FIG. 1, the virtual space event management system 1 is configured to include a server device 10 that executes various processes to realize a virtual event in a virtual three-dimensional space, and a plurality of terminal devices 20 (e.g., terminal devices 20A, 20B, 20C) that have an HMD worn by each viewer and allow the viewer to experience an event in the virtual three-dimensional space using data transmitted from the server device 10 via the network, and are connectable to a network such as the Internet.

The server device 10 is an information processing device that executes various processes to realize virtual events that are executed using, for example, an API (application programming interface) or a specific platform, etc.

Furthermore, the server device 10 may be configured with one (device, processor) or multiple (devices, processors).

The billing information, viewer-related information, and other information stored in the memory area of the server device 10 (memory unit 140, described later) may be stored in a database (broadly speaking, a storage device, memory) connected via a network (intranet or the Internet), and event information and other information stored in the memory area may be stored in a database (broadly speaking, a storage device, memory) connected via a network (intranet or the Internet).

In particular, the server device 10 receives input information based on operations (viewer input) of users of each terminal device 20 (i.e., viewers participating in the virtual event), and performs processing to realize a virtual event in a virtual three-dimensional space based on the received input information.

The server device 10 then transmits to each terminal device 20 an image (including data for displaying the image) of the space in which the event is to be executed (i.e., the event space) rendered into a three-dimensional image, and various data related to the event execution process.

Each terminal device 20 has an HMD unit 200 and a terminal control unit 300, and is a device that allows users to experience a virtual event in a virtual three-dimensional space by displaying a virtual three-dimensional image of the event space and providing a performance or the like in the virtual three-dimensional space.

In addition, each terminal device 20 is composed of an information processing device such as a smartphone, a mobile phone, a PHS, a computer, a game device, a PDA, a portable game device, an image generating device, etc., and is a device that can be connected to the server device 10 via a network such as the Internet (WAN) or a LAN. The communication line between the terminal device 20 and the server device 10 may be wired or wireless.

In addition, each terminal device 20 has a configuration including a communication control function for communicating with the server device 10, a function for controlling display using data received from the server device 10, and a function for transmitting operation information input by the viewer to the server device 10.

Each terminal device 20 is configured to provide a virtual event to viewers based on the information transmitted from the server device 10.

[1.2] Description of Virtual Event Next, an overview of a virtual event realized by this embodiment as a VR experience will be described with reference to Fig. 2. Fig. 2 is a diagram for explaining the overview of the virtual event of this embodiment.

The virtual three-dimensional space 11 is constructed as a virtual space (virtual three-dimensional space), for example as shown in FIG. 2(A), and the virtual three-dimensional space 11 includes a stage 4, which is the performance area for the live stage, and a number of spectator seats 6, in which the viewer avatars 5 are positioned.

One or more NPCs (non-avatar idol characters 8 (acting characters)) perform on stage, and the viewer 2 can focus on the performance of the idol characters 8 via the avatar 5.

In other words, avatar 5 is a viewer character that is operated by each viewer placed in the virtual space and is placed at the viewing position of each viewer.

The content of the live stage is a live performance such as singing songs, playing musical instruments, dancing, street performance, etc. For example, in this embodiment, a live performance of singing a song with choreography is performed.

Stage 4 can be set as appropriate, for example, an outdoor stage, a concert hall, a live music venue, etc. Depending on the content of the virtual event, it is also possible to set situations such as a stage in a school gymnasium, a podium in a classroom, the bed of a truck, or a deck.

The seats 6 are seats in a virtual space, and are viewing positions (i.e., viewing positions) from which the live stage is viewed. In principle, a large number of seats, each seat for one person, are prepared at the venue of one live stage. The layout of the seats 6 can be set appropriately according to the design of the stage 4.

The seats 6 are assigned to viewers for each virtual event, and each seat in the seats 6 is associated with a viewer's ID and stored as seat information in the server device 10.

Avatars 5, each playing the role of an idol's fan, are placed in the spectator seats 6, and viewers participate in the virtual event by associating themselves with at least one of the avatars 5, each of which has a preset appearance, appearance, item, etc.

Note that FIG. 2(A) shows an example in which the spectator seats 6 are set up as standing room only. However, they may also be seated.

In addition, each seat in the spectator seats 6 is ranked from best to worst in terms of the viewing environment relative to the viewer's viewing position, which indicates the distance and direction in virtual space from the position where the virtual event is being carried out (hereinafter referred to as the "execution position" and stage 4 above), the presence or absence of obstacles and the condition of the facilities between the execution position and the viewing position, and the associated listening and viewing environments (including influences based on the viewing conditions of other viewers).

In other words, each seat 6 is assigned a predefined ranking based on the quality of the listening and viewing environments.

For example, each seat may be individually ranked from highest to lowest, or multiple seats may be ranked (graded) together.

Then, at each seat in the spectator seats 6, an avatar 5 of a viewer is set that corresponds to the seat that is ranked based on the result of a given game for each viewer, their progress, costs such as the amount charged for an event, or the result of a lottery event.

In contrast, in this embodiment, during the event, the avatar 5 moves from the seat in which it is set to another seat in accordance with the information of each viewer (specifically, variable parameters, etc.).

In other words, in this embodiment, a position control process is executed to control the viewing position of each viewer during the event.

Details about the position control process that is performed during an event in this embodiment will be described later.

The gender, age, and number of idol characters 8 performing the act can be set as appropriate. In particular, in this embodiment, the idol characters 8 are made up of a duo consisting of a first idol character (first acting character) 8A and a second idol character (second acting character) 8B, as shown in FIG. 2(A). However, they may be made up of a single person, or a group of three or more people.

In particular, in this embodiment, the idol character 8 performing the act may perform the act based on operational input from the administrator of the virtual event (including not only the administrator who manages the virtual event, but also the operator of the virtual event, or an operator or distributor commissioned by the administrator or operator), or may be automatically controlled by a program.

Each avatar 5 is automatically controlled to synchronize with and link to the viewer's movements detected by the HMD unit 200 worn by the viewer 2, for example, as shown in FIG. 2(B).

Specifically, the head posture of the avatar 5 is synchronized with the head posture of the viewer 2 detected by the HMD unit 200, the line of sight of the avatar 5 is synchronized based on the viewing direction (line of sight) of the viewer detected by the HMD unit 200, and the avatar 5 in the virtual three-dimensional space 11 is automatically controlled based on these viewer inputs.

At the position of the avatar 5 in the virtual three-dimensional space 11, virtual cameras for the right and left eyes, whose shooting angle of view and depth of field are set to correspond to the human viewing angle, are set to face the head, and the images captured by these cameras are displayed on the HMD unit 200 (specifically, the right-eye display panel 261 and the left-eye display panel 262, which will be described later). Therefore, the viewer 2 can view the image in the virtual three-dimensional space 11 as a three-dimensional image through the eyes of the avatar 5 by changing the direction and posture of his or her head and the direction of his or her line of sight.

In addition, an avatar 5 corresponding to each viewer is placed in each seat of the bleachers 6. However, even in bleachers 6 where no avatar 5 is placed, an NPC is automatically placed there and automatically controlled by the computer to behave as a fan of the idol.

Furthermore, in the virtual event of this embodiment, the avatar 5 associated with each viewer may or may not be displayed in the virtual three-dimensional image provided to each viewer, and similarly, the avatars 5 of other viewers may or may not be displayed in the three-dimensional image provided to the viewer.

[2] Server device First, the outline and configuration of the server device 10 of this embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram showing functional blocks of the server device 10 of this embodiment. Also, the server device 10 of this embodiment may have a configuration in which some of the components (each unit) of Fig. 3 are omitted.

The server device 10 includes a server processing unit 100 that executes processing to provide virtual events in a virtual three-dimensional space, an input unit 120 for use in input from an administrator and others, a display unit 130 that performs specified displays, a memory unit 140 that stores data on the virtual event and each viewer, an information storage medium 180 in which specified information is stored, and a communication unit 196 that communicates with terminal devices 20 and others.

The input unit 120 is used by a system administrator or the like to input settings related to virtual events and other necessary settings and data. For example, the input unit 120 in this embodiment is configured with a mouse, keyboard, etc.

In particular, the input unit 120 accepts operational input from the administrator. For example, the input unit 120 accepts operational input for controlling the operation of an acting character, instructions for setting the position of the virtual camera (i.e., the viewing position) for each viewer when the viewer starts watching a virtual event, and instructions for changing the virtual camera (including instructions for the destination of the change) when executing a position control process.

The display unit 130 displays an operation screen for the system administrator. For example, the display unit 130 in this embodiment is configured with a liquid crystal display or the like.

The information storage medium 180 (a computer-readable medium) stores programs, data, etc., and its functions are realized by optical disks (CD, DVD), magneto-optical disks (MO), magnetic disks, hard disks, magnetic tapes, or memory (ROM), etc.

The communication unit 196 is a device that performs various controls for communicating with the outside (e.g., a terminal, another server, or another network system), and its functions are configured by hardware such as various processors or communication ASICs, programs, etc.

The memory unit 140 serves as a work area for the server processing unit 100, the communication unit 196, etc., and its functions are realized by RAM (VRAM) etc. The information stored in the memory unit 140 may be managed by a database.

In addition, in this embodiment, the memory unit 140 stores a main memory unit 142 used as a work area, a performance information memory unit 144 related to the performance in the virtual event to be provided, a viewer-related information memory unit 146 related to each viewer, a seat information memory unit 148 showing information on the seats 6, and a storage unit 149 for images related to the virtual event (hereinafter referred to as "event images") such as images viewed from each virtual camera during the virtual event (hereinafter referred to as "virtual camera images"). However, in addition to the above information, the memory unit 140 stores various information necessary for calculations related to the event.

In particular, the viewer-related information storage unit 146 stores the following information for each viewer in association with the viewer ID:
(A1) Viewer attributes such as name, age, sex, and account information for billing settlement, and information about the viewer himself/herself (hereinafter referred to as "viewer identification information") including information about the avatar (hereinafter referred to as "avatar information");
(A2) Information regarding the viewer's behavior regarding the event (hereinafter referred to as "viewer behavior"), which changes during the execution of the virtual event (hereinafter referred to as "viewer behavior information");
is stored

The avatar information includes various information for setting the avatar, such as the basic shape (basic shape (including size) of a person, animal, or robot, appearance (including color) such as hairstyle and makeup, and hairstyle), and owned items (clothes, accessories, possessions (towels and glow sticks)).

The seating information storage unit 148 contains data regarding the ranking (rank or grade) of each seat.

The server processing unit 100 performs various processes using the main memory unit 142 in the memory unit 140 as a work area. The functions of the server processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.) and ASICs (gate arrays, etc.), or by programs.

The server processing unit 100 performs various processes of this embodiment based on programs (data) stored in the information storage medium 180. That is, the information storage medium 180 stores programs for causing a computer to function as each part of this embodiment (programs for causing a computer to execute the processes of each part).

For example, the server processing unit 100 (processor) controls the entire server device 10 based on the program stored in the information storage medium 180, and performs processes such as controlling the execution of virtual events, special performance control, image generation, and sound generation.

The server processing unit 100 also performs processes to control the execution of a virtual event, such as starting a virtual event when a virtual event start condition is met, progressing the virtual event, placing various objects in an object space (three-dimensional space) such as a character or map, displaying objects, calculating the results of the virtual event, or terminating the virtual event when a virtual event termination condition is met.

Specifically, the server processing unit 100 of this embodiment has at least a communication control unit 101, a viewer management unit 102, a display control unit 103, an information acquisition unit 104, a viewer behavior management unit 105, a virtual camera control unit 106, a sound generation unit 107, an image generation unit 108, an information provision unit 109, an event control unit 110, and a timer unit 160.

For example, the event control unit 110 of this embodiment constitutes the execution control means, reception processing means, setting means, object control means, comparison means, and criterion change means of the present invention, and the display control unit 103 constitutes the display control means of the present invention. Also, for example, the information acquisition unit 104 of this embodiment constitutes the detection means of the present invention, and the image generation unit 108 constitutes the image generation means of the present invention. Furthermore, for example, the information provision unit 109 of this embodiment constitutes the provision means of the present invention.

The communication control unit 101 performs processing to transmit and receive data to and from the terminal device 20 via a network. That is, the server device 10 performs various processing based on various information, including viewer operation information, received by the communication control unit 101 from the terminal device 20, etc.

The viewer management unit 102 handles processes related to viewer registration procedures (including login settings, etc.) and manages the storage of data linked to accounts (viewer IDs).

Specifically, the viewer management unit 102 controls the allocation of accounts when a viewer registers, manages registration information to register and manage personal information about the viewer, sets up a virtual account linked to the account and used as a source of funds for payment of the fees related to the execution of billing elements and controls deposits and withdrawals, registers the billing history related to billing elements by the viewer of the account, and stores and manages event progress information related to the progress of a virtual event by linking it to the account.

The display control unit 103 displays on the display unit 130 images related to the viewer's current viewing and virtual events currently taking place.

In particular, the display control unit 103 executes processing to superimpose information about the corresponding viewer's virtual space onto an image generated by the image generation unit 108 with the virtual camera for each viewer as the viewpoint, and display the superimposed information on the display unit 130.

The information acquisition unit 104 acquires various pieces of information necessary for the processing of the server processing unit 100. In other words, it performs a process of accepting this information. For example, the information acquisition unit 104 acquires viewer operation information from each terminal device 20.

Specifically, the information acquisition unit 104 acquires viewer operation information including viewer's gaze information based on image information captured by the imaging unit 210 of the HMD unit 200 in the terminal device 20 during the virtual event, information detected by the HMD unit 200 (motion sensor 220 described below) (hereinafter referred to as "motion detection information"), and information on switch inputs input in conjunction with the virtual event while viewing the virtual event (hereinafter referred to as "switch input information").

In particular, the information acquisition unit 104 may acquire information about each of the three axes of the viewer's head as motion detection information using the HMD unit 200, and obtain information about the direction in which the viewer's head is facing as gaze information by calculating the rotation angle around the three axes based on the acquired motion detection information, or may acquire imaging information that captures the direction of the viewer's eyeballs, and while performing a predetermined image processing on the acquired imaging information, acquire gaze information indicating the viewer's gaze direction using the direction of the viewer's head calculated based on the motion detection information.

The information acquisition unit 104 may acquire the gaze information based on operation information from the input unit 260 (e.g., a controller) of the terminal device 20. For example, the information acquisition unit 104 may acquire (identify) the gaze information based on operation information obtained by the viewer operating a directional key, an analog stick, or an operation button provided on the input unit 260.

In addition to the motion detection information of the HMD unit 200, the viewer's line of sight information may be obtained using images captured by an imaging unit (not shown) of multiple light-emitting elements (LEDs) of a light-emitting unit (not shown).

Furthermore, the viewer's gaze information may be detected using information other than the motion detection information of the HMD unit 200. For example, a depth sensor capable of detecting depth information in three-dimensional space may be provided in an imaging unit (not shown), and the viewer's skeleton information may be extracted using a color image from a color image sensor and the depth information from the depth sensor, and the viewer's gaze information may be obtained using the extracted skeleton information.

The viewer behavior management unit 105 manages, for each viewer, event-related behavior such as participation in related events (such as participation in the same event in the past) and purchase of event goods for the event to be attended, based on the viewer's instructions, and registers information related to the event, including the type and timing of the behavior, in the viewer-related information storage unit 146 (behavior history information) in association with the viewer ID.

In addition, for behaviors that involve charges, such as product purchases, among the behaviors that it manages, the viewer behavior management unit 105 registers the charging information in the viewer-related information storage unit 146 (charging history information) that corresponds to the viewer ID.

Then, the viewer behavior management unit 105 executes a billing process for the billing elements during the virtual event, and executes a process (hereinafter referred to as "billing process") of storing information related to the billing (i.e., the billing information) in the viewer-related information storage unit 146 as a billing history.

In particular, the viewer behavior management unit 105 executes a process of calculating the cumulative charge amount during the execution of a virtual event for each viewer based on billing history information in which billing information is registered as a history, or a process of calculating the amount of items consumed during a virtual event, such as tipping items, and the amount when such consumption is converted into a charge amount (hereinafter also referred to as "charge amount based on item consumption behavior").

Then, the viewer behavior management unit 105 stores the charge amount calculated in each process in the viewer-related information storage unit 146, or updates the charge amount calculated in each process from the charge amount information already stored in the viewer-related information storage unit 146.

In addition, the viewer behavior management unit 105 requests billing by using virtual currency or points, or a credit card or prepaid card, and executes each billing process based on the viewer's instructions.

The virtual camera control unit 106 performs control processing of a virtual camera (viewpoint, reference virtual camera) to generate an image that can be seen from a predetermined seat position (i.e., a viewing position where the viewer's avatar is located) in the object space (i.e., virtual space).

Specifically, processing is performed to control the position (X, Y, Z) or rotation angle (rotation angle around the X, Y, Z axes) of the virtual camera (processing to control the viewpoint position, line of sight direction, or angle of view).

The image generation unit 108 performs drawing processing based on the results of various processes (virtual event processing, simulation processing) performed by the server processing unit 100, thereby generating an image, and transmits the generated image data to the terminal device 20.

In particular, the image generation unit 108 generates an image in a virtual space that is visible from the corresponding viewing position for each viewer.

Specifically, the image generation unit 108 performs geometry processing such as coordinate transformation (world coordinate transformation, camera coordinate transformation), clipping, perspective transformation, or light source processing, and creates drawing data (position coordinates of vertices of primitive surfaces, texture coordinates, color data, normal vectors, alpha values, etc.) based on the results of this processing. Then, based on this drawing data (primitive surface data), the object (one or more primitive surfaces) after perspective transformation (after geometry processing) is drawn in a drawing buffer (not shown) (a buffer that can store image information in pixel units, such as a frame buffer or work buffer). This generates an image that can be seen from the virtual camera (a given viewpoint) in the object space.

The drawing process performed by the image generation unit 108 can be realized by vertex shader processing, pixel shader processing, etc.

Then, the image generating unit 108 generates parallax images (for the right eye and the left eye) to realize stereoscopic vision by allowing the viewer wearing the HMD unit 200 to view an image in a virtual three-dimensional space having a predetermined amount of parallax with both eyes.

The sound generation unit 107 performs sound processing based on the results of various processes performed in the server processing unit 100, generates virtual event sounds such as background music, sound effects, or voice, and outputs them to the HMD unit 200 (specifically, the sound output unit 240) via the communication unit 196.

The information providing unit 109 provides data (content data) for viewing a virtual event to each terminal device 20 by incorporating the sound generated by the sound generating unit 107 into the image generated by the image generating unit 108, and associates the data with each viewer.

In addition, the information providing unit 109 provides the relevant terminal device 20 with the information necessary for viewing the virtual event in association with each viewer.

The event control unit 110 performs various processes related to managing the execution of virtual events. In this embodiment, the event control unit 110 communicates with the terminal device 20 and controls the provision of data necessary for playing the virtual event.

Specifically, the event control unit 110 includes an event management unit 111, a viewing position control unit 112, an avatar setting unit 113, an object control unit 114, and an avatar line of sight control unit 115.

For example, the event management unit 111 constitutes the execution control means and the criteria change means of the present invention, and the viewing position control unit 112 constitutes the setting means and the comparison means of the present invention. Also, for example, the object control unit 114 of this embodiment constitutes the object control means of the present invention.

The event management unit 111 performs various processes related to the execution of virtual events, including the start and end processing of the performance of the acting character, and the processing for executing each virtual event.

In particular, when executing a virtual event including the performance of an acting character, the event management unit 111 sets a live stage in a virtual three-dimensional space where the acting character performs based on the viewer's operational input, and executes various controls such as the playback of music and lighting during the performance (i.e., during the performance) in which the acting character performs on the set live stage.

The viewing position control unit 112 sets the position of the viewer's avatar on the live stage set by the event management unit 111, i.e., the viewing seats relative to the stage, based on the viewer's operational input, and sets virtual cameras (for the right eye and the left eye) that serve as the viewpoints of the viewer corresponding to that viewing position.

The viewing position control unit 112 of this embodiment sets the viewing positions (i.e., the viewing positions, which are the positions of the virtual camera) by reserving and designating viewing seats prior to the opening of the live stage, and executes a position control process that controls the viewing positions (the positions of the virtual camera) of each viewer during the event according to viewer-related information indicating information about the viewer and a predetermined ranking of each viewing position.

The viewing position control unit 112 may compare the viewer-related information of each viewer and perform position control processing while the virtual event is being carried out.

In addition, the viewing position control unit 112 sets the viewing position (spectator seats) at the start of viewing of the virtual event while the virtual event is being executed, based on the administrator's operational instructions received by the input unit 120, and while the virtual event is being executed, executes position control processing according to at least one of the viewer-related information of each viewer and the execution status of the virtual event, and the predetermined ranking of each viewing position.

The avatar setting unit 113 sets an avatar associated with the viewer based on the viewer's operational input, and registers the set avatar in the viewer-related information storage unit 146.

Specifically, the avatar setting unit 113 performs settings for dressing the avatar, such as the basic shape (basic shape (including size) of a person, animal, or robot, appearance (including color) such as hairstyle and makeup, and hairstyle), and owned items (clothes, accessories, belongings (towels and glow sticks)), based on the viewer's operation.

The avatar setting unit 113 also performs settings for dressing the avatar by having the user select predetermined parts, etc. When the avatar is set by paying a fee, the avatar setting unit 113 works in conjunction with the viewer behavior management unit 105 to set the avatar for the portion for which a fee has been charged.

In addition, expiration dates are set for components and items that affect the appearance of the avatar, and the avatar setting unit 113 controls the avatar so that it cannot be set if the expiration date has passed and the viewer already owns the item, even if the viewer inputs a setting instruction.

On the other hand, the avatar setting unit 113 is configured to be able to set items that correspond to real objects such as clothes and accessories (including gifts and tips for the acting character) that exist in the real world to the avatar based on the viewer's operation.

In addition, items may be provided in the form of a medium such as a virtual event card instead of an actual object, and conceptual items such as tips may also be provided in the form of a medium such as a virtual event card.

In addition, when used during a virtual event, such as when an acting character is performing a tipping session, the avatar setting unit 113 is configured to be able to register the item in advance in the viewer-related information storage unit 146 before the start of the virtual event, based on the viewer's operation.

The object control unit 114 performs processing to set up an object space (a virtual three-dimensional space that is a three-dimensional virtual space) in which multiple objects are placed. For example, it performs processing to place and set in the object space various objects (objects composed of primitive surfaces such as polygons, free-form surfaces, or subdivision surfaces) that represent display objects such as characters (people, animals, robots, etc.), maps (terrain), buildings, courses (roads), trees, walls, and water surfaces. That is, it determines the position and rotation angle (synonymous with orientation and direction) of an object in the world coordinate system, and places the object at that position (X, Y, Z) with that rotation angle (rotation angle around the X, Y, and Z axes).

Specifically, the storage unit 170 stores object data, such as the position, rotation angle, movement speed, and movement direction of an object (part object), in association with an object number. In addition, the object control unit 114 performs processing such as updating this object data for each frame.

In addition, the object control unit 114 controls the arrangement of various objects, including acting characters, and the movements of the acting characters and various objects, such as avatars, within the virtual three-dimensional space, including their movement.

That is, the object control unit 114 controls objects including viewer characters that are operated by each viewer and placed at the viewing position of each viewer in the virtual space.

In particular, the object control unit 114 controls, for each acting character, the facial direction, eye movement, gaze direction, body orientation, and movement of each part of the body, including lines, on stage during the virtual event, including during the acting performance (choreography).

The object control unit 114 also places each viewer's viewer character at a position in the virtual three-dimensional space of each viewer, and controls the movement of each viewer character's avatar based on viewer input including the line of sight of each viewer, or according to the virtual event situation.

The object control unit 114 controls the acting characters and the viewer characters according to the program. However, the object control unit 114 may also control the acting characters based on operational instructions from the administrator received by the input unit 120.

The avatar gaze control unit 115 controls the gaze of the avatar by controlling the attitude of the virtual camera associated with the viewer based on the gaze input, which is the viewer's operational input output from the terminal device 20.

The timer unit 160 uses the system clock to perform timing operations to measure timer values such as the current date and time, time limits, and time management for controlling the progress of a virtual event.

[3] Terminal Device Next, the terminal device 20 of this embodiment will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a diagram showing functional blocks of the terminal device 20 of this embodiment, and Fig. 5 is an example of a diagram showing the external configuration of the terminal device 20 of this embodiment. Also, the terminal device 20 of this embodiment may have a configuration in which some of the components (parts) of Fig. 5 are omitted.

The HMD unit 200 is composed of an imaging unit 210 that detects the line of sight of the viewer wearing the HMD unit, a motion sensor 220 that detects the posture, including the position and direction, of the viewer's head, an interface 230, a sound output unit 240, and a switch 250.

The HMD unit 200 also has a structure that holds the terminal control unit 300 and is worn by the viewer, as shown in Figures 5(A) and (B).

The HMD unit 200 has a display panel (for the right eye) 261 and a display panel (for the left eye) 262 for realizing stereoscopic vision by allowing the viewer wearing the terminal device 20, which is an HMD, to view images in a virtual three-dimensional space having a predetermined amount of parallax with both eyes, and has a structure for displaying a parallax image for the right eye and a parallax image for the left eye displayed on the terminal device 20.

Note that the parallax images used to realize stereoscopic vision are similar to those used for conventional three-dimensional moving images, and therefore a detailed description thereof will be omitted. Also, FIG. 5(B) is a diagram in which the sound output unit 240 is omitted from the terminal device 20.

The imaging unit 210 captures images of the eyes (eye movement) of a viewer wearing the HMD unit 200, detects the direction of the viewer's gaze, and outputs a signal according to the detection.

The imaging unit 210 is also composed of an imaging camera 211 having a predetermined imaging element such as a CCD and an optical system such as a lens, and an image generation unit 212 that images the object imaged based on the output of the imaging camera and outputs the image data to the terminal control unit 300.

The motion sensor 220 is realized by, for example, an acceleration sensor or a gyro sensor. For example, the motion sensor 220 detects the rotational movement of the viewer's head (HMD) around three axes, the X, Y, and Z axes, specifically, the rotation angle and angular velocity around each of the X, Y, and Z axes, using an acceleration sensor and a gyro sensor.

The interface 230 is, for example, a wired input/output interface such as HDMI (High-Definition Multimedia Interface/registered trademark) or USB (Universal Serial Bus/registered trademark), or a wireless interface such as Bluetooth (registered trademark) or IEEE802.11a, g, n, ac, and has a function for performing communication with the terminal control unit 300 (specifically, the communication unit 296) via a wired or wireless connection.

The interface 230 is also composed of hardware such as a communications ASIC or a communications processor, and communications firmware.

The sound output unit 240 outputs the sound generated by the server processing unit 100, and this function can be realized by hardware such as a speaker or headphones.

The switch 250 is linked to a switch on the terminal control unit 300 and is used to perform specified operation inputs while the HMD unit 200 is being worn.

The terminal control unit 300 is composed of an input unit 260, a memory unit 270, an information storage medium 280, a display unit 290, a communication unit 296, a vibration unit 340, and a terminal processing unit.

The input unit 260 is a device for inputting input information from the viewer, and outputs the viewer's input information to the terminal processing unit 310. In this embodiment, the input unit 260 is configured to detect the viewer's input information (input signal). For example, the input unit 260 is configured with a lever, a button, a steering wheel, a microphone, a touch panel display, a keyboard, a mouse, etc.

In this embodiment, the input unit 260 is formed by a touch panel formed on the display unit 290.

On the other hand, the input unit 260 may be equipped with a microphone for collecting the viewer's voice in order to recognize the viewer's voice instructions, or may be configured with an imaging camera.

In particular, the imaging camera is provided to image two-dimensional barcodes as identification information for identifying real-world items that are digitized and used as items for avatars or virtual events.

In addition to the above, the input unit 260 may also include an acceleration sensor, a gaze detection sensor, and the like. The acceleration sensor and the gaze detection sensor may function in place of the imaging unit 210 and the motion sensor 220 provided in the HMD unit 200.

The storage unit 270 serves as a work area for the device processing unit 310, the communication unit 296, and the like, and its functions can be realized by a RAM (VRAM) or the like.
includes a main memory unit 271 used as a work area, and an image buffer 272 in which the final display image, etc. are stored. Note that a configuration in which some of these components are omitted may also be used.

The information storage medium 280 (a computer-readable medium) stores programs, data, etc., and its functions can be realized by optical disks (CD, DVD), magneto-optical disks (MO), magnetic disks, hard disks, magnetic tapes, or memory (ROM), etc.

The device processing unit 310 performs various processes of this embodiment based on programs (data) stored in the information storage medium 280. The information storage medium 280 can store programs for causing a computer to function as each part of this embodiment (programs for causing a computer to execute the processing of each part).

In this embodiment, the programs for causing a computer to function as each part of this embodiment, and data for realizing a virtual event, which are stored in the information storage medium 180 and memory unit 140 of the server device 10, are received via a network, and the received programs and data are stored in the information storage medium 280. The programs and data received from the server device 10 may also be stored in the memory unit 270. The case where a network system is operated by receiving programs and data in this manner is also included within the scope of the present invention.

The display unit 290 outputs the image generated by this embodiment, and its function can be realized by a CRT, LCD, touch panel display, HMD (head mounted display), etc.

For example, the display unit 290 displays the parallax images transmitted from the server device 10 at the positions of the right-eye display panel 261 and the left-eye display panel 262 when the HMD unit 200 is worn. In this embodiment, the display unit 290 is formed of a touch panel display.

The communication unit 296 performs various controls for communicating with external devices such as the server device 10, and its functions can be realized by hardware such as various processors or communication ASICs, programs, etc.

The device processing unit 310 (processor) performs processes such as event control processing (including performance control), image generation processing, and sound generation processing based on input information and programs output from the input unit 260 and the HMD unit 200.

Specifically, the device processing unit 310 performs various processes using the main memory unit 271 in the memory unit 270 as a work area. The functions of the device processing unit 310 can be realized by hardware such as various processors (CPU, DSP, etc.) and ASICs (gate arrays, etc.), or by programs.

The device processing unit 310 includes a communication control unit 311, an event processing unit 312, a drawing unit 320, and a sound processing unit 330. Some of these may be omitted.

The communication control unit 311 performs processing to transmit and receive data to and from the server device 10. The communication control unit 311 also performs processing to store data received from the server device 10 in the storage unit 270, to analyze the received data, and to control processing related to the transmission and reception of other data.

The communication control unit 311 may store and manage the destination information (IP address, port number) of the server in the information storage medium 280.
may be configured to communicate with the server device 10 when input information for starting communication is received from the viewer.

The event processing unit 312 performs various types of computational processing to realize various virtual events. For example, this includes processing to start a virtual event when a start condition for the virtual event is met, processing to progress the virtual event, and processing to end the virtual event when a termination condition for the virtual event is met.

The event processing unit 312 may also execute part of the virtual event processing in the server device 10, or may execute a predetermined virtual event processing in conjunction with the server device 10.

The drawing unit 320 performs drawing processing based on various processes (e.g., various processes for realizing a virtual event) performed by the device processing unit 310, thereby generating an image, which is output to the display unit 290. In particular, the drawing unit 320 generates a parallax image based on image data transmitted from the server device 10, and displays the generated parallax image on the display unit 290.

The sound processing unit 330 performs sound processing based on the sound data output from the server device 10 and the results of various processes performed by the device processing unit 310, generates sounds to be used in virtual events such as background music, sound effects, or voice, and outputs these to the sound output unit 240.

The vibration unit 340 has a vibrating body 341 and is configured to vibrate the vibrating body 341 based on vibration pattern data output from the server device 10 or vibration pattern data generated based on the results of various processes performed by the device processing unit 310.

[4] Method of the Present Embodiment [4.1] Overview Next, an event viewing control process including a position control process during a virtual event executed by the server device 10 of the present embodiment will be described with reference to Figs. 6 and 7 .

Note that Figures 6 and 7 are diagrams for explaining the position control process during a virtual event executed by the server device 10 of this embodiment, and Figure 7 is a diagram showing an example of an image of the virtual space (hereinafter also referred to as a "virtual space image") viewed by each viewer when a virtual camera is set up in each seat.

The server device 10 of this embodiment is a server device that allows viewers to watch virtual events that are carried out in a virtual space.

The server device 10 is also configured to execute a position control process that controls the execution of the virtual event and changes the viewing position according to the viewing status of each viewer of the virtual event, on the premise that a viewing position (viewing position) in the virtual space is set in association with each viewer ID before the virtual event for each viewer.

In particular, the server device 10 of this embodiment is configured to use a virtual space to provide a sense of realism similar to that of an event in real space, while controlling the viewing environment through the viewer's own actions, such as improving the viewing environment (i.e., changing the viewing position to a better viewing environment) or maintaining the viewing environment, and to worsen the viewing environment depending on the viewer's attitude toward the virtual event (i.e., the viewing situation).

In other words, during a virtual event, for a viewer who does not meet certain conditions, such as the viewer's entertainment viewing level (rank or player level in the case of a game), amount charged, number of comments, attributes, or conditions regarding relationships with other viewers, or for a viewer who does meet certain conditions, the server device 10 changes the position of the virtual camera during the virtual event for that viewer to a lower or higher position in the viewing environment, or maintains the position of the virtual camera, thereby improving the viewing environment.

More specifically, as shown in FIG. 6, the server device 10
(A1) executing a viewing position setting process for setting a position of a virtual camera that functions as a viewpoint of a viewer for viewing the virtual event from among a plurality of viewing positions that are provided in a virtual space and that are ranked according to viewing environment;
(A2) executing a position control process to control the position of the virtual camera of a viewer during viewing of the virtual event in accordance with viewer-related information indicating information about the viewer and a ranking of each viewing position (e.g., a seat rank determined based on the viewing position);
(A3) generating an image of the virtual space formed in the viewing direction of the viewer from the position of the virtual camera, and providing the generated image to the viewer;
It has a configuration.

For example, as shown in FIG. 6, assume that at the start of the virtual event, viewer α's viewing position is set to seat G, seat number 10 (seat rank 7th) where the seats are ranked by row, and that the seat rank increases by one (i.e., the viewer moves to a front row, improving the viewing environment) according to the number of tip items consumed as viewer-related information and item consumption behavior information (e.g., every time the number of tip items consumed increases by two).

In this case, if viewer α consumes four tip items at a specific timing while watching the virtual event (for example, 10 minutes after the start of the virtual event), the server device 10 performs a position control process to move viewer α's viewing position from seat G, number 10, to seat E, row, number 5 (seat rank 5), which is not set as a seat for any other viewer, as shown in FIG. 6.

Furthermore, if viewer α subsequently consumes six tip items at a predetermined timing during viewing of the virtual event (e.g., 30 minutes after the start of the virtual event), the server device 10 performs a position control process to move viewer α's viewing position from seat E, example number 5, to seat A, row number 12 (seat rank 1) of another viewer β who has not consumed any tip items during the virtual event, as shown in FIG. 6, thereby switching the viewing positions of viewer α and the other viewer β.

Then, as shown in FIG. 7, the server device 10 generates an image of the virtual space from the viewpoint of a virtual camera set at each spectator seat, and provides content data that incorporates sound into the generated image to the terminal device 20 of the viewer α.

FIG. 7(A) shows an example of an image (content) viewed by viewer α in seat number 10 in row G (seat rank 7), FIG. 7(B) shows an example of an image (content) viewed by viewer α in seat number 5 in row E (seat rank 7), and FIG. 7(C) shows an example of an image (content) viewed by viewer α in seat number 12 in row A (seat rank 1).

In this embodiment, by having such a configuration, it is possible to increase the viewer's motivation to watch the virtual event by having them concentrate on watching the virtual event and maintain a good viewing environment, and to encourage active participation in the virtual event being viewed.

In addition, this embodiment allows for new viewing behavior through a mechanism that is difficult to achieve in real space (changing the viewing position while watching), while increasing the viewer's interest in entertainment in virtual space, which is a viewing environment different from real space.

[4.2] Viewer-Related Information Next, the viewer-related information of this embodiment will be described.

As described above, the viewer-related information is stored in the viewer-related information storage unit 146.
(A1) Information for identifying a viewer, which includes viewer attributes such as name, age, sex, and account information for billing settlement, and viewer identification information regarding the viewer himself/herself, including avatar information, etc.;
(A2) viewer behavior information (including history information) that includes input information (including current viewing and past viewing) input by a viewer to the entertainment, the viewer behavior information being information regarding the viewer's event and that defines parameters that vary during the execution of the virtual event;
It consists of:

The viewer identification information may include, for example, the following information in association with the viewer ID:
(A1-1) Viewer attributes (age, generation, sex, game level, membership grade, and other viewer level, if any),
(A1-2) Attributes such as the type, level (character level), or characteristics of the character (e.g., the player character used in a game) used by the viewer for entertainment;
(A1-3) Friend relationship (hereinafter, this refers to "both the relationship of following, which allows easy access to information about other viewers, and the relationship of following, which allows easy access to information about one's own viewer", including the relationship of "following and following"), or the relationship with a registered person, such as the viewer having an account in a specific network service and registering that account (for example, registering it as a "favorite" account) (hereinafter, this is also referred to as "registered person relationship"), or the number of registered people,
(A1-4) In the case where the entertainment is a game, attributes such as the type and level (team level) of the team or group to which the person belongs, and
(A1-5) The number of times the entertainment being viewed or entertainment related to the entertainment being viewed is viewed, or the number of times the entertainment is viewed or the number of times the entertainment is logged in to view (perform) the entertainment;
It includes various information such as:

The viewer identification information also includes information that has been quantified based on information such as the relationship between subscribers and the number of subscribers (for example, a value calculated by multiplying a predetermined value for each registration type, such as friend (e.g., 5 points for friends, or 3 points for followers) by the number of days each subscriber has been registered, and then multiplying this by the number of subscribers (e.g., intimacy level)).

The viewer behavior information may include, for example, the following information in association with the viewer ID:
(A2-1) Behavioral information regarding charges (including direct charges such as tipping and indirect charges such as purchasing items used in virtual events), including a charge amount (i.e., a parameter value) for a virtual event (hereinafter referred to as "charge information");
(A2-2) Behavioral information regarding comments entered about other viewers (including those based on plug-in button inputs (buttons provided on the entertainment screen) that indicate the viewer's intentions, such as "Like") and the number of such comments (i.e., parameter values) (
Hereinafter referred to as "Comment Behavior Information").
(A2-3) Information regarding item consumption behavior (hereinafter referred to as “item consumption behavior”) including the number of uses and consumption amount (i.e., parameter value) of items (e.g., tips such as tips) used in virtual events (hereinafter referred to as “item consumption behavior information”).
(A2-4) Event-related behavior information indicating the presence or absence of participation, including the number of times of participation in various events (i.e., parameter values) (hereinafter referred to as "event behavior information"); and (A2-5) the viewer's viewing status for the virtual event.
It includes various information such as:

For example, the intimacy level may be calculated using comment information. In this case, it is calculated using a predetermined formula (for example, a formula using the number of registered users and the number of comments).

An item is, for example, something that can be used in the virtual space while watching a virtual event, and may be a part of an avatar, an item that can be equipped to the avatar, or an item such as a tip that can be offered (given) to an acting character during a virtual event.

Items include various weapons used by the player character when the entertainment is a game, as well as in-game currency.

For example, item behavior information includes the number and amount of items consumed when items are consumed, and, if the items were acquired through a charge, also includes information about the amount charged for the consumed items.

On the other hand, the viewing situation defined by viewer behavior information includes, for example,
(A2-5-1) The type and attributes of the avatar or character you are using,
(A2-5-2) The value of a parameter set by the viewer (in the case of a game, the score, experience points, amount of life energy, etc.),
(A2-5-3) Length of viewing time,
(A2-5-4) Number of position changes, and
(A2-5-5) Current viewing position,
etc.

In particular, the viewer status in this embodiment basically includes the status of other viewers other than the viewer who is the subject of the position control process (hereinafter referred to as the "target viewer"), and uses the difference between the above (A2-5-1) to (A2-5-5) statuses of the target viewer and other viewers (for example, the difference in viewing time or the difference in the number of position changes), but the status of other viewers may also be used, such as by adding the status of the other viewers to the viewer status of the target viewer.

In contrast, in this embodiment, the viewer behavior management unit 105 registers and updates viewer behavior information (behavior type, execution date and time, and charged amount (if charging information is available)) indicating various behaviors related to the virtual event used to extract specific viewers for each viewer in the viewer-related information storage unit 146.

In particular, the viewer behavior management unit 105 works in conjunction with the information acquisition unit 104 to register the above information in the viewer-related information storage unit 146 based on operational inputs such as gaze input, voice volume input, vibration input (input by shaking motion), and switch input (e.g., rapid tapping or combo input) to the HMD unit 200 of the terminal device 20 or its associated controller.

In addition, while a virtual event is being viewed, the viewer behavior management unit 105 registers in the viewer-related information storage unit 146 (associating it with the viewer ID) event history information such as the date and time of participation in the virtual event (including the login date and time), the time of participation in the virtual event (including a specified period in addition to the entire event), the frequency of the virtual event (including the login frequency), the viewer's level (in the case of a game, the game level, etc.), items acquired in the virtual event, information on winnings in gacha, and information based on relationships with friends registered in the virtual event (for example, the number of friends and the viewing time viewed with friends).

Furthermore, the viewer behavior management unit 105 registers, for each viewer (associated with the viewer ID), in the viewer-related information storage unit 146, for charges, for example, when a product or the like is purchased, the type of charge, the date and time when the charge was made, the type of product purchased with the charge, the number of purchases or the number of charges (frequency), or information regarding charges when the above-mentioned game is played.

[4.3] Viewing Position Setting Processing Next, the viewing position setting processing of this embodiment will be described.

Before the start of a virtual event, the viewing position control unit 112 registers and manages in the viewing seat information storage unit 148 viewing seat information that associates each viewing seat reserved in advance by a viewer with each viewer (specifically, a viewer ID) in association with an event ID for identifying the virtual event.

When a virtual event is held, the viewing position control unit 112 sets each viewer's virtual camera to the corresponding seat based on the seat information stored in the seat information storage unit 148.

When a viewer participates in a virtual event using a terminal device 20 (such as a terminal device that has been set in advance for a seat or a terminal device held by the viewer) (i.e., when the viewer wears the HMD unit 200 and logs in to a game or event program of the virtual event), the viewing position control unit 112 sets each viewer's virtual camera to the corresponding seat in the bleachers 6 based on the seat information.

[4.4] Position Control Processing [4.4.1] Basic Principles of Position Control Processing Next, the basic principles of the position control processing of this embodiment will be described.

When each viewer starts viewing based on the viewing seats set as described above, the viewing position control unit 112 executes a position control process during viewing of the virtual event according to at least one of the viewer-related information of each viewer and the execution status of the virtual event, and the predetermined ranking of each viewing position.

In particular, the viewing position control unit 112 performs position control processing for each viewer as follows:
(A1) a determination process for determining whether or not a given determination condition is met for at least one of viewer-related information and an execution status of the virtual event during the execution of the virtual event; and
(A2) a change control process for changing the position of the viewer's virtual camera in accordance with the ranking of each viewing position when it is determined by the determination process that a given determination condition is met, or a maintenance control process for maintaining the position of the viewer's virtual camera;
Execute.

Specifically, the viewing position control unit 112 performs the following determination process:
(A1-1) A determination process for determining whether or not the execution status of a virtual event is a given status (specifically, a predetermined status, hereinafter referred to as a "specific status") using a given determination condition (hereinafter referred to as a "specific status determination process").
(A1-2) A determination process (hereinafter referred to as a "specific condition determination process") for determining whether or not the viewer-related information satisfies a given determination condition (i.e., a predetermined determination condition, hereinafter referred to as a "specific determination condition") at a given timing (hereinafter referred to as a "specific timing") during the execution of a virtual event; or
(A1-3) A determination process for determining whether or not to execute a position control process based on viewer-related information during the execution of a virtual event using a given determination condition (hereinafter referred to as a "position control execution determination process");
Execute.

On the other hand, as a change control process, the viewing position control unit 112 executes a process of changing only the viewing position of the viewer who is the target of the position control process (i.e., the position of the virtual camera) when the above-mentioned judgment conditions are met by each judgment process, or executes a process of replacing the viewing position with that of another viewer who is the target of the change.

Then, in the change control process, if the above conditions are not met as a result of each determination process, the viewing position control unit 112 executes a process that does not change the viewing position to be changed (basically the same as the maintenance control process).

In addition, as a maintenance control process, the viewing position control unit 112 executes control to prevent the viewing position from being changed from the current position when the above-mentioned judgment conditions are met by each judgment process.

Then, as a maintenance control process, if the above-mentioned judgment conditions are not met by each judgment process, the viewing position control unit 112 executes a process of changing the current viewing position to another viewing position (basically the same as the change control process).

In addition, the viewing position control unit 112 of this embodiment may perform the determination process for multiple viewers, or for all viewers simultaneously, instead of for each viewer.

In addition, the viewing position control unit 112 may use two or more types of viewer-related information or may use the execution status of two or more types of virtual events when performing the above-mentioned position control process.

Furthermore, in the judgment process, the viewing position control unit 112 may determine whether or not to execute the position control process based on a specified operational instruction from the viewer or administrator, such as an instruction to start the viewer's position control process (i.e., the timing when the specified operational instruction is input), instead of or in addition to the above-mentioned timing and conditions being met.

[4.4.2] Determination Process Next, the determination process in the position control process of this embodiment will be described.
(Specific situation determination process)
As described above, during the execution of a virtual event, the viewing position control unit 112 executes a specific situation determination process for each viewer to determine whether or not the execution status of the virtual event is a specific situation by using given determination conditions.

Specifically, the viewing position control unit 112 determines, as a given determination condition,
(A1) A condition related to a predetermined timing, such as the occurrence timing of an event (e.g., a lottery event that allows a player to obtain a given item) that occurs during the execution of the virtual event;
(A2) A condition regarding elapsed time, such as a time when a predetermined period of time has elapsed since a predetermined time, such as the start of entertainment execution;
(A3) Conditions regarding the progress of entertainment (in the case of a singing event, the degree of progress against a set list (song order list), or in the case of a game, the progress of task completion or item acquisition);
(A4) Audience-related conditions, such as the number of viewers who will watch the entertainment, or (A5) a combination of (A1) to (A4);
Using this, a special situation determination process is performed to determine whether the execution situation of the virtual event is a special situation.

For example, the viewing position control unit 112 executes a specific situation determination process using a given determination condition to determine whether a specific timing has occurred during the execution of a virtual event, such as the timing when a specific lottery event has occurred, whether a predetermined period of time has passed since the start of the game, whether the progress of the virtual event has reached a predetermined percentage or more, such as when more than half of the content of the virtual event has been completed, or whether the number of viewers has reached a predetermined number or more.

(Specific condition determination process)
As described above, the viewing position control unit 112 performs a specific condition judgment process for each viewer at a specific timing during the execution of the virtual event, while referring to the corresponding viewer-related information stored in the viewer-related information storage unit 146, to judge whether the viewer-related information satisfies a specific judgment condition.

Specifically, similar to the specific timing used in the specific situation determination process, the viewing position control unit 112 determines the specific timing for the specific condition determination process as follows:
(B1) At the occurrence timing of an event (for example, a lottery event that allows a player to obtain a given item) that occurs during the execution of a virtual event,
(B2) At a timing when a predetermined period has elapsed from a predetermined timing such as the start timing of the execution of a virtual event,
(B3) When the progress of the virtual event (in the case of a singing event, the progress of the set list (song order list) or in the case of a game, the progress of the task completion or the acquisition of an item) reaches a predetermined progress, or
(B4) When the number of viewers watching the virtual event reaches a predetermined number, a specific condition determination process is executed.

Then, the viewing position control unit 112 sets the specific determination condition as follows:
(C1) Conditions regarding the type and number (amount) of items to be consumed (including tips) and conditions regarding viewer behavior information such as viewer operation inputs,
(C2) Conditions related to viewer identification information that changes during viewing, such as the viewer's level, the level of the team to which the viewer belongs, the number of viewers belonging to the team, the number of registered friends, or the like; or
(C3) a combination of two or more of (C1), two or more of (C2), or one or more of (C1) and (C2);
The specific condition determination process is executed using the above.

In particular, the viewing position control unit 112 sets the following as conditions related to the viewer behavior information:
(C1-1) Conditions for item consumption, such as the type and number (amount) of items to be consumed (including tips);
(C1-2) Conditions for entertainment charges, and
(C1-3) Conditions for the viewer's operation input information, such as execution of a predetermined operation input or gaze-related input or the number of times of such input,
The specific condition determination process is executed using the above.

In addition, the viewing position control unit 112 sets the following as a condition related to the viewer identification information:
(C2-1) Conditions regarding the attributes of viewers (the level of viewers or the grade of members, if any);
(C2-2) Attributes such as the type, level (character level), or characteristics of the character (e.g., avatar) used by the viewer during the virtual event;
(C2-3) Friend relationships, registrant relationships with registrants, intimacy, or the number of registrants;
(C2-4) When watching a virtual event in a group, attributes such as the type and level (team level) of the group to which the user belongs, and
(C2-5) The number of times the virtual event being viewed or a virtual event related to the virtual event is viewed, or the number of times the user has logged in to view (perform) the virtual event,
In this embodiment, however, it is preferable that the viewer specification information varies during the execution of the virtual event.

For example, the viewing position control unit 112 executes a specific condition determination process to determine whether the amount (number) of tip items consumed is equal to or greater than a certain amount a predetermined period of time after the start of the virtual event.

(Position control execution determination process)
As described above, the viewing position control unit 112 performs a position control execution determination process for each viewer, by referring to the corresponding viewer-related information stored in the viewer-related information storage unit 146, and determining whether or not the viewer-related information satisfies a given determination condition (hereinafter referred to as the "position control execution condition") during the execution of the virtual event, thereby determining whether or not to execute the position control process.

In particular, the viewing position control unit 112 sets, as the position control execution condition, the specific determination condition of the specific condition determination process, as follows:
(D1) Conditions regarding viewer behavior information;
(D2) conditions related to viewer identification information, or
(D3) A combination of (D1) and (D2);
The position control execution determination process is performed using

For example, the viewing position control unit 112 executes a position control execution determination process to determine whether the consumption amount (number) of tip items is equal to or greater than a certain amount during the execution of a virtual event.

[4.4.3] Varying Control Process Next, the varying control process in the position control process of this embodiment will be described.

As described above, when it is determined by the specific situation determination process, the specific condition determination process, or the position control execution determination process that a given determination condition is met, the viewing position control unit 112 executes a change control process to change the position of the virtual camera (i.e., the viewing position of the viewer, which is the seat where the avatar is placed) for the viewer who is the subject of the position control process (e.g., the first viewer) from a first position to a second position different from the first position, according to the ranking of each viewing position determined in advance.

In particular, the viewing position control unit 112 executes a change control process to change the first position to a position with a higher ranking (i.e., a position with a better viewing environment) in principle.
may execute a change control process to change the first position to a position lower in rank (i.e., a position with a poor viewing environment).

In addition, a destination seat is associated with each judgment condition used in the judgment process, and the viewing position control unit 112 changes the position of the virtual camera that is the subject of the change control process to the destination seat set in association with the judgment condition, as the destination virtual camera position. However, the destination virtual camera position may be selected by lottery or may be specified by an operational instruction from the viewer.

Specifically, when multiple virtual cameras can be set for each seat, or when the new seat is an empty seat (including when a viewer acting at the command of a computer, such as an NPC, is set in a seat), the viewing position control unit 112 executes a target viewing position change control process to change the position of the viewer's virtual camera to another viewing position (regardless of whether it is set as the viewing position of other viewers), as shown in FIG. 6 (first position control process) above.

In addition, when only one virtual camera can be set per seat and the new seat is not an empty seat (not including the case where a seat is set to a viewer acting according to instructions from a computer such as an NPC), the viewing position control unit 112 executes a swap change control process to swap the position of the viewer's virtual camera with another viewing position, as shown in Figure 6 above (second position control process).

On the other hand, the viewing position control unit 112 executes a change control process to change the position to a higher ranking as described above, but may also execute a change control process to change the position to a lower ranking.

For example, in this case, when the specific condition determination process meets the determination condition that a certain number (amount) or less of tip items have been used before a certain time has elapsed during the execution of the virtual event, the viewing position control unit 112 executes a position control process to change the seat to a lower-ranked seat.

On the other hand, if the viewing position control unit 112 determines in the change control process that the above conditions are not met, it executes a process that does not change the viewing position to be changed (in principle, a process similar to the maintenance control process).

[4.4.4] Maintenance Control Process Next, the maintenance control process in the position control process of this embodiment will be described.

As described above, when it is determined by the specific situation determination process, the specific condition determination process, or the position control execution determination process that a given determination condition is met, the viewing position control unit 112 executes a maintenance control process to maintain the position of the viewer's virtual camera (i.e., the viewing position).

In addition, if the viewing position control unit 112 determines that the judgment conditions are not met through the above judgment process, it changes the position of the viewer's virtual camera instead of maintaining it.

When changing the position of the viewer's virtual camera, the viewing position control unit 112 executes processing similar to the change control processing described above.

In this case, the viewing position control unit 112 executes a change control process to change the position to a position lower in rank than the first position (i.e., a position with a poor viewing environment). However, the viewing position control unit 112 may also change the position to a position higher in rank than the first position (i.e., a position with a good viewing environment).

As described above, each judgment condition used in the judgment process is associated with a new seat, and the viewing position control unit 112 changes the position of the virtual camera that is the target of the change control process to the new seat set in association with the judgment condition, as in the change control process described above. However, the new virtual camera position may be selected by lottery or may be specified by the viewer's operational instruction.

[4.4.5] Position control processing between viewers Next, the position control processing between viewers in this embodiment will be described.

In order to introduce a competitive principle to secure a better viewing position between each viewer, the viewing position control unit 112 may compare the viewer viewing information of each viewer and perform position control processing between viewers based on the results, instead of performing position control processing for each viewer.

That is, the viewing position control unit 112
(A1) performing a comparison process during the virtual event to compare viewer-related information for each viewer;
(A2) As the position control process, the position of the virtual camera of each viewer may be controlled according to the comparison result of the viewer-related information and the ranking of the viewing positions.

In this case, the viewing position control unit 112 refers to specific viewer viewing information of the multiple target viewers at a given timing (e.g., a specific timing used when the specific condition determination process is executed), and executes a comparison process that compares the referenced specific viewer-related information.

Then, the viewing position control unit 112 executes a position control process to change the position of the virtual camera of the viewer who meets the conditions based on the comparison process.

In particular, the viewing position control unit 112 may perform the comparison process using all viewers participating in the virtual event as the comparison targets, or, in a case where multiple seats are associated with the same seat ranking, may perform the comparison process using multiple viewers grouped according to a predetermined condition as the comparison targets, such as multiple viewers whose viewing positions are seats with the same ranking.

Specifically, in the comparison process, the viewing position control unit 112 compares the variable parameters and information in the viewer behavior information and viewer identification information, such as the amount charged, experience points, points, viewer level, or number of items acquired, from the start of the virtual event to a specific timing, or during a predetermined period during the virtual event.

Then, the viewing position control unit 112 executes a position control process to change the position of the virtual camera of the viewer with the best parameters or information as a result of the comparison process, or of one or more viewers with parameters or information that meet certain conditions, from the current position to a position with a higher ranking.

For example, assume that a position control process is executed to change the position of the virtual camera of a viewer who consumes the most tipping items and spends the most on them during a predetermined period during a virtual event (hereinafter referred to as the "target period"), and that the amounts spent on tipping items by viewers α, β, and γ, who are comparison subjects during the target period, are 1,000 yen, 1,500 yen, and 800 yen, respectively.

In this case, the viewing position control unit 112 compares the amounts spent on tipping items by the viewers α, β, and γ who are to be compared, and executes a position control process to change the position of the overworked camera of viewer B, who has spent the most, from the current seat to a seat of a predetermined rank (moving up one rank).

The viewing position control unit 112 may target viewers with different current seating positions, or may change the positions of the virtual cameras of multiple viewers who meet certain conditions.

The viewing position control unit 112 may also target a viewer with a high seating rank and a viewer with a low seating rank, and if the low seating rank viewer satisfies a predetermined condition, swap the current virtual camera position of the high seating rank viewer with the current virtual camera position of the low seating rank viewer.

[5] Modifications [5.1] Modification 1 (Game Management System)
Next, a first modified example (game management system) of this embodiment will be described.

This embodiment has been described using a virtual space event management system that allows performances (acting and singing) to be performed in a virtual three-dimensional space, but it may also be applied to a game management system that controls the execution of games that are run in a virtual space as entertainment.

In this case, the player as a viewer plays the game based on each viewing position, and position control processing is executed during the game.

Note that in the case of a simulation game that uses an event venue, the viewing positions can be set to the spectator seats at the event venue, but in other games, the viewing positions will be positions within the virtual space that are determined when the game is executed. However, even in this case, it is assumed that each viewing position is ranked.

[5.2] Modification 2 (position control process based on the viewer's viewing situation)
Next, a second modification of this embodiment (position control process based on the viewing situation of the viewer) will be described with reference to FIG.

Note that FIG. 8 is a diagram for explaining variant example 2 of this embodiment (position control processing based on the viewer's viewing status).

In this embodiment, the position control process is performed based on viewer-related information including item consumption behavior information, the execution status of the virtual event, and both of these, but the position control process may also be performed based on the viewing status of the viewer.

In other words, in this embodiment, even if the item consumption behavior (e.g., consumption amount) indicated by the item consumption behavior information is a viewer with a good viewing condition (e.g., a viewer who is determined to be contributing to the execution of the virtual event), the viewing environment may be changed to a position with a better viewing environment (i.e., a higher ranking position, a position with a larger range of jump up in ranking) than a viewer with a bad viewing condition (e.g., a viewer who is determined not to be contributing to the execution of the virtual event).

Specifically, the viewing position control unit 112
(A1) When performing a position control process, a viewing situation of the viewer is detected;
(A2) changing a parameter determined by item consumption behavior information as viewer-related information based on the detected viewing status of the viewer to be advantageous or disadvantageous to the viewer;
(A3) A position control process may be executed according to the parameter of the item consumption behavior information whose value has changed favorably.

In particular, when performing the position control process, the viewing position control unit 112 changes the parameters determined by the item consumption behavior information in a direction that makes the viewing environment of the viewer more favorable or in a direction that makes the viewing environment less favorable.

In addition, the viewing position control unit 112 may store, as the viewing situation of the viewer,
(B1) The type and attributes of the avatar or character used;
(B2) The value of a parameter set by the viewer, such as a level (in the case of a game, points, experience points, amount of life energy, etc.),
(B3) length of viewing time;
(B4) The number of position changes, and
(B5) current viewing position,
etc. are used.

In particular, the viewer's situation in this embodiment basically includes the situations of other viewers, and uses the difference between the above (B1) to (B5) situations of other viewers (for example, the difference in viewing time or the difference in the number of position changes), but the situation of other viewers may also be used, such as by adding the situation of other viewers to one's own viewer's situation.

For example, we will consider a case in which the number of times the viewer has viewed a virtual event is used as the viewer's viewing status, and the amount charged (parameter) based on the amount of tipping items consumed is used as item consumption behavior information, and the larger the amount charged based on the amount of tipping items consumed, the more likely it is that a position control process will be executed to change the viewing position to one with a better viewing environment.

Let's also assume that for every 500 yen increase in the charged amount, the seat ranking increases by one.

In this case, as shown in FIG. 8, when the viewing position control unit 112 detects that viewer α, whose virtual camera is set at seat number 10 in row G, has been charged 500 yen based on the amount of tip items consumed by a specified timing and has changed position twice as a viewing situation, the viewing position control unit 112 corrects the charged amount to 1,000 yen (= 500 yen x 2 times).

Then, the viewing position control unit 112 executes a position control process to change the position of the virtual camera, which was set at seat number 10 in row G, to seat number 5 in row E, which is two seats up and is vacant.

In a similar case, when the viewing position control unit 112 detects that the number of position advances is 1 as the viewing situation, as shown in FIG. 8, the billing amount becomes 500 yen (= 500 yen x 1 time), and a position control process is executed to change the position of the virtual camera set at seat G, row 10 to seat F, row 15, which is an empty seat that has been moved up one place in the ranking.

On the other hand, the viewing status of other viewers in the same group or friends may be used instead of the viewer who is the target of the position control process.

That is, in this case, the viewing position control unit 112
(C1) When performing a position control process, the viewing status of other viewers is detected;
(C2) changing a parameter determined by the item consumption behavior information as viewer-related information based on the detected viewing status of the other viewers to be advantageous or disadvantageous to the viewer who is the target of the position control process;
(C3) Depending on the parameter of the item consumption behavior information whose value has changed advantageously or disadvantageously, a position control process may be executed on the viewer who is the target of the position control process.

For example, as in the above case, a case is assumed in which the number of times a viewer has viewed a video is used as the viewer's viewing status, and a charge amount (parameter) based on the amount of tipping items consumed is used as item consumption behavior information, and the larger the charge amount based on the amount of tipping items consumed, the more likely it is that a position control process will be executed to change the viewing position to one with a better viewing environment.

In this case, we will assume that the seat ranking will increase by one for every 100,000 yen increase in the charged amount.

In this case, when the viewing position control unit 112 detects that viewer α, whose virtual camera is set at seat number 10 in row G of the auditorium, is charged 500 yen based on the amount of tip items consumed by the specified timing, and that the viewing situation shows that other viewer B in the same group has advanced in position twice, and that viewer α is charged 300 yen based on the amount of tip items consumed by the specified timing, the viewing position control unit 112 corrects the charged amount to 300,000 yen (= 500 yen x 2 times x 300 yen).

Then, the viewing position control unit 112 executes a position control process to change the position of the virtual camera, which was set at seat number 10 in row G, to seat number 9 in row D, which is an empty seat that has been moved up three places in the ranking.

When the viewing position control unit 112 detects that viewer α, whose virtual camera is set at seat number 10 in row G, is charged 500 yen based on the amount of tip items consumed by the specified timing, and that other viewer β in the same group has made a position advance twice as a viewing situation, and that viewer α is charged 300 yen based on the amount of tip items consumed by the specified timing, and that other viewer β in the same group has made a position advance once as a viewing situation, the viewing position control unit 112 corrects the charged amount to 600,000 yen (= 500 yen x 2 times x 300 yen x 2 times).

Then, the viewing position control unit 112 executes a position control process to change the position of the virtual camera, which was set at seat number 10 in row G, to seat number 5 in row A, which is an empty seat that has been moved up six places in the rankings.

[5.3] Modification 3 (Changes in execution conditions of position control processing based on the viewing situation of the viewer)
Next, a third modification of this embodiment (changing the execution conditions of the position control process based on the viewing situation of the viewer) will be described.

In this embodiment, the reference value set for the item consumption behavior information when performing the position control process may be changed based on the viewer's viewing status (e.g., the viewing status used in variant example 2).

That is, in this embodiment, based on the viewing situation of the viewer,
(A1) The amount required to purchase an item (tipping item) for executing the position control process,
(A2) A reference value for initiating the position control process (i.e., a value that defines the above-mentioned judgment condition), or
(A3) A reference value such as an amount of change when changing the ranking of the corresponding viewing position to another viewing position in the position control process may be used.

Specifically, as described above, the viewing position control unit 112 determines, as the viewing situation of the viewer, for example,
(B1) The type and attributes of the avatar or character used;
(B2) The value of a parameter set by the viewer, such as a level (in the case of a game, points, experience points, amount of life energy, etc.),
(B3) length of viewing time;
(B4) The number of position changes, and
(B5) current viewing position,
etc. are used.

The viewing position control unit 112 then sets the above-mentioned reference value based on these viewing conditions and executes the position control process based on the set reference value.

For example, consider a case where the number of times a viewer has viewed a virtual event is used as the viewer's viewing status, and the amount (parameter) of tip items consumed is used as item consumption behavior information, and the purchase amount of the tip items as a reference value is changed based on the viewing status.

In this case, the event management unit 111
(C1) When the number of views is 1, set the purchase price of tip item 1 to 300 yen.
(C2) When the number of views is 2, set the purchase price of tip item 1 to 200 yen.
(C3) When the number of views is 3, set the purchase price of the tip item 1 to 100 yen, and
(C4) When the number of views is 4 or more, the purchase price of one tip item is set to 50 yen.

Then, when the consumption amount of tip items at a specific timing satisfies a predetermined condition (for example, when it is equal to or greater than a certain amount), the viewing position control unit 112 executes a position control process (a change control process or a maintenance control process).

The viewing position control unit 112 also changes the ranking of the new viewing position depending on the amount of the tip item consumed.

On the other hand, for example, a case is considered in which the number of times the viewer has viewed a virtual event is used as the viewing status of the viewer, and the amount (parameter) of tip items consumed is used as item consumption behavior information, and the judgment conditions based on tip items as a reference value are changed based on the viewing status.

In this case, the viewing position control unit 112
(D1) When the number of views is 1, if the billing amount based on the consumption amount of one tip item is 800 yen, it is determined that the judgment condition is met,
(D2) When the number of views is 2, if the billing amount based on the consumption amount of the tip item 1 is 500 yen, it is determined that the judgment condition is met,
(D3) When the number of views is three or more, if the billing amount based on the consumption of one tip item is 300 yen, it is determined that the judgment condition is met.

Then, the viewing position control unit 112 changes the ranking of the new viewing position according to the charged amount based on the consumption amount of the tip item.

On the other hand, for example, it is assumed that the number of times the viewer has viewed a virtual event is used as the viewer's viewing status, and the amount of tipping items consumed (parameters) is used as item consumption behavior information, and the ranking of the viewing positions to which the change is made when the position control process is executed is changed based on the viewing status.

In this case, when the viewing position control unit 112 determines that the determination condition is met,
(E1) When the number of views is 1, the position of the virtual camera is changed to the seat of the next higher rank every time the amount of tipping items consumed increases by 3.
(E2) When the number of views is 2, the position of the virtual camera is changed to the seat of the next higher rank every time the amount of the tip item consumed increases by 2.
(E3) When the number of views is three or more, the position of the virtual camera is changed to the spectator seat of the next higher rank each time the amount of tip item consumed increases by one.

[5.4] Modification 4 (Position control process based on item consumption behavior of other viewers)
Next, a fourth modified example of this embodiment (position control process based on item consumption behavior of other viewers) will be described.

In this embodiment, when a virtual event is viewed by a team made up of multiple viewers, the viewing environment of the target viewers who are the subject of the position control process may be changed based on viewer-related information such as the item consumption behavior of other viewers who belong to the group or team.

That is, in this embodiment, the viewing position control unit 112 may provide a special effect (i.e., an effect of improving the viewing environment) such as changing the viewing position of the target viewer to a higher ranking position based on item consumption behavior information of other viewers (hereinafter referred to as "cooperative viewers") who belong to the same group as the target viewer.

Specifically, in this case, when the viewing position control unit 112 executes a position control process for a first viewer (target viewer) belonging to a group consisting of one or more viewers, it executes a determination process to determine whether or not the input of item consumption behavior information as viewer-related information of a second viewer (cooperating viewer) who belongs to the same group as the target viewer and is different from the target viewer satisfies given input conditions.

Then, when the viewing position control unit 112 determines that the input conditions are met, it may execute a position control process for the first viewer according to the item consumption behavior information of the cooperating viewer, together with the viewing-related information of the target viewer, and the ranking of each viewing position.

In particular, in this modified example, the input condition is that, for example, the item consumption behavior information of the cooperating viewer is input before the item consumption behavior information of the target viewer is input, and a predetermined amount of the item indicated by the item consumption behavior information is input by the first viewer, the second viewer, or both (i.e., a predetermined amount (number) of items are consumed). However, in this input condition, the item consumption behavior information of the target viewer may be input before the item of the cooperating viewer, or an additional condition may be added that the item consumption behavior information of the first viewer, the second viewer, or both is input within a certain period of time.

For example, in this case, when the viewing position control unit 112 receives an instruction to consume a predetermined number of tip items as item consumption behavior information of a cooperating viewer, and then receives an instruction to consume a predetermined number of tip items as item consumption behavior information of a target viewer within a certain period thereafter (for example, a period set by the virtual event side, such as within one minute), it adds up the tip items of the target viewer and the tip items of the cooperating viewer, and executes position control processing of the target viewer based on the added value.

[5.5] Modification 5 (Position control process 1 based on the same viewing position by multiple viewers)
Next, a fifth modified example of this embodiment (first position control process based on the same viewing position of a plurality of viewers) will be described with reference to FIG.

Note that FIG. 9 is a diagram for explaining variant 5 of this embodiment (position control processing based on the same viewing position by multiple viewers).

In the above embodiment, basically, position control processing is performed for each viewer, but when multiple viewers, such as from the same team (group), watch a virtual event from the same viewing position, the viewer-related information of multiple viewers at the same viewing position may be added together to perform position control processing.

In other words, this modified example has a configuration that allows viewers from the same team to share a viewing environment for a virtual event, creating a sense of unity among the team regarding the virtual event.

Specifically, the viewing position control unit 112 performs the following position control process in such a case:
(A1) At the start of a virtual event or during the virtual event, the viewing positions of each viewer of a group (i.e., a team) consisting of one or more grouped viewers are set to the same viewing position;
(A2) Counting viewer-related information of each viewer who is grouped and set to the same viewing position when performing the position control process;
(A3) performing a change control process or a maintenance control process for the viewing positions of the group according to the collected viewer-related information and the ranking of each viewing position;
It has a configuration.

For example, as shown in FIG. 9, assume that the positions of the virtual cameras of viewers α, β, and γ of the same team are all set to seat number 10 in row G of the bleachers, and the amounts of tip items consumed in the item consumption behavior information (viewer-related information) of each of viewers α, β, and γ are "3," "2," and "0," respectively.

In this case, the viewing position control unit 112 adds up the consumption amount of tip items and executes a change control process or a maintenance control process based on the total value (i.e., the consumption amount "5").

In particular, as shown in FIG. 9, when the viewing position control unit 112 changes the position of the virtual camera to another seat by the change control process, it changes the positions of all the virtual cameras of viewers α, β, and γ of the same team to the position of the new seat (for example, seat number 5 in row C).

In this modified example, the change control process and maintenance control process are the same as in the above embodiment, so their explanation will be omitted.

In addition, the groups and teams in this modified example may be generated by the will of each viewer, or may be automatically grouped based on attributes associated with each viewer (e.g., the attributes of the above-mentioned viewers and their characters).

Furthermore, in this modified example, the viewing position control unit 112 controls parameters such as item consumption behavior information as follows:
(B1) By adding up the data for each group,
(B2) In the case of the presence or absence or number of types of viewer identification information, by using predetermined table data in which the sum value or the sum ratio is predetermined, or
(B3) By converting the data into a numerical value through a predetermined calculation,
Change control processing and maintenance control processing are executed.

[5.6] Modification 5 (Position control process 2 based on the same viewing position by multiple viewers)
Next, a sixth modified example of this embodiment (position control process 2 based on the same viewing position of a plurality of viewers) will be described.

In the above embodiment, basically, position control processing is performed for each viewer, but multiple viewers may watch a virtual event from the same viewing position.

In this modified example, each viewing position is used as a viewing position for multiple viewers, and the number of users who can set the viewing position is determined. In this case, the viewing position control unit 112 manages the number of users who can set the viewing position for each viewing position.

Specifically, for each viewing position, a number of users that can be set, or a percentage of the number of viewers based on the total number of participants in the virtual event, is set, and these numbers and percentages are set individually according to the order and rank, as described above.

The viewing position control unit 112 then assigns each viewing position to each viewer based on the number of viewers or the ratio of viewers set for each viewing position, and if a change is made from the first position to the second position during the virtual event and the number of viewers at the second position exceeds the limit, the viewing position control unit 112 changes the viewing position of the viewer who has already been set at the second position to another position.

In other words, in this modified example, multiple viewers can be set at the same viewing position, while the number of viewers at each viewing position can be limited, introducing a competitive principle to secure the best viewing position among each viewer.

For example, if it is possible to set the top 10% of viewers for a given seat's seat rank (e.g., A rank), the viewing position control unit 112 will set 10 viewers when the total number of viewers is 100, and will set 1 viewer when the total number of viewers is 10.

Then, when the viewing position of a viewer who has been set to a lower seat rank (e.g., rank B) is changed to the seat in question (a seat with a rank A) during the execution of the virtual event, the viewing position control unit 112 changes the viewing position of the viewer who has already been set to the seat in question to another viewing position.

In this case, if the viewing position control unit 112 assigns seats to each viewer in order of seat rank before the event starts, the top-ranked seats will always be set up with the same number of viewers as the capacity limit, so it is possible to introduce a competitive principle to secure better viewing positions among each viewer.

[5.7] Modification 7 (Position control process based on operational instructions from administrator)
Next, a seventh modified example of this embodiment (position control process based on an operational instruction by an administrator) will be described.

In the above embodiment, the position control process is executed based on the judgment result of the judgment process at a given timing during the execution of the virtual event, but the position control process may be executed based on the administrator's instructions in order to directly control the viewing environment of the viewer by the administrator or operator in order to take special measures such as providing benefits, imposing penalties, or correcting various errors.

Specifically, when the viewing position control unit 112 receives operational input such as an instruction from the administrator to execute a position control process or a new virtual camera position, it executes a change control process to change the position of the viewer's virtual camera based on the received operational instruction from the administrator.

For example, the viewing position control unit 112 works in conjunction with the display control unit 103 to generate a menu image for displaying on the display unit 130 a display menu for instructing the administrator to change the viewer's camera position, and as a change control process, when the display menu displayed on the display unit 130 is operated in real time by the administrator while entertainment is being played, the viewing position of the corresponding viewer is changed to the camera position specified by the administrator.

On the other hand, in the above embodiment, when the location control process is executed by using viewer-related information, such as by executing the location control process based on item consumption behavior information provided by the viewer, the location control process may be executed on the premise that the use of the viewer-related information has been approved by the administrator.

For example, even if the number of viewers increases and it becomes difficult to identify the provider of the tip items provided as viewer-related information and the amount provided, the information may be organized by an operator, and even in such a case, the use of the viewer-related information may be approved by an administrator in order to accurately control the viewing position of each viewer.

Specifically, when the viewer-related information is, for example, information regarding the consumption of a tip item and the position control process is executed by consuming the tip item, and the operator approves the use of the tip item to be consumed in the position control process, the viewing position control unit 112 executes the position control process for the viewer.

In this case, if the administrator has not approved a consumable item such as a tip item, the viewing position control unit 112 may return the unapproved item to the viewer in question, or may refund the equivalent of the consumption in the form of another item, a ticket, or money.

[5.8] Modification 8 (Display control process of virtual events for administrator)
Next, an eighth modified example of this embodiment (a process for controlling display of a virtual event to an administrator) will be described.

In the above embodiment, the administrator may cause an image of the virtual event being viewed by each viewer (specifically, an image of the virtual event as seen from the position of each viewer's virtual camera) to be displayed on a monitor.

That is, in this modified example, a configuration capable of being monitored may be provided in order to check the operations of the administrator as described above and reduce the complexity for the administrator.

Specifically, the display control unit 103 works in conjunction with the image generation unit 108 to perform control (which may be a multi-screen display or a switching display) to display images of the performance of the acting character as seen from each viewer's virtual camera on the display unit 130, which is a monitor for the administrator.

In addition, when displaying images seen from each viewer's virtual camera on the display unit 130, the display control unit 103 may superimpose each viewer's viewer-related information on the corresponding image.

[5.9] Modification 9 (Provision of viewing record information of each viewer in position control processing)
Next, a ninth modified example of this embodiment (provision of viewing record information of each viewer in position control processing) will be described.

In this embodiment, the seat where each viewer stayed during the position control process and the duration of time spent at each seat may be provided to each viewer as viewing history information.

In other words, in this modified example, each viewer's viewing history may be provided as information to the viewer in order to allow each viewer to recognize the viewer's objective situation regarding viewing of the virtual event and to increase the viewer's motivation to watch the virtual event.

Specifically, during viewing of the virtual event, the viewing position control unit 112
(A1) Detecting the position of a viewer's virtual camera and the duration of time the viewer's virtual camera stays at that position;
(A2) Based on the detected position of the virtual camera of the viewer and the duration of time the viewer's virtual camera stayed at that position, information indicating the viewing history of the viewer is associated with the relevant viewer as viewing history information and stored or updated in the viewer-related information storage unit 146, and management thereof is performed.

In this case, the information providing unit 109 also provides the viewing history information of each managed viewer to each associated viewer and other viewers.

For example, the viewing history information for each viewer may be points (benefits) or ranking information (information that can be compared with other viewers) for the transition when the position of the virtual camera is changed, or the history may be visualized on an overall map of the spectator seats in the virtual space, and information showing the viewer's relative superiority or inferiority to other viewers.

Note that viewing history information is not limited to this, as long as it is information for visualizing the transition when the position of the virtual camera is changed.

[5.10] Modification 10 (Use of a portable information terminal device or a terminal device with fixed settings)
In this embodiment, entertainment is viewed using an HMD, but entertainment may also be viewed using a terminal device such as a smartphone or a tablet information terminal device.

In this case, the terminal device 20 is equipped with an image display unit, a sound output unit, an imaging unit, as well as a motion sensor and a GPS function, and detects the viewing direction of the viewer by pointing the terminal device body in the desired viewing direction, or by operating the terminal device to instruct the desired viewing direction in advance, and provides information on the detected or instructed viewing direction to the server device 10.

Then, based on the provided viewing direction, the server device 10 generates a virtual space image by imaging the virtual space as seen from each virtual camera placed in the bleachers, and outputs data of the generated virtual space image to each of the corresponding terminal devices 20 at any time.

In this case, the terminal device 20 may have a camera imaging function and detect the viewing direction of the viewer based on the captured image.

In this case, the terminal device 20 displays a two-dimensional or three-dimensional image on the image display unit in a virtual space formed in the viewing direction.

In this modification, the terminal device 20 is a portable device, but may also be equipped with a fixedly installed camera. In this case, the terminal device 20 provides the image of the virtual space by communicating with the fixedly installed camera.

[6] Operation in the Present Embodiment Next, the operation of the virtual event execution process specialized for the position control process, which is executed by the server device 10 in the present embodiment, will be described with reference to FIG.

Note that FIG. 10 is a flowchart showing the operation of the virtual event execution process specialized for the position control process executed by the server device 10 of this embodiment.

This operation is performed when each viewer watches a virtual event individually, and is performed in conjunction with a virtual event in a virtual space that has multiple spectator seats where the positions of the virtual cameras of each viewer are set, and a stage where the performance of the acting characters is performed.

In this operation, viewer-related information such as viewer identification information and viewer behavior information (billing history information and item consumption behavior information) for each viewer is already stored in the viewer-related information storage unit 146, and the values of parameters defined by some of the viewer behavior information are changed as necessary during the execution of the virtual event.

Furthermore, in this operation, while the acting character is performing, the object control unit 114 places, moves, or operates each object, including the acting character, in the virtual three-dimensional space in accordance with the program, and the event management unit 111 executes each performance in the virtual three-dimensional space.

Meanwhile, the information acquisition unit 104 acquires gaze information output from each terminal device 20 at predetermined timings (every 5 ms) while the virtual event is being carried out, and the avatar gaze control unit 115 determines the gaze direction of each avatar in the virtual three-dimensional space for each participant and each time it acquires gaze information.

Then, during the virtual event, the image generation unit 108 generates a virtual three-dimensional space image by imaging the virtual three-dimensional space as seen from each virtual camera placed in the spectator stand based on the determined line of sight direction for each participant, and outputs data of the generated virtual three-dimensional space image to the corresponding terminal device 20 at any time.

It is assumed that, while each viewer is watching the virtual event, each terminal device 20 generates an image (parallax image) for displaying an image of a virtual three-dimensional space based on image data output from the image generation unit 108, and displays the image on the HMD unit 200 worn by the viewer.

This operation will be described using an example in which, as a position control process, a specific condition determination process is executed based on item consumption behavior information at a specific timing (specifically, consumption of a tip item), and a change control process is executed to change the position of the virtual camera.

Furthermore, this operation describes a case where a network service allows a viewer to view a virtual event, provided that the viewer logs in.

First, when the viewing position control unit 112 receives a viewer's operation instruction (hereinafter also referred to as a "viewing position setting instruction") sent from the terminal device 20 before the start of the virtual event, the viewer's operation instruction being input on the premise of logging in to a network service to set a viewing position (step S101), the viewing position control unit 112 logs the viewer into the network service and sets the virtual camera to the corresponding seat based on the seat information stored in the seat information storage unit 148, the received viewer ID, and the event ID for identifying the virtual event to be viewed (step S102).

Next, when the event management unit 111 starts executing the virtual event at a predetermined timing (step S103), it determines whether the virtual event has ended (step S104).

At this time, if the event management unit 111 determines that the virtual event has not ended, it proceeds to the processing of step S105, and if it determines that the virtual event has ended, it terminates this operation.

Next, if the event management unit 111 determines that the virtual event has not ended, the viewing position control unit 112 determines whether a specific timing has arrived, such as a predetermined period of time having elapsed since the start of the virtual event (step S105), and if it determines that the specific timing has not arrived, the process returns to step S104.

On the other hand, when the viewing position control unit 112 determines that a specific timing has arrived, such as when a predetermined period of time has elapsed since the start of the virtual event, it executes a specific condition determination process to determine whether or not the value of a parameter indicated by the item consumption behavior information (e.g., the amount of tip item consumed or the amount charged based on that amount) satisfies a specific determination condition (step S106).

At this time, if the viewing position control unit 112 determines that the parameter value indicated by the item consumption behavior information does not satisfy the specific judgment condition, it returns to the processing of step S104, and if it determines that the parameter value satisfies the specific judgment condition, it proceeds to the processing of step S107.

Next, if the viewing position control unit 112 determines that the parameter value indicated by the item consumption behavior information satisfies a specific judgment condition, it executes a change control process to change the position of the viewer's virtual camera (step S107), and returns to the process of step S104.

In the processing of step S107, the viewing position control unit 112 determines a destination seat based on the ranking of the current seats relative to the viewing environment, the parameter value indicated by the item consumption behavior information, and the destination condition (e.g., the amount of change in the parameter and the step-up width) that is determined in advance in correspondence with a specific judgment condition, and sets the position of the virtual camera of the viewer to the determined seat.

[7] Others The present invention is not limited to the above-described embodiment, and various modifications are possible. For example, a term cited in the description of the specification or drawings as a term with a broad meaning or synonymous meaning can be replaced with a term with a broad meaning or synonymous meaning in other descriptions of the specification or drawings.

In this embodiment, it is described as a simulation event in which the player gazes at an acting character, but it can also be used in other simulation events such as love simulations, battle events, or other events such as RPGs.

In addition, in this embodiment, each event may be provided to the terminal device 20 by a single server device 10, or multiple server devices 10 may be linked together to form a server system, and each event may be provided to the terminal device 20.

In addition, in this embodiment, the control and position control processing of the virtual event is performed by the server device 10, but the terminal control unit 300 of the above-mentioned terminal device 20 may execute each function of the server processing unit 100 and the event program, and the above-mentioned event may be realized as a standalone. Furthermore, when an event is executed by multiple participants, one terminal device 20 may also function as the above-mentioned server.

The present invention includes configurations that are substantially the same as the configurations described in the embodiments (for example, configurations with the same functions, methods, and results, or configurations with the same purpose and effect). The present invention also includes configurations that replace non-essential parts of the configurations described in the embodiments. The present invention also includes configurations that achieve the same effects as the configurations described in the embodiments, or that can achieve the same purpose. The present invention also includes configurations that add publicly known technology to the configurations described in the embodiments.

Although the embodiments of the present invention have been described in detail above, it will be readily apparent to those skilled in the art that many modifications are possible that do not substantially depart from the novel aspects and effects of the present invention. Therefore, all such modifications are intended to be included within the scope of the present invention.

1: Virtual space event management system 10: Server device 20: Terminal device 100: Server processing unit 101: Communication control unit 102: Viewer management unit 103: Display control unit 104: Information acquisition unit 105: Viewer behavior management unit 106: Virtual camera control unit 107: Sound generation unit 108: Image generation unit 109: Information provision unit 110: Event control unit 111: Event management unit 112: Viewing position control unit 113: Avatar setting unit 114: Object control unit 115: Avatar line of sight control unit 120: Input unit 130: Display unit 140: Memory unit 142: Main memory unit 144: Production information memory unit 146: Viewer related information memory unit 148: Grandstand information memory unit 149: Memory unit 160: Timer unit 170: Memory unit 180: Information storage medium 196: Communication unit 200 : HMD unit 210 : Imaging section 211 : Imaging camera 212 : Image generating section 220 : Motion sensor 230 : Interface 240 : Sound output section 250 : Switch 260 : Input section 261 : Right eye display panel 262 : Left eye display panel 270 : Memory section 271 : Main memory section 272 : Image buffer 280 : Information storage medium 290 : Display section 296 : Communication section 300 : Terminal control unit 310 : Terminal processing section 311 : Communication control section 312 : Event processing section 320 : Drawing section 330 : Sound processing section 340 : Vibration section 341 : Vibrator

Claims (14)

An entertainment viewing management system that allows viewers to view entertainment executed in a virtual space, comprising:
an execution control means for executing the entertainment;
a setting means for setting a position of a virtual camera that functions as a viewpoint of a viewer for viewing the entertainment from among a plurality of viewing positions that are provided in the virtual space and that are ranked according to viewing environment;
an image generating means for generating an image of the virtual space formed from the position of the virtual camera in the viewing direction of the viewer;
providing means for providing the generated image to the viewer;
Equipped with
The setting means:
An entertainment viewing management system characterized by: determining whether or not a condition related to the progress of execution of the entertainment is met while the entertainment is being viewed; and, if it is determined that the condition related to the progress of execution of the entertainment is met, executing a position control process to control the position of the virtual camera of the viewer in accordance with the ranking of each viewing position. 2. The entertainment viewing management system according to claim 1,
The setting means:
An entertainment viewing management system that, as the position control process, when it is determined that a condition regarding the progress of entertainment execution is met , executes (a) a change control process to change the position of the virtual camera of the viewer to another viewing position, or (b) a maintenance control process to maintain the viewing position of the viewer, depending on the ranking of each viewing position. 3. The entertainment viewing management system according to claim 1 ,
The setting means:
As the position control process, when the position of the virtual camera for a first viewer is changed from a first position to a second position different from the first position, the position of the virtual camera for a second viewer that was set to the second position is changed to a position different from the second position. The entertainment viewing management system according to any one of claims 1 to 3 ,
The entertainment viewing management system further comprises an object control means for controlling objects including a viewer character that is to be operated by each viewer placed in the virtual space and is placed at the viewing position of each viewer. The entertainment viewing management system according to any one of claims 1 to 4 ,
a comparison means for performing a comparison process for comparing viewer-related information indicating information about each viewer during the entertainment;
The setting means:
The entertainment viewing management system controls the position of each viewer's virtual camera according to the progress of the entertainment, the comparison result of the viewer-related information, and the ranking of the viewing positions as the position control process. 6. The entertainment viewing management system according to claim 5 ,
The viewer-related information includes:
viewer behavior information relating to the viewer's behavior with respect to the entertainment, the viewer behavior information varying during the performance of the entertainment; and
Viewer identification information for identifying the viewer;
An entertainment viewing management system including at least one of the above. 7. The entertainment viewing management system according to claim 6 ,
The viewer behavior information is
An entertainment viewing management system, wherein the behavioral information input during viewing of the entertainment is item consumption behavioral information related to consumption of items used in the entertainment. 8. The entertainment viewing management system according to claim 7 ,
The setting means:
When executing the position control process, a viewing situation of the viewer is detected;
changing a parameter determined by the item consumption behavior information as the viewer-related information based on the detected viewing status of the viewer;
An entertainment viewing management system that executes the position control process in accordance with the changed parameters of the item consumption behavior information. 9. The entertainment viewing management system according to claim 7 ,
The entertainment viewing management system further comprises a standard changing means for changing a standard value set for the item consumption behavior information when executing the position control process, based on the viewing status of the viewer. The entertainment viewing management system according to any one of claims 1 to 9 ,
The system further includes a reception processing means for receiving an operation input from an operation manager,
The setting means:
and executing the position control process for changing a position of the viewer's virtual camera in response to the accepted operation input from the operation manager. 11. The entertainment viewing management system according to claim 10 ,
The entertainment viewing management system further includes a display control means for displaying an image of a character generated by the image generation means and relating to a gaze character gazed upon by the viewer on a display means for an operation manager , and for displaying viewer-related information of each viewer in correspondence with the viewing position of the viewer. 12. The entertainment viewing management system according to claim 10 ,
The setting means:
An entertainment viewing management system that executes the location control process for a viewer when the location control process is executed by consuming an item owned by the viewer and when the operation manager approves the use of the item to be consumed in the location control process. The entertainment viewing management system according to any one of claims 1 to 12 ,
detection means for detecting a position of the viewer's virtual camera and a dwell time of the viewer's virtual camera position during viewing of the entertainment;
a viewing record management means for managing information indicating the viewing record of the viewer as viewing record information based on the detected position of the virtual camera of the viewer and the stay time of the virtual camera at the position of the viewer;
Further comprising:
The providing means comprises:
and an entertainment viewing management system that provides the managed viewing record information to a corresponding viewer. A program for managing entertainment viewing that allows a viewer to view entertainment executed in a virtual space, comprising:
an execution control means for executing said entertainment;
a setting means for setting a position of a virtual camera that functions as a viewer's viewpoint for viewing the entertainment from among a plurality of viewing positions that are provided in the virtual space and that are ranked according to viewing environment;
an image generating means for generating an image of the virtual space formed in a viewing direction of the viewer from the position of the virtual camera; and
providing means for providing the generated image to the viewer;
The computer functions as
The setting means:
A program characterized by executing a position control process that determines whether or not a condition related to the progress of execution of the entertainment is met while the entertainment is being viewed, and if it is determined that the condition related to the progress of execution of the entertainment is met, controls the position of the virtual camera of the viewer in accordance with the ranking of each viewing position .

Images