JP6962579B2 - Display control device, display control system, and program - Google Patents

Description

The present invention relates to a display control device, a display control system, and a program.

A display control device that controls the display of a head-mounted display equipped with a display unit capable of displaying a virtual space image representing a virtual space viewed from a virtual viewpoint in the virtual space as a stereoscopic image using binocular parallax. It has been known. According to such a display control device, since the depth can be expressed by the head-mounted display, a high immersive feeling can be provided to the user, and the user can experience the illusion of being in a virtual space.

Japanese Unexamined Patent Publication No. 2016-224823

In the display control device as described above, there is a case where it is desired to switch the virtual space image displayed on the head-mounted display from the first virtual space image to the second virtual space image. For example, when the virtual viewpoint is moved from the first position to the second position, the virtual space image displayed on the head-mounted display is displayed at the second position from the first virtual space image showing the virtual space viewed from the first position. You may want to switch to a second virtual space image that shows the virtual space as seen from. Further, for example, when advancing (returning) the time in the virtual space from the first time point to the second time point, the virtual space image displayed on the head-mounted display is displayed from the first virtual space image showing the virtual space at the first time point. , You may want to switch to a second virtual space image that shows the virtual space at the second time point. However, in the display control device as described above, since the feeling of immersion in the virtual space is high, if the virtual space image displayed on the head-mounted display is simply switched from the first virtual space image to the second virtual space image, It may give the user a strong sense of discomfort and impair the immersive feeling.

The present invention has been made in view of the above problems, and an object of the present invention is to change a virtual space image displayed on a head-mounted display from a first virtual space image to a second virtual space without impairing the immersive feeling in the virtual space. It is an object of the present invention to provide a display control device, a display control system, and a program capable of switching to a spatial image.

In order to solve the above problems, the display control device according to one aspect of the present invention is a virtual space image representing a virtual space viewed from a virtual viewpoint in the virtual space as a stereoscopic image using binocular disparity. In a display control device that controls the display of a head-mounted display provided with a display unit capable of displaying the above, a detection result acquisition means for acquiring a detection result of the orientation of the head-mounted display and a first virtual space image acquisition first. A display that executes control for combining the acquisition means, the second acquisition means for acquiring the second virtual space image, the first virtual space image and the second virtual space image, and displaying them on the display unit. The second acquisition means includes a control means and a changing means for lowering the degree of shielding of the second virtual space image by the first virtual space image according to the passage of time, and the second acquisition means changes the orientation of the head-mounted display. Based on the above, the second virtual space image in the viewing direction corresponding to the changed orientation of the head-mounted display is newly acquired, and the display control means is based on the change in the orientation of the head-mounted display. The second virtual space image displayed on the display unit is updated with the newly acquired second virtual space image, and the first virtual space image displayed on the display unit is displayed on the head-mounted display. Move in the movement direction based on the direction opposite to the direction of change of direction.

The display control system according to one aspect of the present invention includes a display unit capable of displaying a virtual space image representing a virtual space viewed from a virtual viewpoint in the virtual space as a stereoscopic image using binocular disparity. In the display control system that controls the display of the head mount display, the detection result acquisition means for acquiring the detection result of the orientation of the head mount display, the first acquisition means for acquiring the first virtual space image, and the second virtual space. A second acquisition means for acquiring an image, a display control means for executing control for synthesizing the first virtual space image and the second virtual space image and displaying them on the display unit, and a display control means according to the passage of time. The second acquisition means includes the changing means for lowering the degree of shielding of the second virtual space image by the first virtual space image, and the second acquisition means after the change based on the change in the orientation of the head mount display. The second virtual space image in the viewing direction corresponding to the orientation of the head mount display is newly acquired, and the display control means displays the second virtual space image displayed on the display unit based on the change in the orientation of the head mount display. The second virtual space image is updated with the newly acquired second virtual space image, and the first virtual space image displayed on the display unit is in the direction opposite to the change direction of the orientation of the head mount display. Move in the direction of movement based on.

It is a figure which shows the hardware composition of the game apparatus which is an example of the display control apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the appearance of a head-mounted display. It is a figure which shows an example of a game space. It is a figure which shows an example of a game space image. It is a figure which shows another example of a game space image. It is a figure for demonstrating the display control processing at the time of switching an image to be displayed on a head-mounted display from a 1st game space image to a 2nd game space image. It is a figure which shows an example of the change of the head orientation of a user. It is a figure for demonstrating change of a view direction. It is a figure which shows another example of a game space image. It is a figure for demonstrating the movement of the 1st game space image displayed on the head-mounted display. It is a figure for demonstrating the display control processing at the time of switching an image to be displayed on a head-mounted display from a 1st game space image to a 2nd game space image. It is a figure for demonstrating an example of the setting method of the alpha value of each pixel of the 1st game space image. It is a figure for demonstrating another example of the setting method of the alpha value of each pixel of the 1st game space image. It is a functional block diagram of a game device. It is a flow chart which shows an example of the process executed by a game apparatus. It is a figure which shows the whole structure of the game system which is an example of the display control system which concerns on other embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following, "The display of a head-mounted display equipped with a display unit capable of displaying a virtual space image representing a virtual space viewed from a virtual viewpoint in the virtual space as a stereoscopic image using binocular parallax is controlled. An example in which the present invention is applied to a game device, which is an example of a “display control device”, will be mainly described.

[1. Hardware Configuration] FIG. 1 shows a hardware configuration of a game device which is an example of a display control device according to an embodiment of the present invention. The game device 10 is a computer used by the user to play a game. For example, the game device 10 includes a stationary game machine (household game machine), a commercial game machine installed in an amusement facility, a desktop computer, a laptop computer, a portable game machine, and a mobile information terminal (tablet computer). (Including) or mobile phones (including smartphones).

As shown in FIG. 1, the game device 10 includes a control unit 11, a storage unit 12, an optical disk drive unit 13, a communication unit 14, an operation unit 15, a head-mounted display 16, a tracking unit 17, and a sound output unit 18. The head-mounted display 16 is provided as an external device connected to the main body of the game device 10 via an interface. The operation unit 15, the tracking unit 17, and the sound output unit 18 may be provided as an external device connected to the main body of the game device 10 via an interface, or may be provided in the main body of the game device 10.

The control unit 11 includes at least one microprocessor (CPU), and executes processing according to a program stored in the storage unit 12 or the information storage medium of the optical disk. The control unit 11 may include a graphic processor (GPU) for performing image processing. The storage unit 12 includes a main storage unit (for example, RAM) and an auxiliary storage unit (for example, a non-volatile semiconductor memory, a hard disk drive, or a solid state drive). The storage unit 12 is for storing programs and data. The storage unit 12 is a memory for expanding graphic data, and may include a graphic memory (VRAM) accessed from a CPU via a graphic controller.

The optical disk drive unit 13 reads programs and data stored in the optical disk. Programs and data are supplied to the game device 10 via an optical disc. The game device 10 may be provided with a component (for example, a memory card slot) for reading a program or data stored in an information storage medium (for example, a memory card) other than an optical disk. Then, the program or data may be supplied to the game device 10 via an information storage medium other than the optical disc.

The communication unit 14 is for data communication with another device via a network. The program or data may be supplied to the game device 10 via the network.

The operation unit 15 is for the user to operate the game. The operation unit 15 includes, for example, a button (key), a stick (lever), a touch panel, a mouse, or the like. The operation unit 15 may be for the user to perform an operation by voice or gesture.

The head-mounted display 16 is a display worn on the user's head, and provides the user with a stereoscopic image utilizing binocular parallax. FIG. 2 is a diagram showing an example of the appearance of the head-mounted display 16. The head-mounted display 16 is a display unit (for example, an organic EL display or a liquid crystal display) capable of displaying a virtual space image representing a virtual space viewed from a virtual viewpoint in the virtual space as a stereoscopic image using binocular parallax. Etc.). When the user U wears the head-mounted display 16, the field of view of the user U is covered by the housing of the head-mounted display 16. When the user U wears the head-mounted display 16, the display unit is located in front of the user U. Therefore, the outside world of the head-mounted display 16 is blocked from the view of the user U, and only the image displayed on the display unit can be seen by the user U's eyes. Stereoscopic viewing is realized by displaying the image for the left eye and the image for the right eye on the display unit, and the user U can see the stereoscopic image. In the following, displaying a virtual space image on the display unit of the head-mounted display 16 may be simply described as "displaying the virtual space image on the head-mounted display 16."

The head-mounted display 16 includes a sensor for detecting the orientation of the head-mounted display 16 (user's head). For example, a gyro sensor, an acceleration sensor, or the like is built in the head-mounted display 16. The tracking unit 17 is for detecting the position of the head-mounted display 16 (user's head). For example, the head-mounted display 16 includes a plurality of light sources (LEDs and the like), and the tracking unit 17 includes a photographing unit for photographing the head-mounted display 16. The tracking unit 17 is fixed at a predetermined position, and the position of the head-mounted display 16 is specified based on the positions of a plurality of light source units appearing in the image captured by the photographing unit (outside-in method). The head-mounted display 16 may include a photographing unit. Then, the position of the head-mounted display 16 may be specified based on an object (an object around the user) appearing in the captured image (inside-out method).

As described above, the head-mounted display 16 displays a virtual space image. The virtual space image displayed on the head-mounted display 16 changes according to the change in the orientation and position of the head-mounted display 16. For example, when the user U changes the direction of the head from the first direction (for example, the front direction) to the second direction (for example, the left direction), the virtual space image displayed on the head-mounted display 16 is first based on the change. It changes from a virtual space image corresponding to a direction to a virtual space image corresponding to a second direction. As a result, the user U can experience the illusion of being in a virtual space.

The sound output unit 18 is a headphone, an earphone, a speaker, or the like, and outputs sound. It should be noted that the so-called stereophonic sound may be provided by simulating the sound coming into the ear from various directions and distances and outputting it from the sound output unit 18. Further, the sound output from the sound output unit 18 may be changed according to the orientation of the head-mounted display 16 (user's head).

In the game device 10, the game is executed by executing the program. In the game device 10, for example, a sports game (a game based on baseball, soccer, tennis, American football, basketball, volleyball, etc.), a race game, a fighting game, a battle game, a card game, a role-playing game, a simulation game, an adventure It is possible to execute various games regardless of the game format and genre, such as a game or a training game.

[2. Overview of display control processing] Hereinafter, the display control processing for switching the image displayed on the head-mounted display 16 from the first virtual space image to the second virtual space image will be described without impairing the immersive feeling in the virtual space. ..

Here, the "virtual space" is a virtual three-dimensional space constructed in a memory (graphic memory: VRAM or the like). Multiple objects are placed in the "virtual space". The game space (see FIG. 3) described later corresponds to an example of the “virtual space”.

The "virtual space image" is an image showing a virtual space viewed from a virtual viewpoint in the viewing direction. In other words, the "virtual space image" is an image in which the virtual space is projected based on the direction of the field of view. That is, the "virtual space image" is an image showing a region (that is, a field of view) within a predetermined viewing angle with respect to the field of view direction in the virtual space. The game space images (FIGS. 4, 5 and 9) described later correspond to an example of the "virtual space image".

The "virtual viewpoint" is the position of the virtual camera set in the virtual space. In the case of the head-mounted display 16, there are two virtual cameras, one for the right eye and one for the left eye.

The “field of view” is the direction of the virtual space displayed on the head-mounted display 16. This is the direction in which the virtual space (field of view) displayed on the head-mounted display 16 is determined. This is the central direction of the virtual space image. The direction of view may or may not coincide with the direction of line of sight. For example, in the head-mounted display 16 having an eye tracking function, the viewing direction and the line-of-sight direction may be different.

In the game device 10, a game space (an example of a virtual space) is constructed to execute a game. FIG. 3 shows an example of a game space. FIG. 3 shows a game space GS that imitates a baseball field, which is constructed when a baseball game is executed. A field (ground) FD and a stand (audience seat) SD are arranged in the game space GS shown in FIG. Further, in the field FD, a home base HB, a first base base FB, a second base base SB, and a third base base TB are arranged. Actually, the player character (object representing a baseball player) and the referee character (object representing the referee) are arranged in the field FD, and the spectator character (object representing the spectator) is arranged in the stand SD. I'm omitting it.

Further, in the game device 10, a game space image representing a field of view from a virtual viewpoint set in the game space is displayed on the head-mounted display 16. 4 and 5 show an example of a game space image generated to be displayed on the head-mounted display 16 as a stereoscopic image utilizing binocular parallax.

The first game space image GA shown in FIG. 4 is an image representing the game space GS when the field of view direction VD1 is viewed from the virtual viewpoint VP1. As shown in FIG. 3, the virtual viewpoint VP1 is set at a position near the pole RP on the right wing side in the stand SD of the outfield on the right wing side. Further, the field of view direction VD1 is set in the direction from the stand SD of the outfield on the right wing side to the home base HB. Therefore, the first game space image GA shown in FIG. 4 represents the game space GS as viewed from the stand SD of the outfield on the right wing side to the home base HB.

On the other hand, the second game space image GB shown in FIG. 5 is an image representing the game space GS when the view direction VD2 is viewed from the virtual viewpoint VP2. As shown in FIG. 3, the virtual viewpoint VP2 is set at the position of the catcher character arranged behind the home base HB. Further, the field of view direction VD2 is set toward the center from the catcher character. Therefore, the second game space image GB shown in FIG. 5 represents the game space GS viewed from the catcher character in the center direction.

[2-1] In a baseball game, it may be necessary to switch the game space image displayed on the head-mounted display 16. For example, when the batter character strikes out and the next batter character enters the turn at bat, if the next batter character suddenly appears in the turn at bat, the user may feel uncomfortable. In such a case, for example, the game space image is once switched to the game space image viewed from the position in the stand SD, and then the game space image is switched to the game space image viewed from another position in the stand SD, and then the player character (for example, the catcher character) is switched to. , The pitcher character, or the batter character) can be switched to a game space image viewed from the user so as not to give a sense of discomfort to the user. Hereinafter, the display control process in the present embodiment will be described by taking as an example a case where the image displayed on the head-mounted display 16 is switched from the first game space image GA to the second game space image GB.

FIG. 6 is a diagram for explaining the outline of the display control process, and is a diagram showing an image displayed on the head-mounted display 16. In FIG. 6, for the sake of simplicity of explanation, the first game space image GA and the second game space image GB are shown in a simplified manner, and the image showing the letter “A” corresponds to the first game space image GA. , The image showing the letter "B" corresponds to the second game space image GB. Further, here, it is assumed that the orientation of the head-mounted display 16 (user's head) is constant.

When switching the image displayed on the head mount display 16 from the first game space image GA to the second game space image GB, in the present embodiment, the first game space image GA and the second game space image GB are image-synthesized. The image is displayed on the head mount display 16. Specifically, an image obtained by semi-transparently synthesizing (alpha blending) the first game space image GA and the second game space image GB is displayed on the display unit 161 of the head-mounted display 16.

For example, if the alpha value is indicated by a value of 0 to 255 and the alpha value of the first game space image GA is α, in this case, the pixel value of each pixel of the display unit 161 of the head mount display 16 is It is set to "pixel value of the corresponding pixel of the first game space image GA * α + pixel value of the corresponding pixel of the second game space image GB * (255-α)". The "corresponding pixel" is a pixel of the first game space image GA or the second game space image GB drawn on the pixel of the display unit 161 of the head-mounted display 16. Also, "*" is a multiplication operator.

When switching the image displayed on the head-mounted display 16 from the first game space image GA to the second game space image GB, first, the alpha value (α) of the first game space image GA is set to “255”. In this case, the first game space image GA is in a completely opaque state, and the second game space image GB is in a completely transparent state. As a result, as shown in FIG. 6A, only the first game space image GA is displayed on the display unit 161 of the head-mounted display 16.

After that, the alpha value (α) of the first game space image GA is gradually lowered according to the passage of time. In this case, as shown in FIG. 6B, the first game space image GA and the second game space image GB are displayed in a semi-transparent state on the display unit 161 of the head mount display 16, and the first game The transparency of the spatial image GA gradually increases, and the transparency of the second game spatial image GB gradually decreases. That is, in the display unit 161 of the head-mounted display 16, the first game space image GA gradually becomes thinner (gradually approaches a completely transparent state), and instead, the second game space image GB gradually becomes darker. (Gradually approaches a completely opaque state).

Finally, when the alpha value (α) of the first game space image GA becomes “0”, the first game space image GA becomes completely transparent and the second game space image GB becomes completely opaque. become. As a result, as shown in FIG. 6C, only the second game space image GB is displayed on the display unit 161 of the head-mounted display 16, and the first game space image GA is switched to the second game space image GB. Is completed. The switching from the first game space image GA to the second game space image GB is performed over, for example, about 1 second.

According to the above, when the image displayed on the head mount display 16 is switched from the first game space image GA to the second game space image GB, the first game space image GA and the second game space image GB Is translucently combined and displayed on the head mount display 16, and the transparency of the first game space image GA is increased and the transparency of the second game space image GB is decreased according to the passage of time. Compared with the case where the image displayed on the mount display 16 is simply switched from the first game space image GA to the second game space image GB, the discomfort given to the user can be reduced.

In the above, the transparency of the first game space image GA is increased and the transparency of the second game space image GB is decreased according to the passage of time. However, the transparency of the second game space image GB is increased. May be kept constant and the transparency of the first game space image GA may be increased with the passage of time, or the transparency of the first game space image GA may be kept constant and the transparency of the second game space image GB may be increased. You may want to reduce the transparency of the game over time.

Further, in the above, the first game space image GA and the second game space image GB are semi-transparently combined and displayed on the head-mounted display 16, but an image composition method other than the semi-transparent composition may be used. For example, an image composition method for synthesizing images in a mesh shape may be used. Also in this case, the image displayed on the head-mounted display 16 may be gradually changed from the first game space image GA to the second game space image GB. That is, in the head-mounted display 16, the number of pixels (area) on which the first game space image GA is displayed gradually decreases with the passage of time, and the number of pixels on which the second game space image GB is displayed ( Area) should be gradually increased. That is, the number (area) of pixels in which the second game space image GB is shielded by the first game space image GA may gradually decrease with the passage of time.

Further, in the above, the image displayed on the head mount display 16 is a game in which the view direction VD2 is viewed from the virtual viewpoint VP2 from the first game space image GA representing the game space GS in which the view direction VD1 is viewed from the virtual viewpoint VP1. The case of switching to the second game space image GB representing the space GS has been described. However, the image displayed on the head mount display 16 represents, for example, the game space GS in which the view direction VD2 is viewed from the virtual viewpoint VP2 at the first time point. The game space image may be switched to a game space image representing the game space GS in which the view direction VD2 is viewed from the virtual viewpoint VP2 at the second time point (time point in the future (or past) than the first time point).

[2-2] When the user changes the direction of the head while switching the image displayed on the head-mounted display 16 from the first game space image GA to the second game space image GB as described above, the head If the image displayed on the mounted display 16 is not updated according to the orientation of the user's head, the user may feel uncomfortable. That is, when the user changes the direction of the head during the above switching, both the first game space image GA and the second game space image GB are oriented in the direction of the user's head due to the processing power of the control unit 11 and the like. It is difficult to generate a new one according to the change. However, when the user changes the direction of the head during the above switching, the user must generate a new first game space image GA corresponding to the changed direction of the user's head. Since the first game space image GA before the orientation is changed and is visually recognized by the user as it is displayed as a fixed image, there is a risk of giving the user a sense of discomfort. As a result, the immersive feeling in the game space (virtual space) may be impaired. Hereinafter, the display control process for reducing such discomfort will be described.

Here, in the state shown in FIG. 6B, as shown in FIG. 7, when the user U wearing the head-mounted display 16 changes the direction of the head from the first direction UD1 to the second direction UD2. Is assumed. The second direction UD2 is a direction formed by rotating the user U as a rotation axis by a relatively small angle θ from the first direction UD1 in the right direction (clockwise).

In this case, for example, as shown in FIG. 8, a new field of view direction VD2N corresponding to the second direction UD2 is set. In FIG. 8, the field of view VD2N is set in the direction from the catcher character arranged behind the home base HB to the pole RP on the right wing side. Then, in this case, as shown in FIG. 9, a new second game space image GBN representing the game space GS in which the view direction VD2N is viewed from the virtual viewpoint VP2 is generated and displayed on the display unit 161 of the head mount display 16. The second game space image GB is updated to the new second game space image GBN.

Further, in this case, the first game space image GA displayed on the display unit 161 of the head-mounted display 16 is moved in a direction corresponding to the direction opposite to the changing direction of the head direction of the user U. In the example shown in FIG. 7, since the direction of the head of the user U is changed to the right when viewed from the user U, the first game space image GA displayed on the display unit 161 of the head-mounted display 16 is displayed from the user U. Look and move to the left.

FIG. 10 is a diagram for explaining the movement of the first game space image GA in this case. FIG. 10A shows a state before the movement (that is, a state when the head direction of the user U is the first direction UD1). In the state shown in FIG. 10A, the center pixel CP of the first game space image GA is displayed at the center point 162 of the display unit 161 of the head-mounted display 16.

FIG. 10B shows a state after movement (that is, a state when the direction of the head of the user U changes to the second direction UD2). In the state shown in FIG. 10B, the center pixel CP of the first game space image GA is displayed at a position moved leftward by a distance X from the center point 162 of the display unit 161 when viewed from the user. Here, the distance X is a distance corresponding to the amount of change in the direction of the user's head. In FIG. 10B, the right end E of the first game space image GA is displayed on the display unit 161 due to the movement of the first game space image GA to the left. Although omitted in FIG. 10B, the area outside the first game space image GA is, for example, a black image.

FIG. 11 is a diagram for explaining an image displayed on the head-mounted display 16 when the head direction of the user U is the second direction UD2. In FIG. 11, for the sake of simplicity of explanation, the first game space image GA and the new second game space image GBN are shown in a simplified manner. That is, in FIG. 11, the image showing the character “A” shows the first game space image GA. Further, the image showing the character "BN" shows the new second game space image GBN.

As shown in FIG. 11A, in this case, the head is an image formed by semi-transparently synthesizing the first game space image GA moved to the left and the newly generated new second game space image GBN. It is displayed on the display unit 161 of the mount display 16. For example, if the alpha value is indicated by a value of 0 to 255 and the alpha value of the first game space image GA is α, in this case, the pixel value of each pixel of the display unit 161 of the head mount display 16 is It is set to "pixel value * α of the corresponding pixel of the first game space image GA + pixel value * (255-α) of the corresponding pixel of the new second game space image GBN". In this case, by displaying the above image on the head-mounted display 16, the image displayed on the head-mounted display 16 is updated according to the direction of the user's head.

After that, the alpha value (α) of the first game space image GA is gradually lowered according to the passage of time. In this case, the transparency of the first game space image GA gradually increases, and the transparency of the new second game space image GBN gradually decreases. That is, in the head-mounted display 16, the first game space image GA gradually becomes thinner (gradually approaches a completely transparent state), and instead, the new second game space image GBN gradually becomes darker (completely). Gradually approaching an opaque state). Finally, when the alpha value (α) of the first game space image GA becomes “0”, the first game space image GA becomes completely transparent, and the new second game space image GBN becomes completely transparent. It becomes opaque. As a result, as shown in FIG. 11B, only the new second game space image GBN is displayed on the display unit 161 of the head-mounted display 16.

As described above, in the present embodiment, when the user changes the direction of the head while switching the image displayed on the head-mounted display 16 from the first game space image GA to the second game space image GB. Regarding the second game space image GB, a new second game space image GBN representing the game space GS in the viewing direction corresponding to the changed head orientation of the user is generated, and the second game space image GBN is displayed on the head-mounted display 16. 2 The game space image GB is updated to the new second game space image GBN. On the other hand, regarding the first game space image GA, the generation of the new first game space image GA is restricted without newly generating the first game space image GA corresponding to the changed orientation of the user's head (that is, the generation of the new first game space image GA is restricted). Then, by moving the first game space image GA displayed on the head mount display 16 in the movement direction corresponding to the direction opposite to the change direction of the user's head direction, the first game space image GA displayed on the head mount display 16 is displayed. 1 Makes the game space image GA appear as if it has been updated according to the orientation of the user's head. By doing so, the image displayed on the head-mounted display 16 is updated according to the direction of the user's head, so that the discomfort given to the user can be reduced.

As described above, in the present embodiment, the first game space image GA displayed on the head-mounted display 16 is generated without newly generating the first game space image GA corresponding to the changed head orientation of the user. By moving the user's head in the direction opposite to the changing direction, the first game space image GA displayed on the head-mounted display 16 appears to be updated according to the user's head orientation. There is. As a method for updating the first game space image GA displayed on the head mount display 16 according to the orientation of the user's head, as in the case of the new second game space image GBN, the orientation of the user's head after the change. A new first game space image representing the game space GS in the viewing direction corresponding to the above is newly acquired, and the first game space image displayed on the head mount display 16 is updated with the newly acquired new first game space image. However, in this method, it is necessary to newly acquire the new first game space image together with the new second game space image GBN, so that the processing load increases. In this respect, according to the present embodiment, it is not necessary to divert the first game space image GA before the user changes the direction of the head and newly acquire the new first game space image, so that the processing load can be reduced. ..

[2-3] As described above, in the present embodiment, the user has a head while switching the image displayed on the head-mounted display 16 from the first game space image GA to the second game space image GB. When the orientation is changed, the first game space image GA corresponding to the orientation of the user's head after the change is displayed on the head-mounted display 16 without being newly generated in consideration of the processing load of the control unit 11. By moving the first game space image GA to be generated in the direction opposite to the changing direction of the user's head direction, the first game space image GA displayed on the head-mounted display 16 is adjusted to the direction of the user's head. It looks as if it has been updated. In this regard, when the first game space image GA displayed on the head-mounted display 16 is moved, the end E of the first game space image GA is moved to the head-mounted display 16 as shown in FIG. 10 (B). The head-mounted display 16 has a portion in which the first game space image GA is displayed and a portion in which the first game space image GA is not displayed, with the end E as a boundary. As a result, the area outside the first game space image GA (for example, the area where the black image is represented) may also be seen by the user, which may give the user a sense of discomfort.

Therefore, in the present embodiment, the transparency of the end portion of the first game space image GA is set to be higher than the transparency of the central portion of the first game space image GA, so that each pixel of the first game space image GA is Set the alpha value.

For example, the alpha value is set so that the alpha value gradually decreases as the distance from the central pixel CP increases, the alpha value of each pixel of the first game space image GA is set, and the alpha at the end of the first game space image GA. Set the value to zero or near zero.

For example, as shown in FIG. 12, the alpha value of the first game space image GA is α, the length from the center pixel CP to the end E of the first game space image GA is L, and the center of the first game space image GA. Assuming that the length from the pixel CP to the pixel P is l, in the present embodiment, the alpha value of each pixel P of the first game space image GA is set to (α * ((L−l) / L)).

Alternatively, as shown in FIG. 13, for example, n subregions PA1 to PAn are set in the first game space image GA according to the distance from the central pixel CP, and each of these subregions PA1 to PAn is set. You may set the alpha value. For example, the alpha value of the partial region PAi may be set to (α * ((n−i) / n)). Alternatively, the alpha value of the partial region PAi may be set to (α * ((n−i + 1) / n)). In the first game space image GA, an end region near the end E (for example, an region within a predetermined distance from the end E like the partial region PAn shown in FIG. 13) and an region other than the end region are provided. It may be set, the alpha value of the end region may be set to zero or substantially zero, and the alpha value of the region other than the end region may be set to α.

At this time, the alpha value (α) of the first game space image GA is set to a value corresponding to the alpha value (α) of the first game space image GA at the time immediately before changing the direction of the head of the user U. Will be done. For example, the alpha value (α) of the first game space image GA at the time point T1 immediately before the head direction of the user U changes from the first direction UD1 to the second direction UD2 is set to “α0”, and the alpha value per unit time is set. Assuming that the amount of change in (α) is “Δα”, the alpha value (α) of the first game space image GA at the time point T2 immediately after the direction of the head of the user U changes from the first direction UD1 to the second direction UD2 is It is set to "α0-Δα * (T2-T1)".

By doing the above, the boundary between the part where the first game space image GA is displayed and the part where the first game space image GA is not displayed can be made inconspicuous, and in this respect as well, the user. It is possible to reduce the discomfort given to the user. Note that the first game space image GA is only available when the first game space image GA is moved while the image displayed on the head mount display 16 is being switched from the first game space image GA to the second game space image GB. The transparency of the edge portion may be set higher than the transparency of the central portion, or when the image displayed on the head mount display 16 is switched from the first game space image GA to the second game space image GB. From the beginning, the transparency of the edge portion of the first game space image GA may be set higher than the transparency of the central portion. However, only when the first game space image GA is moved during the above switching, the mode in which the transparency at the end of the first game space image GA is set higher than the transparency at the center increases the processing load. Can be reduced.

[3. Functional block] A functional block realized by the game device 10 will be described. FIG. 14 is a functional block diagram showing functional blocks realized by the game device 10 that are related to the present invention. As shown in FIG. 14, the game device 10 includes a data storage unit 100, a detection result acquisition unit 110, a virtual space image acquisition unit 120, a display control unit 130, and a change unit 140.

The data storage unit 100 is realized by an optical disk mounted on the storage unit 12 or the optical disk drive unit 13. The data storage unit 100 may be realized by a storage unit included in another device accessible from the game device 10. On the other hand, the data storage unit 100, the detection result acquisition unit 110, the virtual space image acquisition unit 120, the display control unit 130, and the change unit 140 are mainly realized by the control unit 11.

[3-1] The data storage unit 100 stores data necessary for displaying a virtual space image on the head-mounted display 16. For example, the data necessary for generating the virtual space image is stored in the data storage unit 100. Specifically, for example, the virtual space data D101 indicating the current state of the virtual space is stored in the data storage unit 100. For example, the virtual space data D101 includes data indicating the current state (position, posture, orientation, etc.) of each object arranged in the virtual space, and data indicating the virtual viewpoint and the viewing direction set in the virtual space. include. In the above-mentioned example, the game space GS corresponds to an example of the “virtual space”, and in this case, the virtual space data D101 indicating the current state of the game space GS is stored in the data storage unit 100.

[3-2] The detection result acquisition unit 110 acquires the detection result of the orientation of the head-mounted display 16.

The "detection result of the orientation of the head-mounted display 16" is the detection result of the orientation of the head-mounted display 16 that changes when the user changes the orientation of the head when the head-mounted display 16 is attached to the user. Is. The above "detection result" is detected by a detection unit that detects a change in the orientation of the head-mounted display 16. For example, a sensor (gyro sensor, acceleration sensor, etc.) built in the head-mounted display 16 or a separately installed tracking unit 17 (photographing unit, etc.) corresponds to an example of the “detection unit”. Based on the above "detection result", the presence / absence of change in the orientation of the head-mounted display 16, the change direction, or the amount of change can be acquired.

[3-3] The virtual space image acquisition unit 120 acquires a virtual space image.

“Acquiring a virtual space image” means, for example, generating a virtual space image. Alternatively, "acquiring a virtual space image" may be acquired by receiving a virtual space image generated by another device and transmitted from the device.

[3-3-1] The virtual space image acquisition unit 120 includes a first acquisition unit 121 and a second acquisition unit 122. The first acquisition unit 121 acquires the first virtual space image. The second acquisition unit 122 acquires the second virtual space image.

The "first virtual space image" and the "second virtual space image" are virtual space images that are different from each other. Hereinafter, specific examples of the "first virtual space image" and the "second virtual space image" will be described.

(1) For example, the "first virtual space image" and the "second virtual space image" are virtual space images in which at least one of the virtual viewpoint and the viewing direction is different.

Specifically, the "first virtual space image" is an image representing the virtual space viewed from the first virtual viewpoint in the first viewing direction, and the "second virtual space image" is the second image from the second virtual viewpoint. It is an image showing a virtual space seen in the viewing direction. When the first virtual viewpoint and the second virtual viewpoint are different, the second visual field direction may be different from the first visual field direction or may be the same direction. Further, when the first visual field direction and the second visual field direction are different, the second virtual viewpoint may be different from or the same as the first virtual viewpoint.

For example, in the case of a virtual space imitating a baseball field, one of the "first virtual space image" and the "second virtual space image" can be either a player character (for example, a catcher character or a batter character) or a referee character (for example, a catcher character or a batter character). For example, an image showing the virtual space seen from the position of the referee character) may be used, and the other may be an image showing the virtual space seen from another position (for example, the position of the stand). Further, for example, in the case of a virtual space imitating a baseball field, an image showing the virtual space seen from the first position in the stand is referred to as a "first virtual space image", and the virtual space seen from the second position in the stand is shown. The image may be a "second virtual space image".

(2) For example, the "first virtual space image" is an image showing the virtual space in the first state when the view direction is viewed from the virtual viewpoint, and the "second virtual space image" is the view direction from the virtual viewpoint. It may be an image showing the virtual space of the second state seen. Specifically, for example, in the case of a virtual space imitating a baseball field, an image showing the virtual space in which the first team is defending is referred to as a "first virtual space image", and the second team defends. An image showing the virtual space in the state of being in the state may be referred to as a "second virtual space image".

(3) For example, the "first virtual space image" is an image showing the virtual space at the first time point, and the "second virtual space image" is a virtual at the second time point after or before the first time point. It may be an image showing space.

(4) For example, the "first virtual space image" is an image showing the first virtual space, and the "second virtual space image" is an image showing a second virtual space different from the first virtual space. You may. Specifically, for example, the image showing the first virtual space showing the first baseball field is referred to as the "first virtual space image", and the image showing the second virtual space showing the second baseball field is referred to as the "second virtual space image". May be.

In the above-mentioned example of the game space GS, the first game space image GA corresponds to an example of the “first virtual space image”, and the second game space image GB corresponds to an example of the “second virtual space image”.

[3-3-2] The second acquisition unit 122 newly acquires a second virtual space image in the field of view corresponding to the changed orientation of the head-mounted display 16 based on the change in the orientation of the head-mounted display 16. do.

"Based on the change in the orientation of the head-mounted display 16, a second virtual space image in the viewing direction corresponding to the changed orientation of the head-mounted display 16 is newly acquired" means that the orientation of the head-mounted display 16 changes. In this case, the second virtual space image is acquired with the direction corresponding to the changed orientation of the head-mounted display 16 as the new viewing direction. That is, it is to acquire a second virtual space image showing the virtual space seen from the virtual viewpoint in the new field of view direction.

In the above-mentioned example of the game space GS, the new second game space image GBN corresponds to an example of "a second virtual space image in the viewing direction corresponding to the orientation of the head-mounted display 16 after the change".

[3-4] The display control unit 130 executes control for displaying the virtual space image on the display unit of the head-mounted display 16.

“Execute control for displaying the virtual space image on the display unit of the head-mounted display 16” may mean generating a virtual space image and displaying it on the display unit of the head-mounted display 16. By transmitting image data for displaying the virtual space image on the display unit of the head-mounted display 16 to another device connected to the head-mounted display 16, the virtual space image is transmitted to the other device of the head-mounted display 16. It may be displayed on the display unit. The "image data" may be data indicating the virtual space image itself, or may be data necessary for generating the virtual space image.

[3-4-1] The display control unit 130 executes control for synthesizing the first virtual space image and the second virtual space image and displaying them on the display unit of the head-mounted display 16.

"Image composition" is to superimpose the first virtual space image and the second virtual space image. For example, translucent composition corresponds to an example of "image composition". That is, alpha blending corresponds to an example of "image composition". More specifically, for example, when the alpha value is represented by a value of 0 to 255 and the alpha value of the first virtual space image is α, the pixel value of each pixel of the head mount display 16 is set to “first virtual space”. Setting the pixel value of the corresponding pixel of the image * α + the pixel value of the corresponding pixel of the second virtual space image * (255-α) ”corresponds to an example of“ image composition ”. Here, the "corresponding pixel" is a pixel of the first virtual space image or the second virtual space image displayed on the pixel of the head-mounted display 16. Note that "image composition" is not limited to translucent composition, and other image composition methods may be used. For example, synthesizing images in a mesh shape corresponds to an example of "image synthesizing".

In the above-mentioned example of the game space GS, the display control unit 130 controls to semi-transparently combine the first game space image GA and the second game space image GB and display them on the display unit 161 of the head-mounted display 16. Execute (see FIG. 6B).

[3-4-2] The display control unit 130 newly obtains a second virtual space image displayed on the display unit of the head-mounted display 16 by the second acquisition unit 122 based on the change in the orientation of the head-mounted display 16. The first virtual space image displayed on the display unit of the head-mounted display 16 is moved in the movement direction based on the direction opposite to the change direction of the direction of the head-mounted display 16. ..

The "moving direction based on the direction opposite to the direction of change in the direction of the head-mounted display 16" is a moving direction obtained based on the direction opposite to the direction of change in the direction of the head-mounted display 16. The movement direction may be a direction that coincides with the direction opposite to the direction of change in the direction of the head mount display 16, or a direction in which the deviation from the direction of change in the direction of the head mount display 16 is less than the threshold value. It may be the direction of movement. The "threshold value" in this case is set to a value small enough not to give a sense of discomfort to the user.

"Move the first virtual space image displayed on the display unit of the head-mounted display 16" means to change the display position of the pixels of the first virtual space image from the current position to another position. This is to update the first virtual space image displayed on the display unit of the mounted display 16.

"Move the first virtual space image displayed on the display unit of the head-mounted display 16 in the moving direction" means that the display position of the pixels of the first virtual space image is moved from the current position in the moving direction. The first virtual space image displayed on the display unit of the head-mounted display 16 is updated by changing to a different position. In this case, the moving speed or moving amount of the first virtual space image is the moving speed or moving amount corresponding to the change (change speed or change amount) of the orientation of the head-mounted display 16.

"The second virtual space image displayed on the display unit of the head-mounted display 16 is updated to the newly acquired second virtual space image according to the change in the orientation of the head-mounted display 16, and the head-mounted display 16 "Move the first virtual space image displayed on the display unit in the moving direction based on the direction opposite to the changing direction of the orientation of the head-mounted display 16" means that when the orientation of the head-mounted display 16 changes, after the change. A second virtual space image in which the direction corresponding to the orientation of the head-mounted display 16 is a new viewing direction, and a first virtual space image in which the head-mounted display 16 is moved in a moving direction based on the opposite direction of the change direction of the orientation. Is to be image-combined and displayed on the display unit of the head-mounted display 16.

In the above-mentioned example of the game space GS, for example, as shown in FIG. 7, when the orientation of the head of the user U changes, the display control unit 130 corresponds to the orientation of the head-mounted display 16 after the change. 2 Control for semi-transparently synthesizing the game space image GBN and the first game space image GA moved in the direction opposite to the direction of change in the direction of the head-mounted display 16 and displaying them on the display unit 161 of the head-mounted display 16. Is executed (see FIG. 11 (A)).

[3-5] The changing unit 140 lowers the degree of shielding of the second virtual space image by the first virtual space image according to the passage of time.

The "shielding degree" is the degree to which the second virtual space image is shielded by the first virtual space image. “Reducing the degree of shielding” means reducing the degree to which the second virtual space image is shielded by the first virtual space image.

When the first virtual space image and the second virtual space image are semi-transparently combined and displayed on the head-mounted display 16, the transparency of the first virtual space image or the transparency of the second virtual space image is the "shielding degree". Corresponds to one example. Increasing the transparency of the first virtual space image corresponds to an example of "decreasing the degree of shielding". Further, lowering the transparency of the second virtual space image corresponds to an example of "lowering the degree of shielding".

For example, when the transparency of the first virtual space image is set to 0% (that is, the transparency of the first virtual space image is set to a completely opaque state), the transparency of the second virtual space image is set to 100%. Therefore, since the second virtual space image becomes completely transparent, the degree of shielding is 100%.

Further, for example, when the transparency of the first virtual space image is set to 100% (that is, the transparency of the second virtual space image becomes 0% and the second virtual space image becomes completely opaque). Since the first virtual space image is set to a completely transparent state, the degree of shielding is 0%.

Similarly, when the transparency of the first virtual space image is set to 25% (that is, when the transparency of the second virtual space image is 75%), the shielding degree is 75%. Further, when the transparency of the first virtual space image is set to 75% (that is, when the transparency of the second virtual space image is 25%), the shielding degree is 25%.

When the first virtual space image and the second virtual space image are combined and displayed on the head mount display 16 so that the second virtual space image is shielded in a mesh shape by the first virtual space image. The ratio of the area where the second virtual space image is shielded by the first virtual space image corresponds to an example of "shielding degree". Reducing the ratio of the area where the second virtual space image is shielded by the first virtual space image corresponds to an example of "reducing the degree of shielding".

"Reducing the degree of shielding with the passage of time" means gradually decreasing the degree of shielding with the passage of time. For example, the degree of shielding is lowered by a predetermined amount at predetermined time intervals.

For example, when the first virtual space image and the second virtual space image are semi-transparently combined and displayed on the head mount display 16, the changing unit 140 changes the first virtual space image and the second virtual space image according to the passage of time. By changing the transparency of at least one of the virtual space images, the degree of shielding of the second virtual space image by the first virtual space image is lowered.

"Transparency" is indicated by, for example, an alpha value. For example, the alpha value is represented by a value of 0 to 255, the alpha value of the first virtual space image is α, and the pixel value of the pixel of the head mount display 16 is “the pixel value of the corresponding pixel of the first virtual space image *. When set to "α + pixel value of the corresponding pixel of the second virtual space image * (255-α)", the transparency of the first virtual space image is α, and the transparency of the second virtual space image is (255-α). α). In this case, the smaller the alpha value of the first virtual space image, the higher the transparency of the first virtual space image, the lower the transparency of the second virtual space image, and the larger the alpha value of the first virtual space image. The lower the transparency of the first virtual space image, and the higher the transparency of the second virtual space image.

"Changing the transmittance of at least one of the first virtual space image and the second virtual space image according to the passage of time" means, for example, the transparency of the first virtual space image as time passes. To change the degree. For example, the transparency of the first virtual space image is gradually increased as time passes.

Or, "changing the transmittance of at least one of the first virtual space image and the second virtual space image according to the passage of time" means, for example, the second virtual space image as time passes. Is to change the transparency of. For example, the transparency of the second virtual space image is gradually reduced as time passes.

Alternatively, "changing the transparency of at least one of the first virtual space image and the second virtual space image according to the passage of time" means, for example, the first virtual space image as time passes. And the second virtual space image and the transparency of both. For example, as time passes, the transparency of the first virtual space image is gradually increased, and the transparency of the second virtual space image is gradually decreased.

The change unit 140 includes at least one of the first change unit 141 and the second change unit 142.

The first change unit 141 increases the transparency of the first virtual space image with the passage of time.

"Increasing the transparency of the first virtual space image with the passage of time" means gradually increasing the transparency of the first virtual space image with the passage of time. For example, from a state in which the transparency of the first virtual space image is set lower than the transparency of the second virtual space image, the transparency of the first virtual space image is gradually increased as time passes. Is. More specifically, for example, the transparency of the first virtual space image is increased by a predetermined value at predetermined time intervals.

“Increasing the transparency of the first virtual space image” means lowering the alpha value of the first virtual space image if it indicates that the smaller the alpha value is, the higher the transparency is. Note that "increasing the transparency of the first virtual space image" means increasing the alpha value of the first virtual space image if it indicates that the larger the alpha value is, the higher the transparency is. For example, the pixel value of each pixel of the display unit of the head mount display 16 is set to "pixel value of the corresponding pixel of the first virtual space image * α + pixel value of the corresponding pixel of the second virtual space image * (255-α)". If this is the case, lowering the value of α corresponds to "increasing the transparency of the first virtual space image".

The first change unit 141 sets the transparency of the first virtual space image so that the transparency of the edge portion of the first virtual space image is higher than the transparency of the central portion of the first virtual space image.

The "edge of the first virtual space image" is a pixel at the end of the first virtual space image. It may be a pixel near the edge of the first virtual space image. The "edge pixel" is a pixel corresponding to the edge of the field of view when the first virtual space image is generated. The "pixel near the edge" is a pixel within a predetermined distance from the edge of the first virtual space image.

The "central portion of the first virtual space image" is a pixel at the center of the first virtual space image. It may be a pixel near the center of the first virtual space image. The "center pixel" is a pixel corresponding to the center of the field of view when the first virtual space image is generated. The "pixel near the center" is a pixel within a predetermined distance from the center of the first virtual space image.

"The transparency of the first virtual space image is set so that the transparency of the edge portion of the first virtual space image is higher than the transparency of the central part of the first virtual space image" is, for example, the first. The transmittance of the first virtual space image is set so that the transparency gradually increases from the center portion to the end portion of the first virtual space image.

Or, for example, "the transparency of the first virtual space image is set so that the transparency of the edge portion of the first virtual space image is higher than the transparency of the central portion of the first virtual space image". , The transparency other than the edge of the first virtual space image is set to the first transparency, and the transparency of the edge of the first virtual space image is set to the second transparency higher than the first transparency. It may be.

The second change unit 142 lowers the transparency of the second virtual space image with the passage of time.

“Reducing the transparency of the second virtual space image with the passage of time” means gradually reducing the transparency of the second virtual space image with the passage of time. For example, from a state in which the transparency of the second virtual space image is set higher than the transparency of the first virtual space image, the transparency of the second virtual space image is gradually lowered as time passes. Is. More specifically. For example, the transparency of the second virtual space image is reduced by a predetermined value at predetermined time intervals.

“Reducing the transparency of the second virtual space image” means increasing the alpha value of the second virtual space image if it indicates that the smaller the alpha value is, the higher the transparency is. Note that "reducing the transparency of the second virtual space image" means lowering the alpha value of the second virtual space image if it indicates that the larger the alpha value is, the higher the transparency is. For example, when the pixel value of each pixel of the head mount display 16 is set to "pixel value of the corresponding pixel of the first virtual space image * α + pixel value of the corresponding pixel of the second virtual space image * (255-α)". If so, increasing the value of (255-α) corresponds to "decreasing the transparency of the second virtual space image". That is, lowering the value of α corresponds to "lowering the transparency of the second virtual space image".

In the above-mentioned example of the game space GS, the first changing unit 141 gradually increases the transparency of the first game space image GA according to the passage of time, and the second changing unit 142 increases the transparency of the first game space image GA according to the passage of time. 2 Gradually reduce the transparency of the game space image GB (or the new second game space image GBN).

[4. Process] The process executed by the game device 10 will be described. FIG. 15 shows an example of processing for switching the image displayed on the display unit of the head-mounted display 16 from the first game space image GA to the second game space image GB. When the control unit 11 executes the process shown in FIG. 15 according to the program, the control unit 11 functions as a functional block (excluding the data storage unit 100) shown in FIG.

As shown in FIG. 15, first, the control unit 11 generates a first game space image GA representing the game space GS in which the view direction VD1 is viewed from the virtual viewpoint VP1 (S100). Further, the control unit 11 generates a second game space image GB representing the game space GS when the view direction VD2 is viewed from the virtual viewpoint VP2 (S102). Further, the control unit 11 initializes the variable α to “255” (S104). Then, the control unit 11 displays an image formed by semi-transparently synthesizing the first game space image GA and the second game space image GB on the display unit 161 of the head-mounted display 16 (S106). In this case, the control unit 11 sets the alpha value of each pixel of the first game space image GA to the value of the variable α. Therefore, the pixel value of each pixel of the display unit 161 of the head-mounted display 16 is "pixel value of the corresponding pixel of the first game space image GA * α + pixel value of the corresponding pixel of the second game space image GB * (255-α). ) ”Is set.

After the execution of step S106, the control unit 11 has changed the orientation of the head-mounted display 16 based on the detection result (or the detection result of the tracking unit 17) of the gyro sensor or the acceleration sensor built in the head-mounted display 16. Whether or not it is determined (S108).

When it is not determined that the orientation of the head-mounted display 16 has changed (S108: No), the control unit 11 subtracts a predetermined amount Δα from the variable α (S118) and displays it on the display unit 161 of the head-mounted display 16. The image is updated (S120). In this case, the control unit 11 sets the alpha value of each pixel of the first game space image GA to the value of the variable α subtracted in step S116. In this case, the pixel value of each pixel of the display unit 161 of the head-mounted display 16 is "pixel value of the corresponding pixel of the first game space image GA * α + pixel value of the corresponding pixel of the second game space image GB * (255-α). ) ”Is set.

On the other hand, when it is determined that the orientation of the head-mounted display 16 has changed (S108: Yes), the control unit 11 acquires the change direction and the amount of change in the orientation of the head-mounted display 16 (S110). Further, the control unit 11 acquires a new view direction VD2N corresponding to the orientation of the head-mounted display 16 after the change, and represents a new second game space GS representing the new view direction VD2N viewed from the virtual viewpoint VP2. A new image GBN is generated (S112).

After executing step S112, the control unit 11 subtracts a predetermined amount Δα from the variable α (S114), and updates the image displayed on the display unit 161 of the head-mounted display 16 (S116).

In this case, the control unit 11 changes the display position of the pixels of the first game space image GA from the original display position in the direction opposite to the change direction of the direction of the head-mounted display 16. The head-mounted display 16 is displayed by semi-transparently synthesizing the first game space image GA and the new second game space image GBN generated in step S112 while making the position moved by the movement distance corresponding to. It is displayed in unit 161.

In this case, the control unit 11 sets the alpha value of each pixel of the first game space image GA to (α * ((L−l) / L)). Here, "L" is the length from the center pixel CP of the first game space image GA to the end E, and "l" is the length from the center pixel CP to the pixel of the first game space image GA. In this case, the pixel value of each pixel of the display unit 161 of the head mount display 16 is "the pixel value of the corresponding pixel of the first game space image GA *, where αp is the alpha value of the corresponding pixel of the first game space image GA. It is set to "αp + pixel value * (255-αp) of the corresponding pixel of the new second game space image GBN". The pixel value of the pixel in the portion where the first game space image GA is not displayed is set to the pixel value of the corresponding pixel of the new second game space image GBN.

After executing step S116 or S120, the control unit 11 determines whether or not the variable α is “0” (S122). When the variable α is “0”, the control unit 11 ends this process. On the other hand, if the variable α is not “0”, the control unit 11 re-executes step S108. That is, the control unit 11 repeatedly executes steps S108 to S120 at predetermined time intervals until the variable α becomes “0”.

[5. Summary] In the game device 10, the first game space image GA and the second game space image GB are image-combined and displayed on the head mount display 16, and the transparency of the first game space image GA is increased according to the passage of time. In order to raise and lower the transparency of the second game space image GB, a sense of discomfort given to the user as compared with the case where the image displayed on the head mount display 16 is simply switched from the first game space image GA to the second game space image GB. Can be reduced.

If the user changes his or her head while switching the image displayed on the head-mounted display 16 from the first game space image GA to the second game space image GB, the image displayed on the head-mounted display 16 is displayed by the user. If it is not updated according to the direction of the head, the user may feel uncomfortable and the immersive feeling in the game space GS (virtual space) may be impaired. In this regard, according to the game device 10, when the orientation of the head-mounted display 16 changes during the switching from the first game space image GA to the second game space image GB (that is, the user turns his / her head). When changed), the second game space image GB displayed on the head-mounted display 16 is updated to a new second game space image GBN corresponding to the orientation of the head-mounted display 16 after the change, and the head-mounted display 16 is displayed. By moving the displayed first game space image GA in the direction opposite to the direction in which the orientation of the head-mounted display 16 changes, the image displayed on the head-mounted display 16 can be updated according to the orientation of the user's head. The discomfort given to the user can be reduced.

As a method for updating the first game space image GA displayed on the head mount display 16 according to the direction of the user's head, the head mount display after the change is the same as the new second game space image GBN. A method of newly acquiring a new first game space image corresponding to 16 orientations and updating the first game space image GA displayed on the head mount display 16 with the newly acquired new first game space image. However, in this method, it is necessary to newly acquire the new first game space image together with the new second game space image GBN, so that the processing load increases. In this regard, according to the game device 10, since it is not necessary to newly acquire the new first game space image (because the acquisition of the new first game space image is restricted), the processing load can be reduced. ..

Further, when the first game space image GA displayed on the head mount display 16 is moved, the end E of the first game space image GA is displayed on the head mount display 16, and the end E is displayed on the head mount display 16. Since there is a portion where the first game space image GA is displayed and a portion where the first game space image GA is not displayed, there is a risk of giving a sense of discomfort to the user. In this regard, according to the game device 10, the transparency of the first game space image GA is set by gradually increasing the transparency from the central portion to the end portion of the first game space image GA. , The boundary between the portion where the first game space image GA is displayed and the portion where the first game space image GA is not displayed can be made inconspicuous, and the discomfort given to the user can be reduced.

Further, according to the game device 10, as a result of reducing the discomfort given to the user, so-called "VR sickness" can also be reduced.

[6. Modifications] The present invention is not limited to the embodiments described above.

[6-1] In the embodiment described above, when the first game space image GA displayed on the head mount display 16 is moved, the first game space image GA is gradually moved from the central portion to the end portion. By setting the transparency of the first game space image GA so that the transparency is high, the part where the first game space image GA is displayed and the part where the first game space image GA is not displayed are displayed. However, for example, another image (for example, an abstract pattern or a pattern such as innumerable balls or bats) is displayed in the part where the first game space image GA is not displayed. You may direct them to approach.

[6-2] The present invention can also be applied to a game system in which an image displayed on the head-mounted display 16 is updated while performing data communication between a game device and a game server.

FIG. 16 is a diagram showing a configuration of a game system 1A, which is an aspect of a display control system according to another embodiment of the present invention. The game system 1A includes a game device 10A and a game server 30A. The game device 10A and the game server 30A are connected to the network N, and data communication is possible between the game device 10A and the game server 30A. Since the game device 10A is the same as the game device 10 shown in FIG. 1, description thereof will be omitted here.

The game server 30A is, for example, a server computer. As shown in FIG. 16, the game server 30A includes a control unit 31, a storage unit 32, an optical disk drive unit 33, and a communication unit 34. These are the same as the control unit 11, the storage unit 12, the optical disk drive unit 13, and the communication unit 14 shown in FIG. Programs and data are supplied to the game server 30A via an optical disc. The game server 30A may be provided with a component (for example, a memory card slot) for reading a program or data stored in an information storage medium (for example, a memory card) other than an optical disk. Then, the program or data may be supplied to the game server 30A via an information storage medium other than the optical disc. Alternatively, the program or data may be supplied to the game server 30A via the network N.

In the game system 1A, all of the functional blocks shown in FIG. 14 may be realized by the game device 10A (an example of the display control device) or the game server 30A (another example of the display control device). good. Further, a part of the functional blocks shown in FIG. 14 may be realized by the game device 10A, and the rest may be realized by the game server 30A.

For example, the first game space image GA or the second game space image GB is generated by the game server 30A, and the first game space image GA or the second game space image GB is transmitted to the game device 10A. The spatial image GA or the second game spatial image GB may be displayed on the head mount display 16. In this case, data regarding the orientation of the head mount display 16 is transmitted to the game server 30A, and when the orientation of the head mount display 16 changes, the game server 30A responds to the new orientation of the head mount display 16 after the change. The new second game space image GBN may be displayed on the head mount display 16 by newly generating the two game space image GBN and transmitting the new second game space image GBN to the game device 10A.

[6-3] In the above, the case where the game space image of the game space GS imitating a baseball field is displayed on the head-mounted display 16 has been mainly described, but the present invention has described another game space image on the head-mounted display 16. It can also be applied when displaying in. The present invention can also be applied to display control devices other than game devices 10 and 10A and game server 30A, and display control systems other than game system 1A. That is, the present invention can also be applied to the case where a virtual space image other than the game space image is displayed on the head-mounted display 16.

[7. Supplementary note] From the above description, the present invention can be grasped as follows, for example. In addition, in order to facilitate the understanding of the present invention, the reference numerals described in the drawings are appropriately described in parentheses, but the present invention is not limited to the illustrated mode.

1) The display control device (10, 10A, 30A) according to one aspect of the present invention is a stereoscopic image using binocular disparity, from a virtual viewpoint (VP1, VP2) in a virtual space (GS) to a viewing direction (VP1, VP2). A display control device (10, 10A) that controls the display of a head-mounted display (16) provided with a display unit capable of displaying a virtual space image (GA, GB, GBN) representing a virtual space in which VD1, VD2, VD2N) is viewed. , 30A), the detection result acquisition means (110) for acquiring the detection result of the orientation of the head-mounted display (16), the first acquisition means (121) for acquiring the first virtual space image (GA), and the first. 2 The second acquisition means (122) for acquiring the virtual space image (GB), the first virtual space image (GA), and the second virtual space image (GB) are image-combined and displayed on the display unit. A display control means (130) for executing the control for the purpose, and a change means (140) for lowering the degree of shielding of the second virtual space image (GB) by the first virtual space image (GA) according to the passage of time. The second acquisition means (122) includes the view direction (VD2N) corresponding to the changed orientation of the head-mounted display (16) based on the change in the orientation of the head-mounted display (16). The second virtual space image (GBN) is newly acquired, and the display control means (130) displays the second virtual space image (GBN) on the display unit based on a change in the orientation of the head-mounted display (16). The virtual space image (GB) is updated to the newly acquired second virtual space image (GBN), and the first virtual space image (GA) displayed on the display unit is displayed on the head-mounted display (16). ) Is moved in the movement direction based on the opposite direction of the change direction.

4) The display control system (1A) according to one aspect of the present invention can display a virtual space image representing a virtual space viewed from a virtual viewpoint in the virtual space as a stereoscopic image using binocular disparity. In a display control system (1A) that controls the display of a head-mounted display (16) provided with a display unit, a detection result acquisition means for acquiring a detection result of the orientation of the head-mounted display (16) and (110), first. 1 First acquisition means (121) for acquiring a virtual space image, second acquisition means (122) for acquiring a second virtual space image, and image composition of the first virtual space image and the second virtual space image. A display control means (130) that executes control for displaying on the display unit, and a change means (140) that lowers the degree of shielding of the second virtual space image by the first virtual space image according to the passage of time. ), And the second acquisition means (122) is based on the change in the orientation of the head mount display (16), and is in the view direction corresponding to the changed orientation of the head mount display (16). The second virtual space image is newly acquired, and the display control means (130) obtains the second virtual space image displayed on the display unit based on the change in the orientation of the head mount display (16). , The first virtual space image is updated to the newly acquired second virtual space image, and the first virtual space image displayed on the display unit is moved in a direction opposite to the change direction of the direction of the head mount display (16). Move to.

5) The display control device (10, 10A, 30A) according to one aspect of the present invention is a virtual space representing a virtual space viewed from a virtual viewpoint in the virtual space as a stereoscopic image using binocular disparity. In the display control device (10, 10A, 30A) that controls the display of the head mount display (16) provided with a display unit capable of displaying an image, the detection result of acquiring the detection result of the orientation of the head mount display (16). The acquisition means (110) and the means for acquiring the first virtual space image, which correspond to the changed orientation of the head mount display (16) based on the change in the orientation of the head mount display (16). A means for newly acquiring the first virtual space image in the viewing direction (121) and a means for acquiring the second virtual space image, based on a change in the orientation of the head mount display (16). The second acquisition means (122) for newly acquiring the second virtual space image in the view direction corresponding to the orientation of the head mount display (16) after the change, the first virtual space image, and the first virtual space image. The display control means (130) that executes control for synthesizing the two virtual space images and displaying them on the display unit, and the first virtual space image and the second virtual space image are image-combined and described. When displayed on the display unit, the display control device (10, In 10A and 30A), when the first virtual space image and the second virtual space image are image-combined and displayed on the display unit, the first virtual space image and the second virtual space image are combined. The display control means (130) further includes a means (120) for restricting new acquisition of one of the virtual space images, and the display control means (130) is attached to the display unit based on a change in the orientation of the head mount display (16). The first virtual space image and the first virtual space image displayed on the display unit by moving the displayed one virtual space image in a movement direction based on the direction opposite to the change direction of the direction of the head mount display (16). The other virtual space image of the second virtual space image is updated with the newly acquired virtual space image.

6) The display control system (1A) according to one aspect of the present invention can display a virtual space image representing a virtual space viewed from a virtual viewpoint in the virtual space as a stereoscopic image using binocular disparity. In the display control system (1A) that controls the display of the head-mounted display (16) provided with various display units, the detection result acquisition means (110) for acquiring the detection result of the orientation of the head-mounted display (16), and the first 1 A means for acquiring a virtual space image, based on a change in the orientation of the head mount display (16), and the first virtual in the viewing direction corresponding to the changed orientation of the head mount display (16). The first acquisition means (121) for newly acquiring a spatial image and the second virtual space image acquisition means for acquiring the head mount after the change based on the change in the orientation of the head mount display (16). The second acquisition means (122) for newly acquiring the second virtual space image in the viewing direction corresponding to the orientation of the display (16), and the image composition of the first virtual space image and the second virtual space image. When the display control means (130) that executes the control for displaying on the display unit and the first virtual space image and the second virtual space image are image-combined and displayed on the display unit. The display control system (1A) includes the changing means (140) for lowering the degree of shielding of the second virtual space image by the first virtual space image according to the passage of time. And the second virtual space image are image-combined and displayed on the display unit, a new acquisition of one of the first virtual space image and the second virtual space image is obtained. The display control means (130) further includes a limiting means (130), and the display control means (130) displays the one virtual space image displayed on the display unit based on the change in the orientation of the head mount display (16). The other virtual of the first virtual space image and the second virtual space image displayed on the display unit by moving the head mount display (16) in a movement direction based on the direction opposite to the change direction of the direction. The spatial image is updated with the newly acquired virtual spatial image.

7) Further, the program according to one aspect of the present invention is the display described in the display control device (10, 10A, 30A) according to any one of 1) to 3), 5), or the display described in 4) or 6). This is a program for operating a computer as a control system (1A).

8) Further, the information storage medium according to one aspect of the present invention is a computer-readable information storage medium in which the program described in 7) is recorded.

9) Further, the display control method according to one aspect of the present invention can display a virtual space image representing a virtual space viewed from a virtual viewpoint in the virtual space as a stereoscopic image using binocular disparity. In the display control method for controlling the display of the head mount display (16) provided with the display unit, the detection result acquisition step (S110) for acquiring the detection result of the orientation of the head mount display and the first virtual space image are acquired. The display unit is a combination of a first acquisition step (S100), a second acquisition step (S102, S112) for acquiring a second virtual space image, the first virtual space image, and the second virtual space image. A display control step (S106, S116, S120) for executing control for displaying the image, and a change step (S114, S114,) for lowering the degree of shielding of the second virtual space image by the first virtual space image according to the passage of time. In the second acquisition step (S112), the view direction corresponding to the changed orientation of the head-mounted display (16) is based on the change in the orientation of the head-mounted display (16). The second virtual space image is newly acquired, and in the display control step (S116), the second virtual space image displayed on the display unit is displayed based on the change in the orientation of the head mount display (16). Is updated to the newly acquired second virtual space image, and the first virtual space image displayed on the display unit is moved in a moving direction based on the direction opposite to the changing direction of the orientation of the head mount display. Let me.

According to the inventions described in 1), 4) to 9) above, the first virtual space image and the second virtual space image are image-synthesized and displayed on the head mount display, and the first virtual space image is displayed according to the passage of time. In order to reduce the degree of shielding of the second virtual space image by the virtual space image, the virtual space image displayed on the head mount display is given to the user as compared with the case where the virtual space image is simply switched from the first virtual space image to the second virtual space image. You can reduce the feeling of strangeness.

Further, when the user changes the direction of the head during the switching from the first virtual space image to the second virtual space image, the first virtual space image and the second virtual space image displayed on the head-mounted display are displayed. If it is not updated according to the direction of the user's head, the user may feel uncomfortable and the immersive feeling in the virtual space may be impaired. For example, when the user turns his / her head during the above switching, the direction of the user's head after changing both the first virtual space image and the second virtual space image due to the processing power of the display control device or the like. It may be difficult to acquire (generate) a new one according to the above. In this regard, if the user changes his / her head orientation during the above switching, he / she must acquire a new first virtual space image corresponding to the changed user's head orientation before the user moves his / her head. Since the first virtual space image remains displayed as a fixed image and is visually recognized by the user, there is a risk of giving the user a sense of discomfort. In this regard, according to the present invention, when the orientation of the head-mounted display changes during the switching from the first virtual space image to the second virtual space image (that is, when the user changes the orientation of the head). In addition, the second virtual space image displayed on the head-mounted display is updated to the second virtual space image in the viewing direction corresponding to the orientation of the head-mounted display after the change, and the first virtual space image displayed on the head-mounted display is updated. By moving the spatial image in the movement direction based on the direction opposite to the direction of change in the orientation of the head-mounted display, the first virtual space image and the second virtual space image displayed on the head-mounted display are oriented toward the user's head. It will be updated at the same time, and the discomfort given to the user can be reduced.

If it is possible in terms of the processing capacity of the display control device, the second virtual method is used as a method for updating the first virtual space image displayed on the head-mounted display according to the direction of the user's head. Similar to the spatial image, the first virtual spatial image in the viewing direction corresponding to the changed orientation of the head-mounted display is newly acquired, and the first virtual spatial image displayed on the head-mounted display is newly acquired. A method of updating to the first virtual space image is also conceivable, but in this method, it is necessary to newly acquire the first virtual space image together with the second virtual space image, which increases the processing load. In this respect, according to the present invention, it is not necessary to divert the first virtual space image before the user changes the direction of the head and newly acquire the first virtual space image, so that the processing load can be reduced.

2) In one aspect of the present invention, the changing means (140) changes at least one of the transparency of the first virtual space image and the transparency of the second virtual space image according to the passage of time. This is a means for lowering the degree of shielding of the second virtual space image by the first virtual space image, and the changing means (140) increases the transparency of the first virtual space image with the passage of time. At least one of the first changing means (141) and the second changing means (142) that reduces the transparency of the second virtual space image according to the passage of time may be included.

2) According to the present invention, the first virtual space image and the second virtual space image are combined and displayed on a head mount display, and the transparency of the first virtual space image is increased with the passage of time. , In order to reduce the transparency of the second virtual space image, as compared with the case where the virtual space image displayed on the head mount display is simply switched from the first virtual space image to the second virtual space image. It is possible to reduce the discomfort given to the user.

3) In one aspect of the present invention, the changing means (140) is such that the transparency of the edge portion of the first virtual space image is higher than the transparency of the central portion of the first virtual space image. The transparency of the first virtual space image may be set.

According to the invention described in 3), it is possible to reduce the discomfort given to the user due to the movement of the first virtual space image displayed on the head-mounted display. When the first virtual space image displayed on the head-mounted display is moved, the end of the first virtual space image is displayed on the head-mounted display, and the head-mounted display displays the first virtual space image with the end as a boundary. Since there is a portion where is displayed and a portion where the first virtual space image is not displayed, there is a risk of giving a sense of discomfort to the user. In this regard, according to the present invention, the transparency of the first virtual space image is set so that the transparency of the edge portion of the first virtual space image is higher than the transparency of the central portion of the first virtual space image. By doing so, the boundary between the portion where the first virtual space image is displayed and the portion where the first virtual space image is not displayed can be made inconspicuous, and the discomfort given to the user can be reduced.

1A game system, N network, 10,10A game device, 11 control unit, 12 storage unit, 13 optical disk drive unit, 14 communication unit, 15 operation unit, 16 head mount display, 17 trekking unit, 18 sound output unit, 30A game Server, 31 control unit, 32 storage unit, 33 optical disk drive unit, 34 communication unit, 100 data storage unit, 110 detection result acquisition unit, 120 virtual space image acquisition unit, 121 first acquisition unit, 122 second acquisition unit, 130 Display control unit, 140 change unit, 141 first change unit, 142 second change unit, U user, GS game space, FD field, SD stand, RP right wing pole, HB home base, FB first base base, SB second base base , TB third base, VP1, VP2 virtual viewpoint, VD1, VD2, VD2N view direction, GA 1st virtual space image, GB 2nd virtual space image, GBN new 2nd virtual space image, UD1 1st direction, UD2 2nd direction , CP center pixel, E end.

Claims (5)

A display control device that controls the display of a head-mounted display equipped with a display screen that can display a virtual space image that represents the virtual space viewed from the virtual viewpoint in the virtual space as a stereoscopic image using binocular parallax. In
A detection result acquisition means for acquiring the detection result of the orientation of the head-mounted display, and
A first acquisition means for acquiring a first virtual space image which is a field image viewed from a first viewpoint set in the virtual space and is a field image in a field direction specified based on the detection result.
A second virtual space which is a field image viewed from a second viewpoint set at a position different from the first viewpoint in the virtual space and is a field image in the field direction specified based on the detection result. The second acquisition means to acquire the image and
Display control that executes control for displaying at least one of the first virtual space image acquired by the first acquisition means and the second virtual space image acquired by the second acquisition means on the display screen. and means,
It includes,
Before Symbol display control means, wherein the viewpoint-switching period for switching the view point between the first viewpoint and the second viewpoint, the display screen and the second virtual space image and the first virtual space image by image synthesis The second virtual space image is updated to a new image according to the detection result, and the first virtual space image is restricted from being updated to a new image according to the detection result. , The first virtual space image is moved so as to move in the direction opposite to the change direction of the orientation of the head mount display with respect to the display screen.
Display control device. In the display control device according to claim 1,
In the viewpoint switching period, a changing means for lowering the degree of shielding of the second virtual space image by the first virtual space image according to the passage of time is further included.
Display control device. In the display control device according to claim 1 or 2.
The display control means does not display the second virtual space image on the display screen before the viewpoint switching period, but displays the first virtual space image on the display screen, and after the viewpoint switching period. The first virtual space image is not displayed on the display screen, and the second virtual space image is displayed on the display screen.
Display control device. A display control system that controls the display of a head-mounted display equipped with a display screen that can display a virtual space image that represents the virtual space viewed from the virtual viewpoint in the virtual space as a stereoscopic image using binocular parallax. In
A detection result acquisition means for acquiring the detection result of the orientation of the head-mounted display, and
A first acquisition means for acquiring a first virtual space image which is a field image viewed from a first viewpoint set in the virtual space and is a field image in a field direction specified based on the detection result.
A second virtual space which is a field image viewed from a second viewpoint set at a position different from the first viewpoint in the virtual space and is a field image in the field direction specified based on the detection result. The second acquisition means to acquire the image and
Display control that executes control for displaying at least one of the first virtual space image acquired by the first acquisition means and the second virtual space image acquired by the second acquisition means on the display screen. and means,
It includes,
Before Symbol display control means, wherein the viewpoint-switching period for switching the view point between the first viewpoint and the second viewpoint, the display screen and the second virtual space image and the first virtual space image by image synthesis The second virtual space image is updated to a new image according to the detection result, and the first virtual space image is restricted from being updated to a new image according to the detection result. , The first virtual space image is moved so as to move in the direction opposite to the change direction of the orientation of the head mount display with respect to the display screen.
Display control system. A program for operating a computer as the display control device according to any one of claims 1 to 3 or the display control system according to claim 4.

Images