JP7748193B2 - Game program, recording medium, and game processing method - Google Patents

Description

The present invention relates to a game program, a recording medium, and a game processing method.

Conventionally, game systems that perform game processing that reflects the relationship between a player's line of sight and a character are known. For example, Patent Document 1 describes a game system that calculates line of sight relationship information that represents the relationship between the player's line of sight and a character that is the subject of the player's game play, based on the line of sight information, and performs game processing by changing game parameters based on the line of sight relationship information.

Japanese Patent Application Laid-Open No. 2015-231443

In the above-mentioned conventional technology, the player and character communicate in a virtual three-dimensional space. However, it is not possible to share real-world experiences with the character.

The present invention was made in consideration of these problems, and aims to provide a game program, recording medium, and game processing method that allows players to share real-world experiences with game characters.

To achieve the above objective, the game program of the present invention causes a display unit that is configured to be wearable on the player's head and that displays a virtual image superimposed on an image of real space, a gaze direction detection unit that detects the direction of the player's gaze, and an information processing device configured to send and receive signals to function as: a gaze direction setting processing unit that sets the gaze direction of a virtual game character having eyes based on the detected gaze direction of the player; and a character display processing unit that displays an image of the game character on the display unit so that the game character changes its gaze direction based on the set gaze direction of the game character.

To achieve the above objective, the recording medium of the present invention is a recording medium that stores the above game program and is readable by an information processing device.

To achieve the above-mentioned objective, the game processing method of the present invention is executed by an information processing device configured to be worn on a player's head and to display a virtual image superimposed on an image of real space, a gaze direction detection unit that detects the direction of the player's gaze, and to transmit and receive signals, and includes the steps of: setting the gaze direction of a virtual game character having eyes based on the detected gaze direction of the player; and displaying an image of the game character on the display unit so that the game character changes its gaze direction based on the set gaze direction of the game character.

The game program of the present invention allows you to share your real-world experiences with game characters.

1 is a system configuration diagram showing an example of the overall configuration of a game system common to all embodiments. FIG. 1 is a block diagram illustrating an example of a schematic configuration of a head-mounted display. FIG. 10 is a diagram showing a specific example of a manual operation by a player. 10 is a flowchart illustrating an example of the flow of a game executed by a control unit of a head-mounted display and an information processing device. FIG. 10 is a diagram illustrating an example of a character selection screen. FIG. 10 is a diagram illustrating an example of a screen for adjusting the position of a virtual object. FIG. 10 is a diagram illustrating an example of a virtual object orientation adjustment screen. FIG. 10 is a diagram illustrating an example of a display screen of a game character. FIG. 10 is a diagram showing an example of a game screen when a game character is touched. FIG. 10 is a diagram illustrating an example of a game screen in a fan mode. FIG. 10 is a diagram illustrating an example of a game screen in a spray mode. FIG. 2 is a block diagram illustrating an example of a functional configuration of the information processing device according to the first embodiment. FIG. 10 is a diagram illustrating an example of a screen on which a game character is displayed by adjusting the position and orientation of a virtual object of a chair with a backrest. FIG. 10 is a diagram illustrating an example of a screen on which a game character is displayed by adjusting the position and orientation of a balance ball virtual object. 10A and 10B are diagrams illustrating an example of a screen on which a game character is displayed by adjusting the position and orientation of a virtual object of a seat cushion. 10A and 10B are diagrams illustrating an example of a screen on which a game character is displayed by adjusting the position and orientation of a virtual pillow object. FIG. 10 is a diagram illustrating an example of a screen on which a game character is displayed by adjusting the position and orientation of a virtual object, which is a glass with a straw. FIG. 10 is a diagram illustrating an example of a screen on which a game character is displayed by adjusting the position and orientation of a virtual object on a table. FIG. 10 is a diagram illustrating an example of a screen on which a game character is displayed by adjusting the position and orientation of a virtual wall object. 4 is a flowchart illustrating an example of a processing procedure executed by a CPU of the information processing apparatus according to the first embodiment. FIG. 10 is a block diagram illustrating an example of a functional configuration of an information processing device according to a modified example of the first embodiment. FIG. 10 is a diagram illustrating an example of a real space in which a virtual object is registered. FIG. 10 is a block diagram illustrating an example of a functional configuration of an information processing device according to a second embodiment. FIG. 10 is an explanatory diagram showing an example of a case where the direction of the game character's line of sight is changed to follow the direction of the player's line of sight when the player and game character face each other. FIG. 10 is an explanatory diagram showing an example of changing the line of sight of the game character to follow the line of sight of the player when the player and game character are side by side. 10 is a flowchart illustrating an example of a processing procedure executed by a CPU of an information processing device according to a second embodiment when setting and changing the line of sight of a game character based on the line of sight of a player. FIG. 10 is a block diagram illustrating an example of a functional configuration of an information processing device according to a modified example of the second embodiment. FIG. 10 is an explanatory diagram showing an example of changes in the direction of the line of sight of the game character and the player when a time difference is set in a case where the player and game character are side by side. FIG. 10 is an explanatory diagram showing an example of the change in the direction of the head and eyes of a game character and the direction of the player's gaze when the game character's gaze direction is set based on the direction of the player's head when the player and game character are side-by-side. FIG. 11 is a block diagram illustrating an example of a configuration of a head-mounted display and a functional configuration of an information processing device according to a third embodiment. FIG. 11 is a diagram illustrating an example of a game screen according to a third embodiment. FIG. 11 is a diagram illustrating another example of a game screen according to the third embodiment. A flowchart showing an example of a processing procedure executed by the CPU of an information processing device according to the third embodiment when changing the deformation pattern and behavior of a flexible object associated with a game character in accordance with detected wind conditions. FIG. 10 is a block diagram illustrating an example of a configuration of a head-mounted display and a functional configuration of an information processing device according to a fourth embodiment. FIG. 13 is a diagram illustrating an example of a game screen according to a fourth embodiment. FIG. 13 is a diagram illustrating another example of a game screen according to the fourth embodiment. A flowchart showing an example of a processing procedure executed by the CPU of an information processing device related to the fourth embodiment when changing the wetness or sweating of a game character's skin or an object associated with the game character in accordance with detected humidity and temperature. FIG. 2 is a block diagram illustrating an example of a hardware configuration of an information processing device.

The first to fourth embodiments of the present invention will be described below with reference to the drawings.

<1. Overall structure of the game system>
First, an example of the overall configuration of a game system 1 common to all embodiments will be described using Fig. 1. As shown in Fig. 1, the game system 1 includes an information processing device 3, a game controller 5, and a head-mounted display 7. Each of the game controller 5 and the head-mounted display 7 is connected to the information processing device 3 via wire or wirelessly so as to be communicable (capable of transmitting and receiving signals).

The information processing device 3 is, for example, a stationary game console. However, it is not limited to this and may be, for example, a portable game console that is equipped with an input unit, display unit, etc. In addition to game consoles, it may also be, for example, a computer that is manufactured and sold, such as a server computer, desktop computer, notebook computer, tablet computer, etc., or a telephone that is manufactured and sold, such as a smartphone, mobile phone, phablet, etc.

The information processing device 3 and the head-mounted display 7 may be integrated by mounting the information processing device 3 on the head-mounted display 7. Furthermore, if the head-mounted display 7 has the same functions as the information processing device 3, the information processing device 3 may be omitted.

The player uses the game controller 5 to perform various operational inputs. In the example shown in FIG. 1, the game controller 5 includes, for example, a cross key 9, multiple buttons 10, a joystick 11, a touchpad 12, etc.

The head-mounted display 7 is a display device that can be worn on the user's head or face and realizes what is known as MR (Mixed Reality). The head-mounted display 7 has a transparent display unit 13, and displays virtual images related to the game generated by the information processing device 3 superimposed on images in real space.

2. General configuration of head-mounted display
2 and 3, an example of a schematic configuration of the head-mounted display 7 will be described. As shown in Fig. 2, the head-mounted display 7 has a display unit 13, a gaze direction detection unit 15, a position detection unit 17, an audio input unit 19, an audio output unit 21, a manual operation input unit 23, an information acquisition unit 25, and a control unit 27.

The display unit 13 is composed of, for example, a transmissive (see-through) liquid crystal display or organic EL display, and displays a virtual image related to the game generated by the information processing device 3, superimposed as, for example, a holographic video, on an image of real space that can be seen through the display. The virtual image may be either a two-dimensional image or a three-dimensional image, and may be either a still image or a video. The display unit 13 may also be non-transmissive, and display a virtual image generated by the information processing device 3, superimposed on an image of real space captured by a camera, for example.

The gaze direction detection unit 15 detects the direction of the player's gaze. In this specification, "the player's gaze direction" refers to a direction that combines the direction of the player's eyes and head. For example, if the player turns their head to the right from a reference direction and then turns their eyes to the right, the gaze direction will be the sum of the angle of the head facing right and the angle of the eyes facing right from the reference direction. The gaze direction detection unit 15 has an eye direction detection unit 29 and a head direction detection unit 31.

The eye direction detection unit 29 detects the direction of the player's eyes. The eye direction is detected, for example, as a relative direction (angle) with respect to the forward direction of the head. The method for detecting eye direction is not particularly limited, and various detection methods can be adopted. For example, the eye direction detection unit 29 may be configured with an infrared LED and an infrared camera. In this case, the infrared camera may capture an image of the eyes illuminated by the infrared LED, and based on the captured image, the control unit 27 may calculate the player's eye direction based on the position of the pupil relative to the position of the corneal reflex, with the reference point being the position on the cornea of the reflected light (corneal reflex) created by the infrared LED illumination and the moving point being the pupil. Also, for example, the eye direction detection unit 29 may be configured with a visible light camera. Based on an image of the player's eyes captured by the visible light camera, the control unit 27 may calculate the eye direction based on the position of the iris relative to the inner corner of the eye, with the reference point being the inner corner of the eye and the moving point being the iris (the so-called black eye).

The head direction detection unit 31 detects the direction of the player's head (face direction). The head direction is detected as a direction (vector) in a stationary coordinate system in real space recognized, for example, by the spatial recognition process described below. There are no particular limitations on the method for detecting the head direction, and various detection methods can be used. For example, the head-mounted display 7 may be equipped with an acceleration sensor, gyro sensor, etc., and the control unit 27 may calculate the direction of the player's head based on the detection results of these sensors.

The position detection unit 17 detects the position of the player's head. There are no particular limitations on the method for detecting the head position, and various detection methods can be used. For example, cameras and depth sensors may be provided at multiple locations around the head-mounted display 7, and the depth sensors may be used to recognize the space around the player (real space), with the control unit 27 recognizing the position of the player's head in the surrounding space based on the detection results from the multiple cameras. Another example is to install a camera outside the head-mounted display 7 and attach a marker such as a light-emitting element to the head-mounted display 7, and use the external camera to detect the position of the player's head.

The audio input unit 19 is composed of, for example, a microphone, and inputs the player's voice and other external sounds. The control unit 27 recognizes the input player's voice as words, for example, through voice recognition processing, and performs processing based on the recognized voice. The control unit 27 also recognizes the type of sound of the input external sound, for example, through voice recognition processing, and performs processing based on the recognized type of sound.

The audio output unit 21 is composed of, for example, a speaker, and outputs audio to the player's ears. For example, it outputs character voices, sound effects, background music, etc.

The hand operation input unit 23 is composed of, for example, a camera, which detects the player's hand movements and inputs them as hand operations. The control unit 27 executes processing based on the input hand operations. This allows the player to perform various operations with hand movements. Specifically, as shown in FIG. 3, possible operations include a "tap" operation in which the tip of the thumb and the tip of the index finger of the right hand touch once, a "double tap" operation in which they touch twice, and a "rotation" operation in which the index finger of the right hand is extended upward and rotated. A wide variety of other hand operations may also be possible.

The information acquisition unit 25 connects to the Internet, for example, via wireless communication, and acquires various information from information distribution sites, databases, etc. For example, it can acquire information related to the date and time, weather, news, entertainment (concert and movie schedules, etc.), shopping (bargain sales, etc.), etc. The information acquisition unit 25 may also acquire information about the player's current location based on signals from GPS satellites, for example.

The control unit 27 executes various processes based on the detection signals of the various sensors. These processes include, for example, image display processing, gaze direction detection processing, gaze adjustment processing, position detection processing, spatial recognition processing, voice recognition processing, voice output processing, manual input processing, and information acquisition processing. In addition, a wide variety of other processes may also be executed.

The information processing device 3 generates or changes a virtual image to be displayed on the display unit 13 based on the processing results of the gaze direction detection unit 15, position detection unit 17, voice input unit 19, manual operation input unit 23, information acquisition unit 25, etc. of the head-mounted display 7, thereby expressing MR (mixed reality).

<3. Overview of the game>
Next, an example of the outline of the game according to this embodiment, that is, the game provided by executing the game program and game processing method of the present invention by the information processing device 3, will be described with reference to FIGS.

The game according to this embodiment allows the player to communicate with a game character that appears to exist in real space by overlaying an image of the virtual game character onto an image of real space. The position, posture, movements, behavior, etc. of the game character change in response to various operational inputs by the player (eye movement and head movement, hand operations, voice, operational inputs via the game controller 5, etc.). The game character may be any virtual character or object with eyes, and there are no particular limitations on its type. For example, it may be a human male character, a female character, a non-human animal character, a virtual living creature character other than a human or animal, a non-living robot, etc.

Figure 4 shows an example of the flow of a game executed by the control unit 27 of the head-mounted display 7 and the information processing device 3.

In step S5, the control unit 27 determines whether or not this is the first time the player has worn the head-mounted display 7. For example, a message confirming whether or not this is the first time the player has worn the head-mounted display 7 may be displayed on the display unit 13, and the determination may be made based on an input by the player (YES or NO). If this is the first time (step S5: YES), the process proceeds to the next step S10. On the other hand, if this is not the first time (step S5: NO), the process proceeds to step S15, which will be described later.

In step S10, the control unit 27 executes a line-of-sight adjustment process. The line-of-sight adjustment method is not particularly limited. For example, markers may be displayed at five locations near the center and four corners of the player's field of view on the display unit 13, and line-of-sight information may be detected while the player is gazing at the markers.

In step S15, the control unit 27 displays the home menu screen on the display unit 13.

In step S20, the control unit 27 determines whether or not to start the game. For example, this determination may be made based on whether or not the game has been started by the player on the home menu screen. The control unit 27 waits in step S20 until the game is to be started (step S20: NO), and if the game is to be started (step S20: YES), the control unit 27 proceeds to the next step S25.

In step S25, the control unit 27 executes a spatial recognition process to recognize the real space around the player using, for example, a depth sensor or a camera. This generates a stationary coordinate system (a coordinate system corresponding to real space) that does not change even if the position of the head-mounted display 7 changes as the player moves around.

In step S30, the information processing device 3 displays a virtual object on the display unit 13. The virtual object is displayed, for example, in the center of the field of view of the display unit 13, and in the depth direction, at a position near the collision point between the direction in which the display unit 13 is facing (the direction of the player's head) and the real space recognized in step S25 above. When the player changes the direction of their head, the display position of the virtual object in the field of view does not change from the center, and only the position in the depth direction changes according to the real space. Note that the position in the depth direction may also be fixed and displayed at a preset position. Alternatively, the player may be able to adjust the position in the up/down/left/right directions or the position in the depth direction in the field of view. The type of virtual object is not particularly limited. For example, it may be an object with a simple shape such as a cube, rectangular parallelepiped, or sphere, or it may be a virtual object that imitates various real-world objects such as a chair or table. Alternatively, the game character itself may be displayed.

In step S35, the information processing device 3 determines whether a game character has been selected by the player. The information processing device 3 waits in step S35 until a game character is selected (step S35: NO), and if a game character has been selected (step S35: YES), the information processing device 3 proceeds to the next step S40.

Figure 5 shows an example of a character selection screen. In the example shown in Figure 5, rectangular parallelepiped virtual objects 33A to 33C are displayed superimposed on an image 35 of the player's room, which is real space. In this example, virtual objects 33A to 33C are displayed, for example, near a sofa. Virtual objects 33A, 33B, and 33C correspond to game characters A, B, and C, respectively, and each object is a different color. The player can switch between virtual objects 33A, 33B, and 33C in order as shown in Figure 5, for example, by performing the tap operation described above or a switching operation using the game controller 5. Note that virtual objects may also be switched by calling the character name out loud. Furthermore, the player can select a game character by, for example, performing the double-tap operation described above or a confirmation operation using the game controller 5 when a virtual object corresponding to the desired game character is displayed.

Returning to FIG. 4, in step S40, the information processing device 3 determines whether the position and orientation of the virtual object have been determined by the player. The information processing device 3 waits in step S40 until the position and orientation of the virtual object have been determined (step S40: NO), and if the position and orientation of the virtual object have been determined (step S40: YES), the information processing device 3 proceeds to the next step S45.

Figure 6 shows an example of a virtual object position adjustment screen. As shown in Figure 6, the player can adjust the position of virtual object 33A, which is displayed in the center of the field of view of the display unit 13, in real space in the up, down, left, or right directions, for example, by changing the direction of their head. Because the display position of virtual object 33A corresponds to the display position of game character A, the player adjusts the position of virtual object 33A so that game character A is placed in the desired position.

Figure 7 shows an example of a virtual object orientation adjustment screen. As shown in Figure 7, the player can adjust the orientation of virtual object 33A by rotating it around the vertical axis, for example, by performing the rotation operation using the hand movement described above or by performing a rotation operation using the game controller 5. Because the orientation of virtual object 33A corresponds to the orientation of game character A, the player adjusts the orientation of virtual object 33A so that game character A faces the desired direction.

Once the player has finished adjusting the position and orientation of the virtual object relative to real space, they can confirm the position and orientation of the virtual object by, for example, performing the double-tap operation described above or a confirm operation using the game controller 5.

Returning to FIG. 4, in step S45, the information processing device 3 displays the game character so that it is positioned in accordance with the position and orientation of the virtual object. FIG. 8 shows an example of a game character display screen. In this example, game character A, a female game character 37, is displayed standing in front of a sofa, for example.

In step S50, the information processing device 3 executes a communication process that enables communication between the player and the game character. The player can communicate with the game character in various ways. For example, the player can move around the displayed game character by moving around in real space, looking at it from various directions and talking to it.

The player can also touch a game character, for example. Figure 9 shows an example of a game screen when touching a game character. As shown in Figure 9, a targeting line 41 is projected from the player's left hand 39. When the targeting line 41 is projected onto a touchable portion of the game character 37, it changes color, allowing the player to identify the touchable portion. When the color of the targeting line 41 has changed, the player can touch the game character 37 by, for example, fisting their left hand. At this time, the game character 37 may exhibit an action corresponding to being touched, such as expressing joy, blushing in embarrassment, becoming upset, or saying a predetermined line. In Figure 9, for example, the targeting line 41 is projected onto the right hand of the game character 37. In this state, the player can touch the right hand of the game character 37 (fist their right hand) by fisting their left hand. Note that the image of real space is omitted from Figure 9 (the same applies to Figures 10 and 11 described below).

Although not shown in the figures, the player can stroke the head of the game character 37 by, for example, tilting the left hand 39 so that it is roughly parallel to the floor and moving it left and right while shining the aiming line 41 on the head of the game character 37. At this time, the game character 37 may take a behavior in response to being stroked on the head, such as showing joy, acting cute, or saying lines such as "ehehe."

Furthermore, if the player waves their right hand towards the game character 37, the game character 37 may wave back while saying a line such as "Bye-bye." Furthermore, if the player makes a peace sign with their right hand towards the game character 37, the game character 37 may return the peace sign while saying a predetermined line such as "Peace!".

Furthermore, if the player utters "fan" while holding out their right hand, for example, the right hand will switch to fan mode. Figure 10 shows an example of a game screen in fan mode. As shown in Figure 10, when the player waves (fans) their right hand 43 toward the game character 37 while in fan mode, a virtual wind is generated in a direction corresponding to the direction of the fan with the right hand 43, causing flexible objects attached to the game character 37, such as hair or clothing, to flutter in the wind. In Figure 10, for example, the hair 45 of the game character 37 is fluttering in a direction corresponding to the virtual wind. At this time, the game character 37 may take an action in response to the wind, such as bracing themselves or yelling "Eek!" An image of a fan may also be displayed in addition to or instead of the right hand 43.

Furthermore, if the player utters "spray bottle" while holding out their right hand, for example, the right hand switches to spray bottle mode. Figure 11 shows an example of a game screen in spray bottle mode. As shown in Figure 11, when the player is in spray bottle mode, for example, if the player bends the second joint of the index finger 47 of their right hand while extending it upward, spray 49 from the spray bottle is fired toward the game character 37. Note that the spray 49 may or may not be displayed. As a result, the skin of the game character 37 and associated objects (e.g., hair, clothing, etc.) become wet. Because spray 49 is fired each time the index finger 47 is bent, repeated spraying gradually progresses the wet state until the game character 37 becomes completely soaked. In Figure 11, for example, the face 51 and clothing 53 of the game character 37 are wet. At this time, the game character 37 may take an action corresponding to being wet, such as getting defensive, yelling "Eek!", or getting angry.

The player can also call out to the game character 37. For example, if the player calls the game character 37 by name, the game character 37 may reply. For example, if the player makes a compliment such as "cute" or "pretty," the game character 37 may become happy or blush with embarrassment. For example, if the player says "Say cheese," the game character 37 may strike a pose for a photo, such as making a peace sign or smiling. In addition, in response to various calls from the player, the game character 37 may show various expressions and gestures, such as laughing, looking troubled, or angry, and may speak lines.

Returning to FIG. 4, in step S55, it is determined whether or not to end the game. If the game is not to be ended (step S55: NO), the process returns to step S50 above. On the other hand, if the game is to be ended (step S55: YES), this flowchart ends.

Note that while the above description has been given of the case where the game character 37 is displayed in a standing position, it is also possible to display the game character 37 so that it is positioned in accordance with the position and orientation of a real object, such as sitting in an actual chair. The details of this process will be explained next.

4. First embodiment
In the first embodiment, details of the processing for arranging a game character in accordance with the position and orientation of a real object will be described. The processing content of this embodiment is executed by switching modes in the communication processing in step S50 described above, for example, when the player issues a call such as "let's sit down." Note that, although not described below, in this embodiment, after arranging a game character in accordance with the position and orientation of a real object, it is possible to engage in the various types of communication with the game character described in step S50 described above.

(4-1. Functional configuration of information processing device)
First, an example of the functional configuration of the information processing device 3 according to the first embodiment will be described with reference to Fig. 12. Note that although the configuration of the head-mounted display 7 is not shown in Fig. 12, it has the same configuration as that shown in Fig. 2 described above.

As shown in FIG. 12, the information processing device 3 has an object selection processing unit 55, an object display processing unit 57, an object adjustment processing unit 59, a character posture setting processing unit 61, a first character display processing unit 63, and an object non-display processing unit 65.

The object selection processing unit 55 selects the type of virtual object based on the player's input. Virtual objects that mimic various real objects that exist in real space may be prepared in advance, and the player may be able to select the desired virtual object from among them. Virtual objects may include, for example, virtual seating objects such as chairs, sofas, balls, and cushions; virtual furniture objects such as tables and dressers; virtual tableware objects such as glasses, cups, and plates; and virtual wall objects against which the game character can lean. For example, if the player wants to have the game character sit on a real seating object (an example of an object to be sat on) such as a chair, sofa, ball, or cushion in real space, the player can select a virtual seating object.

The object display processing unit 57 displays an image of the virtual object selected by the object selection processing unit 55 on the display unit 13, superimposed on an image of real space.

The object adjustment processing unit 59 adjusts at least one of the position and orientation of the virtual object relative to the image of real space based on the player's input. For example, if the player wants to have a game character sit on a real seating object, the object adjustment processing unit 59 adjusts at least one of the position and orientation of the virtual seating object relative to the real seating object included in the image of real space based on the player's input. As described above, the player can adjust the position of the virtual object displayed in the center of the field of view of the display unit 13 in the up, down, left, or right directions relative to real space, for example, by changing the direction of their head. The depth position of the virtual object is located near the point of collision between the direction of the player's head and real space, as described above. Note that the depth position along the line of sight may be adjusted, for example, by hand operation or operation using the game controller 5. The player can also adjust the orientation of the virtual object, for example, by rotating the virtual object using the hand movement described above or by rotating the virtual object using the game controller 5. The player may adjust both the position and orientation of the virtual object, or only one of the position or orientation.

The character posture setting processing unit 61 sets the posture of the game character based on the type of virtual object selected by the object selection processing unit 55. For example, if the selected object is a virtual seating object such as a chair, sofa, ball, or cushion, the character is set to a posture of sitting on that object. For example, if the selected object is a virtual table object, the character is set to a posture of sitting facing the player with the virtual table object between them. For example, if the selected object is a virtual tableware object such as a glass, cup, or plate, the character is set to a posture of placing a hand on the object. For example, if the selected object is a virtual wall object, the character is set to a posture of leaning against the virtual wall object.

The first character display processing unit 63 (an example of a character display processing unit) displays an image of a virtual game character on the display unit 13 so that the image is positioned to match the position or orientation of a virtual object whose position or orientation, at least one of which has been adjusted by the object adjustment processing unit 59. For example, when the position or orientation of a virtual seated object is adjusted relative to a real seated object, the first character display processing unit 63 displays an image of the game character on the display unit 13 so that the game character is positioned to match the position or orientation of the real seated object. The first character display processing unit 63 also displays an image of the game character in the posture set by the character posture setting processing unit 61 on the display unit 13.

The object non-display processing unit 65 hides the image of the virtual object when the image of the game character is displayed by the first character display processing unit 63.

The processing in each processing unit described above is not limited to these examples of processing divisions, and may be performed by a smaller number of processing units (e.g., one processing unit), or by further subdivided processing units. The functions of each processing unit described above are implemented by a game program executed by the CPU 301 (see FIG. 38 described below), but some of them may be implemented by actual devices such as dedicated integrated circuits such as ASICs or FPGAs, or other electrical circuits. Furthermore, the processing units described above are not limited to being implemented entirely on the information processing device 3, and some or all of them may be implemented on the head-mounted display 7 (e.g., the control unit 27). In this case, the control unit 27 of the head-mounted display 7 is an example of an information processing device.

(4-2. Example of virtual object adjustment and character display screen)
Next, an example of a screen on which a game character is displayed by adjusting the position and orientation of a virtual object will be described with reference to FIGS.

In the example shown in FIG. 13, a virtual seating object 67, which is a chair with a backrest, is selected by the player. As shown in the top row of FIG. 13, the orientation of the virtual seating object 67 is adjusted to match the orientation of a real seating object 69, which is a chair with a backrest that exists in real space. Next, as shown in the middle row of FIG. 13, the position of the virtual seating object 67 is adjusted to match the position of the real seating object 69. At this time, for example, the seat heights of the virtual seating object 67 and the real seating object 69 may be adjusted to match. Furthermore, the orientation and position adjustments may be performed in the reverse order to that described above, or may be performed simultaneously (similarly in FIGS. 14 to 19). Then, as shown in the bottom row of FIG. 13, a game character 71 set to a seated posture is positioned to match the position and orientation of the adjusted virtual seating object 67, and the virtual seating object 67 is hidden. This allows the game character 71 to be displayed as if seated on the real seating object 69.

In the example shown in FIG. 14 , a virtual seating object 73, such as a balance ball, is selected by the player. The orientation of the virtual seating object 73 is also displayed. As shown in the top row of FIG. 14 , the orientation of the virtual seating object 73 is adjusted to match the orientation of a real seating object 75, which is a balance ball existing in real space. In this example, because the real seating object 75 is ball-shaped and has no orientation, the player may adjust it to face the desired direction. Next, as shown in the middle row of FIG. 14 , the position of the virtual seating object 73 is adjusted to match the position of the real seating object 75. At this time, the height of the seat surfaces (top surfaces) of the virtual seating object 73 and the real seating object 75 may be adjusted to match. After that, as shown in the bottom row of FIG. 14 , a game character 77 set in a seated position is positioned to match the adjusted position and orientation of the virtual seating object 73, and the virtual seating object 73 is hidden. This allows the game character 77 to appear as if it is sitting on the real seating object 75.

In the example shown in FIG. 15, a virtual seating object 79, such as a seat cushion, is selected by the player. As shown in the top row of FIG. 15, the orientation of the virtual seating object 79 is adjusted to match the orientation of a real seating object 81, which is a seat cushion existing in real space. Next, as shown in the middle row of FIG. 15, the position of the virtual seating object 79 is adjusted to match the position of the real seating object 81. At this time, for example, the height of the seat surfaces of the virtual seating object 79 and the real seating object 81 may be adjusted to match. Thereafter, as shown in the bottom row of FIG. 15, a game character 83 set in a seated posture is positioned to match the position and orientation of the adjusted virtual seating object 79, and the virtual seating object 79 is hidden. This allows the game character 83 to be displayed as if sitting on the real seating object 81.

Although not shown in the figures, it is also possible to use a square cushion that can be sat on in four different directions, with a game character sitting on it facing one direction in the same way as above, and a player sitting next to it facing the other direction.

In the example shown in FIG. 16 , a virtual object 85, for example, a body pillow, is selected by the player. As shown in the top row of FIG. 16 , the orientation of virtual object 85 is adjusted to match the orientation of real object 87, which is a body pillow that exists in real space. At this time, for example, the longitudinal directions (axial directions) of virtual object 85 and real object 87 may be adjusted to match. Next, as shown in the middle row of FIG. 16 , the position of virtual object 85 is adjusted to match the position of real object 87. At this time, for example, the heights or central positions of the top surfaces of virtual object 85 and real object 87 may be adjusted to match. Thereafter, as shown in the bottom row of FIG. 16 , a game character 89 set in a sleeping pose hugging a pillow is positioned to match the adjusted position and orientation of virtual object 85, and virtual object 85 is hidden. This makes it possible to display game character 89 as if it were hugging real object 87.

In the example shown in FIG. 17 , a player selects a virtual object 91, for example, a glass with a straw. As shown in the top row of FIG. 17 , the orientation of the virtual object 91 is adjusted to match the orientation of a real object 93, which is a glass with a straw that exists in real space. At this time, for example, the orientations of the straws on virtual object 91 and real object 93 may be adjusted to match. Next, as shown in the middle row of FIG. 17 , the position of virtual object 91 is adjusted to match the position of real object 93. At this time, for example, the heights of the straws on virtual object 91 and real object 93 may be adjusted to match. After that, as shown in the bottom row of FIG. 17 , a game character 95 is positioned with its hand on the glass and the straw in its mouth to match the adjusted position and orientation of virtual object 91, and virtual object 91 is hidden. This makes it possible to display the game character 95 as if it is holding real object 93 in its hand and drinking a drink.

18, a virtual object 97, for example, a table, is selected by the player. As shown in the upper part of FIG. 18, the orientation of the virtual object 97 is adjusted to match the orientation of a real object 99, which is a table existing in real space. At this time, for example, the longitudinal directions of the virtual object 97 and the real object 99 may be adjusted to match. Next, as shown in the middle part of FIG. 18, the position of the virtual object 97 is adjusted to match the position of the real object 99. At this time, for example, the height of the top surfaces of the virtual object 97 and the real object 99 may be adjusted to match. After that, as shown in the lower part of FIG. 18, a game character 101 is positioned facing the player across the table, with hands or elbows on the table, to match the adjusted position and orientation of the virtual object 97, and the virtual object 97 is hidden. This makes it possible to display the game character 101 as if eating a meal with the player. Note that by making similar adjustments to glasses, plates, etc. on the table in addition to the table, it is possible to display the game character 101 as if he or she is holding glasses, plates, etc. and eating at the table. This allows players to feel like they're on a date.

In the example shown in FIG. 19 , a player selects virtual object 103, which is, for example, a wall. As shown in the upper part of FIG. 19 , the orientation of virtual object 103 is adjusted to match the orientation of real object 105, which is a wall that exists in real space. At this time, for example, adjustment may be made so that virtual object 103 and real object 105 are parallel. Next, as shown in the middle part of FIG. 19 , the position of virtual object 103 is adjusted to match the position of real object 105. At this time, for example, adjustment may be made so that the wall surfaces (depth positions) of virtual object 103 and real object 105 are aligned. Thereafter, as shown in the lower part of FIG. 19 , game character 107, which is set to lean against the wall, is positioned to match the adjusted position and orientation of virtual object 103, and virtual object 103 is hidden. As a result, for example, when a player places their right hand 109 against the wall of real object 105, the player can experience the feeling of performing a so-called kabedon.

(4-3. Processing procedure executed by information processing device)
Next, an example of a processing procedure executed by the CPU 301 of the information processing device 3 according to the first embodiment will be described with reference to FIG.

In step S110, the information processing device 3 causes the object selection processing unit 55 to select a type of virtual object based on the player's input.

In step S120, the information processing device 3 causes the object display processing unit 57 to display an image of the virtual object selected in step S110 above, superimposed on the image of real space on the display unit 13.

In step S130, the information processing device 3, using the object adjustment processing unit 59, adjusts at least one of the position or orientation of the virtual object displayed in step S120 above relative to the image in real space, based on input from the player.

In step S140, the information processing device 3 causes the character posture setting processing unit 61 to set the posture of the game character based on the type of virtual object selected in step S110 above.

In step S150, the information processing device 3 causes the first character display processing unit 63 to display on the display unit 13 an image of the game character assuming the pose set in step S140 above, so that the image is positioned in accordance with the position or orientation of the virtual object adjusted in step S130 above.

In step S160, the information processing device 3 causes the object hiding processing unit 65 to hide the image of the virtual object. This ends this flowchart.

Note that the above-described processing procedure is an example, and at least some of the above procedures may be deleted or modified, or procedures other than those described above may be added. Furthermore, the order of at least some of the above procedures may be changed, or multiple procedures may be combined into a single procedure. For example, steps S120 and S130 and step S140 may be executed in the reverse order, or may be executed simultaneously in parallel.

(4-4. Effects of the First Embodiment)
As described above, the game program of this embodiment causes the display unit 13, which is configured to be wearable on the player's head and displays a virtual image superimposed on an image of real space, and the information processing device 3, which is configured to transmit and receive signals, to function as an object display processing unit 57 that displays an image of a virtual object on the display unit 13, an object adjustment processing unit 59 that adjusts at least one of the position and orientation of the virtual object with respect to the image of real space based on input from the player, a first character display processing unit 63 that displays an image of a virtual game character on the display unit 13 so that the image is positioned in accordance with at least one of the position and orientation of the adjusted virtual object, and an object non-display processing unit 65 that hides the image of the virtual object when the image of the game character is displayed.

In this embodiment, an image of a virtual object is displayed by the display unit 13, superimposed on the image of real space, and at least one of the position or orientation of the virtual object relative to the image of real space is adjusted based on input from the player. Then, an image of a virtual game character is displayed by the display unit 13, superimposed on the image of real space, so as to be positioned in accordance with the adjusted position or orientation of the virtual object, and the image of the virtual object is hidden.

By adjusting the position and orientation of the virtual object to match that of an actual object in real space, the game character can be displayed so that it matches the position and orientation of the actual object. This makes it possible for the player to feel as if the game character is present in the real world, allowing the player to feel as if they are sharing a real-world experience with the game character.

In addition, in this embodiment, the object adjustment processing unit 59 may adjust at least one of the position and orientation of the virtual seated object relative to the real seated object included in the image of real space based on the player's input, and the first character display processing unit 63 may display an image of the game character on the display unit 13 so that the game character is positioned in accordance with at least one of the position and orientation of the real seated object.

In this case, the game character can be displayed as if seated on an actual seating object that exists in real space. This allows the player to communicate with the game character seated in a real chair, for example, making the player feel as if the game character exists in the real world.

In addition, in this embodiment, the game program may cause the information processing device 3 to further function as an object selection processing unit 55 that selects the type of virtual object based on input from the player.

In this case, the player can select the type of virtual object to match the type of actual object that exists in real space. For example, if a chair exists in real space, the player can select a virtual chair object and adjust the position and orientation of the chair object to match the actual chair that exists in real space, thereby making the game character appear to be sitting in an actual chair. This makes the player feel that the game character exists in the real world more realistically.

In addition, in this embodiment, the game program may cause the information processing device 3 to further function as a character posture setting processing unit 61 that sets the posture of the game character based on the type of selected virtual object, and in that case, the first character display processing unit 63 may cause the display unit 13 to display an image of the game character in the set posture.

In this case, the game character can be displayed in a pose that corresponds to the type of virtual object selected by the player. For example, if the player selects a glass with a straw, the game character can be displayed in a pose where it places its hand on the glass and clings to the straw, and is positioned to match the position and orientation of the actual glass with a straw. This makes the game character seem more realistic to the player, as if it were actually in the real world.

(4-5. Modification of the first embodiment)
In the first embodiment described above, the adjusted position and orientation of the virtual object may be registered, and the behavior of the game character may be changed based on the registered content.

Figure 21 shows an example of the functional configuration of an information processing device 3 according to this modified example. As shown in Figure 21, in addition to the configuration shown in Figure 12 above, the information processing device 3 has an object registration processing unit 111 and a first character action setting processing unit 113.

The object registration processing unit 111 registers at least one of the position and orientation of the virtual object adjusted by the object adjustment processing unit 59 in an appropriate recording medium (e.g., RAM 305, recording device 317, etc.; see Figure 38 described below).

The first character action setting processing unit 113 (an example of a character action setting processing unit) sets the action of the game character based on at least one of the position and orientation of the virtual object registered by the object registration processing unit 111. "Action" includes the game character's movement, body movements, facial expressions and gestures, speech, etc. The first character display processing unit 63 displays an image of the game character on the display unit 13 so that the game character performs the action set by the first character action setting processing unit 113.

Figure 22 shows an example of a real space in which virtual objects are registered. Figure 22 shows, for example, a player's room, which is equipped with a sofa 115, table 117, chest of drawers 119, television 121, calendar 123, window 125, and other items. The player selects virtual objects corresponding to each real object, adjusts their position and orientation as described above, and registers the type, position, orientation, and other information of each virtual object. This allows the game character to perform actions in accordance with the arrangement of furniture and other items in the player's room. For example, the game character can perform a wide variety of actions in accordance with the registered content, such as sitting on sofa 115, sitting in front of television 121 and looking in the direction of the television, resting its elbows on table 117, eating and drinking, opening a drawer in front of chest of drawers 119, looking at calendar 123 and saying something like, "Our anniversary is coming up soon," or looking outside in front of window 125 and saying something like, "The weather is nice today."

According to this modified example, a player can adjust and register the position and orientation of a virtual object according to the arrangement of furniture in their room, for example, and have the game character behave in accordance with the arrangement of furniture in the player's room. This makes it possible for the player to feel as if the game character is actually present in their room, and as if they are sharing a real-life experience with the game character.

5. Second Embodiment
In the second embodiment, details of the process for setting the line of sight of a game character based on the line of sight of a player will be described. Note that the process content of this embodiment is executed in the communication process in step S50 described above.

(5-1. Functional configuration of information processing device)
First, an example of the functional configuration of the information processing device 3 according to the second embodiment will be described with reference to Fig. 23. Note that although the configuration of the head-mounted display 7 is not shown in Fig. 23, it has the same configuration as that shown in Fig. 2 above.

As shown in FIG. 23, the information processing device 3 has a line of sight direction setting processing unit 127, a second character display processing unit 129, an additional information acquisition processing unit 131, and a second character action setting processing unit 133.

The gaze direction setting processing unit 127 sets the gaze direction of a virtual game character with eyes based on the gaze direction of the player detected by the gaze direction detection unit 15 of the head-mounted display 7. As mentioned above, "virtual game characters with eyes" are not limited to humans, but also include non-human animal characters, virtual biological characters other than humans or animals, and non-living robots. Also, as mentioned above, the "player's gaze direction" is a direction that includes both the direction of the player's eyes and the direction of their head, and the gaze direction setting processing unit 127 sets the gaze direction of the game character based on both the detected direction of the player's eyes and the direction of their head. Note that the "game character's gaze direction" refers to a direction that combines the direction of the game character's eyes, head, and body.

The gaze direction setting processing unit 127 may, for example, set the gaze direction of the game character to follow the detected gaze direction of the player. "Follow" means that, for example, when the player and game character are facing each other (for example, when the intersection angle between the player's front direction and the game character's front direction is greater than 90 degrees), the gaze direction of the game character intersects with the player's gaze direction at a position between the player and game character (for example, an intermediate position). Also, when the player and game character are side-by-side (for example, when the player's front direction and the game character's front direction are parallel or the intersection angle is 90 degrees or less), the gaze direction of the game character and the player's gaze direction are approximately parallel. Furthermore, when the detected gaze direction of the player corresponds to the game character, the gaze direction setting processing unit 127 may set the gaze direction of the game character to the direction corresponding to the player.

The second character display processing unit 129 (an example of a character display processing unit) causes the display unit 13 to display an image of the game character superimposed on an image of real space so that the game character changes its direction of gaze based on the direction of gaze of the game character set by the gaze direction setting processing unit 127. At this time, the second character display processing unit 129 displays the image of the game character so that the game character changes its direction of gaze by changing at least one of the game character's eye direction, head direction, and body direction. Therefore, the game character may change its direction of gaze only by the direction of its eyes, or by the direction of its eyes and head direction, or the direction of its eyes and body direction, or by the direction of its head and body direction without changing its eye direction, or by changing its direction of gaze by all of the direction of its eyes, head direction, and body direction.

Figures 24 and 25 show an example of changing the gaze direction of a game character to follow the gaze direction of a player. Note that Figures 24 and 25 are not game play screens displayed on the display unit 13, but are explanatory diagrams for explaining the relationship between the gaze direction of a game character and the gaze direction of a player (the same applies to Figures 28 and 29 described below). Figure 24 shows an example of a case where a player and a game character face each other. As shown in the top row of Figure 24, if the gaze direction 137 of the player 135 faces, for example, to the right as seen from the player's perspective, the gaze direction 141 of the game character 139 faces to the right as seen from the player's perspective so as to intersect with and follow the gaze direction 137 of the player 135. As shown in the middle row of Figure 24, if the gaze direction 137 of the player 135 faces, for example, to the left as seen from the player's perspective, the gaze direction 141 of the game character 139 faces to the left as seen from the player's perspective so as to intersect with and follow the gaze direction 137 of the player 135. As shown in the bottom row of Figure 24, when the line of sight 137 of the player 135 faces the direction of the game character 139, the line of sight 141 of the game character 139 faces the direction of the player 135, and they stare at each other.

Figure 25 shows an example where the player and game character are side-by-side. As shown in the top row of Figure 25, when the line of sight 137 of the player 135 faces, for example, to the right when viewed from the front of the player, the line of sight 141 of the game character 139 changes to become approximately parallel to the line of sight 137 of the player 135 and follows it. As shown in the middle row of Figure 25, when the line of sight 137 of the player 135 faces, for example, to the left when viewed from the front of the player, the line of sight 141 of the game character 139 changes to become approximately parallel to the line of sight 137 of the player 135 and follows it. As shown in the bottom row of Figure 25, when the line of sight 137 of the player 135 faces the game character 139, the line of sight 141 of the game character 139 faces the player 135 and they look at each other.

Although not shown in the figures, even if the line of sight 137 of the player 135 changes in the direction of elevation or depression, the line of sight 141 of the game character 139 follows so as to intersect with the line of sight 137 of the player 135, as described above. Also, although the above describes a case in which the game character 139 changes the line of sight 141 by, for example, changing the direction of their eyes, the line of sight 141 may also be changed by changing the direction of their head or body instead of or in addition to the direction of their eyes. For example, if the change in the line of sight 137 of the player 135 is small, the direction of the game character's eyes may be changed; if the change is moderate, the direction of their head may be changed instead of or in addition to the direction of their eyes; and if the change is large, the direction of their body may be changed instead of or in addition to the direction of their eyes or head.

Returning to Figure 23, the incidental information acquisition processing unit 131 connects to a network NW such as the Internet, for example, via a communication device 323 (see Figure 38 described below), and acquires various types of information from information distribution sites that distribute information, databases, etc. The incidental information acquisition processing unit 131 may also acquire information about the player's current location based on signals from GPS satellites, for example. The incidental information acquisition processing unit 131 may also acquire information by receiving information detected by various sensors in the head-mounted display 7 or information acquired by the information acquisition unit 25. For example, it can acquire information related to the date and time, weather, news, entertainment (concert and movie schedules, etc.), shopping (bargain sales, etc.), etc.

The second character action setting processing unit 133 sets the game character's actions based on the information acquired by the supplementary information acquisition processing unit 131. "Action" includes the game character's movement, physical movements, facial expressions and gestures, speech, etc. The second character display processing unit 129 displays an image of the game character on the display unit 13 so that the game character performs the action set by the second character action setting processing unit 133.

The second character behavior setting processing unit 133 allows the game character to perform, for example, the following actions. For example, if a brightness sensor is provided in the head-mounted display 7, when the player sees a shooting star while looking up at the night sky, the game character's gaze will follow as the player changes their gaze toward the shooting star. At this time, the shooting star can be determined based on the detection information from the brightness sensor, and the game character can make statements appropriate to the situation, such as "The stars are beautiful" or "There's another shooting star." Similarly, when the player is watching fireworks, the game character can follow as the player changes their gaze toward the fireworks. At this time, the fireworks can be determined based on the detection information from the brightness sensor, and the game character can make statements appropriate to the situation, such as "The fireworks are beautiful."

For example, when the doorbell rings, the game character can follow the player's gaze as they change their line of sight towards the front door. At this time, the game character can determine that the doorbell is ringing based on information detected by the audio input unit 19 of the head-mounted display 7, and make a statement appropriate to the situation, such as "It looks like someone's here."

In addition, by combining multiple pieces of acquired information, even more advanced communication between the player and game character becomes possible. For example, by adding time of day information to the information detected by the brightness sensor, it becomes possible to determine whether the light is sunlight or starlight. Furthermore, by adding current location information and line of sight information from GPS to the information detected by the brightness sensor and time of day information, it becomes possible to determine which constellation the starlight belongs to. This makes it possible for game characters to engage in short stories related to constellations, for example.

Furthermore, for example, by obtaining news distribution information according to current location information, coupon information that can be used at nearby stores can be obtained, and if the player makes a statement such as "I'm hungry," the content of the statement can be determined based on information detected by the voice input unit 19, and the game character can make a suggestion such as "X's lunch box is cheap."

Also, for example, if the current location information is a movie theater, it is possible to determine the movie currently being shown by obtaining the theater's screening schedule information, and have the game character be scared if it is a horror movie, or laugh if it is a comedy movie. This allows the player to feel like they are watching a movie together with the game character.

Also, for example, when watching the fireworks mentioned above, by acquiring current location information, it will be possible to determine the location of the fireworks display and tell a short story related to the display.

The processing in each processing unit described above is not limited to these examples of processing divisions, and may be performed by a smaller number of processing units (e.g., one processing unit), or by further subdivided processing units. The functions of each processing unit described above are implemented by a game program executed by the CPU 301 (see FIG. 38 described below), but some of them may be implemented by actual devices such as dedicated integrated circuits such as ASICs or FPGAs, or other electrical circuits. Furthermore, the processing units described above are not limited to being implemented entirely on the information processing device 3, and some or all of them may be implemented on the head-mounted display 7 (e.g., the control unit 27). In this case, the control unit 27 of the head-mounted display 7 is an example of an information processing device.

(5-2. Processing procedure executed by information processing device)
Next, using Figure 26, we will explain an example of a processing procedure executed by the CPU 301 of the information processing device 3 related to the second embodiment when setting and changing the direction of the line of sight of a game character based on the direction of the player's line of sight.

In step S210, the information processing device 3 acquires information regarding the direction of the player's gaze detected by the gaze direction detection unit 15 of the head-mounted display 7.

In step S220, the information processing device 3 uses the line of sight direction setting processing unit 127 to set the line of sight direction of the game character based on the line of sight direction of the player.

In step S230, the information processing device 3 causes the second character display processing unit 129 to display an image of the game character on the display unit 13 so that the game character changes its line of sight based on the line of sight direction of the game character set in step S220 above. This completes this flowchart.

Note that the above-described processing procedures are merely examples, and at least some of the procedures may be deleted or modified, or procedures other than those described above may be added. Furthermore, the order of at least some of the procedures may be changed, or multiple procedures may be combined into a single procedure.

(5-3. Effects of the Second Embodiment)
As described above, the game program of this embodiment causes the display unit 13, which is configured to be wearable on the player's head and displays a virtual image superimposed on an image of real space, the gaze direction detection unit 15, which detects the direction of the player's gaze, and the information processing device 3, which is configured to send and receive signals, to function as: a gaze direction setting processing unit 127 that sets the gaze direction of a virtual game character having eyes based on the detected direction of the player's gaze; and a second character display processing unit 129 that displays an image of the game character on the display unit 13 so that the game character changes its gaze direction based on the set gaze direction of the game character.

In this embodiment, the direction of the game character's gaze is set based on the direction of the player's gaze, and an image of the game character is generated so that the game character changes its gaze direction in the set direction, and is displayed by the display unit 13 superimposed on the image of real space. In this way, when the player changes their gaze direction in response to an event in the real world, the direction of the game character's gaze can be changed to correspond to that change. This allows the player to feel as if they are sharing an experience in the real world with the game character.

In addition, in this embodiment, the gaze direction setting processing unit 127 may set the gaze direction of the game character to follow the detected gaze direction of the player.

In this case, if the player changes their line of sight in response to an event in the real world, the game character's line of sight can be changed to follow that line of sight. This makes the player feel as if they are looking at the same thing in the real world as the game character, enhancing the sense of sharing.

In addition, in this embodiment, if the detected direction of the player's gaze corresponds to the direction of the game character, the gaze direction setting processing unit 127 may set the gaze direction of the game character to the direction corresponding to the player.

In this case, for example, the game character's line of sight can be changed to follow the direction of the player's gaze, and when the player looks in the direction of the game character, the game character can also look in the direction of the player and the two can gaze at each other, creating the feeling of a romantic relationship or a date.

In addition, in this embodiment, the second character display processing unit 129 may display an image of the game character so that the game character changes its line of sight by changing at least one of the direction of the game character's eyes, head, and body.

In this case, for example, if the change in the gaze direction of the set game character is small, the direction of the eyes can be changed; if it is medium, the head direction can be changed instead of or in addition to the eye direction; and if it is large, the body direction can be changed instead of or in addition to the eye direction or head direction. In this way, by changing the manner in which the game character's gaze direction is changed depending on the magnitude of the change in the gaze direction of the set game character, a more natural expression can be achieved.

(5-4. Modification of the second embodiment)
In the second embodiment described above, when a game character is caused to follow the direction of the player's line of sight, the face of the game character may be made more visible to the player.

Figure 27 shows an example of the functional configuration of an information processing device 3 according to this modified example. As shown in Figure 27, the information processing device 3 has a time difference setting processing unit 143 in addition to the configuration shown in Figure 23 above.

When the player's gaze direction detected by the gaze direction detection unit 15 of the head-mounted display 7 changes from a direction not corresponding to the game character to a direction corresponding to the game character, the time difference setting processing unit 143 sets a predetermined time difference between the change in the player's gaze direction and the change in the game character's gaze direction. The "predetermined time difference" may be set to, for example, one to several seconds.

Figure 28 shows an example of the change in the gaze direction of the game character and the gaze direction of the player when a time difference is set, for example, when the player and game character are standing side by side. As shown in the top row of Figure 28, if the gaze direction 137 of the player 135 turns to the right when viewed from the front of the player, the gaze direction 141 of the game character 139 changes to be approximately parallel to the gaze direction 137 of the player 135 and follows it. Next, as shown in the middle row of Figure 28, if the gaze direction 137 of the player 135 turns toward the game character 139, the gaze direction 141 of the game character 139 does not change for the duration of the time difference set by the time difference setting processing unit 143. Then, after the time difference has passed, the gaze direction 141 of the game character 139 turns toward the player 135, and they look at each other, as shown in the bottom row of Figure 28.

According to this modified example, for example, if the game character's line of sight is changed to follow the player's line of sight, and the player looks in the direction of the game character, the game character will look in the player's direction after a predetermined time difference has passed. This allows the player to watch and confirm for a while that the game character is looking at the same thing as the player, further enhancing the player's sense that they are sharing an experience in the real world with the game character.

In addition to the above methods, the gaze direction setting processing unit 127 may set the gaze direction of the game character based on either the direction of the player's eyes or the direction of their head, for example, the direction of their head, detected by the gaze direction detection unit 15 of the head-mounted display 7.

Figure 29 shows an example of the change in the gaze direction of the game character and the player in this case. As shown in the top row of Figure 29, if the head direction 137a of the player 135 turns, for example, to the right when viewed from the front of the player, the gaze direction 141 of the game character 139 changes to be approximately parallel to the head direction 137a of the player 135 and follows it. Next, as shown in the bottom row of Figure 29, if the player 135 turns only the eye direction 137b toward the game character 139 without changing the head direction 137a, the gaze direction 141 of the game character 139 does not change. This allows the player to change only the direction of their eyes and see the game character looking at the same thing as them.

This modified example makes it possible to change the direction of a game character's gaze so that it follows only the direction of the player's head, for example. In this way, by independently detecting the direction of the player's eyes and head and controlling the direction of the game character's gaze, it becomes possible, for example, to make the direction of the game character's gaze follow the direction of the player's head, and for the player to change only the direction of their eyes to look at the game character and confirm their appearance, an action known as "glancing," which further enhances the player's sense of sharing a real-world experience with the game character.

6. Third Embodiment
In the third embodiment, details of processing will be described for detecting wind conditions in the real space around the player and changing the manner in which flexible objects (e.g., hair, clothing, etc.) associated with the game character are deformed in accordance with the detected wind conditions. Note that the processing content of this embodiment is executed in the communication processing in step S50 described above. For example, it may be executed when switching to the fan mode described above.

(6-1. Functional configuration of information processing device)
First, an example of the configuration of the head-mounted display 7 and the functional configuration of the information processing device 3 according to the third embodiment will be described with reference to Fig. 30. Note that the head-mounted display 7 has the same configuration as that shown in Fig. 2 in addition to the configuration shown in Fig. 30, but the same configuration as that shown in Fig. 2 is not shown.

As shown in FIG. 30, the head-mounted display 7 has a wind detection unit 145. The wind detection unit 145 detects the state of wind in the real space around the player. The wind detection unit 145 detects at least one of the wind volume, wind speed, and wind direction around the player as the "wind state." The wind detection unit 145 may be installed on the front, side, or rear of the head-mounted display 7, or may be installed in multiple locations. The wind detection unit 145 may be installed integrally with the head-mounted display 7, or may be installed separately so that signals can be sent and received.

The wind detection unit 145 has a wind volume detection unit 147, a wind speed detection unit 149, and a wind direction detection unit 151. The wind volume detection unit 147 is, for example, an anemometer, and detects the volume of wind around the player. The wind speed detection unit 149 is, for example, an anemometer, and detects the wind speed around the player. The wind direction detection unit 151 is, for example, a wind vane, and detects the wind direction around the player. Note that the wind volume detection unit 147, wind speed detection unit 149, and wind direction detection unit 151 do not need to be separate entities, and two or more detection units may be integrated, for example, as in a wind vane and anemometer.

The information processing device 3 has a third character display processing unit 153, an object transformation processing unit 155, a third character action setting processing unit 157, and an additional information acquisition processing unit 131.

The third character display processing unit 153 (an example of a character display processing unit) superimposes an image of a virtual game character onto an image of real space and displays it on the display unit 13.

The object transformation processing unit 155 changes the deformation mode of a flexible object attached to a game character based on the wind conditions (at least one of wind volume, wind speed, and wind direction) detected by the wind detection unit 145 of the head-mounted display 7. A "flexible object" is, for example, the game character's hair, clothes or swimsuit worn by the game character, etc. If the game character is a female character, it may also include body parts such as the breasts. The "deformation mode" is, for example, the magnitude of the deformation, the direction of the deformation, shaking, vibration, flipping up, etc. If the flexible object is, for example, clothes or swimsuit, it may also include tearing, breaking, disassembly, etc.

The third character behavior setting processing unit 157 (an example of a character behavior setting processing unit) sets the game character's behavior to change based on the wind conditions (at least one of wind volume, wind speed, and wind direction) detected by the wind detection unit 145 of the head-mounted display 7. The third character display processing unit 153 displays an image of the game character on the display unit 13 so that the game character performs the behavior set by the third character behavior setting processing unit 157.

The incidental information acquisition processing unit 131 is the same as in the second embodiment described above, and therefore a description thereof will be omitted. The third character action setting processing unit 157 sets the action of the game character based on the information acquired by the incidental information acquisition processing unit 131. The third character display processing unit 153 displays an image of the game character on the display unit 13 so that the game character performs the action set by the third character action setting processing unit 157.

Figures 31 and 32 show examples of game screens in this embodiment. The example shown in Figure 31 shows a case where an event occurs in the real world that causes wind to blow around the player, and the strength of the wind is relatively weak. Events that cause wind to blow are not particularly limited, but include, for example, the player turning their head up with their hand or a fan, breathing out, being exposed to the wind from a fan, being exposed to the wind from a hair dryer, and being exposed to the wind from outside. Note that in the cases of turning their head up, breathing out, being exposed to the wind from a hair dryer, etc., the wind detection unit 145 may be installed separately from the head-mounted display 7 so that it can detect these winds. As shown in Figure 31, the hair 161 of the game character 159 is fluttering in the direction of the wind. At this time, the game character 159 may be made to utter a line corresponding to the strength of the wind, such as "It's cool and comfortable."

The example shown in Figure 32 is a case where an event occurs in the real world that causes wind around the player, and the wind is relatively strong. As shown in Figure 32, the hair 161 of the game character 159 is fluttering wildly in the direction of the wind, and the skirt 163 is flipped up. At this time, the game character 159 may be made to scream "Eek!" and hold down the skirt 163, or act embarrassed.

Furthermore, by setting actions based on information acquired by the supplementary information acquisition processing unit 131, it becomes possible to have even more advanced communication between the player and the game character. For example, in the case shown in Figure 31 above, it may be determined that it is summer from calendar information, and that the wind is from an electric fan from camera images and the player's voice, and the character may be made to say something like, "In summer, all you need is an electric fan." It may also be determined that the character is near the ocean at night based on time zone information and current location information obtained from GPS, and the character may be made to say something like, "The ocean breeze at night is pleasant." For example, in Figure 32 above, it may be determined that a typhoon is approaching based on weather information, and the character may be made to say something like, "A typhoon is approaching."

The processing in each processing unit described above is not limited to these examples of processing divisions, and may be performed by a smaller number of processing units (e.g., one processing unit), or by further subdivided processing units. The functions of each processing unit described above are implemented by a game program executed by the CPU 301 (see FIG. 38 described below), but some of them may be implemented by actual devices such as dedicated integrated circuits such as ASICs or FPGAs, or other electrical circuits. Furthermore, the processing units described above are not limited to being implemented entirely on the information processing device 3, and some or all of them may be implemented on the head-mounted display 7 (e.g., the control unit 27). In this case, the control unit 27 of the head-mounted display 7 is an example of an information processing device.

(6-2. Processing procedure executed by information processing device)
Next, using Figure 33, we will explain an example of a processing procedure executed by the CPU 301 of the information processing device 3 according to the third embodiment when changing the deformation pattern and behavior of a flexible object associated with a game character according to the detected wind conditions.

In step S310, the information processing device 3 causes the third character display processing unit 153 to superimpose an image of the virtual game character onto an image of real space and display it on the display unit 13.

In step S320, the information processing device 3 acquires information (at least one of wind volume, wind speed, and wind direction) related to the wind conditions in the real space around the player detected by the wind detection unit 145 of the head-mounted display 7.

In step S330, the information processing device 3 causes the object transformation processing unit 155 to set a change in the deformation mode of the flexible object associated with the game character based on the wind conditions acquired in step S320, and causes the third character display processing unit 153 to display an image of the flexible object on the display unit 13 so that the flexible object undergoes the set deformation.

In step S340, the information processing device 3 causes the third character behavior setting processing unit 157 to set the game character's behavior to change based on the wind conditions acquired in step S320, and causes the third character display processing unit 153 to display an image of the game character on the display unit 13 so that the game character performs the set behavior. This completes this flowchart.

Note that the above-described processing procedures are merely examples, and at least some of the procedures may be deleted or modified, or procedures other than those described above may be added. Furthermore, the order of at least some of the procedures may be changed, or multiple procedures may be combined into a single procedure.

(6-3. Effects of the Third Embodiment)
As described above, the game program of this embodiment causes the display unit 13, which is configured to be wearable on the player's head and displays a virtual image superimposed on an image of real space, the wind detection unit 145, which detects the wind conditions in the real space around the player, and the information processing device 3, which is configured to send and receive signals, to function as a third character display processing unit 153, which displays an image of a virtual game character on the display unit 13, and an object transformation processing unit 155, which changes the manner of transformation of a flexible object associated with the game character based on the detected wind conditions.

In this embodiment, an image of a virtual game character is displayed superimposed on an image of real space by the display unit 13. At this time, the wind conditions in the real space around the player are detected, and the deformation mode of a flexible object associated with the game character changes depending on the detected wind conditions.

This allows the deformation of the game character's hair, clothing, etc. to change depending on the strength and direction of the wind when an event occurs in the real world. For example, if the wind is strong, the hair will flutter wildly in the wind's direction and the skirt will be flipped up, while if the wind is weak, only the hair will flutter. This allows the player to feel as if they are sharing an experience in the real world with the game character.

In addition, in this embodiment, the game program may cause the information processing device 3 to further function as a third character behavior setting processing unit 157 that sets the game character's behavior to change based on the detected wind conditions, and in that case, the third character display processing unit 153 may display an image of the game character on the display unit 13 so that the game character performs the set behavior.

In this case, if an event occurs in the real world that causes wind, the game character's behavior can be changed depending on the wind conditions. For example, if the wind is strong, the character can scream "Eek!" and act embarrassed while trying to prevent her skirt from flipping up, or if the wind is weak, the character can say something appropriate to the wind's strength, such as "It's cool and comfortable." This makes it feel more realistic for the player, as if they are sharing a real-world experience with the game character.

In addition, in this embodiment, the wind detection unit 145 may detect at least one of the wind volume, wind speed, and wind direction around the player, and the object transformation processing unit 155 may change the deformation mode of the flexible object based on at least one of the detected wind volume, wind speed, and wind direction.

In this case, when an event occurs in the real world that causes wind, it is possible to change not only the strength of the wind (volume and speed) but also the manner in which the game character's hair, clothing, etc. deform (including the direction of deformation) depending on the wind direction. For example, when the volume and speed of the wind are strong, the hair will flutter widely in the direction of the wind and the skirt will be turned up in the direction of the wind, while when the volume and speed of the wind are weak, only the hair will flutter in the direction of the wind. This makes it possible for the player to feel more realistic, as if they are sharing a real-world experience with the game character.

7. Fourth Embodiment
In the fourth embodiment, details of processing will be described for detecting the humidity in the real space around the player and changing the wetness of the game character's skin or objects associated with the game character (hair, clothing, etc.) in accordance with the detected humidity. Note that the processing content of this embodiment is executed in the communication processing in step S50 described above. For example, it may be executed when switching to the spray mode described above.

(7-1. Functional configuration of information processing device)
First, an example of the configuration of the head-mounted display 7 and the functional configuration of the information processing device 3 according to the fourth embodiment will be described with reference to Fig. 34. Note that the head-mounted display 7 has the same configuration as that shown in Fig. 2 described above in addition to the configuration shown in Fig. 34, but the same configuration as that shown in Fig. 2 is not shown.

As shown in FIG. 34, the head-mounted display 7 has a humidity detection unit 165 and a temperature detection unit 167. The humidity detection unit 165 is, for example, a hygrometer, and detects the humidity in the real space around the player. The temperature detection unit 167 is, for example, a thermometer, and detects the temperature in the real space around the player. The humidity detection unit 165 and the temperature detection unit 167 may be installed on the front, side, or rear of the head-mounted display 7, or may be installed in multiple locations. Furthermore, the humidity detection unit 165 and the temperature detection unit 167 may be installed integrally with the head-mounted display 7, or may be installed separately so that signals can be sent and received. Note that it is also possible to install only one of the humidity detection unit 165 and the temperature detection unit 167, rather than installing both.

The information processing device 3 has a fourth character display processing unit 169, a wetness processing execution processing unit 171, a sweating processing execution processing unit 173, a fourth character behavior setting processing unit 175, and an additional information acquisition processing unit 131.

The fourth character display processing unit 169 (an example of a character display processing unit) superimposes an image of a virtual game character onto an image of real space and displays it on the display unit 13.

The wetness processing execution processor 171 performs wetness processing to change the wetness of the game character's skin or objects associated with the game character based on the humidity detected by the humidity detection unit 165 of the head-mounted display 7. "Game character's skin" includes the skin on the game character's face and body. "Objects associated with the game character" include, for example, the game character's hair, clothing, and swimsuit worn by the game character. For example, wetness processing may be performed so that the wetness (e.g., degree of wetness, range of wetness, etc.) and the transparency of clothing (e.g., degree of transparency, range of transparency, etc.) change depending on the humidity level. For example, when the humidity is high, the game character's skin and hair become soaked or the clothing they are wearing becomes wet and transparent, and when the humidity is low, the game character's skin and hair become only slightly wet and the clothing does not become transparent. In addition to wetness processing, the degree of flushing of the game character's face may also change depending on the humidity level.

The sweating process execution processing unit 173 executes sweating processing to change the degree of sweating on the game character's skin based on the temperature detected by the temperature detection unit 167 of the head-mounted display 7. For example, sweating processing may be performed so that the game character does not sweat, or sweats only a small amount over a small area when the temperature is low, and sweats a large amount over a large area when the temperature is high, changing the amount of sweat or the area of sweating depending on the temperature. In addition to the sweating process, the degree of flushing on the game character's face may also be changed depending on the temperature.

The fourth character behavior setting processing unit 175 (an example of a character behavior setting processing unit) sets the game character's behavior to change based on at least one of the humidity and temperature detected by the humidity detection unit 165 and temperature detection unit 167 of the head-mounted display 7. The fourth character display processing unit 169 displays an image of the game character on the display unit 13 so that the game character performs the behavior set by the fourth character behavior setting processing unit 175.

The additional information acquisition processing unit 131 is the same as in the second embodiment described above, and therefore a description thereof will be omitted. The fourth character action setting processing unit 175 sets the action of the game character based on the information acquired by the additional information acquisition processing unit 131. The fourth character display processing unit 169 displays an image of the game character on the display unit 13 so that the game character performs the action set by the fourth character action setting processing unit 175.

Figures 35 and 36 show examples of game screens in this embodiment. The example shown in Figure 35 is a case where an event occurs in the real world that increases humidity around the player, and the humidity is relatively high. Events that increase humidity are not particularly limited, but include, for example, spraying with a spray bottle, spraying water from a hose, taking a shower, and being caught in the rain. Note that in the case of the above-mentioned spraying, spraying water from a hose, showering, etc., the humidity detection unit 165 may be installed separately from the head-mounted display 7 so that changes in humidity caused by these events can be detected. In the example shown in Figure 35, the face 179, hair 181, clothes 183, etc. of the game character 177 are soaked. In this case, the game character 177 may utter a line corresponding to the humidity, such as "I've gotten wet in the rain."

The example shown in Figure 36 is a case where an event occurs in the real world that causes the temperature around the player to rise, and that temperature is relatively high. As shown in Figure 36, the face 187 of the game character 185 is flushed and sweating, and the game character 185 is wiping his face with a handkerchief 189. At this time, the game character 185 may say something in response to the temperature, such as "It's really hot today."

Furthermore, by setting actions based on information acquired by the supplementary information acquisition processing unit 131, it becomes possible to have even more advanced communication between the player and the game character. For example, in the case shown in Figure 35 above, it may be determined from camera images and the player's voice that water is being sprayed from a hose, and the character may be made to say something like "I'm soaked!" to make the character angry. It may also be determined that there is an evening shower based on time zone information and weather information, and the character may be made to say something like "I got caught in an evening shower." For example, in Figure 36 above, it may be determined that the season is summer based on calendar information, and the character may be made to say something like "It's going to be extremely hot this summer."

Note that, although this embodiment describes the case where both humidity and temperature are detected, it is not necessary to detect both; it is also possible to detect only humidity or only temperature and perform processing based on the detection results.

The processing in each processing unit described above is not limited to these examples of processing divisions, and may be performed by a smaller number of processing units (e.g., one processing unit), or by further subdivided processing units. The functions of each processing unit described above are implemented by a game program executed by the CPU 301 (see FIG. 38 described below), but some of them may be implemented by actual devices such as dedicated integrated circuits such as ASICs or FPGAs, or other electrical circuits. Furthermore, the processing units described above are not limited to being implemented entirely on the information processing device 3, and some or all of them may be implemented on the head-mounted display 7 (e.g., the control unit 27). In this case, the control unit 27 of the head-mounted display 7 is an example of an information processing device.

(7-2. Processing procedure executed by information processing device)
Next, using Figure 37, we will explain an example of a processing procedure executed by the CPU 301 of the information processing device 3 related to the fourth embodiment when changing the wetness or sweating of a game character's skin or an object associated with the game character in accordance with the detected humidity and temperature.

In step S410, the information processing device 3 causes the fourth character display processing unit 169 to superimpose an image of the virtual game character onto an image of real space and display it on the display unit 13.

In step S420, the information processing device 3 acquires information related to the humidity and temperature in the real space around the player detected by the humidity detection unit 165 and temperature detection unit 167 of the head-mounted display 7.

In step S430, the information processing device 3, using the wetness processing execution processing unit 171, executes wetness processing to change the wetness of the game character's skin or an object associated with the game character based on the humidity detected by the humidity detection unit 165 of the head-mounted display 7, and displays the result on the display unit 13.

In step S440, the information processing device 3 causes the sweating process execution processing unit 173 to execute sweating processing so that the degree of sweating on the game character's skin changes based on the temperature detected by the temperature detection unit 167 of the head-mounted display 7, and displays this on the display unit 13.

In step S450, the information processing device 3 causes the fourth character behavior setting processing unit 175 to set the game character's behavior to change based on the humidity and temperature detected by the humidity detection unit 165 and temperature detection unit 167 of the head-mounted display 7, and causes the fourth character display processing unit 169 to display an image of the game character on the display unit 13 so that the game character performs the set behavior. This completes this flowchart.

Note that the above-described processing procedure is an example, and at least some of the above procedures may be deleted or changed, or procedures other than those described above may be added. Furthermore, the order of at least some of the above procedures may be changed, or multiple procedures may be combined into a single procedure. For example, while the above describes a case where both humidity and temperature are detected, it is not necessary to detect both; only humidity or only temperature may be detected, and processing may be performed based on the detection results. If only humidity is detected, step S440 is not necessary, and if only temperature is detected, step S430 is not necessary.

(7-3. Effects of the Fourth Embodiment)
As described above, the game program of this embodiment causes the display unit 13, which is configured to be wearable on the player's head and displays a virtual image superimposed on an image of real space, the humidity detection unit 165, which detects the humidity in the real space around the player, and the information processing device 3, which is configured to send and receive signals, to function as a fourth character display processing unit 169, which displays an image of a virtual game character on the display unit 13, and a wetness processing execution processing unit 171, which executes wetness processing to change the wetness of the game character's skin or an object associated with the game character based on the detected humidity.

In this embodiment, an image of a virtual game character is displayed superimposed on an image of real space by the display unit 13. At this time, the humidity in the real space around the player is detected, and the wetness of the game character's skin or objects associated with the game character changes depending on the detected humidity.

This means that, for example, if an event occurs in the real world that increases humidity, the wetness of the game character's skin or, for example, hair or clothing can be changed depending on the humidity level. For example, when the humidity is high, the skin and hair will be soaked and the clothing will be transparent, and when the humidity is low, the skin and hair will only be slightly wet and the clothing will not be transparent. This makes it possible for the player to feel as if they are sharing an experience in the real world with the game character.

In addition, in this embodiment, the game program may cause the information processing device 3 to further function as a fourth character behavior setting processing unit 175 that sets the game character's behavior to change based on the detected humidity, and in that case, the fourth character display processing unit 169 may display an image of the game character on the display unit 13 so that the game character performs the set behavior.

In this case, for example, if an event occurs in the real world that causes an increase in humidity, the game character's behavior can be changed depending on the humidity level. For example, if the humidity is high, the character's clothes will become transparent and the character will scream "Eek!" in embarrassment, while if the humidity is low, only the skin will become wet and the character will say something like "It's cold and feels good." This makes it feel more realistic for the player, as if they are sharing a real-world experience with the game character.

In addition, in this embodiment, the game program may also cause the information processing device 3 to function as a sweating process execution processing unit 173 that executes sweating processing to change the degree of sweating on the game character's skin based on the detected temperature.

In this case, for example, if an event occurs in the real world that causes the temperature to rise (such as taking a walk during the day in summer), the degree of sweating on the game character's skin can be changed depending on the temperature. This makes it feel more realistic for the player to feel as if they are sharing a real-world experience with the game character.

In addition to what has already been described above, the methods of the above embodiments and their modifications may be combined as appropriate. Although not specifically illustrated, the above embodiments and their modifications may be implemented with various modifications within the spirit and scope of the invention.

8. Hardware configuration of information processing device
Next, an example of a hardware configuration of the information processing device 3 that realizes each processing unit implemented by a program executed by the CPU 301 etc. described above will be described with reference to Fig. 38. Note that the control unit 27 of the head-mounted display 7 may have a similar hardware configuration.

As shown in FIG. 38, the information processing device 3 includes, for example, a CPU 301, a ROM 303, a RAM 305, a GPU 306, a dedicated integrated circuit 307 built for a specific application, such as an ASIC or FPGA, an input device 313, an output device 315, a recording device 317, a drive 319, a connection port 321, and a communication device 323. These components are connected to each other via a bus 309, an input/output interface 311, etc., so that signals can be transmitted between them.

The game program can be recorded, for example, in ROM 303, RAM 305, or a recording device 317 such as a hard disk.

The game program can also be temporarily or permanently (non-temporarily) recorded on removable recording media 325, such as a magnetic disk such as a flexible disk, various optical disks such as CDs, MO disks, and DVDs, or semiconductor memory. Such recording media 325 can also be provided as so-called packaged software. In this case, the game program recorded on these recording media 325 can be read by the drive 319 and recorded on the recording device 317 via the input/output interface 311, bus 309, etc.

The game program can also be stored, for example, on a download site, another computer, or another storage device (not shown). In this case, the game program is transferred via a network NW such as a LAN or the Internet, and the communication device 323 receives the program. The program received by the communication device 323 may then be recorded on the storage device 317 via the input/output interface 311, bus 309, etc.

The game program can also be recorded, for example, on an appropriate externally connected device 327. In this case, the game program may be transferred via an appropriate connection port 321 and recorded on the recording device 317 via the input/output interface 311, bus 309, etc.

The CPU 301 then executes various processes in accordance with the programs recorded on the recording device 317, thereby realizing processes by the aforementioned object selection processing unit 55, object display processing unit 57, object adjustment processing unit 59, character posture setting processing unit 61, first character display processing unit 63, object non-display processing unit 65, object registration processing unit 111, first character action setting processing unit 113, line of sight direction setting processing unit 127, second character display processing unit 129, incidental information acquisition processing unit 131, second character action setting processing unit 133, time difference setting processing unit 143, third character display processing unit 153, object transformation processing unit 155, third character action setting processing unit 157, fourth character display processing unit 169, wetness processing execution processing unit 171, sweating processing execution processing unit 173, fourth character action setting processing unit 175, etc. In this case, the CPU 301 may, for example, read and execute the programs directly from the recording device 317, or may first load the programs into RAM 305 and then execute them. Furthermore, when the CPU 301 receives a program via the communication device 323, drive 319, or connection port 321, for example, the CPU 301 may execute the received program directly without recording it in the recording device 317.

In addition, the CPU 301 may perform various processes as necessary based on signals and information input from an input device 313, such as a microphone, mouse, keyboard, etc. (not shown), including the aforementioned game controller 5.

The GPU 306 performs image display processing, such as rendering processing, in response to instructions from the CPU 301.

The CPU 301 and GPU 306 then output the results of the above processing from an output device 315, which may include, for example, the display unit 13 of the head-mounted display 7. Furthermore, the CPU 301 and GPU 306 may transmit the processing results via the communication device 323 or connection port 321 as necessary, or may record them on the recording device 317 or recording medium 325.

3 Information processing device 7 Head-mounted display 13 Display unit 15 Gaze direction detection unit 27 Control unit (information processing device)
55 Object selection processing unit 57 Object display processing unit 59 Object adjustment processing unit 61 Character posture setting processing unit 63 First character display processing unit 65 Object non-display processing unit 67 Virtual seated object (virtual object)
71 Game character 73 Virtual seated object (virtual object)
77 Game character 79 Virtual seated object (virtual object)
83 Game character 85 Virtual object (virtual object)
89 Game Character 91 Virtual Object (Virtual Object)
95 Game Character 97 Virtual Object (Virtual Object)
101 Game character 103 Virtual object (virtual object)
107 Game character 111 Object registration processing unit 113 First character action setting processing unit (character action setting processing unit)
127 Line-of-sight direction setting processing unit 129 Second character display processing unit (character display processing unit)
131: Additional information acquisition processing unit 133: Second character action setting processing unit 143: Time difference setting processing unit 145: Wind detection unit 147: Wind volume detection unit 149: Wind speed detection unit 151: Wind direction detection unit 153: Third character display processing unit (character display processing unit)
155 Object transformation processing unit 157 Third character action setting processing unit (character action setting processing unit)
165 Humidity detection unit 167 Temperature detection unit 169 Fourth character display processing unit (character display processing unit)
171 Wetness processing execution processing unit 173 Sweating processing execution processing unit 175 Fourth character action setting processing unit (character action setting processing unit)
325 Recording Media

Claims (9)

a display unit configured to be wearable on the head of a player and displaying a virtual image superimposed on an image of real space; a gaze direction detection unit detecting the direction of the player's gaze; and an information processing device configured to transmit and receive signals,
a gaze direction setting processing unit that sets the gaze direction of a virtual game character having eyes based on the detected gaze direction of the player;
a character display processing unit that displays an image of the game character on the display unit so that the game character changes its line of sight based on the set line of sight direction of the game character;
an object selection processing unit that selects a type of virtual object based on an input from the player;
a character posture setting processing unit that sets a posture of the game character based on the selected type of the virtual object;
an object adjustment processing unit that adjusts at least one of a position and an orientation of the virtual object with respect to the image in real space based on an input from the player;
a character action setting processing unit that sets an action of the game character based on at least one of the position and the orientation of the virtual object;
It functions as
The character display processing unit
When an image of the game character is displayed on the display unit so as to be positioned in accordance with at least one of the position and orientation of the virtual object, the image of the virtual object is hidden, and the image of the game character is displayed on the display unit so as to cause the game character to perform the set action.
Game program. The information processing device
an additional information acquisition processing unit that acquires additional information from at least one of an information distribution site, a database, a GPS satellite, and a sensor;
It further functions as
The character behavior setting processing unit
setting the behavior of the game character based on the supplementary information;
The game program according to claim 1 . The line of sight direction setting processing unit
setting the direction of the line of sight of the game character so as to follow the detected direction of the line of sight of the player;
The game program according to claim 2 . The line of sight direction setting processing unit
when the detected direction of the player's line of sight is a direction corresponding to the game character, setting the direction of the game character's line of sight to a direction corresponding to the player;
The game program according to claim 3 . The information processing device
a time difference setting processing unit that, when the detected direction of the player's line of sight changes from a direction not corresponding to the game character to a direction corresponding to the game character, sets a predetermined time difference between the change in the direction of the player's line of sight and the change in the direction of the game character's line of sight;
To further function as
The game program according to claim 4. The character display processing unit
displaying an image of the game character so that the game character changes its line of sight by changing at least one of the direction of the game character's eyes, head, and body;
6. The game program according to claim 1. The gaze direction detection unit
an eye direction detection unit that detects the direction of the player's eyes;
a head direction detection unit that detects the direction of the player's head,
The line of sight direction setting processing unit
setting a line of sight direction of the game character based on at least one of the detected eye direction or head direction of the player;
7. The game program according to claim 1. A recording medium readable by an information processing device, on which the game program described in any one of claims 1 to 7 is recorded. A game processing method executed by an information processing device configured to be wearable on a player's head and to display a virtual image superimposed on an image of real space, a gaze direction detection unit that detects the direction of the player's gaze, and to transmit and receive signals, comprising:
setting a gaze direction of a virtual game character having eyes based on the detected gaze direction of the player;
displaying an image of the game character on the display unit so that the game character changes its line of sight based on the set line of sight direction of the game character;
selecting a type of virtual object based on an input from the player;
setting a posture of the game character based on the selected type of the virtual object;
adjusting at least one of a position and an orientation of the virtual object with respect to the image of real space based on an input from the player;
setting an action of the game character based on at least one of the position and the orientation of the virtual object;
and
The step of displaying the image of the game character on the display unit includes :
When an image of the game character is displayed on the display unit so as to be positioned in accordance with at least one of the position and orientation of the virtual object, the image of the virtual object is hidden, and the image of the game character is displayed on the display unit so as to cause the game character to perform the set action.
Game processing method.