JP7794485B2 - program - Google Patents

Description

The present invention relates to a program.

Technology that adds, removes, emphasizes, or attenuates information in the real environment, expanding the real world as perceived by humans, is sometimes called augmented reality (AR).

For example, a space that combines a computer-generated virtual space with real space is called an AR space, and an image of an AR space (an image that combines real space and virtual space) is called an AR image (synthetic image).

The position coordinates of the virtual space in the AR space are set in correspondence with the reference position coordinates in real space. Furthermore, the generated AR image, for example, follows the movements of the user viewing it and is changed as needed. This allows the user to get the feeling that a virtual object is actually present in real space.

AR technology is described in the following Patent Document 1.

Patent Publication No. 2013-59573

AR is used, for example, in the gaming field. By using AR in games, users can feel a sense of realism, allowing them to concentrate and become more immersed in the game. As such, AR is used in a wide range of fields, but there are still some fields in which it has not yet been put to use.

Therefore, one disclosure is to provide a program that utilizes AR in the healthcare field.

A program possessed by a device having a position detection function for the device itself and a display unit for displaying images, the program causing a processor possessed by the device to execute a process for generating a virtual space in which the ground is set on a horizontal plane a predetermined distance below the position of the device, and a determination process for displaying a pressable start button when the tilt of the device is within a tilt threshold, and determining the direction in which a target is located in the virtual space when it is detected that the start button has been pressed.

AR can be used in the healthcare field.

FIG. 1 is a diagram illustrating an example of the configuration of a device 100. FIG. 2 is a diagram showing an example of a processing flowchart of the health care processing S10. FIG. 3 is a diagram showing an example of the main screen. FIG. 4 is a diagram showing an example of a game screen displayed in the game processing S104. FIG. 5 is a diagram showing an example of a game screen in which the user moves while following the target T1. FIG. 6 is a diagram showing an example of a user's actions when the game screen in FIG. 5 is displayed. FIG. 7 is a diagram showing an example of a processing flowchart of the game processing S104. FIG. 8 is a diagram showing an example of an AR image when an obstacle exists in real space. FIG. 9 shows an example of a screen displayed at the end of the game. FIG. 10 is a diagram showing an example of a processing flowchart of the virtual space ground position determination processing S1030. FIG. 11 is a diagram showing an example of a processing flowchart of the target start position determination processing S1031. FIG. 12 is a diagram showing an example of a processing flowchart of the foul play determination process S105. FIG. 13 is a diagram showing an example in which a target in the virtual space moves to an area where it is not displayed. FIG. 14 is a diagram showing an example in which the game process is aerobics. FIG. 15 is a diagram showing an example including a display object other than the target T1. FIG. 16 is a diagram showing an example of a game in which targets are avoided.

[First embodiment]
A first embodiment will be described.

<Device configuration example>
1 is a diagram illustrating an example of the configuration of a device 100. The device 100 is an apparatus for performing healthcare, such as a smartphone.

The device 100 includes a CPU (Central Processing Unit) 110, a storage 120,
The device includes a memory 130 , a display device 150 , a position detection device 140 , and a camera 160 .

Storage 120 is an auxiliary storage device such as a flash memory, HDD (Hard Disk Drive), or SSD (Solid State Drive) that stores programs and data. Storage 120 stores a healthcare program 121 and a position detection program 124.

Memory 130 is an area into which programs stored in storage 120 are loaded. Memory 130 is also used as an area where programs store data.

The display device 150 is a monitor that displays still images and videos, and is, for example, a liquid crystal display or an organic electroluminescence (EL) display. For example, the display device 150 displays images according to the program being executed. The display device 150 also functions as an operation unit through which the user (the operator of the device 100) operates the device. The user can operate the device by touching a specific position on the display device (for example, a displayed button). Furthermore, the operations performed by the user can also be recognized by each program.

The position detection device 140 is a device having a position detection function for detecting (measuring) the position and tilt of the device 100, and is, for example, a gyro sensor or a GPS (Global Positioning System).
The position of the device 100 detected by the position detection device 140 is, for example,
The position detection device 140 may measure the amount of change in the position of the device 100 from the last time the position was measured.

The tilt of the device detected by the position detection device 140 is, for example, the tilt of the device 100 from the reference attitude in the forward direction (e.g., toward the screen of the display device 150) and the tilt of the device 100 in the lateral direction (e.g., perpendicular to the screen of the display device 150).

The position and orientation of the device 100 in real space are determined based on the position and tilt detected by the position detection device 140. Hereinafter, the position of the device 100 in real space may be referred to as the real position (Xn, Yn, Zn) (n is an integer). n indicates the measurement timing, with n = 0 being the initial measurement timing. Furthermore, the real position (Xn, Yn, Zn) indicates the amount of change in the X component (e.g., latitude), Y component (e.g., longitude), and Z component (e.g., height) from the real position (Xn-1, Yn-1, Zn-1). Furthermore, the real position (Xn, Yn, Zn) may be an absolute numerical value rather than the amount of change in the X component, Y component, and Z component.

Camera 160 is a camera that captures images of the surrounding environment (images of real space). Camera 160 captures, for example, still images and videos. The captured still images are used, for example, for AR images.

The CPU 110 is a processor that loads programs stored in the storage 120 into the memory 130, executes the loaded programs, and performs various processes.

The CPU 110 performs healthcare processing by executing the healthcare program 121. The healthcare processing is a process for managing the user's health by having the user of the device 100 exercise by playing a game and displaying the calories burned and accumulated through exercise. A game provided in the healthcare processing is, for example, a game in which the user moves the device 100 to capture a moving target displayed on an AR screen.

The CPU 110 executes the game module 122 to perform game processing. The game processing involves a game in which the user exercises by moving the device 100. For example, the game processing involves changing (e.g., moving) a target present in a virtual space and executing a game in which the user moves the device 100 to capture the changing target. The game processing includes generating a composite space that combines the virtual space with the real space, and generating and displaying an image of the composite space (an AR image that combines an image of the virtual space with an image of the real space). The game processing also includes displaying a target that changes in the virtual space. The game processing also includes setting a hit range (hit box) indicating a predetermined range in the virtual space according to the position to which the device 100 has moved, and determining whether the target is located within the hit box. The game processing also includes determining the time (e.g., movement time) and distance (e.g., movement distance) of the target depending on the amount of exercise desired for the user (the amount of exercise required of the user).

In the following, in the first embodiment, the change in target will be described as the target moving from a source point to a destination point.

The CPU 110 executes the foul play determination submodule 1221 to perform foul play determination processing. The foul play determination processing is a process that imposes some kind of penalty if the distance between the target's starting position and the device 100's position in the virtual space is within a predetermined range. The foul play determination processing includes a process for calculating the distance.

The CPU 110 performs virtual space ground position determination processing by executing the virtual space ground position determination submodule 1222. The virtual space ground position determination processing is processing that determines the position of the ground in the virtual space based on the position of the device 100 when generating a virtual space.

The CPU 110 executes the target start position determination submodule 1223 to perform target start position determination processing. The target start position determination processing determines the position from which the target starts moving (start point of movement), and determines the start position based on the tilt of the device 100 and user operations.

The CPU 110 executes the calorie-related module 123 to perform calorie-related processing. The calorie-related processing is processing for calculating calories burned, calculating accumulated calories, and displaying the calculated calories. The calorie-related processing includes processing for displaying accumulated calories and judgment processing.

The CPU 110 executes the cumulative calorie display submodule 1231 to perform cumulative calorie display processing. The cumulative calorie display processing calculates the cumulative calories consumed over a specified period of time (counting time) and displays the cumulative calories for each counting time, including past results.

The CPU 110 executes the calorie consumption display submodule 1232 to perform the calorie consumption display process. The calorie consumption display process calculates the calories consumed during one game run and displays the calculated calories consumed when the game ends.

The CPU 110 executes the position detection program 124 to perform position detection processing. The position detection processing is processing to detect the position of the device 100, and includes, for example, receiving data output by the position detection device 140 and converting the received data into a format used in healthcare processing. The device position detection processing also controls the position detection device 140 to output the position of the device 100 as necessary.

<Healthcare processing>
2 is a diagram showing an example of a processing flowchart of the health care processing S10. The health care processing S10 is processing that is executed when the user of the device 100 starts a health care program. The health care processing is processing that causes the user to exercise by playing a game, and displays the calories that the user has burned through the exercise.

Note that while the AR space in the first embodiment is accompanied by AR images, the AR space may also be composed of, for example, sound. For example, when the AR space is composed of sound, the sound emitted by an object in the virtual space is emitted from a position in real space that corresponds to the position of the object in the virtual space. This allows the user to hear the sound emitted in real space and recognize that the object in the virtual space is located in the direction from which the sound is emitted.

When the device 100 detects a user action, such as the user tapping on a healthcare program icon displayed on the display unit (operation unit), it executes the healthcare program and starts healthcare processing S10 (S100).

When the healthcare process S10 is started, the device 100 displays the main screen on the display unit (S101). The main screen displays a graph of the calories the user has consumed in the past.

Figure 3 shows an example of the main screen. The main screen (cumulative calorie display image) displays a calorie graph P1, today's calories burned P2, and a start button P3. The calorie graph P1 is, for example, a graph of calories burned per day, and displays the calories burned for the past few days, including today.

Today's calorie consumption P2 is the total number of calories (cumulative calories) consumed by the user today. Note that in the health care processing S10, one day (24 hours) is considered to be from midnight to the next midnight, and the reference timing for today is, for example, the start time of game processing, the end time of game processing, or the display time of the main screen.

The start button P3 is a button that starts the game processing. Tapping the start button P3 starts the game processing.

The main screen is the screen that is always displayed from the time the game is launched until it is running. By displaying the accumulated calories on the main screen, users always have the opportunity to see their past accumulated calories when they start the game, which has the effect of further motivating them to exercise.

Returning to the processing flowchart of Figure 2, the device 100 waits for the start button to be pressed (No in S102). When the device 100 detects that the start button has been pressed (Yes in S102), it performs virtual space ground position determination processing S1030, which is pre-processing for game processing. The virtual space ground position determination processing S1030 is processing for determining the ground in the virtual space. In the virtual space ground position determination processing S1030, the device 100 determines the ground in the virtual space of an infinite or predetermined range. Details of the virtual space ground position determination processing S1030 will be described later.

After executing the virtual space ground position determination process S1030, the device 100 performs target start position determination process S1031, which is pre-processing for game processing. The target start position determination process S1031 determines the start position (initial position: origin point) of the target in virtual space and simultaneously determines the game field. For example, in the soccer game described below, the target is a soccer ball and the game field is a soccer court. The initial position of the target in virtual space is the point where the ball is placed before being kicked in a penalty kick. Details of the target start position determination process S1031 will be described later.

Once the initial position of the target has been determined, the device 100 executes game processing S104. Game processing S104 is, for example, a game for getting the user to exercise. The game performed in game processing S104 is, for example, a game in which a target moves from a certain point (origin point) to another point (destination point). In the game, the user moves the device 100 to follow the moving target or move to the destination point. In this way, the user exercises. Details of the game will be described later.

When the game processing S104 ends, the device 100 displays the main screen again (S101). The calorie graph on the main screen displays the calories burned the previous time the game processing was performed, adding up to the current value. Thereafter, each process is repeated until the healthcare program is terminated.

<Game Processing>
4 is a diagram showing an example of a game screen executed in game processing S104. The game is, for example, a soccer game. The game screen transitions from FIG. 4(A) to FIG. 4(B) to FIG. 4(C) as time passes. Note that FIG. 4 is an example of a screen when the user holding the device 100 does not move in real space (the user's position does not change).

The game simulates a penalty kick in soccer, where the kicker kicks a soccer ball (target), and the user, acting as the goalkeeper, moves the device 100 to catch the kicked soccer ball.

When the game starts, the ground in the virtual space, the target's starting position, and the game field have already been constructed. The target's movement direction and destination (destination point) may also be determined.

In Figure 4(A), line L1 indicates the horizon, the area above line L1 (hereinafter sometimes referred to as the background area) is an image showing the background and the sky, and the area below line L1 (hereinafter sometimes referred to as the ground area) is an image showing the ground. For example, in Figure 4(A), the background area displays an image actually captured by the camera of device 100, and the ground area displays the ground and game field in virtual space. Furthermore, person H1 is the kicker for a penalty kick in soccer. Furthermore, target T1 is a soccer ball, and in Figure 4(A) is located at the initial position (starting point).

After a predetermined time has passed, the screen will transition to that shown in Figure 4(B). Figure 4 assumes that the user is not moving, so the images of the background and ground are the same. Target T1, kicked out by person H1, will fly, for example, from the back of the virtual space towards the upper right in front of the user (destination point). Therefore, target T1 is positioned at the upper right and displayed slightly larger than in Figure 4(A).

After a predetermined time has passed, the screen changes to that shown in Figure 4(C). Target T1 continues to move in the virtual space, and is positioned further up and to the right compared to Figure 4(B), and is displayed larger.

In this way, target T1 is displayed as if it is moving in front of the user in the upper right direction in virtual space.

Figure 5 shows an example of a game screen in which the user moves while following the target T1. Figure 6 shows an example of the user's actions when the game screen in Figure 5 is displayed. Figures 5 and 6 will be explained below.

Figure 5(A) shows the game screen at the start of the game, and is the same as Figure 4(A). At this time, the user is in the state shown in Figure 6(A). In Figure 6(A), user U1 is holding device 100 with both hands. Device 100 is positioned approximately in front of user U1's face. It is expected that the user will start the game in the state shown in Figure 6(A).

After a predetermined time has passed, the game screen changes to that shown in Figure 5(B), and the user enters the state shown in Figure 6(B). User U1 recognizes that the target ball is flying in the upper right direction in front of them, so they follow the movement of the ball and move device 100 slightly to the upper right, as shown in Figure 6(B). Also, because the user moves device 100 slightly to the upper right, it may tilt diagonally, as shown in Figure 6(B). At this time, the game screen will show line L1 tilting diagonally or moving up and down depending on the tilt of device 100 and its position after movement, as shown in Figure 5(B). Also, at this time, the game screen will show that the position of target T1 moves depending on the position of device 100, as shown in Figure 5(B).

Furthermore, after a predetermined time has elapsed, the screen transitions to that shown in Figure 5(C). As shown in Figure 5(C), the game screen further moves the position of line L1 and the position of the target in accordance with the movement of the device 100. User U1 moves the device 100 further to the upper right, as shown in Figure 6(C).

Note that user U1 in Figures 6(A) to (C) may stand in the same position and move device 100 by moving only their hands, or they may move device 100 by moving their hands while moving the position of their entire body (standing position). Whether or not to move the position is determined, for example, by the distance the target moves left or right, and if the moving distance is large, the user will perform an exercise that involves moving their own standing position. In this way, by having the user play a game, the user can be made to exercise.

The device 100 also determines the location of the target's destination (destination point) according to the amount of exercise the user is desired to perform (assuming that an increase in the amount of device movement also increases the amount of exercise) (an example of process S104-0 in FIG. 7). For example, the device 100 can increase the distance the user moves the device 100 and increase the amount of exercise the user performs by moving the target's destination point (destination point) in the game farther left/right or up/down than the initial position (start point). In other words, the user's amount of exercise can be adjusted by changing the target's destination point.

In addition, device 100 determines the travel time of the target from its origin point to its destination point based on the amount of exercise the user is desired to engage in (assuming that the amount of exercise increases as the device's movement speed increases). For example, device 100 can increase the amount of exercise the user engages in by moving the target at a high speed, thereby causing the user (device 100) to move faster.

Furthermore, when device 100 moves multiple targets consecutively or simultaneously, it may determine the timing at which the targets start moving (in a soccer game, the timing at which the soccer ball is kicked) and the destination positions of successive targets according to the amount of exercise desired by the user (the amount of exercise required of the user). That is, the device determines the time (interval time) from when the first target finishes moving until the second target starts moving, the position at which the first target arrives (destination point of the first target: first destination point), and the position at which the second target arrives (destination point of the second target: second destination point) according to the amount of exercise desired by the user. For example, if device 100 wants the user to perform more exercise, it may shorten the interval time, or increase the distance between the first destination point and the second destination point (point-to-point distance), or both. Furthermore, for example, if the device 100 wants the user to exercise less, it may increase the interval time, or shorten the distance between the first destination point and the second destination point (point-to-point distance), or do both.

Furthermore, device 100 may also take into account physical characteristics of the user, such as height and weight. For example, it can be assumed that a tall user will exercise less than a short user even when moving the same distance. Therefore, for example, device 100 may set a destination position for a tall user that is farther left or right than the destination position of the target for a short user. This allows device 100 to provide target changes that are suited to the user's physical characteristics, such as tallness or shortness.

FIG. 7 is a diagram showing an example of a processing flowchart of game processing S104. The device 100 determines the target change based on the requested amount of exercise (S104-0). For example, the device 100 determines the amount of target change, the timing of the start and end of the change, or the target's position before and after the change based on the amount of exercise requested by the device 100 from the user using the device 100 (the amount of exercise the device 100 wants the user to exercise, or the amount of exercise the user wants to exercise). In the first embodiment, the device 100 determines the target's destination point and origin point, and, when multiple targets are sent, the interval between target sends and the destination point of each target. In addition to the amount of exercise requested of the user, the device 100 may also take into account the user's physical characteristics.

In game processing S104, the device 100 detects the device position (S104-1). The device position is, for example, the tilt of the device 100 or the actual position of the device 100 (Xn, Yn, Zn).

The device 100 calculates the calories burned based on the device location (S104-2). The calories burned are calculated, for example, using the following formula (1):

Sn=Dn×C...Formula (1)

Sn indicates the calories burned when the position detection timing is n. Dn indicates the distance traveled by the device 100 between timing n-1 and timing n. C indicates a coefficient. The calories burned are calculated by multiplying the distance traveled by the device by the coefficient.

In process S104-2, the calories burned from timing n-1 to timing n are calculated, but for example, the total calories burned from timing 0 to timing n (the sum of the calories burned between each timing) may also be calculated. When calculating the total calories burned in process S104-2, it is not necessary to calculate the total calories burned in process S104-12, which will be described below.

The device 100 generates a virtual space image according to the device position (S104-3). As the device 100 moves, the user's viewpoint also changes, so the device 100 generates a virtual space image according to the video captured by the camera.

The device 100 also generates a target image according to the device position (S104-4).

The device 100 also analyzes the real space using images captured by the camera of the device 100 (S104-5). Analyzing the real space involves, for example, analyzing objects that exist in the real space from images of the real space and identifying the objects that exist in the real space as analysis results. Furthermore, based on the results of the analysis of the real space, the device 100 determines whether an object will be an obstacle that will affect the user's movement or actions. For example, the device 100 determines that a chair or desk that exists in the real space, or a person other than the user, is an obstacle. The device 100 may also determine whether an object in the real space is an obstacle based on its size, movement, shape, or a combination of these. For example, the device 100 determines that an object is an obstacle if its height is equal to or greater than a predetermined height.

Note that analysis of real space may be performed using not only the images of real space described above, but also other sensors. For example, if device 100 is equipped with a sensor that acquires information such as the shape, size, and material of objects in real space using infrared rays or radar, analysis of real space may be performed based on the information acquired by that sensor.

Then, the device 100 generates an AR image based on the analysis results (S104-6). The device 100 generates, for example, an image by combining the generated image of the virtual space, the target image, and the captured video. The device 100 then generates the AR image by reflecting objects determined to be obstacles as a result of the analysis in the combined image in a format that allows the user to understand them as obstacles. The format that allows the user to understand them as obstacles is an image that highlights the obstacle or an image of a virtual object that the user can recognize as dangerous. The format that allows the user to understand them as obstacles may also be the display of a warning message to prevent the user from moving toward the obstacle.

Figure 8 shows an example of an AR image (synthetic image) when an obstacle is present in real space. Figure 8 (A) is an image (video) of real space. For example, device 100 recognizes the chair located on the right edge (located within range X1) as an obstacle. Then, as shown in Figure 8 (B), device 100 moves (kicks) target T1 in the direction of arrow A2 to prevent the user from moving into range X1. Device 100 may also display a message on the display unit informing the user that there is an obstacle in range X1 or urging the user not to move into range X1.

The device 100 generates a hit box in virtual space according to the device position (S104-7). The hit box is an area in which the user can secure a target, and is, for example, an area surrounded by a rectangular parallelepiped or sphere.

In the first embodiment, the user is made to recognize the AR space through an AR image, but the user may be made to recognize the AR space by other means. Device 100 may express the AR space using audio. For example, instead of displaying an AR image of a target moving in the upper right direction, device 100 may instruct the user by outputting audio instructing the user to move in the upper right direction through an audio output unit (e.g., a speaker, earphones, etc.; not shown) possessed by device 100. Furthermore, device 100 may output audio so that it sounds like it is coming from the upper right direction, so that the user knows that the target is located (or moving) in the upper right direction. For example, outputting audio so that it sounds like it is coming from the upper right direction may be achieved by actually outputting the audio from the upper right direction, or by specially processing the audio (e.g., processing the volume or frequency of the sound, or by combining multiple audio output units to create an effect).

The device 100 determines whether the target is located within the hit box (S104-8). For example, the device 100 determines whether the center position of the target in virtual space is located within the coordinate range of the hit box.

When the device 100 determines that the target is located within the hit box (Yes in S104-8), it determines that the hit has been successful (S104-9). A success indicates, for example, that the user has successfully secured the target, such as a goalkeeper successfully catching the soccer ball in a soccer game.

On the other hand, if the device 100 determines that the target is not located within the hit box (No in S104-8), it determines whether a failure condition is met (S104-10). A failure condition is a condition that must be met to indicate that the user has failed to capture the target. A failure condition is a condition that cannot be changed to success in the future, such as the passage of a predetermined time (third time) or the target passing through a predetermined position (point, planar area, or three-dimensional area) (for example, a vertical plane, as described below).

In the soccer game, for example, the device 100 sets the destination point to a vertical plane including the device 100 or a vertical plane behind the device 100 (the destination point is on the other side of the device 100 from the source point). A vertical plane is a plane that is 90 degrees from the horizontal plane and faces the front of the device 100. A characteristic of soccer games (particularly penalty kicks) is that the user (the goalkeeper) does not move forward, but moves up, down, left, and right. Therefore, by setting the destination point to the above-mentioned vertical plane, the device 100 can more appropriately predict the user's destination and encourage the user to move left, right, up, and down.

When the device 100 determines that the failure condition is met (Yes in S104-10), it determines that there has been a failure (S104-11). A failure may, for example, indicate that the user failed to secure the target, such as when the goalkeeper in a soccer game fails to catch the soccer ball, allowing the opponent to score a goal.

On the other hand, if the device 100 determines that the failure condition is not met (No in S104-10), it detects the device's position again, calculates the calories burned (S104-2), and regenerates the AR image (processes S104-3 to S104-7). In this way, the device 100 repeats the calculation of the calories burned and the regeneration of the AR image until success or failure is determined. This repeated process is performed a predetermined number of times per second (e.g., 30 times).

When success or failure is determined, the device 100 calculates the total number of calories burned and displays it on the screen (S104-12), and then ends the game processing S104. The total number of calories burned calculated here is the calories burned during one game execution.

Figure 9 shows an example of a screen displayed when a game ends. Figure 9 (A) is a success screen indicating that the game was successful. The success screen (determination result image) displays, for example, "GOOD!" to indicate that the central portion of the game was successful. Figure 9 (B) is a failure screen indicating that the game was unsuccessful. The failure screen (determination result image) displays, for example, "MISS" to indicate that the central portion of the game was unsuccessful. In addition, on both the success screen and the failure screen, the calories burned by the user while playing the game are displayed in the upper right corner.

<Virtual space ground position determination process>
10 is a diagram showing an example of a processing flowchart of the virtual space ground position determination process S1030. In the virtual space ground position determination process S1030, the device 100 performs device position detection (S1030-1). Device position detection is a process for detecting the position and inclination of the device 100, and is the same as, for example, process S104-1 in the game process S104.

The device 100 generates (sets) the ground of the virtual space on a horizontal plane located a predetermined distance (e.g., 130 cm) below the detected position of the device 100 (S1030-2), and ends the virtual space ground position determination process S1030. The ground of the virtual space generated at this time may have an infinite range (no ground range is set), or may have a range calculated based on the distance the user can travel in real space within a predetermined time.

One process for generating (setting) the ground in a virtual space is to perform plane recognition processing to detect the actual ground or floor, and then use the detected ground or floor as the ground in the virtual space. However, plane recognition generally takes time, and depending on the condition of the ground, it may not be possible to detect the ground or floor even after a certain amount of time has passed.

When generating a virtual space ground surface using plane recognition processing in healthcare processing, the user may be unable to start the game or it may take a long time for the game to start, resulting in reduced usability. Therefore, in this embodiment, the device 100 generates the virtual space ground surface in the virtual space ground position determination processing S1030, allowing the virtual space ground surface to be generated quickly and preventing a reduction in usability.

The predetermined distance below the predetermined distance is a distance that is estimated based on the user's length from below the eyes to the feet, assuming that the device 100 is located directly in front of the user. By changing the predetermined distance according to the user's height, for example, it is possible to generate the ground surface of the virtual space at a position closer to the ground surface or floor of the real space.

<Target start position determination process>
11 is a diagram showing an example of a processing flowchart of the target start position determination processing S1031. In the target start position determination processing S1031, the device 100 performs device position detection (S1031-1). The device position detection is a process for detecting the position and tilt of the device 100, and is the same as, for example, processing S104-1 in the game processing S104.

The device 100 checks whether the tilt of the device 100 is within a threshold value (tilt threshold value) (S1031-2). If the tilt of the device 100 is greater than the threshold value (No in S1031-2), the device 100 determines that the user has not brought the device 100 in front of the user and is not viewing the game screen of the device 100, and waits for the tilt of the device 100 to return to within the threshold value without starting the game.

On the other hand, when the tilt of the device 100 falls within the threshold value (Yes in S1031-2), the device 100 determines that the user is ready to start the game, and makes the start button pressable and displays it on the screen (S1031-3).

Then, the device 100 waits for the start button to be pressed (No in S1031-4). When the device 100 detects that the start button has been pressed (Yes in S1031-4), it determines the start position of the target to be the front position of the device 100 at the time the start button was pressed (or the current position) (S1031-5). In other words, by determining the front direction of the device, the device 100 can determine the direction (orientation) in which the target is located in virtual space.

In other words, by generating a game space based on the device position at the time the start button is pressed, the device 100 can determine the starting point and degree of change of the target, such as the target's starting position, the target's position when the target does not move, or the target's range of movement.

The device 100 then generates and displays objects other than the ground in the virtual space (S1031-6), and ends the target start position determination process. For example, in the case of a soccer game, objects other than the ground in the virtual space could be a background image of the real space, a soccer ball, a kicker, and the soccer field (such as penalty kick lines). It may also display a message announcing the start of the game.

One method for determining the target start position is, for example, to do so simultaneously with the generation of the ground in the virtual space. However, when the ground in the virtual space is generated, the direction in which the user will face when starting the game has not yet been determined, and the target start position may be set at a position different from the intended target of the game. Therefore, in the target start position determination process S1031, the device 100 disables the start button from being pressed until the tilt of the device 100 is within a threshold, thereby preventing the game from starting until the device 100 is facing somewhat directly in front of the user. Furthermore, by not determining the target start position until the user presses the start button, the device 100 can reliably determine the target start position when the user is ready to start the game. In other words, the user can preview and avoid locations or directions that are uncomfortable for the user to play the game, such as when playing facing the setting sun is too bright, or when starting play in a narrow space horizontally, which could lead to crashing into a wall, and select a more comfortable game environment.

Second Embodiment
Next, a second embodiment will be described.

In the second embodiment, the game processing S104 further includes a foul play determination processing S105. The foul play determination processing S105 is a processing that is executed, for example, between before the game starts (before the target starts moving) and the start of the game (when the target starts moving), and is a processing that imposes some kind of penalty if the distance between the device 100 and the target is shorter than a predetermined distance.

<Foul play judgment process>
12 is a diagram showing an example of a processing flowchart of the foul play determination process S105. In the foul play determination process S105, the device 100 detects the device position (S105-1). The device position detection is a process for detecting the position and tilt of the device 100, and is the same as, for example, process S104-1 in the game process S104.

The device 100 calculates the distance between the device 100 and the target start position (origin point) (S105-2). For example, the device 100 subtracts the X, Y, and Z components of the coordinates of the target start position from the X, Y, and Z components of the coordinates in the virtual space of the device 100, squares each of the subtracted values, adds the squared values together, and calculates the square root of the sum as the distance.

The device 100 determines whether the calculated distance is within a threshold (second threshold) (S105-3). If the calculated distance is within the threshold (Yes in S105-3), the device 100 imposes a penalty (S105-4) and repeats the process from device position detection S105-1 again. A penalty is a control that has a disadvantageous effect on the user, such as not starting to move the target or failing to capture the target regardless of the device 100's position. The reason for imposing a penalty when the distance is within the threshold is that once the device 100 gets close enough to the target, the target can be captured without moving the device 100, so the user will almost certainly succeed in capturing the target, which would eliminate the fun of the game.

On the other hand, if the calculated distance is not within the threshold (No in S105-3), the device 100 cancels the penalty (S105-5) and repeats the process from device position detection S105-1 again.

[Other embodiments]
Next, other embodiments will be described.

Figure 13 is a diagram showing an example of when a target in virtual space moves into an area where it is not displayed. In Figure 13, the area V1 surrounded by a dotted line is the synthetic space. There is a limit to the range that can be displayed on the display unit 150, and if the target moves significantly, the target may not be displayed within the display unit 150, as shown in Figure 12. In this case, the device 100 displays an arrow A1 in part of the AR image, as shown in Figure 12. The arrow A1 indicates the position of the target that is not displayed. By displaying the arrow A1, the device 100 allows the user to follow the target even if it is no longer displayed on the display unit.

FIG. 14 is a diagram illustrating an example of a game process in which the game is aerobics. In the first embodiment, the target moves from the back to the front of the virtual space. However, the target may also move in various directions, such as up, down, left, or right, or rotate within the virtual space. For example, as shown in FIG. 14 , the device 100 may represent the target as an arrow A3, and by changing the direction of the arrow A3 or moving the arrow A3, the device 100 prompts the user to move the device 100 in the direction of the arrow. The target may also be used to instruct the user to rotate their entire body (or waist) or turn backward. Note that, in FIG. 14 , a portion of the arrow A3 is outside the range of the display unit 150. However, the user can move the device 100 to display the arrow A3 outside the range of the display unit on the display unit.

The target may also be the musical note picture M1 in FIG. 14. The musical note picture M1 is displayed for a predetermined time and then removed (hidden). The user performs exercise by moving the device 100 in the direction of the musical note picture while it is displayed. The musical note picture M13 is an example of a target and is not limited to a musical note picture. The musical note picture M1 may also, for example, change to a specific color for a predetermined time or have a special effect such as glowing. The user can perform exercise by moving the device 100 in the direction of the musical note picture while the musical note picture M1 is the specific color or has the special effect. The timing when the target starts to be displayed is sometimes referred to as the display start timing, and the timing when the target stops being displayed and becomes hidden is sometimes referred to as the display end timing.

Furthermore, the position at which the musical note picture M1 appears may be determined in relation to the positions of other musical note pictures M1 based on the amount of exercise required of the user. For example, the device 100 may increase the distance (inter-position distance) between the position of a certain musical note picture (first position) and the position of another musical note picture (second position) the greater the amount of exercise required of the user. For example, the device 100 may decrease the distance (inter-position distance) between the position of a certain musical note picture (first position) and the position of another musical note picture (second position) the less the amount of exercise required of the user.

In addition, by adjusting the timing of when the musical note picture M1 is displayed (when the color change begins) and when it is hidden (when the color change ends), it is possible to encourage the user to move faster or slower, thereby adjusting the amount of exercise the user is doing.

Figure 15 is a diagram showing an example including a display object other than target T1. In Figure 15, target T1 is defender DF1. Defender DF1 is, for example, a defender in a soccer game. The user moves device 100 in the opposite direction to defender DF1 or in a direction that will not collide with defender DF1. The example of target T1 described in the first embodiment is a soccer ball, and since the user performs the movements of a goalkeeper, a success is determined when target T1 is located within the hit box. However, if defender DF1 is targeted, a failure is determined when defender DF1 is located within the hit box. The success/failure determination may be made in a game in which the objective is to capture a target or a game in which the objective is to avoid a target. Furthermore, if there are multiple targets, a different success/failure determination may be made for each target.

Figure 16 is a diagram showing an example of a game in which the player must avoid a target. For example, the target is a ghost G1. The ghost G1 moves around in a virtual space, and the user moves (escapes) in the real space corresponding to the virtual space so as not to collide with the ghost G1. In this case, if the target is located within the hit box, a failure determination may be made (the player is determined to have been caught by the ghost). Furthermore, if the device 100 is moving at a speed equal to or greater than a predetermined speed, the device 100 may determine that the ghost G1 has found the device 100, and cause the ghost G1 to chase the device 100. In this way, the device 100 can prompt the user to move the device 100 slowly (slower than the predetermined speed) so as not to be chased by the ghost G1.

For example, in Figure 16, if the target is located at ghost G2, a special sound may be emitted from the direction of the position of ghost G2 in real space that corresponds to the position of ghost G2 in virtual space, to inform the user of the location of ghost G2 audibly. Also, as shown in Figure 13, an arrow or the like may be displayed indicating the position of ghost G2.

Furthermore, when expressing ghosts disappearing and reappearing, ghost G1 may be hidden. In this case, as with the example of ghost G2, a special sound may be used to notify the user of ghost G1's location.

Furthermore, when multiple users are playing the game simultaneously, when another user is captured by ghost G1, the user may be notified that the other user has been captured by ghost G1 by playing a special sound from the direction of the position of ghost G1 in real space that corresponds to the position of ghost G1 in virtual space.

In addition, in the first embodiment, the game processing ends after a single success or failure determination, but success or failure determination may be made multiple times. For example, in a game in which the device 100 follows an arrow as described above, it may be determined that the device is successful (or is following successfully) while it is following, and that the device is unsuccessful (or is failing to follow) while it is unable to follow. In this case, the condition for ending the game may be, for example, the passage of a predetermined time, or failure continuing for more than a predetermined time.

In the first embodiment, a soccer ball was used as an example of a target, but the target may also be an irregularly moving object, such as a balloon. Also, the target may be, for example, a boxing glove, and the user may think of the device as a boxing mitt.

In addition, in the first embodiment, the game ends after one success or failure, but the game may be played multiple times. For example, the game may be repeated until N (e.g., 5) failures have occurred. Also, for example, the game may be repeated a total of M times, regardless of success or failure.

Furthermore, for example, game results can be scored based on success or failure, and scores can be managed centrally on a server, allowing users to compete against each other for the highest score. Also, for example, short-range communication can be used, such as infrared or Bluetooth (registered trademark), to share the same AR space (including AR images and targets). Furthermore, the same AR space can be shared remotely via a server. This can increase users' motivation to play the game and encourage them to exercise more. Users can also compete based on calories burned or accumulated calories instead of scores.

100: Device 110: CPU
120: Storage 121: Healthcare program 122: Game module 1221: Foul play determination submodule 1222: Virtual space ground position determination submodule 1223: Target start position determination submodule 123: Calorie-related module 1231: Accumulated calorie display submodule 1232: Calorie consumption display submodule 124: Position detection program 130: Memory 140: Position detection device 150: Display device (display unit)
160: Camera

Claims (2)

A program for encouraging a user to exercise, the program being included in a device having a position detection function of the device itself and a display unit that displays images,
A process of generating the virtual space by setting the ground in the virtual space on a horizontal plane that is a predetermined distance below the position of the device;
a determination process of displaying a pressable start button on the display unit when the tilt of the device is within a tilt threshold, and determining a direction in which a target is located in the virtual space when it is detected that the start button has been pressed;
A process of generating a composite space by combining the virtual space and the real space based on the setting;
a process of making the target appear in the synthetic space and changing the target based on the determined direction in which the target is located in the virtual space, and prompting the user to move the device in accordance with the change in the target;
A program to be executed by a processor possessed by the device. The program described in claim 1, wherein the predetermined distance is determined based on the height of the user using the device.